paulovn/spark-base64 Vagrant box

How to use this box with Vagrant: 

Vagrant.configure("2") do |config|
  config.vm.box = "paulovn/spark-base64"
  config.vm.box_version = "1.9.3"
end
vagrant init paulovn/spark-base64 \
  --box-version 1.9.3
vagrant up

v1.9.3

This version was created over 7 years ago.

Contains software installed on top of a CentOS 7.2 distribution:

  • Apache Spark 2.0.2
  • A virtualenv for Python 2.7.5 with a scientific Python stack (scipy, numpy, matplotplib, pandas, statmodels, gensim, networkx, scikit-learn, theano+keras) plus IPython 5 + Jupyter notebook
  • R 3.3.1 with a few packages installed (rmarkdown, magrittr, dplyr, tidyr, data.table, ggplot2, caret, sparklyr)
  • Spark notebook Kernels for Python 2.7, Scala (Toree) and R (IRKernel), in addition to the default "plain" (i.e. non-Spark capable) Python 2.7 kernel.
  • A few small notebook extensions
  • A notebook startup daemon script with facilities to configure Spark execution mode

Note this is a base box, in particular neither Spark nor Jupyter notebook are fully configured. A complementary Vagrantfile builds on this base box to provide a fully functional Spark environment. That one is available in the ml-vm-notebook repository.

Changes: Spark is 2.0.2, Theano linked to OpenBLAS, based on CentOS 7.2 (w/ Python 2.7.5), no Python SCL installation (uses system Python 2.7), IPython 5.1.0, removed Spark add-ons (csv is now built-in, graphframes can be downloaded on the fly), notebook installed as a systemd unit

1 provider for this version.
  • virtualbox
    unknown Hosted by Vagrant Cloud (2.25 GB)