Currently reading articles under label: Spark

Scala the Language

Install Sbt

echo "deb /" | sudo tee -a /etc/apt/sources.list.d/sbt.list

sudo apt-key adv --keyserver hkp:// --recv 2EE0EA64E40A89B84B2DF73499E82A75642AC823

sudo apt-get update

sudo apt-get install sbt

ref: (v1.0)



This for how to install Spark with standalone/yarn/mesos.

see also: spark-vs-h2o

For usage, see scale-py chapter 8 & 9.

Read also: The Internals of Apache Spark 2.4.0 | GitBook

The following content is tested in Ubuntu 16 (before 2019) & 18.04 (after 2018).

OBS: Assuming username: hpc.