Spark

Scala the Language

2019-02-12. Category & Tags: Scala, Spark, Sbt

Install Sbt # echo "deb https://dl.bintray.com/sbt/debian /" | sudo tee -a /etc/apt/sources.list.d/sbt.list sudo apt-key adv --keyserver hkp://keyserver.ubuntu.com:80 --recv 2EE0EA64E40A89B84B2DF73499E82A75642AC823 sudo apt-get update sudo apt-get install sbt ref: scala-sbt.org (v1.0) Compile # see ref

Spark

2016-11-15. Category & Tags: Spark, Hadoop

Related: The Internals of Apache Spark 2.4.0 | GitBook For usage after installation, see scale-py chapter 8 & 9. StreamProcessing comparison /stream-processing ~~ spark-vs-h2o ~~ The following content is tested in Ubuntu 16 (before 2019) & 18.04 (after 2018). This for how to install Spark with standalone/yarn/mesos. OBS: Assuming username: hpc. STANDALONE (ONE-SINGLE-NODE) # One-node standalone mode might be our fist time to try Spark, so we make the installation as easy as possible. ...