Currently reading articles under label: Hadoop

Hadoop HDFS

(Update: tested v2.7.2 on Ubuntu 18)

Install

OBS: security warning !

Note: change the core-site.xml and hdfs-site.xml content before running.

Note: change the HDUSER username before running.

# w/ java

curl https://raw.githubusercontent.com/SunnyBingoMe/install-hadoop/master/setup-hadoop | bash

E......

Spark

This for how to install Spark with standalone/yarn/mesos.

see also: spark-vs-h2o

For usage, see scale-py chapter 8 & 9.

Read also: The Internals of Apache Spark 2.4.0 | GitBook

The following content is tested in Ubuntu 16 (before 2019) & 18.04 (after 2018).

OBS: Assuming username: hpc.

STAN......