Hadoop HDFS
(Update: tested v2.7.2 on Ubuntu 18)
Install #
OBS: security warning !
Note: change the core-site.xml and hdfs-site.xml content before running.
Note: change the HDUSER username before running.
# w/ java
curl https://raw.githubusercontent.com/SunnyBingoMe/install-hadoop/master/setup-hadoop | bash
Env & Hd-Structure Config (Multi-Node Only) #
Make sure the master node and the hadoop user, e.g. $hduser can access work nodes using passphrase-less ssh keys.
If a different username ($hduser) rather than the installer user ($user) is to run hadoop, we need to run setup_profile and setup_environment after su $hduser (some minor errors will be given by bash, no worries.)