- Hadoop+Spark大數據巨量分析與機器學習整合開發實戰, 作者:林大貴 ,出版社:博碩 ,出版日期:2015/11/0
- http://hadoopspark.blogspot.tw/2015/09/4-hadoop-26-single-node-cluster.html
- 安裝JDK
- SSH
- Hadoop
- Hadoop 下載
- 4-4.Hadoop 環境變數(page 045)
- sudo gedit ~/.bashrc
- source ~/.baserc
- 4-5 修改 Hadoop 組態設定檔
- sudo gedit /usr/local/hadoop/etc/hadoop/hadoop_env.sh
- sudo gedit /usr/local/hadoop/etc/hadoop/core-site.xml
- sudo gedit /usr/local/hadoop/etc/hadoop/yarn-site.xml
- sudo gedit /usr/local/hadoop/etc/hadoop/mapred-site.xml
- sudo gedit /usr/local/hadoop/etc/hadoop/hdfs-site.xml
- 4-6 建立與格式化 HDFS 目錄
- sudo mkdir -p /usr/local/hadoop/hadoop_data/hdfs/namenode
sudo mkdir -p /usr/local/hadoop/hadoop_data/hdfs/datanode
sudo chown hduser:hduser -R /usr/local/hadoop
hadoop namenode -format
- 4-7 啟動 Hadoop
- start-dfs.sh
- start-yarn.sh
- start-all.sh
- 4-8 Hadoop Resource-Manager Web
- 4-9 NameNode HDFS Web