生鲜超市营销策划方案_建立网站方法_搜狗网站seo_网络推广公司运作

/opt/installs/hadoop/etc/hadoop 文件夹下

mapred-site.xml<configuration><property><name>mapreduce.framework.name</name><value>yarn</value></property>
</configuration>指定mapreduce运行平台为yarn

yarn-site.xml<!--指定resourceManager启动的主机为第一台服务器--><property><name>yarn.resourcemanager.hostname</name><value>bigdata01</value></property><!--配置yarn的shuffle服务--><property><name>yarn.nodemanager.aux-services</name><value>mapreduce_shuffle</value> </property>

检查hadoop-env.sh 中是否配置了权限：

export YARN_RESOURCEMANAGER_USER=root
export YARN_NODEMANAGER_USER=root

继续配置：为了防止报AppMaster的错误，需要如下配置

yarn-site.xml<property><name>yarn.application.classpath</name><value>/opt/installs/hadoop/etc/hadoop:/opt/installs/hadoop/share/hadoop/common/lib/*:/opt/installs/hadoop/share/hadoop/common/*:/opt/installs/hadoop/share/hadoop/hdfs:/opt/installs/hadoop/share/hadoop/hdfs/lib/*:/opt/installs/hadoop/share/hadoop/hdfs/*:/opt/installs/hadoop/share/hadoop/mapreduce/*:/opt/installs/hadoop/share/hadoop/yarn:/opt/installs/hadoop/share/hadoop/yarn/lib/*:/opt/installs/hadoop/share/hadoop/yarn/*</value> </property>

获取classpath的值：

分发mapred-site.xml & yarn-site.xml 到另外两台电脑上。

cd /opt/installs/hadoop/etc/hadoop/xsync.sh mapred-site.xml yarn-site.xml

启动和停止yarn平台：

启动： start-yarn.sh
停止： stop-yarn.sh

也可以使用web访问一下：

跟ResourceManager电脑的IP保持一致

http://192.168.233.128:8088

4、关于启动和停止的命令

服务	命令
启动,停止hdfs	start-dfs.sh stop-dfs.sh
启动,停止yarn	start-yarn.sh stop-yarn.sh
停止和启动整个集群（包含hdfs,以及Yarn）	start-all.sh stop-all.sh start-all.sh ==(start-dfs.sh start-yarn.sh ) stop-all.sh == (stop-dfs.sh stop-yarn.sh )
只启动resourcemanager 停止resourcemanager	yarn --daemon start resourcemanger yarn --daemon stop resourcemanger
只启动nodemanager 停止nodemanager	yarn --daemon start nodemanger yarn --daemon stop nodemanger

hdfs 中单独启动的命令：

namenode : hdfs --daemon start namenode

datanode : hdfs --daemon start datanode [ 这个命令只能启动一个 datanode]