1. Hadoop相关
1.1 Yarn公平调度器
在yarn-site.xml 中配置使用公平调度器:
<property>
<name>yarn.resourcemanager.scheduler.class</name>
<value>org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler</value>
</property>
在提交MR任务的时候会出现下面的错误:
java.io.IOException: org.apache.hadoop.yarn.exceptions.YarnException: Failed to submit application_1725292900384_0001 to YARN : root is not a leaf queue
at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:346)
at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:251)
at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1571)
at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1568)