大数据Hadoop为什么这么受欢迎？

1、环境准备 7台机器

miniMaster1 ResourceManager1 QuorumPeerMain

miniMaster2 ResourceManager2 QuorumPeerMain

miniMaster3 QuorumPeerMain

miniSlave1 NodeManager

miniSlave2 NodeManager

miniSlave3 NodeManager

miniSlave4 NodeManager

关闭防火墙，selinux（所有虚拟机），ssh免秘钥，jdk，hosts，zk

2、YARN HA 配置

yarn-site.xml

Licensed under the Apache License, Version 2.0 (the "License");

you may not use this file except in compliance with the License.

You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software

distributed under the License is distributed on an "AS IS" BASIS,

WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.

See the License for the specific language governing permissions and

limitations under the License. See accompanying LICENSE file.

-->

yarn.resourcemanager.hostname

miniMaster1

yarn.nodemanager.aux-services

mapreduce_shuffle

yarn.resourcemanager.ha.enabled

true

yarn.resourcemanager.cluster-id

cluster1

yarn.resourcemanager.ha.rm-ids

rm1,rm2

yarn.resourcemanager.hostname.rm1

miniMaster1

yarn.resourcemanager.hostname.rm2

miniMaster2

yarn.resourcemanager.zk-address

miniMaster1:2181,miniMaster2:2181,miniMaster3:2181

yarn.resourcemanager.scheduler.class

org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler

yarn.nodemanager.pmem-check-enabled

false

yarn.nodemanager.vmem-check-enabled

false

3、YARN 资源调度配置

Licensed under the Apache License, Version 2.0 (the "License");

you may not use this file except in compliance with the License.

You may obtain a copy of the License at

作者：清风_d587
链接：https://www.jianshu.com/p/2acb35892504