hadoop 2.5.2 集群安装

之前写过一个，http://zrj.me/archives/888，不过现在是 2.5.2，东西不同了，安装方式有所变化。

说起来，主要以下几点：

安装 JDK
打通 SSH
停掉防火墙
配置 core-site.xml, maprd-site.xml, hdfs-site.xml，新增了一个 yarn-site.xml

参考这里的文章，http://blog.csdn.net/tang9140/article/details/42869531，http://blog.csdn.net/greensurfer/article/details/39450369，配置文件使用如下：

core-site.xml

<configuration>  
    <property>  
        <name>hadoop.tmp.dir</name>  
        <value>/home/hadoop/tmp</value>  
        <description>Abase for other temporary directories.</description>  
    </property>  
    <property>  
        <name>fs.defaultFS</name>  
        <value>hdfs://10.0.1.100:9000</value>  
    </property>  
    <property>  
        <name>io.file.buffer.size</name>  
        <value>4096</value>  
    </property>  
</configuration>

hdfs-site.xml

<configuration>  
    <property>  
        <name>dfs.nameservices</name>  
        <value>hadoop-cluster1</value>  
    </property>  
    <property>  
        <name>dfs.namenode.secondary.http-address</name>  
        <value>10.0.1.100:50090</value>  
    </property>  
    <property>  
        <name>dfs.namenode.name.dir</name>  
        <value>/home/hadoop/dfs/name</value>  
    </property>  
    <property>  
        <name>dfs.datanode.data.dir</name>  
        <value>/home/hadoop/dfs/data</value>  
    </property>  
    <property>  
        <name>dfs.replication</name>  
        <value>2</value>  
    </property>  
    <property>  
        <name>dfs.webhdfs.enabled</name>  
        <value>true</value>  
    </property>  
</configuration>

mapred-site.xml

<configuration>  
    <property>  
        <name>mapreduce.framework.name</name>  
        <value>yarn</value>  
    </property>  
    <property>  
        <name>mapreduce.jobtracker.http.address</name>  
        <value>10.0.1.100:50030</value>  
    </property>  
    <property>  
        <name>mapreduce.jobhistory.address</name>  
        <value>10.0.1.100:10020</value>  
    </property>  
    <property>  
        <name>mapreduce.jobhistory.webapp.address</name>  
        <value>10.0.1.100:19888</value>  
    </property>  
</configuration>

yarn-site.xml

<configuration>  
  
<!-- Site specific YARN configuration properties -->  
    <property>  
        <name>yarn.nodemanager.aux-services</name>  
        <value>mapreduce_shuffle</value>  
    </property>  
    <property>  
        <name>yarn.resourcemanager.address</name>  
        <value>10.0.1.100:8032</value>  
    </property>  
    <property>  
        <name>yarn.resourcemanager.scheduler.address</name>  
        <value>10.0.1.100:8030</value>  
    </property>  
    <property>  
        <name>yarn.resourcemanager.resource-tracker.address</name>  
        <value>10.0.1.100:8031</value>  
    </property>  
    <property>  
        <name>yarn.resourcemanager.admin.address</name>  
        <value>10.0.1.100:8033</value>  
    </property>  
    <property>  
        <name>yarn.resourcemanager.webapp.address</name>  
        <value>10.0.1.100:8088</value>  
    </property>  
</configuration>

最后配置 slaves 文件，没有了 master 文件

然后格式化 namenode，输出如下

zrj@FWSVRLPT01:~/hadoop-2.5.2$ ./bin/hdfs namenode -format
16/03/18 16:22:31 INFO namenode.NameNode: STARTUP_MSG: 
/************************************************************
STARTUP_MSG: Starting NameNode
STARTUP_MSG:   host = FWSVRLPT01/10.16.18.206
STARTUP_MSG:   args = [-format]
STARTUP_MSG:   version = 2.5.2
STARTUP_MSG:   classpath = /home/zrj/hadoop-2.5.2/etc/hadoop:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/commons-configuration-1.6.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/jasper-compiler-5.5.23.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/activation-1.1.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/jsp-api-2.1.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/commons-io-2.4.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/paranamer-2.3.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/httpclient-4.2.5.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/log4j-1.2.17.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/jets3t-0.9.0.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/zookeeper-3.4.6.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/jsr305-1.3.9.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/hadoop-auth-2.5.2.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/java-xmlbuilder-0.4.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/commons-el-1.0.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/jettison-1.1.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/jersey-server-1.9.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/avro-1.7.4.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/commons-codec-1.4.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/commons-cli-1.2.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/commons-net-3.1.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/jetty-util-6.1.26.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/netty-3.6.2.Final.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/commons-digester-1.8.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/hadoop-annotations-2.5.2.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/guava-11.0.2.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/commons-compress-1.4.1.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/jsch-0.1.42.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/commons-beanutils-1.7.0.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/jersey-core-1.9.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/api-util-1.0.0-M20.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/api-asn1-api-1.0.0-M20.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/xz-1.0.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/commons-httpclient-3.1.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/stax-api-1.0-2.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/asm-3.2.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/jackson-xc-1.9.13.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/commons-logging-1.1.3.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/jersey-json-1.9.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/slf4j-api-1.7.5.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/commons-collections-3.2.1.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/commons-math3-3.1.1.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/jetty-6.1.26.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/snappy-java-1.0.4.1.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/hamcrest-core-1.3.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/commons-lang-2.6.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/junit-4.11.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/mockito-all-1.8.5.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/servlet-api-2.5.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/httpcore-4.2.5.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/apacheds-i18n-2.0.0-M15.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/xmlenc-0.52.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/lib/jasper-runtime-5.5.23.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/hadoop-common-2.5.2-tests.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/hadoop-nfs-2.5.2.jar:/home/zrj/hadoop-2.5.2/share/hadoop/common/hadoop-common-2.5.2.jar:/home/zrj/hadoop-2.5.2/share/hadoop/hdfs:/home/zrj/hadoop-2.5.2/share/hadoop/hdfs/lib/jsp-api-2.1.jar:/home/zrj/hadoop-2.5.2/share/hadoop/hdfs/lib/commons-io-2.4.jar:/home/zrj/hadoop-2.5.2/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/home/zrj/hadoop-2.5.2/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/home/zrj/hadoop-2.5.2/share/hadoop/hdfs/lib/jsr305-1.3.9.jar:/home/zrj/hadoop-2.5.2/share/hadoop/hdfs/lib/commons-el-1.0.jar:/home/zrj/hadoop-2.5.2/share/hadoop/hdfs/lib/jersey-server-1.9.jar:/home/zrj/hadoop-2.5.2/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar:/home/zrj/hadoop-2.5.2/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/home/zrj/hadoop-2.5.2/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/home/zrj/hadoop-2.5.2/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar:/home/zrj/hadoop-2.5.2/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/home/zrj/hadoop-2.5.2/share/hadoop/hdfs/lib/netty-3.6.2.Final.jar:/home/zrj/hadoop-2.5.2/share/hadoop/hdfs/lib/guava-11.0.2.jar:/home/zrj/hadoop-2.5.2/share/hadoop/hdfs/lib/jersey-core-1.9.jar:/home/zrj/hadoop-2.5.2/share/hadoop/hdfs/lib/asm-3.2.jar:/home/zrj/hadoop-2.5.2/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/home/zrj/hadoop-2.5.2/share/hadoop/hdfs/lib/jetty-6.1.26.jar:/home/zrj/hadoop-2.5.2/share/hadoop/hdfs/lib/commons-lang-2.6.jar:/home/zrj/hadoop-2.5.2/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar:/home/zrj/hadoop-2.5.2/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/home/zrj/hadoop-2.5.2/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/home/zrj/hadoop-2.5.2/share/hadoop/hdfs/lib/jasper-runtime-5.5.23.jar:/home/zrj/hadoop-2.5.2/share/hadoop/hdfs/hadoop-hdfs-2.5.2-tests.jar:/home/zrj/hadoop-2.5.2/share/hadoop/hdfs/hadoop-hdfs-2.5.2.jar:/home/zrj/hadoop-2.5.2/share/hadoop/hdfs/hadoop-hdfs-nfs-2.5.2.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/lib/jline-0.9.94.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/lib/activation-1.1.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/lib/jackson-jaxrs-1.9.13.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/lib/commons-io-2.4.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/lib/log4j-1.2.17.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/lib/zookeeper-3.4.6.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/lib/jsr305-1.3.9.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/lib/jettison-1.1.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/lib/jersey-server-1.9.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/lib/jackson-mapper-asl-1.9.13.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/lib/commons-codec-1.4.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/lib/commons-cli-1.2.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/lib/jetty-util-6.1.26.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/lib/jersey-client-1.9.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/lib/aopalliance-1.0.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/lib/netty-3.6.2.Final.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/lib/guava-11.0.2.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/lib/jersey-core-1.9.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/lib/guice-3.0.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/lib/xz-1.0.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/lib/commons-httpclient-3.1.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/lib/stax-api-1.0-2.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/lib/asm-3.2.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/lib/jackson-xc-1.9.13.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/lib/commons-logging-1.1.3.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/lib/jersey-json-1.9.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/lib/commons-collections-3.2.1.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/lib/jetty-6.1.26.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/lib/commons-lang-2.6.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/lib/jackson-core-asl-1.9.13.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/lib/servlet-api-2.5.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/lib/javax.inject-1.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/hadoop-yarn-server-tests-2.5.2.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.5.2.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/hadoop-yarn-api-2.5.2.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/hadoop-yarn-server-common-2.5.2.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.5.2.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.5.2.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.5.2.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.5.2.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/hadoop-yarn-client-2.5.2.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.5.2.jar:/home/zrj/hadoop-2.5.2/share/hadoop/yarn/hadoop-yarn-common-2.5.2.jar:/home/zrj/hadoop-2.5.2/share/hadoop/mapreduce/lib/commons-io-2.4.jar:/home/zrj/hadoop-2.5.2/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/home/zrj/hadoop-2.5.2/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/home/zrj/hadoop-2.5.2/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/home/zrj/hadoop-2.5.2/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.9.13.jar:/home/zrj/hadoop-2.5.2/share/hadoop/mapreduce/lib/avro-1.7.4.jar:/home/zrj/hadoop-2.5.2/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/home/zrj/hadoop-2.5.2/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/home/zrj/hadoop-2.5.2/share/hadoop/mapreduce/lib/netty-3.6.2.Final.jar:/home/zrj/hadoop-2.5.2/share/hadoop/mapreduce/lib/hadoop-annotations-2.5.2.jar:/home/zrj/hadoop-2.5.2/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/home/zrj/hadoop-2.5.2/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/home/zrj/hadoop-2.5.2/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/home/zrj/hadoop-2.5.2/share/hadoop/mapreduce/lib/guice-3.0.jar:/home/zrj/hadoop-2.5.2/share/hadoop/mapreduce/lib/xz-1.0.jar:/home/zrj/hadoop-2.5.2/share/hadoop/mapreduce/lib/asm-3.2.jar:/home/zrj/hadoop-2.5.2/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/home/zrj/hadoop-2.5.2/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/home/zrj/hadoop-2.5.2/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar:/home/zrj/hadoop-2.5.2/share/hadoop/mapreduce/lib/junit-4.11.jar:/home/zrj/hadoop-2.5.2/share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar:/home/zrj/hadoop-2.5.2/share/hadoop/mapreduce/lib/jackson-core-asl-1.9.13.jar:/home/zrj/hadoop-2.5.2/share/hadoop/mapreduce/lib/javax.inject-1.jar:/home/zrj/hadoop-2.5.2/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.5.2.jar:/home/zrj/hadoop-2.5.2/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.5.2.jar:/home/zrj/hadoop-2.5.2/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.5.2-tests.jar:/home/zrj/hadoop-2.5.2/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.5.2.jar:/home/zrj/hadoop-2.5.2/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.5.2.jar:/home/zrj/hadoop-2.5.2/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.5.2.jar:/home/zrj/hadoop-2.5.2/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.5.2.jar:/home/zrj/hadoop-2.5.2/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.5.2.jar:/home/zrj/hadoop-2.5.2/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.5.2.jar:/home/zrj/hadoop-2.5.2/contrib/capacity-scheduler/*.jar
STARTUP_MSG:   build = https://git-wip-us.apache.org/repos/asf/hadoop.git -r cc72e9b000545b86b75a61f4835eb86d57bfafc0; compiled by 'jenkins' on 2014-11-14T23:45Z
STARTUP_MSG:   java = 1.7.0_72
************************************************************/
16/03/18 16:22:31 INFO namenode.NameNode: registered UNIX signal handlers for [TERM, HUP, INT]
16/03/18 16:22:31 INFO namenode.NameNode: createNameNode [-format]
Formatting using clusterid: CID-98edc835-228b-479b-b912-be8db8cc32ad
16/03/18 16:22:31 INFO namenode.FSNamesystem: fsLock is fair:true
16/03/18 16:22:31 INFO blockmanagement.DatanodeManager: dfs.block.invalidate.limit=1000
16/03/18 16:22:31 INFO blockmanagement.DatanodeManager: dfs.namenode.datanode.registration.ip-hostname-check=true
16/03/18 16:22:31 INFO blockmanagement.BlockManager: dfs.namenode.startup.delay.block.deletion.sec is set to 000:00:00:00.000
16/03/18 16:22:31 INFO blockmanagement.BlockManager: The block deletion will start around 2016 Mar 18 16:22:31
16/03/18 16:22:31 INFO util.GSet: Computing capacity for map BlocksMap
16/03/18 16:22:31 INFO util.GSet: VM type       = 64-bit
16/03/18 16:22:31 INFO util.GSet: 2.0% max memory 889 MB = 17.8 MB
16/03/18 16:22:31 INFO util.GSet: capacity      = 2^21 = 2097152 entries
16/03/18 16:22:31 INFO blockmanagement.BlockManager: dfs.block.access.token.enable=false
16/03/18 16:22:31 INFO blockmanagement.BlockManager: defaultReplication         = 2
16/03/18 16:22:31 INFO blockmanagement.BlockManager: maxReplication             = 512
16/03/18 16:22:31 INFO blockmanagement.BlockManager: minReplication             = 1
16/03/18 16:22:31 INFO blockmanagement.BlockManager: maxReplicationStreams      = 2
16/03/18 16:22:31 INFO blockmanagement.BlockManager: shouldCheckForEnoughRacks  = false
16/03/18 16:22:31 INFO blockmanagement.BlockManager: replicationRecheckInterval = 3000
16/03/18 16:22:31 INFO blockmanagement.BlockManager: encryptDataTransfer        = false
16/03/18 16:22:31 INFO blockmanagement.BlockManager: maxNumBlocksToLog          = 1000
16/03/18 16:22:31 INFO namenode.FSNamesystem: fsOwner             = zrj (auth:SIMPLE)
16/03/18 16:22:31 INFO namenode.FSNamesystem: supergroup          = supergroup
16/03/18 16:22:31 INFO namenode.FSNamesystem: isPermissionEnabled = true
16/03/18 16:22:31 INFO namenode.FSNamesystem: HA Enabled: false
16/03/18 16:22:31 INFO namenode.FSNamesystem: Append Enabled: true
16/03/18 16:22:31 INFO util.GSet: Computing capacity for map INodeMap
16/03/18 16:22:31 INFO util.GSet: VM type       = 64-bit
16/03/18 16:22:31 INFO util.GSet: 1.0% max memory 889 MB = 8.9 MB
16/03/18 16:22:31 INFO util.GSet: capacity      = 2^20 = 1048576 entries
16/03/18 16:22:31 INFO namenode.NameNode: Caching file names occuring more than 10 times
16/03/18 16:22:31 INFO util.GSet: Computing capacity for map cachedBlocks
16/03/18 16:22:31 INFO util.GSet: VM type       = 64-bit
16/03/18 16:22:31 INFO util.GSet: 0.25% max memory 889 MB = 2.2 MB
16/03/18 16:22:31 INFO util.GSet: capacity      = 2^18 = 262144 entries
16/03/18 16:22:31 INFO namenode.FSNamesystem: dfs.namenode.safemode.threshold-pct = 0.9990000128746033
16/03/18 16:22:31 INFO namenode.FSNamesystem: dfs.namenode.safemode.min.datanodes = 0
16/03/18 16:22:31 INFO namenode.FSNamesystem: dfs.namenode.safemode.extension     = 30000
16/03/18 16:22:31 INFO namenode.FSNamesystem: Retry cache on namenode is enabled
16/03/18 16:22:31 INFO namenode.FSNamesystem: Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis
16/03/18 16:22:31 INFO util.GSet: Computing capacity for map NameNodeRetryCache
16/03/18 16:22:31 INFO util.GSet: VM type       = 64-bit
16/03/18 16:22:31 INFO util.GSet: 0.029999999329447746% max memory 889 MB = 273.1 KB
16/03/18 16:22:31 INFO util.GSet: capacity      = 2^15 = 32768 entries
16/03/18 16:22:31 INFO namenode.NNConf: ACLs enabled? false
16/03/18 16:22:31 INFO namenode.NNConf: XAttrs enabled? true
16/03/18 16:22:31 INFO namenode.NNConf: Maximum size of an xattr: 16384
16/03/18 16:22:31 INFO namenode.FSImage: Allocated new BlockPoolId: BP-667685565-10.16.18.206-1458289351864
16/03/18 16:22:31 INFO common.Storage: Storage directory /home/zrj/hadoop-2.5.2/dfs/name has been successfully formatted.
16/03/18 16:22:32 INFO namenode.NNStorageRetentionManager: Going to retain 1 images with txid >= 0
16/03/18 16:22:32 INFO util.ExitUtil: Exiting with status 0
16/03/18 16:22:32 INFO namenode.NameNode: SHUTDOWN_MSG: 
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode at FWSVRLPT01/10.16.18.206
************************************************************/

记得要分别在文件hadoop-env.sh和yarn-env.sh中添加JAVA_HOME配置

启动 dfs

zrj@FWSVRLPT01:~/hadoop-2.5.2$ ./sbin/start-dfs.sh 
Starting namenodes on [FWSVRLPT01]
FWSVRLPT01: starting namenode, logging to /home/zrj/hadoop-2.5.2/logs/hadoop-zrj-namenode-FWSVRLPT01.out
FWSVRLPT02: starting datanode, logging to /home/zrj/hadoop-2.5.2/logs/hadoop-zrj-datanode-FWSVRLPT02.out
qtdata: starting datanode, logging to /home/zrj/hadoop-2.5.2/logs/hadoop-zrj-datanode-qtdata.out
Starting secondary namenodes [FWSVRLPT01]
FWSVRLPT01: starting secondarynamenode, logging to /home/zrj/hadoop-2.5.2/logs/hadoop-zrj-secondarynamenode-FWSVRLPT01.out

启动 yarn

zrj@FWSVRLPT01:~/hadoop-2.5.2$ ./sbin/start-yarn.sh 
starting yarn daemons
starting resourcemanager, logging to /home/zrj/hadoop-2.5.2/logs/yarn-zrj-resourcemanager-FWSVRLPT01.out
FWSVRLPT02: starting nodemanager, logging to /home/zrj/hadoop-2.5.2/logs/yarn-zrj-nodemanager-FWSVRLPT02.out
qtdata: starting nodemanager, logging to /home/zrj/hadoop-2.5.2/logs/yarn-zrj-nodemanager-qtdata.out

通过浏览器访问

http://10.0.1.100:50070/

http://10.0.1.100:8088/

hadoop 2.5.2 集群安装

Trending Articles

Girasoles para colorear

mayabang Quotes, Torpe Quotes, tanga Quotes

Tagalog Quotes About Crush – Tagalog Love Quotes

OFW quotes : Pinoy Tagalog Quotes

Long Distance Relationship Tagalog Love Quotes

Tagalog Quotes To Move on and More Love Love Love Quotes

5 Tagalog Relationship Rules

Best Crush Tagalog Quotes And Sayings 2017

Re:Mutton Pies (lleechef)

FORECLOSURE OF REAL ESTATE MORTGAGE

Sapos para colorear

tagalog love Quotes – Tiwala Quotes

Break up Quotes Tagalog Love Quote – Broken Hearted Quotes Tagalog

Patama Quotes : Tagalog Inspirational Quotes

Pamatay na Banat and Mga Patama Love Quotes

Tagalog Long Distance Relationship Love Quotes

BARKADA TAGALOG QUOTES

“BAHAY KUBO HUGOT”

Vimeo 10.7.0 by Vimeo.com, Inc.

Vimeo 10.7.1 by Vimeo.com, Inc.