Quantcast
Channel: ZRJ
Viewing all articles
Browse latest Browse all 120

Hadoop HBase 碎碎念

$
0
0

一些小笔记会持续追加到这里

2016-3-25 22:09:24

重启或添加节点:
$bin/hadoop-daemon.sh start datanode

————————–

2016-3-25 22:09:31

Had the same problem with 2.6.0, and shamouda’s answer solved it (I was not using dfs.hosts at all so that could not be the answer. I did add

<property>
  <name>dfs.namenode.datanode.registration.ip-hostname-check</name>
  <value>false</value>
</property>

to hdfs-site.xml and that was enough to fix the issue.

———————–

2016-3-25 22:11:55

$bin/hbase-daemon.sh stop regionserver
$bin/hbase-daemon.sh start regionserver

————————

2016-3-27 16:54:22

disable ‘kline_minute’
describe ‘kline_minute’
alter ‘kline_minute’ , NAME=>’kline’, COMPRESSION=>’gz’
describe ‘kline_minute’
enable ‘kline_minute’
major_compact ‘kline_minute’

启用压缩

http://www.searchtb.com/2011/01/understanding-hbase.html,这里说明了文件的存储方式

http://stackoverflow.com/questions/18656483/data-size-increases-in-hbase,这里有一个计算的例子

————————

2016-3-27 16:56:14

重启一个regionserver

bin/graceful_stop.sh –restart –reload –debugnodename

这个操作是平滑的重启regionserver进程,对服务不会有影响,他会先将需要重启的regionserver上面的所有region迁移到其它的服务器,然后重启,最后又会将之前的region迁移回来,但我们修改一个配置时,可以用这种方式重启每一台机子,这个命令会关闭balancer,所以最后我们要在hbase shell里面执行一下balance_switch true,对于hbase regionserver重启,不要直接kill进程,这样会造成在zookeeper.session.timeout这个时间长的中断,也不要通过bin/hbase-daemon.sh stop regionserver去重启,如果运气不太好,-ROOT-或者.META.表在上面的话,所有的请求会全部失败。

关闭下线一台regionserver

bin/graceful_stop.sh –stop nodename

和上面一样,系统会在关闭之前迁移所有region,然后stop进程,同样最后我们要手工balance_switch true,开启master的region均衡。


Viewing all articles
Browse latest Browse all 120

Trending Articles


Girasoles para colorear


mayabang Quotes, Torpe Quotes, tanga Quotes


Tagalog Quotes About Crush – Tagalog Love Quotes


OFW quotes : Pinoy Tagalog Quotes


Long Distance Relationship Tagalog Love Quotes


Tagalog Quotes To Move on and More Love Love Love Quotes


5 Tagalog Relationship Rules


Best Crush Tagalog Quotes And Sayings 2017


Re:Mutton Pies (lleechef)


FORECLOSURE OF REAL ESTATE MORTGAGE


Sapos para colorear


tagalog love Quotes – Tiwala Quotes


Break up Quotes Tagalog Love Quote – Broken Hearted Quotes Tagalog


Patama Quotes : Tagalog Inspirational Quotes


Pamatay na Banat and Mga Patama Love Quotes


Tagalog Long Distance Relationship Love Quotes


BARKADA TAGALOG QUOTES


“BAHAY KUBO HUGOT”


Vimeo 10.7.0 by Vimeo.com, Inc.


Vimeo 10.7.1 by Vimeo.com, Inc.