Hbase问题处理

Hbase问题处理

Region重叠问题

• 报错信息
  
• 查看问题
  

• 修复问题

  合并两个有问题的分区

  ## 进入hbase shell
  hbase shell
  ## 查看merge是否开启
  hbase(main):004:0> splitormerge_switch 'MERGE',true
  false
  Took 0.0161 seconds
  => 1 
  ## 开启regon合并
  hbase(main):005:0> splitormerge_enabled 'MERGE'
  true
  Took 0.0020 seconds
  => 1
  ## 合并分区
  merge_region 'YS_PROD:IP_DATA_VALUE_PJ6101122010_2022,E,1681786397967.5eddd2dcef386d439aea5e28a43c5b45.','YS_PROD:IP_DATA_VALUE_PJ6101122010_2022,cEq6101122010a5af96904652495ba6c8f39679b2b950elecAccPositiveActiveE1671141600000,1681977486427.1bd83af00e2a11f4bf6eaf60e3f6af51.'
  ## 合并后发现还是有空洞问题，需修复空洞问题需要再合并一次
  merge_region 'YS_PROD:IP_DATA_VALUE_PJ6101122010_2022,D,1681977486428.618ecd0aa6a9b7de147f3715089ac7a0.','YS_PROD:IP_DATA_VALUE_PJ6101122010_2022,E,1681977486428.3c362dc961601b2b6e7e14d8124ceab0.'
  
  ERROR: Skip merging [618ecd0aa6a9b7de147f3715089ac7a0, 3c362dc961601b2b6e7e14d8124ceab0], because a parent, [3c362dc961601b2b6e7e14d8124ceab0], has a merge qualifier (if a 'merge column' in parent, it was recently merged but still has outstanding references to its parents that must be cleared before it can participate in merge -- major compact it to hurry clearing of its references)
  ## 再次合并时发现有报错，需要触发一次合并
  hbase(main):002:0> major_compact 'YS_PROD:IP_DATA_VALUE_PJ6101122010_2022'
  Took 0.1203 seconds  
  ## 再次合并一次
  e7e14d8124ceab0.'> merge_region 'YS_PROD:IP_DATA_VALUE_PJ6101122010_2022,D,1681977486428.618ecd0aa6a9b7de147f3715089ac7a0.','YS_PROD:IP_DATA_VALUE_PJ6101122010_2022,E,1681977486428.3c362dc961601b2b6 

• hbase检查

  hbase hbck

• 拆分region

  hbase(main):004:0> splitormerge_enabled 'SPLIT'
  false
  hbase(main):006:0> splitormerge_switch 'SPLIT',true
  false
  hbase(main):007:0>  splitormerge_enabled 'SPLIT'
  true  
  ## 插分前也需要上面的合并操作完成，所以也需要手动触发下
  hbase(main):012:0> major_compact 'YS_PROD:IP_DATA_VALUE_PJ6101122010_2022'
  Took 0.0509 seconds 
  hbase(main):013:0> split 'YS_PROD:IP_DATA_VALUE_PJ6101122010_2022,D,1681977486429.f68c6d791f2a6a0905374f515c795e49.', 'E'
  Took 0.0170 seconds                                                                                                                                                                                   
  hbase(main):014:0> major_compact 'YS_PROD:IP_DATA_VALUE_PJ6101122010_2022'
  Took 0.0424 seconds