用java api在hadoop上 创建文件报错
hadoop-2.6.0-cdh5.7.0 jdk1.7.0_79 我再windows 下 操作一台部署了hdfs 的ubuntu server 。创建文件夹可以,但是创建文件并写文件时报错:
org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /hdfsapi/test1/aaa.txt could only be replicated to 0 nodes instead of minReplication (=1). There are 1 datanode(s) running and 1 node(s) are excluded in this operation.
相关代码
// /**
* 创建文件
*/
@Test
public void create() throws Exception {
FSDataOutputStream output = fileSystem.create(new Path("/hdfsapi/test1/aaa.txt"));
output.write("hello hadoop".getBytes());
output.flush();
output.close();
}
检查了防火墙,datanode 内存也够,以及jps检查了datanode,namenode都已开启。
我的datanode 的日志:
**/
2018-09-23 09:25:07,940 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: registered UNIX signal handlers for [TERM, HUP, INT]
2018-09-23 09:25:14,100 WARN org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2018-09-23 09:25:17,664 INFO org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from hadoop-metrics2.properties
2018-09-23 09:25:18,286 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s).
2018-09-23 09:25:18,286 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: DataNode metrics system started
2018-09-23 09:25:18,338 INFO org.apache.hadoop.hdfs.server.datanode.BlockScanner: Initialized block scanner with targetBytesPerSec 1048576
2018-09-23 09:25:18,367 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Configured hostname is 172.16.0.8
2018-09-23 09:25:18,387 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Starting DataNode with maxLockedMemory = 0
2018-09-23 09:25:18,778 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Opened streaming server at /0.0.0.0:50010
2018-09-23 09:25:18,781 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Balancing bandwith is 1048576 bytes/s
2018-09-23 09:25:18,781 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Number threads for balancing is 5
2018-09-23 09:25:19,935 INFO org.mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
2018-09-23 09:25:20,014 INFO org.apache.hadoop.security.authentication.server.AuthenticationFilter: Unable to initialize FileSignerSecretProvider, falling back to use random secrets.
2018-09-23 09:25:20,075 INFO org.apache.hadoop.http.HttpRequestLog: Http request log for http.requests.datanode is not defined
2018-09-23 09:25:20,148 INFO org.apache.hadoop.http.HttpServer2: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2018-09-23 09:25:20,200 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
2018-09-23 09:25:20,200 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2018-09-23 09:25:20,227 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2018-09-23 09:25:20,400 INFO org.apache.hadoop.http.HttpServer2: Jetty bound to port 35277
2018-09-23 09:25:20,400 INFO org.mortbay.log: jetty-6.1.26.cloudera.4
2018-09-23 09:25:22,943 INFO org.mortbay.log: Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35277
2018-09-23 09:25:24,078 INFO org.apache.hadoop.hdfs.server.datanode.web.DatanodeHttpServer: Listening HTTP traffic on /0.0.0.0:50075
2018-09-23 09:25:24,113 INFO org.apache.hadoop.util.JvmPauseMonitor: Starting JVM pause monitor
2018-09-23 09:25:25,150 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: dnUserName = t
2018-09-23 09:25:25,150 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: supergroup = supergroup
2018-09-23 09:25:25,317 INFO org.apache.hadoop.ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue
2018-09-23 09:25:25,380 INFO org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 50020
2018-09-23 09:25:25,610 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Opened IPC server at /0.0.0.0:50020
2018-09-23 09:25:25,793 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Refresh request received for nameservices: null
2018-09-23 09:25:26,009 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Starting BPOfferServices for nameservices: <default>
2018-09-23 09:25:26,038 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Block pool <registering> (Datanode Uuid unassigned) service to /0.0.0.0:8020 starting to offer service
2018-09-23 09:25:26,073 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting
2018-09-23 09:25:26,075 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 50020: starting
2018-09-23 09:25:28,101 INFO org.apache.hadoop.hdfs.server.common.Storage: Lock on /home/t/java/tmp/dfs/data/in_use.lock acquired by nodename 20254@ht
2018-09-23 09:25:28,806 INFO org.apache.hadoop.hdfs.server.common.Storage: Analyzing storage directories for bpid BP-1922751431-172.16.0.8-1537692591176
2018-09-23 09:25:28,806 INFO org.apache.hadoop.hdfs.server.common.Storage: Locking is disabled for /home/t/java/tmp/dfs/data/current/BP-1922751431-172.16.0.8-1537692591176
2018-09-23 09:25:28,835 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Setting up storage: nsid=764243406;bpid=BP-1922751431-172.16.0.8-1537692591176;lv=-56;nsInfo=lv=-60;cid=CID-162ab30d-91b0-4b56-a700-e6f630088605;nsid=764243406;c=0;bpid=BP-1922751431-172.16.0.8-1537692591176;dnuuid=ee667dd3-d57a-4717-b7d0-d1f11a10e315
2018-09-23 09:25:29,321 INFO org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetImpl: Added new volume: DS-2f7c927d-6261-4fe6-a604-4a636994e342
2018-09-23 09:25:29,321 INFO org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetImpl: Added volume - /home/t/java/tmp/dfs/data/current, StorageType: DISK
2018-09-23 09:25:29,403 INFO org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetImpl: Registered FSDatasetState MBean
2018-09-23 09:25:29,404 INFO org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetImpl: Volume reference is released.
2018-09-23 09:25:29,404 INFO org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetImpl: Adding block pool BP-1922751431-172.16.0.8-1537692591176
2018-09-23 09:25:29,412 INFO org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetImpl: Scanning block pool BP-1922751431-172.16.0.8-1537692591176 on volume /home/t/java/tmp/dfs/data/current...
2018-09-23 09:25:29,578 INFO org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetImpl: Time taken to scan block pool BP-1922751431-172.16.0.8-1537692591176 on /home/t/java/tmp/dfs/data/current: 164ms
2018-09-23 09:25:29,578 INFO org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetImpl: Total time to scan all replicas for block pool BP-1922751431-172.16.0.8-1537692591176: 174ms
2018-09-23 09:25:29,582 INFO org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetImpl: Adding replicas to map for block pool BP-1922751431-172.16.0.8-1537692591176 on volume /home/t/java/tmp/dfs/data/current...
2018-09-23 09:25:29,582 INFO org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetImpl: Time to add replicas to map for block pool BP-1922751431-172.16.0.8-1537692591176 on volume /home/t/java/tmp/dfs/data/current: 0ms
2018-09-23 09:25:29,582 INFO org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetImpl: Total time to add all replicas to map: 1ms
2018-09-23 09:25:32,930 INFO org.apache.hadoop.hdfs.server.datanode.VolumeScanner: VolumeScanner(/home/t/java/tmp/dfs/data, DS-2f7c927d-6261-4fe6-a604-4a636994e342): no suitable block pools found to scan. Waiting 1812345968 ms.
2018-09-23 09:25:32,934 INFO org.apache.hadoop.hdfs.server.datanode.DirectoryScanner: Periodic Directory Tree Verification scan starting at 1537698184934ms with interval of 21600000ms
2018-09-23 09:25:32,965 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Block pool BP-1922751431-172.16.0.8-1537692591176 (Datanode Uuid null) service to /0.0.0.0:8020 beginning handshake with NN
2018-09-23 09:25:34,544 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Block pool Block pool BP-1922751431-172.16.0.8-1537692591176 (Datanode Uuid null) service to /0.0.0.0:8020 successfully registered with NN
2018-09-23 09:25:34,545 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: For namenode /0.0.0.0:8020 using BLOCKREPORT_INTERVAL of 21600000msec CACHEREPORT_INTERVAL of 10000msec Initial delay: 0msec; heartBeatInterval=3000
2018-09-23 09:25:35,534 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Namenode Block pool BP-1922751431-172.16.0.8-1537692591176 (Datanode Uuid ee667dd3-d57a-4717-b7d0-d1f11a10e315) service to /0.0.0.0:8020 trying to claim ACTIVE state with txid=16
2018-09-23 09:25:35,534 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Acknowledging ACTIVE Namenode Block pool BP-1922751431-172.16.0.8-1537692591176 (Datanode Uuid ee667dd3-d57a-4717-b7d0-d1f11a10e315) service to /0.0.0.0:8020
2018-09-23 09:25:36,195 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Successfully sent block report 0x99c6e2e63d4336b, containing 1 storage report(s), of which we sent 1. The reports had 0 total blocks and used 1 RPC(s). This took 14 msec to generate and 647 msecs for RPC and NN processing. Got back one command: FinalizeCommand/5.
2018-09-23 09:25:36,195 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Got finalize command for block pool BP-1922751431-172.16.0.8-1537692591176
我的namenode 日志:
2018-09-23 09:34:20,237 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* allocateBlock: /hdfsapi/test1/aaa.txt. BP-1922751431-172.16.0.8-1537692591176 blk_1073741827_1003{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-2f7c927d-6261-4fe6-a604-4a636994e342:NORMAL:172.16.0.8:50010|RBW]]}
2018-09-23 09:34:41,473 WARN org.apache.hadoop.hdfs.server.blockmanagement.BlockPlacementPolicy: Failed to place enough replicas, still in need of 1 to reach 1 (unavailableStorages=[], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}, newBlock=true) For more information, please enable DEBUG log level on org.apache.hadoop.hdfs.server.blockmanagement.BlockPlacementPolicy
2018-09-23 09:34:41,473 WARN org.apache.hadoop.hdfs.protocol.BlockStoragePolicy: Failed to place enough replicas: expected size is 1 but only 0 storage types can be selected (replication=1, selected=[], unavailable=[DISK], removed=[DISK], policy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]})
2018-09-23 09:34:41,474 WARN org.apache.hadoop.hdfs.server.blockmanagement.BlockPlacementPolicy: Failed to place enough replicas, still in need of 1 to reach 1 (unavailableStorages=[DISK], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}, newBlock=true) All required storage types are unavailable: unavailableStorages=[DISK], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}
2018-09-23 09:34:41,474 WARN org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:t (auth:SIMPLE) cause:java.io.IOException: File /hdfsapi/test1/aaa.txt could only be replicated to 0 nodes instead of minReplication (=1). There are 1 datanode(s) running and 1 node(s) are excluded in this operation.
2018-09-23 09:34:41,475 INFO org.apache.hadoop.ipc.Server: IPC Server handler 3 on 8020, call org.apache.hadoop.hdfs.protocol.ClientProtocol.addBlock from 123.112.14.249:20643 Call#3 Retry#0
java.io.IOException: File /hdfsapi/test1/aaa.txt could only be replicated to 0 nodes instead of minReplication (=1). There are 1 datanode(s) running and 1 node(s) are excluded in this operation.
at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1595)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3287)
at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:677)
at org.apache.hadoop.hdfs.server.namenode.AuthorizationProviderProxyClientProtocol.addBlock(AuthorizationProviderProxyClientProtocol.java:213)
at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:485)
at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:617)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1073)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2086)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2082)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2080)
2018-09-23 09:34:49,460 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Rescanning after 30000 milliseconds
2018-09-23 09:34:49,460 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Scanned 0 directive(s) and 0 block(s) in 1 millisecond(s).
2018-09-23 09:35:18,678 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: StorageInfo TreeSet fill ratio DS-2f7c927d-6261-4fe6-a604-4a636994e342 : 1.0
2018-09-23 09:35:19,459 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Rescanning after 30000 milliseconds
2018-09-23 09:35:19,460 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Scanned 0 directive(s) and 0 block(s) in 1 millisecond(s).
2018-09-23 09:35:49,460 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Rescanning after 30000 milliseconds
2018-09-23 09:35:49,460 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Scanned 0 directive(s) and 0 block(s) in 1 millisecond(s).
2018-09-23 09:36:19,459 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Rescanning after 30000 milliseconds
2018-09-23 09:36:19,460 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Scanned 0 directive(s) and 0 block(s) in 1 millisecond(s).
2018-09-23 09:36:49,459 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Rescanning after 30000 milliseconds
2018-09-23 09:36:49,460 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Scanned 0 directive(s) and 0 block(s) in 0 millisecond(s).
2018-09-23 09:37:19,460 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Rescanning after 30000 milliseconds
2018-09-23 09:37:19,460 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Scanned 0 directive(s) and 0 block(s) in 1 millisecond(s).
2018-09-23 09:37:49,459 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Rescanning after 30000 milliseconds
2018-09-23 09:37:49,460 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Scanned 0 directive(s) and 0 block(s) in 1 millisecond(s).
2018-09-23 09:38:19,459 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Rescanning after 30000 milliseconds
2018-09-23 09:38:19,460 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Scanned 0 directive(s) and 0 block(s) in 0 millisecond(s).
2018-09-23 09:38:49,460 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Rescanning after 30000 milliseconds
2018-09-23 09:38:49,460 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Scanned 0 directive(s) and 0 block(s) in 1 millisecond(s).
2018-09-23 09:39:19,460 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Rescanning after 30000 milliseconds
2018-09-23 09:39:19,460 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Scanned 0 directive(s) and 0 block(s) in 1 millisecond(s).
2018-09-23 09:39:49,459 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Rescanning after 30000 milliseconds
2018-09-23 09:39:49,460 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Scanned 0 directive(s) and 0 block(s) in 0 millisecond(s).
2018-09-23 09:40:19,460 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Rescanning after 30001 milliseconds
2018-09-23 09:40:19,461 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Scanned 0 directive(s) and 0 block(s) in 0 millisecond(s).
2018-09-23 09:40:49,461 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Rescanning after 30000 milliseconds
2018-09-23 09:40:49,461 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Scanned 0 directive(s) and 0 block(s) in 1 millisecond(s).
2018-09-23 09:41:19,461 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Rescanning after 30000 milliseconds
2018-09-23 09:41:19,461 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Scanned 0 directive(s) and 0 block(s) in 1 millisecond(s).
2018-09-23 09:41:49,460 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Rescanning after 30000 milliseconds
2018-09-23 09:41:49,461 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Scanned 0 directive(s) and 0 block(s) in 0 millisecond(s).
2018-09-23 09:42:19,461 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Rescanning after 30001 milliseconds
2018-09-23 09:42:19,462 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Scanned 0 directive(s) and 0 block(s) in 1 millisecond(s).
2018-09-23 09:42:49,461 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Rescanning after 30000 milliseconds
2018-09-23 09:42:49,463 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Scanned 0 directive(s) and 0 block(s) in 2 millisecond(s).
2018-09-23 09:43:19,461 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Rescanning after 30000 milliseconds
2018-09-23 09:43:19,462 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Scanned 0 directive(s) and 0 block(s) in 1 millisecond(s).
2018-09-23 09:43:49,462 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Rescanning after 30000 milliseconds
2018-09-23 09:43:49,463 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Scanned 0 directive(s) and 0 block(s) in 1 millisecond(s).
2018-09-23 09:44:19,462 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Rescanning after 30000 milliseconds
2018-09-23 09:44:19,464 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Scanned 0 directive(s) and 0 block(s) in 2 millisecond(s).
2018-09-23 09:44:49,462 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Rescanning after 30001 milliseconds
2018-09-23 09:44:49,464 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Scanned 0 directive(s) and 0 block(s) in 2 millisecond(s).
2018-09-23 09:45:18,678 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: StorageInfo TreeSet fill ratio DS-2f7c927d-6261-4fe6-a604-4a636994e342 : 1.0
2018-09-23 09:45:19,462 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Rescanning after 30000 milliseconds
2018-09-23 09:45:19,463 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Scanned 0 directive(s) and 0 block(s) in 1 millisecond(s).
2018-09-23 09:45:49,462 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Rescanning after 30000 milliseconds
2018-09-23 09:45:49,464 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Scanned 0 directive(s) and 0 block(s) in 1 millisecond(s).
2018-09-23 09:46:19,463 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Rescanning after 30001 milliseconds
2018-09-23 09:46:19,464 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Scanned 0 directive(s) and 0 block(s) in 1 millisecond(s).
2018-09-23 09:46:49,464 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Rescanning after 30000 milliseconds
2018-09-23 09:46:49,465 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Scanned 0 directive(s) and 0 block(s) in 1 millisecond(s).
2018-09-23 09:47:19,464 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Rescanning after 30000 milliseconds
2018-09-23 09:47:19,465 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Scanned 0 directive(s) and 0 block(s) in 2 millisecond(s).
2018-09-23 09:47:49,463 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Rescanning after 30000 milliseconds
2018-09-23 09:47:49,465 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Scanned 0 directive(s) and 0 block(s) in 1 millisecond(s).
2018-09-23 09:48:19,464 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Rescanning after 30000 milliseconds
2018-09-23 09:48:19,465 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Scanned 0 directive(s) and 0 block(s) in 2 millisecond(s).
2018-09-23 09:48:49,463 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Rescanning after 30000 milliseconds
2018-09-23 09:48:49,464 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Scanned 0 directive(s) and 0 block(s) in 1 millisecond(s).
2018-09-23 09:49:19,464 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Rescanning after 30000 milliseconds
2018-09-23 09:49:19,465 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Scanned 0 directive(s) and 0 block(s) in 1 millisecond(s).
2018-09-23 09:49:49,464 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Rescanning after 30000 milliseconds
2018-09-23 09:49:49,465 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Scanned 0 directive(s) and 0 block(s) in 1 millisecond(s).
https://stackoverflow.com/que...