使用python远程连接服务器spark集群操作？

Question

检查webui的worker上显示

Caused by: java.io.IOException: Failed to connect to LAPTOP-HQ3SVFP8:54605
    at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:284)
    at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:214)
    at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:226)
    at org.apache.spark.rpc.netty.NettyRpcEnv.createClient(NettyRpcEnv.scala:204)
    at org.apache.spark.rpc.netty.Outbox$$anon$1.call(Outbox.scala:202)
    at org.apache.spark.rpc.netty.Outbox$$anon$1.call(Outbox.scala:198)
    at java.util.concurrent.FutureTask.run(FutureTask.java:266)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:750)
Caused by: java.net.UnknownHostException: LAPTOP-HQ3SVFP8

但是由于环境是部署在阿里云ces上的，在服务器上ping不通本地主机，现在也不知道该怎么办了。

Answer 1

你本地主机去调用对方，只要你本地能ping通对方就可以了，对端ping不通你一般来说没有影响。