Clever Geek Handbook

Spark app keeps running and seems to be HANGING - org.apache.spark.sql.hive.thriftserver.HiveThriftServer2

I'm using HDFS 2.7.3 and Spark2 2.0.0 on a Hadoop cluster. When I start Spark2 Thrift Server it starts successfully, but it automatically starts working with the Hive user and it seems to hang forever. If I manually kill the job, it starts a new job again with a new applicationId.

Before starting the Thrift server After starting the Thrift server org.apache.spark.sql.hive.thriftserver.HiveThriftServer2 job hangs

But if I stop Spark2 Thrift Server it kills the job. Could you please help me understand this problem?

Thanks in advance.

+3


source to share


1 answer


I faced the same problem as you, spark 2.0 is unstable for thriftserver module, better upgrade to spark 2.1



0


source






More articles:


All Articles