Beeline hive failed while configuring Azure blob storage for hdfs

We created a kerberos hadoop cluster with azure block of memory by following the link below. https://hadoop.apache.org/docs/stable/hadoop-azure/index.html

Facing issue connecting hive thirft server beeline wrapper, but the same configuration for storing azure blob works fine with normal cluster.

find information about problems:

ERROR org.apache.thrift.server.TThreadPoolServer: Error occurred during processing of message.
java.lang.NullPointerException
                at org.apache.thrift.transport.TSaslTransport$SaslParticipant.isComplete(TSaslTransport.java:547)
                at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:276)
                at org.apache.thrift.transport.TSaslServerTransport.open(TSaslServerTransport.java:41)
                at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:216)
                at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge.java:761)
                at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge.java:758)
                at java.security.AccessController.doPrivileged(Native Method)
                at javax.security.auth.Subject.doAs(Subject.java:356)
                at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1636)
                at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingTransportFactory.getTransport(HadoopThriftAuthBridge.java:758)
                at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:269)
                at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
                at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
                at java.lang.Thread.run(Thread.java:744)

      

Can anyone help us set up a hive2 server with Azure blash storage instead of HDFS on a Kerberos hasoop cluster?

Thank you,
Selva

+3


source to share





All Articles