Java complains about native Hadoop library

On my Ubuntu x32, Java x32, Hadoop 2.5.0, I am running:

hduser@master:~$ hdfs dfs -ls /
14/08/19 08:51:21 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Found 3 items
drwxr-xr-x   - hduser supergroup          0 2014-08-19 08:37 /data
drwxr-xr-x   - hduser supergroup          0 2014-08-19 08:37 /export
drwxrwx---   - hduser supergroup          0 2014-08-19 08:32 /tmp

      

Can anyone tell me how to fix this warning?

Java version:

hduser@master:~$ java -d64 -version
Error: This Java instance does not support a 64-bit JVM. Please install the desired version.

hduser@master:~$ java -d32 -version
java version "1.7.0_67" Java(TM) SE Runtime Environment (build 1.7.0_67-b01) Java HotSpot(TM) Client VM (build 24.65-b04, mixed mode)

      

Ubuntu version:

hduser @master: ~ $ uname -a Linux master 3.13.0-29-generi # 53-Ubuntu SMP Wed Jun 4 21:02:19 UTC 2014 i686 i686 i686 GNU / Linux

Hadoop version

hduser @master: ~ $ hadoop version of Hadoop 2.5.0 Subversion http://svn.apache.org/repos/asf/hadoop/common -r 1616291 Compiled by jenkins on 2014-08-06T17: 31Z Compiled with protoc 2.5.0 From source with checksum 423dcd5a752eddd8e45ead6fd5ff9a24 This command was run from / home / hduser / hadoop -2.5.0 / share / hadoop / common / hadoop-common-2.5.0.jar

EDIT:

.bashrc

export SQOOP_HOME=/home/hduser/sqoop
export JAVA_HOME=$(readlink -f /usr/bin/javac | sed "s:/bin/javac::")
export PATH=$PATH:$SQOOP_HOME/bin
export HADOOP_COMMON_HOME=/home/hduser/hadoop
export HADOOP_MAPRED_HOME=/home/hduser/hadoop
export HADOOP_HOME=/home/hduser/hadoop
export PATH=$PATH:$HADOOP_HOME/bin
export PIG_HOME=/home/hduser/pig
export PATH=$PATH:$PIG_HOME/bin
export HBASE_HOME=/home/hduser/hbase
export HIVE_HOME=/home/hduser/hive
export PATH=$PATH:$HIVE_HOME/bin

      

+3


source to share


1 answer


Install LD_LIBRARY_PATH

in your environment pointing to the source library path present inHADOOP_HOME/lib/native

EDIT:



This configuration can vary depending on your Hadoop distribution or linux taste. Here is a good link with a good explanation for CentOS.

+2


source







All Articles