Error when running hdfs.init()

[piccolbo]

Opened on behalf of @yoonus786

Hi, I am able to run hdfs.init() in master node. But I am getting error when I am running in the slave node.

hdfs.init()
Error in .jcall("RJavaTools", "Ljava/lang/Object;", "invokeMethod", cl, :
java.io.IOException: failure to login
Please let me know what will be the problem here.

Thanks,
Yoonus

[RevolutionAnalytics]

Sounds like a Hadoop configuration issue. What does your hadoop classpath look like on the node that fails? Can you access hdfs on that node using the hadoop command line?

[yoonus786]

I am able to run jps in master node and get
11510 NameNode
11697 DataNode
11898 SecondaryNameNode
20098 HRegionServer
4038 Jps
19824 HQuorumPeer
11993 JobTracker
12204 TaskTracker
19897 HMaster

and similarly jps in slave node
19029 DataNode
19191 TaskTracker
13100 Jps

Also, I am able to access the hdfs file from slave node using
bin/hadoop fs -ls /

[RevolutionAnalytics]

How are you invoking rhdfs? From a standard R console or from some other process? what does your hadoop classpath look like?

[yugi2245]

Hi All,

I too face the same issue and resolved by reconfiguring the Java for R by simple command in Linux CentOS 6.2.

$R CMD javareconf

Thanks,
Yugandhar

[anoopkumarkm]

Please follow steps below from R shell after installing rhdfs and configuring java using R CMD javareconf

Sys.setenv(HADOOP_CMD="/usr/bin/hadoop")
library(rhdfs)
hdfs.init()
hdfs.ls("/")