Question

I am using hadoop-1.0.4 on amazon ec2 of 3 ubuntu 12.10 instances, 1 master and 2 slaves, just under ~ directory. Now start-all.sh and stop-all.sh is ok, but when i run jps on master or slaves, it prints nothing. Then i tested hadoop examples:

~/hadoop$ bin/hadoop jar hadoop-examples-1.0.4.jar pi 10 10000  

It shows

    Exception in thread "main" java.io.IOException: Permission denied
    at java.io.UnixFileSystem.createFileExclusively(Native Method)
    at java.io.File.createTempFile(File.java:1879)
    at org.apache.hadoop.util.RunJar.main(RunJar.java:115)

However i've chmod 777 -R tmp to tmp folders.

~/hadoop$ sudo bin/hadoop jar hadoop-examples-1.0.4.jar pi 10 10000  

With sudo, it produces

    13/05/12 03:58:11 WARN conf.Configuration: DEPRECATED: hadoop-site.xml
     found in the classpath. Usage of hadoop-site.xml is deprecated.  
    Instead use core-site.xml, mapred-site.xml and hdfs-site.xml to  
    override properties of core-default.xml, mapred-default.xml  
    and hdfs-default.xml respectively
    Number of Maps  = 10
    Samples per Map = 10000
    13/05/12 03:58:12 WARN fs.FileSystem: "54.235.101.85:50001" is a deprecated   
    filesystem name. Use "hdfs://54.235.101.85:50001/" instead.
    13/05/12 03:58:13 INFO ipc.Client: Retrying connect to server: 
    hdmaster/54.235.101.85:50001. Already tried 0 time(s).
    13/05/12 03:58:14 INFO ipc.Client: Retrying connect to server: 
    hdmaster/54.235.101.85:50001. Already tried 1 time(s).
    13/05/12 03:58:15 INFO ipc.Client: Retrying connect to server: 
    hdmaster/54.235.101.85:50001. Already tried 2 time(s).

Then failed to connect. So what is the problem? should i put sudo to run the examples? Thanks a lot.

Was it helpful?

Solution

I think, the problem is, 54.235.101.85 is suppose to be a public IP address. Use ifconfig in all the nodes to get a list of IP address and check for IP beginning with 10.x.x.x/172.x.x.x/192.x.x.x. If you find any, modify your configuration files in all the nodes accordingly.

Licensed under: CC-BY-SA with attribution
Not affiliated with StackOverflow
scroll top