Error on sqoop2 job submission

StackOverflow https://stackoverflow.com/questions/20931062

  •  24-09-2022
  •  | 
  •  

Question

I'm getting an error on sqoop2 job submission.

sqoop:000> start job --jid 1
Submission details
Job id: 1
Status: FAILURE_ON_SUBMIT 
Creation date: 2013-11-06 11:21:30 IST
Last update date: 2013-11-06 11:21:30 IST

Exception: java.io.FileNotFoundException: File does not exist: hdfs://master:9000/usr/local/sqoop/server/webapps/sqoop/WEB-INF/lib/sqoop-common-1.99.3.jar

Do we need to put all sqoop jar files on HDFS?

I’m running sqoop jobs on the same master node of hadoop 2.2.0

Was it helpful?

Solution

I copied all required jar libs into the hdfs finally and it worked.

hadoop fs -mkdir -p /usr/local/sqoop/server/webapps/sqoop/WEB-INF/lib/
hadoop fs -copyFromLocal /usr/local/sqoop/server/webapps/sqoop/WEB-INF/lib/*.jar /usr/local/sqoop/server/webapps/sqoop/WEB-INF/lib/

OTHER TIPS

Modify mapred-site.xml file.

<property>
  <name>mapreduce.framework.name</name>
  <value>yarn</value>
</property>

I succeeded

Licensed under: CC-BY-SA with attribution
Not affiliated with StackOverflow
scroll top