HDInsight Hive not finding SerDe jar in ADD JAR statement

StackOverflow https://stackoverflow.com/questions/23426445

  •  14-07-2023
  •  | 
  •  

Question

I've uploaded json-serde-1.1.9.2.jar to the blob store with path "/lib/" and added

ADD JAR /lib/json-serde-1.1.9.2.jar

But am getting

/lib/json-serde-1.1.9.2.jar does not exist

I've tried it without the path and also provided the full url to the ADD JAR statement with the same result.

Would really appreciate some help on this, thanks!

Was it helpful?

Solution

If you don't include the scheme, then Hive is going to look on the local filesystem (you can see the code around line 768 of the source)

when you included the URI, make sure you use the full form: 

ADD JAR wasb:///lib/json-serde-1.1.9.2.jar

If that still doesn't work, provide your updated command as well as some details about how you are launching the code. Are you RDP'd in to the cluster running via the Hive shell, or running remote via PowerShell or some other API?

Licensed under: CC-BY-SA with attribution
Not affiliated with StackOverflow
scroll top