Question

After running two incremental imports of the same table import_old and import_new using --as--avrofile I simply don't know and I am not able to merge the two.

I see the following Exception:

java.lang.NumberFormatException: For input string: ""fields":[{"name":"cluster_id""

Is there some Avro --jar-file or --class-name I can use?

It must by very simple, but I don't get the trick. I use the following sqoop version:

Sqoop 1.4.3 / git commit id 82fde21d0f6c89059bade4588f3ba6989989dc76 / Compiled by hari on Tue Feb 26 11:28:37 PST 2013`

Was it helpful?

Solution

Sqoop currently do not support merge of avro files (which is required by the incremental import in lastmodified mode). There is already JIRA SQOOP-1094 to add such support.

Licensed under: CC-BY-SA with attribution
Not affiliated with StackOverflow
scroll top