This is no longer an issue. Fixed it by adding --hive-drop-import-delims option. Hope this helps someone. Thanks.
Sqoop merge fails when column contains new line character
Question
Ran Sqoop with options: --fields-terminated-by '\001' --optionally-enclosed-by '\003'
Ran it twice to create 2 directories. This created a QueryResult.java with following line:
private final DelimiterSet __inputDelimiters = new DelimiterSet((char) 1, (char) 10, (char) 3, (char) 0, false);
So far so good!
Used this QueryResult class to run a 'Sqoop Merge' but when it comes to the column that follows the column with new line character, it dies with the exception: java.util.NoSuchElementException
Sqoop version: Sqoop 1.4.4-mapr git commit id 16d0124c5b5f7bc68b8f67fbe77f0c91d46d64c1 Compiled by root on Wed Aug 28 17:22:49 PDT 2013
Any ideas?
Solution
Licensed under: CC-BY-SA with attribution
Not affiliated with StackOverflow