سؤال

I need to create a map-reducing program which reads an Excel file from HDFS and does some analysis on it. From there store the output in the format of excel file. I know that TextInputFormat is used to read a .txt file from HDFS but which method or which inputformat should I have to use?

هل كانت مفيدة؟

المحلول

Generally, hadoop is overkill for this scenario, but some relevant solutions

  1. parse the file externally and convert to an hadoop compatible format

  2. read the complete file as a single record see this answer

  3. use two chained jobs. the 1st like in 2, reads the file in bulk, and emits each record as input for the next job.

مرخصة بموجب: CC-BY-SA مع الإسناد
لا تنتمي إلى StackOverflow
scroll top