Question

I want to create one big table contains all the data from all table in database then export this table into csv file then import this file into Hbase ? My issue is first step which is how to create bigtable from all database tables? i will be thankful for any help . Thanks in advance .

Was it helpful?

Solution

You could use sqoop to transfer all the tables and data to HBase if your desire is to dump all the data to HBase or HDFS. It may not be efficient or feasible to convert all data to one big table. Just noting that, export of CLOB/BLOB data can't be performed to CVS file.

OTHER TIPS

Take a look at sqoop, may be it can help.

We use it to store data from RDBMS into Hive tables. As for hive, it can automatically create tables with appropriate column names and types. It also requires split_by option for custom queries, which specifies how to split data into chunks.

Why would you do that? Write a MapReduce job and inject the output into a the HBase table.

Licensed under: CC-BY-SA with attribution
Not affiliated with StackOverflow
scroll top