Question

I need to periodically load files from local file system into hdfs and update hive table partitions. The query for updating the partitions depends on the

timestamps(select * where date = "").

Could use Oozie EL but I need todays and yesterday's date. Moreover I don't understand how to capture date and pass it as a parameter into hive script.

How do I Do this, any ideas ?

Was it helpful?

Solution

you could write a coordinator.xml and use it's date functions

${coord:dateOffset(coord:nominalTime(), -1, 'DAY')}

docs here: http://oozie.apache.org/docs/3.3.2/CoordinatorFunctionalSpec.html#a6.7.3._coord:nominalTime_EL_Function

Licensed under: CC-BY-SA with attribution
Not affiliated with StackOverflow
scroll top