How to share a tHashInput between jobs?

Question

I want to feed a tHashInput with a lot of data. I want to use the Hash in subjobs to have some modularity in my master job. I know how to share simple data using context variables, but I would like to know how to share this object to use it as tHashOutput. Or maybe there is another way to do it.

Any idea?

Answer 1

As garpitmzn points out the tHash components are private to the job and so cannot be shared across the job.

To share data between jobs you can use the tBuffer components to move data back up to a parent job or of course write the data to a flat file or database.

If performance is a concern you could try using an in memory database such as HSQLDB to temporarily hold the data.

Alternatively you could merge all of the jobs into a single job assuming that it doesn't then exceed the maximum amount of components for a job. This has a lot of obvious drawbacks and means your job complexity becomes very high but it would allow you to carry on using your tHash components.

Answer 2

tHash works for sharing data within the job. For sharing data across sub-jobs you should use tBufferOutput/tBufferInput.