2MM row load job failed after 2 hours, but no useful error message generated

Question

Here's a screenshot of my load job. it says "Unexpected. Please try again." without any additional information. Is there some way to get more detail? or can someone at google take a closer look at the logs and tell my why it failed?

bq shows:

Job tzgqnxt:job_016afefcfc0a42089822d621cf3d6ace

Job Type State Start Time Duration Bytes Processed

---

load FAILURE 27 Jul 10:32:05 2:00:09

Errors encountered during job execution. Unexpected. Please try again.

Answer 1

Given that this job was killed at almost exactly 2 hours, it looks like you hit the two hour limit for import and export jobs. This job likely shouldn't have taken 2+ hours though -- I looked at the job logs, it looks like we encountered some problems with the CSV at about 5.5 million rows. Is there any chance you could give me (tigani@google.com) read access to the file in google storage so that I can debug further?

Answer 2

Do you have bq installed? If so, you can try calling bq show -j <that job id> to see if there's any additional information.

Note that if you are hitting a timeout problem, you could work around it by splitting the file into a few chunks and doing several imports, all with the same destination table. The end result will be the same.