BigQuery boosts paging token expired in first getQueryResults
We see sporadic cases (4x today) of query errors that BigQuery raises on the first attempt to call getQueryResults (for example, without a page marker). Mistake:
HttpError 400 when requesting https://www.googleapis.com/bigquery/v2/projects/.../queries/job_...?alt=json returned " Paging ID expired">
The job status when calling get () returned "DONE".
This is the result of waiting for bq for a failed job:
Waiting ... (0s) Current status: DONE
Running
Job Type State Start Time Duration Processed Bytes
request FAULT 24 May 08:00:06 0:00:00
Errors that occur during the execution of the task. Pagination icon expired
Note that this happened a few seconds after the request job was submitted.
Any ideas on what might be going on here?
source to share
It turns out this is just a bad error message. The problem is, BigQuery only supports decoders for the last 7 days. For the query used in the job mentioned above, the specified time interval in the past was 30 days.
The error should have said something like "invalid table decorator trying to read since XXXX in the past". Instead, he said "The pagination mark has expired." The reason for this is that the dotted tokens under the covers use a similar mechanism for the table decorators, and the wrong message is horrible.
So we'll fix the error message, but the query issue should be fixed as well.
source to share