Calling 'job.begin' on job returned from 'Table.upload_from_file' raises a 400

[theacodes]

Trying to load data into bigquery with upload_from_file returns a 400.

Sample code:

def load_data_from_file(dataset_name, table_name, source_file_name):
    bigquery_client = bigquery.Client()
    dataset = bigquery_client.dataset(dataset_name)
    table = dataset.table(table_name)

    # Reload the table to get the schema.
    table.reload()

    with open(source_file_name, 'rb') as source_file:
        # This example uses CSV, but you can use other formats.
        # See https://cloud.google.com/bigquery/loading-data
        job = table.upload_from_file(
            source_file, source_format='text/csv')

    job.begin()

    wait_for_job(job)

    print('Loaded {} rows into {}:{}.'.format(
        job.output_rows, dataset_name, table_name))

Error:

Traceback (most recent call last):
  File "load_data_from_file.py", line 77, in <module>
    args.source_file_anme)
  File "load_data_from_file.py", line 45, in load_data_from_file
    job.begin()
  File "/Users/jonwayne/workspace/python-docs-samples/bigquery/cloud-client/env/lib/python3.4/site-packages/gcloud/bigquery/job.py", line 364, in begin
    method='POST', path=path, data=self._build_resource())
  File "/Users/jonwayne/workspace/python-docs-samples/bigquery/cloud-client/env/lib/python3.4/site-packages/gcloud/connection.py", line 347, in api_request
    error_info=method + ' ' + url)
gcloud.exceptions.BadRequest: 400 Load configuration must specify at least one source URI (POST https://www.googleapis.com/bigquery/v2/projects/python-docs-samples-tests/jobs)

[matheuspatury]

Any updates on this issue? My project is stuck because of it...

[jgeewax]

Do we know what the problem is yet ? @tseaver

/cc @omaray

[tseaver]

There is a workaround: first upload the file to Storage, and then load the table from there. E.g., see this system test.

I will look into reproducing the issue with a new system test.

[tseaver]

@jonparrott, @matheuspatury Note that it is an error to call job.begin(), because the job returned from table.upload_from_file is a) already started, and b) lacks information needed to start (the error it reports). #2313 shows that the job completes fine without that call.

[theacodes]

Strange, why does the API start this job for you but doesn't do so for
other things? We should be consistent.

On Tue, Sep 13, 2016, 5:50 PM Tres Seaver notifications@github.com wrote:

@jonparrott https://github.com/jonparrott, @matheuspatury
https://github.com/matheuspatury Note that it is an error to call
job.begin(), because the job returned from table.upload_from_file is a)
already started, and b) lacks information needed to start (the error it
reports). #2313
#2313
shows that the job completes fine without that call.

—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
#2133 (comment),
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAPUc7bYLzz5uqVntzL3yOryx2uHTcFCks5qp0TlgaJpZM4Jn6R-
.