OSDir


[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Reading BigQuery Timestamps via python SDK returns error for dates < 1900


Hey,

I am getting an exception when running beam on BigQuery rows that contain Timestamps less than 1900. I get a similar error when using the DirectRunner.

  File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/nativebigqueryavroio.py", line 83, in _fix_field_value
    return dt.strftime('%Y-%m-%d %H:%M:%S.%f UTC')
ValueError: year=1851 is before 1900; the datetime strftime() methods require year >= 1900

How do I read these rows without changing my schema?

Thanks!