osdir.com


[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Log output from Dataflow tests


Hi,

I'm debugging a test failure in Dataflow PostCommit. There are logs available which I can't access. Is it possible to be added to the apache-beam-testing project?

Thanks,
Max


Example:
======================================================================
FAIL: test_streaming_with_attributes (apache_beam.io.gcp.pubsub_integration_test.PubSubIntegrationTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify_PR/src/sdks/python/apache_beam/io/gcp/pubsub_integration_test.py", line 175, in test_streaming_with_attributes
    self._test_streaming(with_attributes=True)
File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify_PR/src/sdks/python/apache_beam/io/gcp/pubsub_integration_test.py", line 167, in _test_streaming
    timestamp_attribute=self.TIMESTAMP_ATTRIBUTE)
File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify_PR/src/sdks/python/apache_beam/io/gcp/pubsub_it_pipeline.py", line 91, in run_pipeline
    result = p.run()
File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify_PR/src/sdks/python/apache_beam/pipeline.py", line 416, in run
    return self.runner.run_pipeline(self)
File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify_PR/src/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py", line 65, in run_pipeline
    hc_assert_that(self.result, pickler.loads(on_success_matcher))
AssertionError:
Expected: (Test pipeline expected terminated in state: RUNNING and Expected 2 messages.)
     but: Expected 2 messages. Got 0 messages. Diffs (item, count):
Expected but not in actual: [(PubsubMessage(data001-seen, {'processed': 'IT'}), 1), (PubsubMessage(data002-seen, {'timestamp_out': '2018-07-11T02:02:50.149000Z', 'processed': 'IT'}), 1)]
  Unexpected: []
  Stripped attributes: ['id', 'timestamp']

-------------------- >> begin captured stdout << ---------------------
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-10-08_14_41_03-9578125971484804239?project=apache-beam-testing.