[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: Tensorflow Hub - cant seem to load module in Airflow


There's nothing directly in Airflow itself that would cause this kind of issue that I can think of.

It depends on what the PythonOperator you are using in the DAG does really. Can you share that code?

-ash

> On 19 Jun 2018, at 10:01, Andrew Maguire <andrewm4894@xxxxxxxxx> wrote:
> 
> Hi All,
> 
> Just wondering if anyone might have a deeper insight into what if anything
> airflow related might be causing this issue
> <https://github.com/tensorflow/hub/issues/76>.
> 
> When i try load a tensorflow hub module within an airflow operator i get
> the error in that issue.
> 
> Works fine if i just run the python script myself.
> 
> Best i could figure out was something airflow was doing didn't agree with
> something tensorflow hub was expecting. And i'm not really sure if there is
> anything i could do to resolve.
> 
> Cheers,
> Andy