osdir.com

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: Reading CSV from google cloud storage to Data Flow


Python

On Sun, Nov 25, 2018 at 4:54 PM Jean-Baptiste Onofré <jb@xxxxxxxxxxxx> wrote:
Hi Unais,

What SDK do you plan to use ? Java or Python ?

Regarding Java, I would use directly TextIO.

Regards
JB

On 25/11/2018 13:09, Unais T wrote:
> Hey guys,
>
> One doubt 
>
> I want to read a csv file from google cloud storage to Data Flow
> which is best method?
>
> 1.   Read csv and sync to BQ and then use BigQuerySource method
> 2.   Read from cloud storage directly to Data Flow (Is there any source
> method for csv from cloud storage to CSV - like `ReadFromText` )
>
> Whats the best way to read csv from cloud storage to Data Flow?

--
Jean-Baptiste Onofré
jbonofre@xxxxxxxxxx
http://blog.nanthrax.net
Talend - http://www.talend.com