OSDir


[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: Schema class in 2.5 ?


Hi Akanksha,

I believe this design document can be helpful for you:
https://docs.google.com/document/d/1tnG2DPHZYbsomvihIpXruUmQ12pHGK0QIvXS1FOTgRc

On 11 Jul 2018, at 10:38, Akanksha Sharma B <akanksha.b.sharma@xxxxxxxxxxxx> wrote:

Hi,

Can you please share some documentation about ongoing changes related to Schema class. 
I am looking to understand why is it being introduced and how can I use it.
I was looking for something like RDD in Beam, i.e. Beam understands schema of data internally and thus can handle some conversions itself, e.g. to SqlRow, ParquetFile etc. 

Regards,
Akanksha