osdir.com

                 

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: pyarrow and DictionaryBatches


hi Naveen -- there is not an API to generate them separately right
now; they are written as part of serializing the schema. I don't see
an issue with adding APIs to create them as buffers separate from the
schema message. Feel free to open a JIRA and/or submit a PR

- Wes

On Thu, Dec 20, 2018 at 9:59 AM Naveen Michaud-Agrawal
<naveen.michaudagrawal@xxxxxxxxx> wrote:
>
> Hello,
>
> Is there any way to created DictionaryBatches from pyarrow? From the docs
> it looks like they are just regular RecordBatches with some extra metadata,
> but I don't see an API to create them directly.
>
> Thanks,
> Naveen