osdir.com


[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: Apache Arrow .NET implementation


Seems like there's no major objections to this code donation, and the
developers intend to keep working on it. I'll start a vote and we can
move forward the donation process
On Thu, Oct 11, 2018 at 5:24 PM Phillip Cloud <cpcloud@xxxxxxxxx> wrote:
>
> +1.
>
> I agree that .NET + Arrow is a good match. Generally speaking, I'm not sure
> there are many systems programming languages whose communities wouldn't
> benefit from an Arrow implementation. I do think it's worth discussing what
> to do about the growing numbers of implementations, but that shouldn't
> block donation of this code. I think there are likely some interesting
> things to explore using C#'s asynchronous APIs as well as potential for
> more esoteric interactions with IronPython and other .NET software. Thanks!
>
> On Thu, Oct 11, 2018 at 6:52 AM Antoine Pitrou <antoine@xxxxxxxxxx> wrote:
>
> >
> > Ah, sorry.  I think it would be good for the project to have a foot in
> > the .NET ecosystem.  I'm not able to comment more specifically, but the
> > general idea sounds fine to me.
> >
> > Regards
> >
> > Antoine.
> >
> >
> > Le 11/10/2018 à 12:46, Wes McKinney a écrit :
> > > This is a topic that bears discussion but I don't think it's related to
> > > whether we accept this donation of IP into the Apache project. Let's
> > > discuss that separately.
> > >
> > > On Thu, Oct 11, 2018, 12:39 PM Antoine Pitrou <antoine@xxxxxxxxxx>
> > wrote:
> > >
> > >>
> > >> Le 11/10/2018 à 12:34, Wes McKinney a écrit :
> > >>> hi Antoine -- this is C# .NET, not C++.
> > >>
> > >> That is what I understood.  My question was whether we want to continue
> > >> gathering all independent implementations (I'm assuming the .NET
> > >> implementation doesn't rely on the C++ libs?) in a single repo.
> > >>
> > >> Regards
> > >>
> > >> Antoine.
> > >>
> > >>
> > >>
> > >>  So this is a new
> > >>> implementation to stand alongside the other languages in the repo at
> > >>> present. I would hope that we can eventually add C# integration tests
> > >>> to the integration test matrix.
> > >>>
> > >>> - Wes
> > >>> On Thu, Oct 11, 2018 at 6:12 AM Antoine Pitrou <solipsis@xxxxxxxxxx>
> > >> wrote:
> > >>>>
> > >>>>
> > >>>> If it's an independent implementation, does it make sense to integrate
> > >>>> it in the current C++ Arrow repository?  AFAIK, the main point is to
> > >>>> run integration tests.  On the other hand, it doesn't scale very well
> > >>>> to integrate all implementations in a single repo.
> > >>>>
> > >>>> It could still be under the Apache Arrow umbrella, but under its own
> > >>>> repository.
> > >>>>
> > >>>> Regards
> > >>>>
> > >>>> Antoine.
> > >>>>
> > >>>>
> > >>>> On Thu, 11 Oct 2018 05:26:22 -0400
> > >>>> Wes McKinney <wesmckinn@xxxxxxxxx> wrote:
> > >>>>> Do others have some opinions about this? I think it would be great to
> > >>>>> bring in folks from the .NET community. Since there is also a Parquet
> > >>>>> .NET library available (
> > https://github.com/elastacloud/parquet-dotnet)
> > >>>>> there may be some interesting collaborations.
> > >>>>>
> > >>>>> Thanks,
> > >>>>> Wes
> > >>>>> On Tue, Oct 9, 2018 at 12:58 PM Christopher S. Hutchinson
> > >>>>> <cshutchinson@xxxxxxxxxx> wrote:
> > >>>>>>
> > >>>>>> I planned on contributing long term in an open-source capacity
> > >> separate from my employer, but I imagine spending professional time as
> > our
> > >> product evolves. I don't have an Apache ID at the moment; I also forgot
> > to
> > >> include that in my ICLA, although I specified in my submission to the
> > >> secretary the ID(s) I prefer.
> > >>>>>>
> > >>>>>> -----Original Message-----
> > >>>>>> From: Wes McKinney [mailto:wesmckinn@xxxxxxxxx]
> > >>>>>> Sent: Tuesday, October 9, 2018 12:04 PM
> > >>>>>> To: dev@xxxxxxxxxxxxxxxx
> > >>>>>> Subject: Re: Apache Arrow .NET implementation
> > >>>>>>
> > >>>>>> hi Christopher,
> > >>>>>>
> > >>>>>> This is great to hear. Do you and your colleagues have plans to
> > >> continue developing it if the donation is accepted into Apache Arrow?
> > >>>>>>
> > >>>>>> Thanks,
> > >>>>>> Wes
> > >>>>>> On Tue, Oct 9, 2018 at 12:01 PM Christopher S. Hutchinson <
> > >> cshutchinson@xxxxxxxxxx> wrote:
> > >>>>>>>
> > >>>>>>> I am writing to announce that my employer (Feyen Zylstra LLC) has
> > >> developed an implementation of Apache Arrow targeting .NET Standard. We
> > are
> > >> donating this implementation to the Apache Software Foundation. The
> > source
> > >> code is available for review on GitHub:
> > >>>>>>>
> > >>>>>>> https://github.com/feyenzylstra/apache-arrow
> > >>>>>>>
> > >>>>>>> Please let me know if you have any questions. Feel free to leave
> > >> issues on GitHub, and happy voting!
> > >>>>>>>
> > >>>>>
> > >>>>
> > >>
> > >
> >