osdir.com


[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: Apache Arrow .NET implementation


+1.

I agree that .NET + Arrow is a good match. Generally speaking, I'm not sure
there are many systems programming languages whose communities wouldn't
benefit from an Arrow implementation. I do think it's worth discussing what
to do about the growing numbers of implementations, but that shouldn't
block donation of this code. I think there are likely some interesting
things to explore using C#'s asynchronous APIs as well as potential for
more esoteric interactions with IronPython and other .NET software. Thanks!

On Thu, Oct 11, 2018 at 6:52 AM Antoine Pitrou <antoine@xxxxxxxxxx> wrote:

>
> Ah, sorry.  I think it would be good for the project to have a foot in
> the .NET ecosystem.  I'm not able to comment more specifically, but the
> general idea sounds fine to me.
>
> Regards
>
> Antoine.
>
>
> Le 11/10/2018 à 12:46, Wes McKinney a écrit :
> > This is a topic that bears discussion but I don't think it's related to
> > whether we accept this donation of IP into the Apache project. Let's
> > discuss that separately.
> >
> > On Thu, Oct 11, 2018, 12:39 PM Antoine Pitrou <antoine@xxxxxxxxxx>
> wrote:
> >
> >>
> >> Le 11/10/2018 à 12:34, Wes McKinney a écrit :
> >>> hi Antoine -- this is C# .NET, not C++.
> >>
> >> That is what I understood.  My question was whether we want to continue
> >> gathering all independent implementations (I'm assuming the .NET
> >> implementation doesn't rely on the C++ libs?) in a single repo.
> >>
> >> Regards
> >>
> >> Antoine.
> >>
> >>
> >>
> >>  So this is a new
> >>> implementation to stand alongside the other languages in the repo at
> >>> present. I would hope that we can eventually add C# integration tests
> >>> to the integration test matrix.
> >>>
> >>> - Wes
> >>> On Thu, Oct 11, 2018 at 6:12 AM Antoine Pitrou <solipsis@xxxxxxxxxx>
> >> wrote:
> >>>>
> >>>>
> >>>> If it's an independent implementation, does it make sense to integrate
> >>>> it in the current C++ Arrow repository?  AFAIK, the main point is to
> >>>> run integration tests.  On the other hand, it doesn't scale very well
> >>>> to integrate all implementations in a single repo.
> >>>>
> >>>> It could still be under the Apache Arrow umbrella, but under its own
> >>>> repository.
> >>>>
> >>>> Regards
> >>>>
> >>>> Antoine.
> >>>>
> >>>>
> >>>> On Thu, 11 Oct 2018 05:26:22 -0400
> >>>> Wes McKinney <wesmckinn@xxxxxxxxx> wrote:
> >>>>> Do others have some opinions about this? I think it would be great to
> >>>>> bring in folks from the .NET community. Since there is also a Parquet
> >>>>> .NET library available (
> https://github.com/elastacloud/parquet-dotnet)
> >>>>> there may be some interesting collaborations.
> >>>>>
> >>>>> Thanks,
> >>>>> Wes
> >>>>> On Tue, Oct 9, 2018 at 12:58 PM Christopher S. Hutchinson
> >>>>> <cshutchinson@xxxxxxxxxx> wrote:
> >>>>>>
> >>>>>> I planned on contributing long term in an open-source capacity
> >> separate from my employer, but I imagine spending professional time as
> our
> >> product evolves. I don't have an Apache ID at the moment; I also forgot
> to
> >> include that in my ICLA, although I specified in my submission to the
> >> secretary the ID(s) I prefer.
> >>>>>>
> >>>>>> -----Original Message-----
> >>>>>> From: Wes McKinney [mailto:wesmckinn@xxxxxxxxx]
> >>>>>> Sent: Tuesday, October 9, 2018 12:04 PM
> >>>>>> To: dev@xxxxxxxxxxxxxxxx
> >>>>>> Subject: Re: Apache Arrow .NET implementation
> >>>>>>
> >>>>>> hi Christopher,
> >>>>>>
> >>>>>> This is great to hear. Do you and your colleagues have plans to
> >> continue developing it if the donation is accepted into Apache Arrow?
> >>>>>>
> >>>>>> Thanks,
> >>>>>> Wes
> >>>>>> On Tue, Oct 9, 2018 at 12:01 PM Christopher S. Hutchinson <
> >> cshutchinson@xxxxxxxxxx> wrote:
> >>>>>>>
> >>>>>>> I am writing to announce that my employer (Feyen Zylstra LLC) has
> >> developed an implementation of Apache Arrow targeting .NET Standard. We
> are
> >> donating this implementation to the Apache Software Foundation. The
> source
> >> code is available for review on GitHub:
> >>>>>>>
> >>>>>>> https://github.com/feyenzylstra/apache-arrow
> >>>>>>>
> >>>>>>> Please let me know if you have any questions. Feel free to leave
> >> issues on GitHub, and happy voting!
> >>>>>>>
> >>>>>
> >>>>
> >>
> >
>