OSDir


[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[jira] [Created] (ARROW-2658) Serialize and Deserialize Table objects


Kunal Gosar created ARROW-2658:
----------------------------------

             Summary: Serialize and Deserialize Table objects
                 Key: ARROW-2658
                 URL: https://issues.apache.org/jira/browse/ARROW-2658
             Project: Apache Arrow
          Issue Type: New Feature
            Reporter: Kunal Gosar


Add support for serializing and deserializing pyarrow Tables. This would allow using Table objects in plasma and DataFrames can be converted to a Table object as intermediary for serialization. Currently I see the following when trying this operation:
{code:java}
In [36]: pa.serialize(t)

---------------------------------------------------------------------------

SerializationCallbackError                Traceback (most recent call last)

<ipython-input-36-48cee5dfe30a> in <module>()

----> 1 pa.serialize(t)



~/dev/arrow/python/pyarrow/serialization.pxi in pyarrow.lib.serialize()

    336

    337     with nogil:

--> 338         check_status(SerializeObject(context, wrapped_value, &serialized.data))

    339     return serialized

    340



~/dev/arrow/python/pyarrow/serialization.pxi in pyarrow.lib.SerializationContext._serialize_callback()

    134

    135         if not found:

--> 136             raise SerializationCallbackError(

    137                 "pyarrow does not know how to "

    138                 "serialize objects of type {}.".format(type(obj)), obj



SerializationCallbackError: pyarrow does not know how to serialize objects of type <class 'pyarrow.lib.Table'>.
{code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)