[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[jira] [Created] (ARROW-2658) Serialize and Deserialize Table objects

Kunal Gosar created ARROW-2658:

             Summary: Serialize and Deserialize Table objects
                 Key: ARROW-2658
                 URL: https://issues.apache.org/jira/browse/ARROW-2658
             Project: Apache Arrow
          Issue Type: New Feature
            Reporter: Kunal Gosar

Add support for serializing and deserializing pyarrow Tables. This would allow using Table objects in plasma and DataFrames can be converted to a Table object as intermediary for serialization. Currently I see the following when trying this operation:
In [36]: pa.serialize(t)


SerializationCallbackError                Traceback (most recent call last)

<ipython-input-36-48cee5dfe30a> in <module>()

----> 1 pa.serialize(t)

~/dev/arrow/python/pyarrow/serialization.pxi in pyarrow.lib.serialize()


    337     with nogil:

--> 338         check_status(SerializeObject(context, wrapped_value, &serialized.data))

    339     return serialized


~/dev/arrow/python/pyarrow/serialization.pxi in pyarrow.lib.SerializationContext._serialize_callback()


    135         if not found:

--> 136             raise SerializationCallbackError(

    137                 "pyarrow does not know how to "

    138                 "serialize objects of type {}.".format(type(obj)), obj

SerializationCallbackError: pyarrow does not know how to serialize objects of type <class 'pyarrow.lib.Table'>.

This message was sent by Atlassian JIRA