osdir.com

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[jira] [Created] (ARROW-3992) pyarrow compile from source issues on RedHat 7.4


David Lee created ARROW-3992:
--------------------------------

             Summary: pyarrow compile from source issues on RedHat 7.4
                 Key: ARROW-3992
                 URL: https://issues.apache.org/jira/browse/ARROW-3992
             Project: Apache Arrow
          Issue Type: Bug
            Reporter: David Lee


Opening a ticket for: [https://github.com/apache/arrow/issues/2281] after running into the same problems with RedHat 7.4.

[https://arrow.apache.org/docs/python/development.html#development]

Additional steps taken:

Added double-conversion, glog and hypothesis:

 
{code:java}
conda create -y -q -n pyarrow-dev \
python=3.6 numpy six setuptools cython pandas pytest double-conversion \
cmake flatbuffers rapidjson boost-cpp thrift-cpp snappy zlib glog hypothesis\
gflags brotli jemalloc lz4-c zstd -c conda-forge
{code}
Added export LD_LIBRARY_PATH to conda lib64 before running py.test pyarrow:

 

 
{code:java}
export LD_LIBRARY_PATH=/home/my_login/anaconda3/envs/pyarrow-dev/lib64
py.test pyarrow
{code}
 

Added extra symlinks with a period at the end to fix string concatenation issues. Running setup.py for the first time didn't need this, but running setup.py a second time would error out with:
{code:java}
CMake Error: File /home/my_login/anaconda3/envs/pyarrow-dev/lib64/libarrow.so. does not exist.
{code}
There is an extra period at the end of the *.so files so I had to make symlinks with extra periods.

 
{code:java}
ln -s libparquet.so.12.0.0 libparquet.so.
ln -s libplasma.so.12.0.0 libplasma.so.
ln -s libarrow.so.12.0.0 libarrow.so.
ln -s libarrow_python.so.12.0.0 libarrow_python.so.
{code}
Creating a wheel file using --with-plasma gives the following error:

 
{code:java}
error: [Errno 2] No such file or directory: 'release/plasma_store_server'
{code}
Had to create the wheel file without plasma..



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)