OSDir


[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[jira] [Created] (ARROW-2632) [Java] ArrowStreamWriter accumulates ArrowBlock but does not use them


Eric Wohlstadter created ARROW-2632:
---------------------------------------

             Summary: [Java] ArrowStreamWriter accumulates ArrowBlock but does not use them
                 Key: ARROW-2632
                 URL: https://issues.apache.org/jira/browse/ARROW-2632
             Project: Apache Arrow
          Issue Type: Bug
          Components: Java - Vectors
            Reporter: Eric Wohlstadter
             Fix For: 0.10.0


{{ArrowStreamWriter}} inherits from {{ArrowWriter}} the behavior of accumulating an {{ArrowBlock}} for each {{ArrowRecordBatch}} that is written. But this data is never used in the context of {{ArrowStreamWriter}}. 

{code:java}
public abstract class ArrowWriter implements AutoCloseable {
  private final List<ArrowBlock> recordBlocks = new ArrayList<>();
  ...


   protected void writeRecordBatch(ArrowRecordBatch batch)  {
      ...
     recordBlocks.add(block);
   }
}
{code}


{{writeRecordBatch}} can be overridden in {{ArrowStreamWriter}} to avoid adding the memory overhead.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)