osdir.com

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[jira] [Created] (ARROW-3407) [C++] Add UTF8 conversion modes in CSV reader conversion options


Wes McKinney created ARROW-3407:
-----------------------------------

             Summary: [C++] Add UTF8 conversion modes in CSV reader conversion options
                 Key: ARROW-3407
                 URL: https://issues.apache.org/jira/browse/ARROW-3407
             Project: Apache Arrow
          Issue Type: New Feature
          Components: C++
            Reporter: Wes McKinney
             Fix For: 0.12.0


There should be a few options:

* Assume UTF8, but do not verify ("no seatbelts mode", for users that have reasonable security about UTF8 and want the maximum performance)

* Full UTF8 verification

* Maybe ASCII-only verification (because ASCII verification is very fast)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)