[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[jira] [Created] (HIVE-19526) Exchange partition not copying data across S3 buckets

David Malinge created HIVE-19526:

             Summary: Exchange partition not copying data across S3 buckets
                 Key: HIVE-19526
                 URL: https://issues.apache.org/jira/browse/HIVE-19526
             Project: Hive
          Issue Type: Bug
    Affects Versions: 2.3.0
            Reporter: David Malinge

Data is not copied when exchanging partition between two tables in different buckets. Only the metadata is copied over.

Assuming we have a partitioned table "table1" in s3://myBucket/table1 (I don't think schemas matter in that case so I will just omit them), my code looks like this:

create table table2 like table1 location 's3://anotherBucket/table2';
alter table table2 exchange partition (mypartition='partition1') with table table1;{code}

The behavior is the following:
 * no error e.g. "No rows affected (1.194 seconds)"
 * old partition metadata with provided key removed from table1
 * new partition metadata with the provided key created properly in the table2
 * data still in s3://myBucket/table1/mypartition=partition1

 It works as expected when using the exact same code but with table2 located in the same bucket as table1.

I have not found any documentation regarding cross-bucket not being supported so I guess this is unwanted behavior. This should probably throw an error if not supported.



This message was sent by Atlassian JIRA