osdir.com


[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

sstableloader making no progress


I am trying to ingest some data from a cluster to a different cluster via sstableloader. I am running DSE 4.8.7 / Cassandra 2.1.14. 
I have re-created the schemas and followed other instructions here:
https://docs.datastax.com/en/cassandra/2.1/cassandra/tools/toolsBulkloader_t.html

I am initially testing the ingest process with a single table, containing 3 really small sstables (just a few KB each):
sstableloader -v -d <mynode> <mykeyspace>/<mytable>
From the console, it appears that the progress quickly reaches 100%, but the command never returns:
progress: [/10.128.X.Y]0:3/3 100% [/10.192.Z.W]0:3/3 100% ... total: 100% 0  MB/s(avg: 0 MB/s)

nodetool netstats shows that there is no progress:
Mode: NORMAL
Bulk Load e495cea0-efde-11e6-9ec0-8f99f25bfcf7
    /10.128.X.Y
        Receiving 3 files, 3963 bytes total. Already received 0 files, 0 bytes total
Bulk Load b2566980-efb7-11e6-a467-8f99f25bfcf7
    /10.128.X.Y
        Receiving 3 files, 3963 bytes total. Already received 0 files, 0 bytes total
Bulk Load f31e7810-efdd-11e6-8484-8f99f25bfcf7
    /10.128.X.Y
        Receiving 3 files, 3963 bytes total. Already received 0 files, 0 bytes total
...
Read Repair Statistics:
Attempted: 8
Mismatch (Blocking): 0
Mismatch (Background): 0
Pool Name                    Active   Pending      Completed
Commands                        n/a         0        2148112
Responses                       n/a         0         977176


The logs show the following, but no error or warning message:
2017-02-10 16:18:49,096 INFO  [STREAM-INIT-/10.128.X.Y:33302]  StreamResultFuture.java:109 - [Stream #e495cea0-efde-11e6-9ec0-8f99f25bfcf7 ID#0] Creating new streaming plan for Bulk Load
2017-02-10 16:18:49,105 INFO  [STREAM-INIT-/10.128.X.Y:33302]  StreamResultFuture.java:116 - [Stream #e495cea0-efde-11e6-9ec0-8f99f25bfcf7, ID#0] Received streaming plan for Bulk Load
2017-02-10 16:18:49,110 INFO  [STREAM-INIT-/10.128.X.Y:33306]  StreamResultFuture.java:116 - [Stream #e495cea0-efde-11e6-9ec0-8f99f25bfcf7, ID#0] Received streaming plan for Bulk Load
2017-02-10 16:18:49,110 INFO  [STREAM-IN-/10.128.X.Y]  StreamResultFuture.java:166 - [Stream #e495cea0-efde-11e6-9ec0-8f99f25bfcf7 ID#0] Prepare completed. Receiving 3 files(3963 bytes), sending 0 files(0 bytes)


Any help would be greatly appreciated.