You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
As we're writing data to the CF for RocksDB via write batches of approximately 1000 keys per batch. Over time using FIFO with compaction style with compaction enabled, with a constant number of writes, we would expect the L0 SST files to be created until we hit the level0_file_num_compaction_trigger. Once that gets hit, we would expect the L0 files to compact down to a single file and then Rocks would continue with the next "batch" of SST files.
Some notes:
We use Leveled Compaction for all other Column Families in the same DB, only 1 column family has FIFO compaction enabled
RocksDB configuration is attached. The relevant CF is CF-DATARocksDB-Options.txt
Actual behavior
We segfault pretty quickly (under an hour of process runtime) with the following segfault:
When we're not segfaulting, we also see that the L0 compaction doesn't catch all the files in the L0 and we end up with a quite a few long-lived (> 2 hours old), small SST files that never get compacted when they should.
Steps to reproduce the behavior
Run FIFO compaction with L0 compaction enabled and a sufficiently high enough write and read throughput.
The text was updated successfully, but these errors were encountered:
Expected behavior
As we're writing data to the CF for RocksDB via write batches of approximately 1000 keys per batch. Over time using FIFO with compaction style with compaction enabled, with a constant number of writes, we would expect the L0 SST files to be created until we hit the
level0_file_num_compaction_trigger
. Once that gets hit, we would expect the L0 files to compact down to a single file and then Rocks would continue with the next "batch" of SST files.Some notes:
CF-DATA
RocksDB-Options.txtActual behavior
We segfault pretty quickly (under an hour of process runtime) with the following segfault:
When we're not segfaulting, we also see that the L0 compaction doesn't catch all the files in the L0 and we end up with a quite a few long-lived (> 2 hours old), small SST files that never get compacted when they should.
Steps to reproduce the behavior
Run FIFO compaction with L0 compaction enabled and a sufficiently high enough write and read throughput.
The text was updated successfully, but these errors were encountered: