TurboKV: Insanely fast Rust key-value store

(github.com)

21 points | by rgbimbochamp 1 hour ago

1 comments

  • nine_k 20 minutes ago
    I suppose the insane speed is due to this:

    > TurboKV's persisted Bloom-filter format uses hardware AES.

    Also, built-in LZ4 compression.

    I would expect SIMD to be used for scans.

    • rgbimbochamp 18 minutes ago
      Those help but the main write speed gain is the WAL, that uses preallocated mmap segments to avoid a write(2) per durable mutation while preserving crash recovery. AES hashing mainly helps Bloom filter point lookups and LZ4 mainly helps SSTable I/O. Scans benefit indirectly, but don’t yet use a custom SIMD merge loop.
      • dangoodmanUT 1 minute ago
        Iirc that’s how badger handles the WAL as well