Skip to content

storage: high write rate roachtest with a large LSM #155363

@sumeerbhola

Description

@sumeerbhola

Motivated by https://github.com/cockroachlabs/support/issues/3457

We should be benchmarking a single node cluster starting with a large LSM (say 1TiB), with a shape that is natural (i.e., not all bytes in L6), and a very high write rate. For the writes, kv0 with large block-bytes (say 512) and high concurrency is good enough. The work here will be to quickly initialize this LSM via a series of ingests that populate L6, L5, ... One possibility is to use external files, then wait until download.

Jira issue: CRDB-55409

Metadata

Metadata

Assignees

No one assigned

    Labels

    A-storageRelating to our storage engine (Pebble) on-disk storage.C-enhancementSolution expected to add code/behavior + preserve backward-compat (pg compat issues are exception)O-supportWould prevent or help troubleshoot a customer escalation - bugs, missing observability/tooling, docsT-storageStorage Team

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions