Track the total number of compaction sorted runs inside BackgroundCallCompaction #13320

archang19 · 2025-01-21T20:13:02Z

Going to try and opt for #13325 instead

archang19 · 2025-01-22T02:08:21Z

db/db_impl/db_impl.h

@@ -2963,6 +2966,10 @@ class DBImpl : public DB {
  // stores the number of compactions are currently running
  int num_running_compactions_;

+  // stores the number of input iterators required for currently running
+  // compactions


uint64_t or size_t makes more sense to me since num_running_compaction_input_iterators_ should not be negative. However, I wanted to follow the convention here since everything else is using int

archang19 · 2025-01-22T02:19:12Z

db/db_impl/db_impl.h

@@ -2963,6 +2966,10 @@ class DBImpl : public DB {
  // stores the number of compactions are currently running
  int num_running_compactions_;

+  // stores the number of input iterators required for currently running
+  // compactions
+  int num_running_compaction_input_iterators_;


I see we have InstrumentedMutexLock l(&mutex_); protecting num_running_compactions_ as well as num_running_flushes_.

I guess that means we do not need std::atomic<int> for num_running_compaction_input_iterators_

facebook-github-bot · 2025-01-22T02:40:35Z

@archang19 has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

facebook-github-bot · 2025-01-22T02:56:02Z

@archang19 has updated the pull request. You must reimport the pull request before landing.

facebook-github-bot · 2025-01-22T02:56:24Z

@archang19 has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

archang19 · 2025-01-22T02:57:35Z

db/db_impl/db_impl.h

@@ -957,6 +957,13 @@ class DBImpl : public DB {
    return num_running_compactions_;
  }

+  // Returns the number of input iterators for currently running compactions.
+  // REQUIREMENT: mutex_ must be held when calling this function.
+  int num_running_compaction_input_iterators() {


I noticed num_running_compactions did not follow the example of num_running_flushes, where db->num_running_flushes() gets called inside HandleNumRunningFlushes. HandleNumRunningCompactions was just accessing num_running_compactions_ directly.

facebook-github-bot · 2025-01-22T17:11:17Z

@archang19 has updated the pull request. You must reimport the pull request before landing.

facebook-github-bot · 2025-01-22T17:12:05Z

@archang19 has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

archang19 · 2025-01-22T17:15:02Z

@cbi42 I added you since this touches compaction code. Perhaps you know a better way of doing this or even another way to obtain the same information

anand1976 · 2025-01-22T17:43:42Z

db/db_impl/db_impl_compaction_flush.cc

@@ -61,6 +61,18 @@ bool DBImpl::EnoughRoomForCompaction(
  return enough_room;
 }

+size_t DBImpl::GetNumberCompactionInputIterators(Compaction* c) {


We should check for and skip trivial moves and deletion compactions since they won't have any input iterators

Ah, good catch. TIL about "deletion compactions"

anand1976 · 2025-01-22T17:49:36Z

db/internal_stats.cc

@@ -1261,7 +1269,13 @@ bool InternalStats::HandleCompactionPending(uint64_t* value, DBImpl* /*db*/,

 bool InternalStats::HandleNumRunningCompactions(uint64_t* value, DBImpl* db,
                                                Version* /*version*/) {
-  *value = db->num_running_compactions_;
+  *value = db->num_running_compactions();


Doesn't num_running_compactions() assert that DB mutex is held?

yes, it does. I think (?) that is what we want. num_running_flushes() also checks mutex_.AssertHeld(); and is called from HandleNumRunningFlushes

Ok I saw your other comment. I will update this PR to just read off the values.

anand1976 · 2025-01-22T17:50:58Z

db/internal_stats.cc

+
+bool InternalStats::HandleNumRunningCompactionInputIterators(
+    uint64_t* value, DBImpl* db, Version* /*version*/) {
+  *value = db->num_running_compaction_input_iterators();


We're not holding the mutex here. Since these are stats, it should be ok to directly read the counter even if its not 100% accurate.

Should I also get rid of num_running_flushes(), which asserts the mutex is held?

anand1976 · 2025-01-22T17:52:21Z

db/db_impl/db_impl.h

-  Status BackgroundCompaction(bool* madeProgress, JobContext* job_context,
-                              LogBuffer* log_buffer,
+  Status BackgroundCompaction(bool* madeProgress,
+                              int& num_compaction_iterators_added,


C++ style guide suggests that output parameters go at the end

cbi42 · 2025-01-22T18:09:13Z

I think the name "input iterator" can be confusing, especially since this will be a public API. How about using "sorted runs" instead?

I think subcompactions can affect this since each subcompaction creates its own iterator.

facebook-github-bot · 2025-01-22T18:10:44Z

@archang19 has updated the pull request. You must reimport the pull request before landing.

archang19 · 2025-01-22T18:12:25Z

I think the name "input iterator" can be confusing, especially since this will be a public API. How about using "sorted runs" instead?

I think that name works. I will update this PR

I think subcompactions can affect this since each subcompaction creates its own iterator.

@cbi42 do you mean that the actual number of iterators (sorted runs) would be more than the number of L0 files + the number of non-L0 levels when there are subcompactions?

facebook-github-bot · 2025-01-22T18:18:10Z

@archang19 has updated the pull request. You must reimport the pull request before landing.

facebook-github-bot · 2025-01-22T18:23:37Z

@archang19 has updated the pull request. You must reimport the pull request before landing.

facebook-github-bot · 2025-01-22T18:28:45Z

@archang19 has updated the pull request. You must reimport the pull request before landing.

facebook-github-bot · 2025-01-22T18:31:45Z

@archang19 has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

facebook-github-bot · 2025-01-22T18:46:31Z

@archang19 has updated the pull request. You must reimport the pull request before landing.

facebook-github-bot · 2025-01-22T18:53:45Z

@archang19 has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

cbi42 · 2025-01-22T19:08:51Z

@cbi42 do you mean that the actual number of iterators (sorted runs) would be more than the number of L0 files + the number of non-L0 levels when there are subcompactions?

Yes, each subcompaction creates input iterators separately.

facebook-github-bot · 2025-01-22T19:28:14Z

@archang19 has updated the pull request. You must reimport the pull request before landing.

archang19 · 2025-01-22T19:30:10Z

@cbi42 do you mean that the actual number of iterators (sorted runs) would be more than the number of L0 files + the number of non-L0 levels when there are subcompactions?

Yes, each subcompaction creates input iterators separately.

@anand1976 do you think this subcompaction exception will be problematic for our purposes? I searched around and found a NUM_SUBCOMPACTIONS_SCHEDULED histogram that we could use.

facebook-github-bot · 2025-01-22T19:30:29Z

@archang19 has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

archang19 · 2025-01-22T19:32:58Z

db/db_compaction_test.cc

@@ -3300,11 +3300,14 @@ TEST_P(DBCompactionTestWithParam, CompressLevelCompaction) {
  GenerateNewFile(&rnd, &key_idx);
  ASSERT_EQ("1,4,8", FilesPerLevel(0));

-  ASSERT_EQ(matches, 12);


@cbi42 the check for IsTrivialMove inside my GetNumberCompactionSortedRuns method messes up the count for InputCompressionMatchesOutput. I did not dig into why the original test values were the way they are, but I do not think my PR would break this functionality. For those who do understand, I updated the expected value to be the original expected value plus what I determined was added by GetNumberCompactionSortedRuns.

Not sure if you had to work with this test case before. Let me know if this is problematic or the comments can be reworded

cbi42 · 2025-01-22T20:27:28Z

Would it be easier to maintain this count inside each compaction job / subcompaction? Similar to how DBImpl::bg_compaction_scheduled_ is passed to CompactionJob and updated by it.

anand1976 · 2025-01-22T20:45:18Z

@anand1976 do you think this subcompaction exception will be problematic for our purposes? I searched around and found a NUM_SUBCOMPACTIONS_SCHEDULED histogram that we could use.

My guess is it would be problematic. To be on the safe side, like @cbi42 suggested we could maintain this count inside each compaction job/subcompaction. Or updating it in MakeInputIterator might be even easier.

archang19 · 2025-01-22T23:38:21Z

thanks for the comments @cbi42 @anand1976. I am following your suggestion and am working on another PR #13325 that updates the stats inside CompactionMergingIterator. I hope to get it out for review soon

facebook-github-bot added the CLA Signed label Jan 21, 2025

archang19 changed the title ~~Add num-running-compaction-iterators stat~~ Add stat for total number of compaction input iterators Jan 21, 2025

archang19 mentioned this pull request Jan 21, 2025

Add histogram statistic for number of compaction input iterators #13299

Draft

archang19 changed the title ~~Add stat for total number of compaction input iterators~~ Track the total number of compaction input iterators Jan 21, 2025

archang19 added 6 commits January 21, 2025 15:59

Add num-running-compaction-iterators stat

87399e4

Constructor inside dbimpl

2c2ba95

input iterators

1e15c3d

Fix naming

e14d51a

Comment

010fdd4

Plenty of asserts

6a71c06

archang19 force-pushed the internal-stats-total-compaction branch from 5e67c21 to 6a71c06 Compare January 21, 2025 23:59

archang19 commented Jan 22, 2025

View reviewed changes

Update one compaction stats unit test

00f5c9a

archang19 marked this pull request as ready for review January 22, 2025 02:40

Assert mutex is held

9fec093

archang19 commented Jan 22, 2025

View reviewed changes

Add comment on precondition and another assertion

f73c9eb

archang19 requested review from anand1976 and cbi42 January 22, 2025 17:12

anand1976 reviewed Jan 22, 2025

View reviewed changes

Access stats directly in handler functions. Move output param to end

68ea158

Handle trivial moves and deletion compactions

03dd23a

archang19 changed the title ~~Track the total number of compaction input iterators~~ Track the total number of compaction sorted runs Jan 22, 2025

Rename to number of compaction sorted runs

21fa2c2

archang19 force-pushed the internal-stats-total-compaction branch from 1231ef7 to 21fa2c2 Compare January 22, 2025 18:28

Update unreleased_history

b8230f3

Fix one compaction test case

cae1281

archang19 commented Jan 22, 2025

View reviewed changes

archang19 changed the title ~~Track the total number of compaction sorted runs~~ Track the total number of compaction sorted runs inside Jan 22, 2025

archang19 changed the title ~~Track the total number of compaction sorted runs inside~~ Track the total number of compaction sorted runs inside BackgroundCallCompaction Jan 22, 2025

archang19 mentioned this pull request Jan 22, 2025

Track the total number of compaction sorted runs from inside CompactionMergingIterator #13325

Open

archang19 marked this pull request as draft January 24, 2025 18:49

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Track the total number of compaction sorted runs inside BackgroundCallCompaction #13320

Track the total number of compaction sorted runs inside BackgroundCallCompaction #13320

archang19 commented Jan 21, 2025 •

edited

Loading

archang19 Jan 22, 2025

archang19 Jan 22, 2025 •

edited

Loading

facebook-github-bot commented Jan 22, 2025

facebook-github-bot commented Jan 22, 2025

facebook-github-bot commented Jan 22, 2025

archang19 Jan 22, 2025

facebook-github-bot commented Jan 22, 2025

facebook-github-bot commented Jan 22, 2025

archang19 commented Jan 22, 2025

anand1976 Jan 22, 2025

archang19 Jan 22, 2025

anand1976 Jan 22, 2025

archang19 Jan 22, 2025

archang19 Jan 22, 2025

anand1976 Jan 22, 2025

archang19 Jan 22, 2025

anand1976 Jan 22, 2025

cbi42 commented Jan 22, 2025

facebook-github-bot commented Jan 22, 2025

archang19 commented Jan 22, 2025 •

edited

Loading

facebook-github-bot commented Jan 22, 2025

facebook-github-bot commented Jan 22, 2025

facebook-github-bot commented Jan 22, 2025

facebook-github-bot commented Jan 22, 2025

facebook-github-bot commented Jan 22, 2025

facebook-github-bot commented Jan 22, 2025

cbi42 commented Jan 22, 2025

facebook-github-bot commented Jan 22, 2025

archang19 commented Jan 22, 2025

facebook-github-bot commented Jan 22, 2025

archang19 Jan 22, 2025

cbi42 commented Jan 22, 2025

anand1976 commented Jan 22, 2025

archang19 commented Jan 22, 2025

Track the total number of compaction sorted runs inside BackgroundCallCompaction #13320

Are you sure you want to change the base?

Track the total number of compaction sorted runs inside BackgroundCallCompaction #13320

Conversation

archang19 commented Jan 21, 2025 • edited Loading

Choose a reason for hiding this comment

archang19 Jan 22, 2025 • edited Loading

Choose a reason for hiding this comment

facebook-github-bot commented Jan 22, 2025

facebook-github-bot commented Jan 22, 2025

facebook-github-bot commented Jan 22, 2025

Choose a reason for hiding this comment

facebook-github-bot commented Jan 22, 2025

facebook-github-bot commented Jan 22, 2025

archang19 commented Jan 22, 2025

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

cbi42 commented Jan 22, 2025

facebook-github-bot commented Jan 22, 2025

archang19 commented Jan 22, 2025 • edited Loading

facebook-github-bot commented Jan 22, 2025

facebook-github-bot commented Jan 22, 2025

facebook-github-bot commented Jan 22, 2025

facebook-github-bot commented Jan 22, 2025

facebook-github-bot commented Jan 22, 2025

facebook-github-bot commented Jan 22, 2025

cbi42 commented Jan 22, 2025

facebook-github-bot commented Jan 22, 2025

archang19 commented Jan 22, 2025

facebook-github-bot commented Jan 22, 2025

Choose a reason for hiding this comment

cbi42 commented Jan 22, 2025

anand1976 commented Jan 22, 2025

archang19 commented Jan 22, 2025

archang19 commented Jan 21, 2025 •

edited

Loading

archang19 Jan 22, 2025 •

edited

Loading

archang19 commented Jan 22, 2025 •

edited

Loading