Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

TestClusterWith2Shards flaky #4938

Open
alecthomas opened this issue Mar 21, 2025 · 0 comments
Open

TestClusterWith2Shards flaky #4938

alecthomas opened this issue Mar 21, 2025 · 0 comments
Labels
triage Issue needs triaging

Comments

@alecthomas
Copy link
Collaborator

Logs 
=== FAIL: internal/raft TestClusterWith2Shards (2.84s)
info:raft: joining cluster as an initial member
2025-03-21 21:30:43.760288 I | dragonboat: go version: go1.24.1, linux/amd64
2025-03-21 21:30:43.760295 I | dragonboat: dragonboat version: 4.0.0 (Dev)
2025-03-21 21:30:43.760299 W | config: mutual TLS disabled, communication is insecure
2025-03-21 21:30:43.760314 I | config: using default EngineConfig
2025-03-21 21:30:43.760320 I | config: using default LogDBConfig
2025-03-21 21:30:43.760342 I | dragonboat: DeploymentID set to 1
info:raft: joining cluster as an initial member
2025-03-21 21:30:43.760575 I | dragonboat: go version: go1.24.1, linux/amd64
2025-03-21 21:30:43.760581 I | dragonboat: dragonboat version: 4.0.0 (Dev)
2025-03-21 21:30:43.760584 W | config: mutual TLS disabled, communication is insecure
2025-03-21 21:30:43.760596 I | config: using default EngineConfig
2025-03-21 21:30:43.760600 I | config: using default LogDBConfig
2025-03-21 21:30:43.760621 I | dragonboat: DeploymentID set to 1
2025-03-21 21:30:43.790814 I | dragonboat: LogDB info received, shard 0, busy false
2025-03-21 21:30:43.792613 I | dragonboat: LogDB info received, shard 0, busy false
2025-03-21 21:30:43.804508 I | dragonboat: LogDB info received, shard 1, busy false
2025-03-21 21:30:43.806297 I | dragonboat: LogDB info received, shard 1, busy false
2025-03-21 21:30:43.820570 I | dragonboat: LogDB info received, shard 2, busy false
2025-03-21 21:30:43.821285 I | dragonboat: LogDB info received, shard 2, busy false
2025-03-21 21:30:43.828631 I | dragonboat: LogDB info received, shard 3, busy false
2025-03-21 21:30:43.834092 I | dragonboat: LogDB info received, shard 3, busy false
2025-03-21 21:30:43.846601 I | dragonboat: LogDB info received, shard 4, busy false
2025-03-21 21:30:43.850533 I | dragonboat: LogDB info received, shard 4, busy false
2025-03-21 21:30:43.873008 I | dragonboat: LogDB info received, shard 5, busy false
2025-03-21 21:30:43.87[93](https://github.com/block/ftl/actions/runs/14001211485/job/39207795127?pr=4937#step:6:94)10 I | dragonboat: LogDB info received, shard 5, busy false
2025-03-21 21:30:43.884905 I | dragonboat: LogDB info received, shard 6, busy false
2025-03-21 21:30:43.896386 I | dragonboat: LogDB info received, shard 6, busy false
2025-03-21 21:30:43.899873 I | dragonboat: LogDB info received, shard 7, busy false
2025-03-21 21:30:43.909114 I | dragonboat: LogDB info received, shard 7, busy false
2025-03-21 21:30:43.914755 I | dragonboat: LogDB info received, shard 8, busy false
2025-03-21 21:30:43.918212 I | dragonboat: LogDB info received, shard 8, busy false
2025-03-21 21:30:43.922512 I | dragonboat: LogDB info received, shard 9, busy false
2025-03-21 21:30:43.929259 I | dragonboat: LogDB info received, shard 9, busy false
2025-03-21 21:30:43.932440 I | dragonboat: LogDB info received, shard 10, busy false
2025-03-21 21:30:43.936147 I | dragonboat: LogDB info received, shard 10, busy false
2025-03-21 21:30:43.[94](https://github.com/block/ftl/actions/runs/14001211485/job/39207795127?pr=4937#step:6:95)1298 I | dragonboat: LogDB info received, shard 11, busy false
2025-03-21 21:30:43.948284 I | dragonboat: LogDB info received, shard 11, busy false
2025-03-21 21:30:43.[95](https://github.com/block/ftl/actions/runs/14001211485/job/39207795127?pr=4937#step:6:96)1400 I | dragonboat: LogDB info received, shard 12, busy false
2025-03-21 21:30:43.956200 I | dragonboat: LogDB info received, shard 12, busy false
2025-03-21 21:30:43.958752 I | dragonboat: LogDB info received, shard 13, busy false
2025-03-21 21:30:43.[96](https://github.com/block/ftl/actions/runs/14001211485/job/39207795127?pr=4937#step:6:97)4071 I | dragonboat: LogDB info received, shard 14, busy false
2025-03-21 21:30:43.969565 I | dragonboat: LogDB info received, shard 13, busy false
2025-03-21 21:30:43.[97](https://github.com/block/ftl/actions/runs/14001211485/job/39207795127?pr=4937#step:6:98)4369 I | logdb: using plain logdb
2025-03-21 21:30:43.974674 I | dragonboat: LogDB info received, shard 15, busy false
2025-03-21 21:30:43.976786 I | dragonboat: logdb memory limit: 8192 MBytes
2025-03-21 21:30:43.977951 I | dragonboat: LogDB info received, shard 14, busy false
2025-03-21 21:30:43.978169 I | dragonboat: NodeHost ID: 1d56b54f-f9a6-47fc-805d-7b2e1414352f
2025-03-21 21:30:43.978179 I | dragonboat: using regular node registry
2025-03-21 21:30:43.978197 I | dragonboat: filesystem error injection mode enabled: false
2025-03-21 21:30:43.978597 I | transport: transport type: go-tcp-transport
2025-03-21 21:30:43.978700 I | dragonboat: transport type: go-tcp-transport
2025-03-21 21:30:43.978727 I | dragonboat: logdb type: sharded-pebble
2025-03-21 21:30:43.978732 I | dragonboat: nodehost address: 127.0.0.1:35893
2025-03-21 21:30:43.[98](https://github.com/block/ftl/actions/runs/14001211485/job/39207795127?pr=4937#step:6:99)5923 I | dragonboat: [00001:00002] replaying raft logs
2025-03-21 21:30:43.986331 I | raft: [00001:00002] created, initial: true, new: true
2025-03-21 21:30:43.986342 W | config: ElectionRTT is not a magnitude larger than HeartbeatRTT
2025-03-21 21:30:43.986350 I | raft: [00001:00002] raft log rate limit enabled: false, 0
2025-03-21 21:30:43.986359 I | raft: [f:1,l:0,t:0,c:0,a:0] [00001:00002] t0 became follower
2025-03-21 21:30:43.986370 I | raft: [f:1,l:0,t:0,c:0,a:0] [00001:00002] t1 became follower
2025-03-21 21:30:43.986377 I | raft: [f:1,l:0,t:0,c:0,a:0] [00001:00002] t1 added bootstrap ConfigChangeAddNode, 1, 127.0.0.1:36441
2025-03-21 21:30:43.986384 I | raft: [f:1,l:0,t:0,c:0,a:0] [00001:00002] t1 added bootstrap ConfigChangeAddNode, 2, 127.0.0.1:35893
2025-03-21 21:30:43.986502 I | rsm: [00001:00002] no snapshot available during launch
2025-03-21 21:30:43.986538 I | dragonboat: [00001:00002] initialized using <00001:00002:0>
2025-03-21 21:30:43.986556 I | dragonboat: [00001:00002] initial index set to 0
2025-03-21 21:30:43.988433 I | dragonboat: [00002:00002] replaying raft logs
2025-03-21 21:30:43.988465 I | raft: [00002:00002] created, initial: true, new: true
2025-03-21 21:30:43.988470 W | config: ElectionRTT is not a magnitude larger than HeartbeatRTT
2025-03-21 21:30:43.988476 I | raft: [00002:00002] raft log rate limit enabled: false, 0
2025-03-21 21:30:43.988482 I | raft: [f:1,l:0,t:0,c:0,a:0] [00002:00002] t0 became follower
2025-03-21 21:30:43.988492 I | raft: [f:1,l:0,t:0,c:0,a:0] [00002:00002] t1 became follower
2025-03-21 21:30:43.988498 I | raft: [f:1,l:0,t:0,c:0,a:0] [00002:00002] t1 added bootstrap ConfigChangeAddNode, 1, 127.0.0.1:36441
2025-03-21 21:30:43.988503 I | raft: [f:1,l:0,t:0,c:0,a:0] [00002:00002] t1 added bootstrap ConfigChangeAddNode, 2, 127.0.0.1:35893
2025-03-21 21:30:43.988566 I | rsm: [00002:00002] no snapshot available during launch
2025-03-21 21:30:43.988588 I | dragonboat: [00002:00002] initialized using <00002:00002:0>
2025-03-21 21:30:43.988604 I | dragonboat: [00002:00002] initial index set to 0
2025-03-21 21:30:43.988647 W | raft: [f:1,l:2,t:1,c:2,a:0] [00001:00002] t1 dropped ReadIndex, no leader
debug:raft: Waiting for shard 1 to be ready on replica 2: 50ms
2025-03-21 21:30:43.989792 I | rsm: [00001:00002] applied ADD ccid 0 (1), n00001 (127.0.0.1:36441)
2025-03-21 21:30:43.989816 I | rsm: [00001:00002] applied ADD ccid 0 (2), n00002 (127.0.0.1:35893)
2025-03-21 21:30:43.[99](https://github.com/block/ftl/actions/runs/14001211485/job/39207795127?pr=4937#step:6:100)4382 I | dragonboat: LogDB info received, shard 15, busy false
2025-03-21 21:30:43.998443 I | logdb: using plain logdb
2025-03-21 21:30:44.002034 I | dragonboat: logdb memory limit: 8192 MBytes
2025-03-21 21:30:44.002968 I | dragonboat: NodeHost ID: aa224191-67ca-4712-aa35-33c46ad6df0d
2025-03-21 21:30:44.002981 I | dragonboat: using regular node registry
2025-03-21 21:30:44.002988 I | dragonboat: filesystem error injection mode enabled: false
2025-03-21 21:30:44.003228 I | transport: transport type: go-tcp-transport
2025-03-21 21:30:44.003368 I | dragonboat: transport type: go-tcp-transport
2025-03-21 21:30:44.003377 I | dragonboat: logdb type: sharded-pebble
2025-03-21 21:30:44.003381 I | dragonboat: nodehost address: 127.0.0.1:36441
2025-03-21 21:30:44.0[100](https://github.com/block/ftl/actions/runs/14001211485/job/39207795127?pr=4937#step:6:101)68 I | dragonboat: [00001:00001] replaying raft logs
2025-03-21 21:30:44.0[101](https://github.com/block/ftl/actions/runs/14001211485/job/39207795127?pr=4937#step:6:102)04 I | raft: [00001:00001] created, initial: true, new: true
2025-03-21 21:30:44.010110 W | config: ElectionRTT is not a magnitude larger than HeartbeatRTT
2025-03-21 21:30:44.010117 I | raft: [00001:00001] raft log rate limit enabled: false, 0
2025-03-21 21:30:44.010127 I | raft: [f:1,l:0,t:0,c:0,a:0] [00001:00001] t0 became follower
2025-03-21 21:30:44.010139 I | raft: [f:1,l:0,t:0,c:0,a:0] [00001:00001] t1 became follower
2025-03-21 21:30:44.010150 I | raft: [f:1,l:0,t:0,c:0,a:0] [00001:00001] t1 added bootstrap ConfigChangeAddNode, 1, 127.0.0.1:36441
2025-03-21 21:30:44.010156 I | raft: [f:1,l:0,t:0,c:0,a:0] [00001:00001] t1 added bootstrap ConfigChangeAddNode, 2, 127.0.0.1:35893
2025-03-21 21:30:44.0[104](https://github.com/block/ftl/actions/runs/14001211485/job/39207795127?pr=4937#step:6:105)32 I | rsm: [00001:00001] no snapshot available during launch
2025-03-21 21:30:44.010461 I | dragonboat: [00001:00001] initialized using <00001:00001:0>
2025-03-21 21:30:44.010479 I | dragonboat: [00001:00001] initial index set to 0
2025-03-21 21:30:44.012766 I | dragonboat: [00002:00001] replaying raft logs
2025-03-21 21:30:44.012799 I | raft: [00002:00001] created, initial: true, new: true
2025-03-21 21:30:44.012805 W | config: ElectionRTT is not a magnitude larger than HeartbeatRTT
2025-03-21 21:30:44.012811 I | raft: [00002:00001] raft log rate limit enabled: false, 0
2025-03-21 21:30:44.012819 I | raft: [f:1,l:0,t:0,c:0,a:0] [00002:00001] t0 became follower
2025-03-21 21:30:44.012829 I | raft: [f:1,l:0,t:0,c:0,a:0] [00002:00001] t1 became follower
2025-03-21 21:30:44.012837 I | raft: [f:1,l:0,t:0,c:0,a:0] [00002:00001] t1 added bootstrap ConfigChangeAddNode, 1, 127.0.0.1:36441
2025-03-21 21:30:44.012842 I | raft: [f:1,l:0,t:0,c:0,a:0] [00002:00001] t1 added bootstrap ConfigChangeAddNode, 2, 127.0.0.1:35893
2025-03-21 21:30:44.012912 I | rsm: [00002:00001] no snapshot available during launch
2025-03-21 21:30:44.012939 I | dragonboat: [00002:00001] initialized using <00002:00001:0>
2025-03-21 21:30:44.012958 I | dragonboat: [00002:00001] initial index set to 0
2025-03-21 21:30:44.013000 W | raft: [f:1,l:2,t:1,c:2,a:0] [00001:00001] t1 dropped ReadIndex, no leader
2025-03-21 21:30:44.014519 I | rsm: [00001:00001] applied ADD ccid 0 (1), n00001 (127.0.0.1:36441)
2025-03-21 21:30:44.014543 I | rsm: [00001:00001] applied ADD ccid 0 (2), n00002 (127.0.0.1:35893)
debug:raft: Waiting for shard 1 to be ready on replica 1: 50ms
2025-03-21 21:30:44.032002 I | rsm: [00002:00002] applied ADD ccid 0 (1), n00001 (127.0.0.1:36441)
2025-03-21 21:30:44.032036 I | rsm: [00002:00002] applied ADD ccid 0 (2), n00002 (127.0.0.1:35893)
2025-03-21 21:30:44.040838 W | raft: [f:1,l:2,t:1,c:2,a:2] [00001:00002] t1 dropped ReadIndex, no leader
debug:raft: Waiting for shard 1 to be ready on replica 2: 71.07182ms
2025-03-21 21:30:44.056322 I | rsm: [00002:00001] applied ADD ccid 0 (1), n00001 (127.0.0.1:36441)
2025-03-21 21:30:44.056439 I | rsm: [00002:00001] applied ADD ccid 0 (2), n00002 (127.0.0.1:35893)
2025-03-21 21:30:44.065322 W | raft: [f:1,l:2,t:1,c:2,a:2] [00001:00001] t1 dropped ReadIndex, no leader
debug:raft: Waiting for shard 1 to be ready on replica 1: 78.392632ms
2025-03-21 21:30:44.[112](https://github.com/block/ftl/actions/runs/14001211485/job/39207795127?pr=4937#step:6:113)181 W | raft: [f:1,l:2,t:1,c:2,a:2] [00001:00002] t1 dropped ReadIndex, no leader
debug:raft: Waiting for shard 1 to be ready on replica 2: 192.490572ms
2025-03-21 21:30:44.144726 W | raft: [f:1,l:2,t:1,c:2,a:2] [00001:00001] t1 dropped ReadIndex, no leader
debug:raft: Waiting for shard 1 to be ready on replica 1: 82.518922ms
2025-03-21 21:30:44.228294 W | raft: [f:1,l:2,t:1,c:2,a:2] [00001:00001] t1 dropped ReadIndex, no leader
debug:raft: Waiting for shard 1 to be ready on replica 1: 205.387647ms
2025-03-21 21:30:44.305273 W | raft: [f:1,l:2,t:1,c:2,a:2] [00001:00002] t1 dropped ReadIndex, no leader
debug:raft: Waiting for shard 1 to be ready on replica 2: 84.737547ms
2025-03-21 21:30:44.355077 W | raft: [f:1,l:2,t:1,c:2,a:2] [00001:00001] t2 became candidate
2025-03-21 21:30:44.355193 W | raft: [f:1,l:2,t:1,c:2,a:2] [00001:00001] t2 received RequestVoteResp from n00001
2025-03-21 21:30:44.355329 W | raft: [f:1,l:2,t:1,c:2,a:2] [00001:00001] t2 sent RequestVote to n00002
2025-03-21 21:30:44.368896 W | raft: [f:1,l:2,t:1,c:2,a:2] [00001:00002] t1 received RequestVote with higher term (2) from n00001
2025-03-21 21:30:44.368914 W | raft: [f:1,l:2,t:1,c:2,a:2] [00001:00002] t1 become followerKE after receiving higher term from n00001
2025-03-21 21:30:44.368924 I | raft: [f:1,l:2,t:1,c:2,a:2] [00001:00002] t2 became follower
2025-03-21 21:30:44.368931 W | raft: [f:1,l:2,t:1,c:2,a:2] [00001:00002] t2 cast vote from n00001 index 2 term 2, log term: 1
2025-03-21 21:30:44.373136 W | raft: [f:1,l:2,t:1,c:2,a:2] [00001:00001] t2 received RequestVoteResp from n00002
2025-03-21 21:30:44.373155 W | raft: [f:1,l:2,t:1,c:2,a:2] [00001:00001] t2 received 2 votes and 0 rejections, quorum is 2
2025-03-21 21:30:44.373164 I | raft: [f:1,l:2,t:1,c:2,a:2] [00001:00001] t2 became leader
2025-03-21 21:30:44.380391 W | raft: [f:1,l:2,t:1,c:2,a:2] [00002:00002] t2 became candidate
2025-03-21 21:30:44.380406 W | raft: [f:1,l:2,t:1,c:2,a:2] [00002:00002] t2 received RequestVoteResp from n00002
2025-03-21 21:30:44.380415 W | raft: [f:1,l:2,t:1,c:2,a:2] [00002:00002] t2 sent RequestVote to n00001
2025-03-21 21:30:44.382861 W | raft: [f:1,l:2,t:1,c:2,a:2] [00002:00001] t1 received RequestVote with higher term (2) from n00002
2025-03-21 21:30:44.382993 W | raft: [f:1,l:2,t:1,c:2,a:2] [00002:00001] t1 become followerKE after receiving higher term from n00002
2025-03-21 21:30:44.383026 I | raft: [f:1,l:2,t:1,c:2,a:2] [00002:00001] t2 became follower
2025-03-21 21:30:44.383034 W | raft: [f:1,l:2,t:1,c:2,a:2] [00002:00001] t2 cast vote from n00002 index 2 term 2, log term: 1
2025-03-21 21:30:44.392193 W | raft: [f:1,l:2,t:1,c:2,a:2] [00002:00002] t2 received RequestVoteResp from n00001
2025-03-21 21:30:44.392218 W | raft: [f:1,l:2,t:1,c:2,a:2] [00002:00002] t2 received 2 votes and 0 rejections, quorum is 2
2025-03-21 21:30:44.392239 I | raft: [f:1,l:2,t:1,c:2,a:2] [00002:00002] t2 became leader
debug:raft: Shard 1 on replica 2 is ready
2025-03-21 21:30:44.392964 W | raft: [f:1,l:3,t:2,c:2,a:2] [00002:00002] t2 dropped ReadIndex, not ready
debug:raft: Waiting for shard 2 to be ready on replica 2: 50ms
debug:raft: Shard 1 on replica 1 is ready
debug:raft: Shard 2 on replica 1 is ready
info:raft: All shards are ready
debug:raft: Shard 2 on replica 2 is ready
info:raft: All shards are ready
debug:raft: Getting session for shard 1 on replica 1
2025-03-21 21:30:44.674422 W | dragonboat: [00001:00001] had 5 LocalTick msgs in one batch
debug:raft: Got error timeout, retrying in 50ms
2025-03-21 21:30:44.674943 W | dragonboat: [00001:00002] had 4 LocalTick msgs in one batch
debug:raft: Getting session for shard 1 on replica 1
2025-03-21 21:30:44.898815 W | dragonboat: [00001:00001] had 4 LocalTick msgs in one batch
2025-03-21 21:30:44.900827 W | dragonboat: [00001:00002] had 5 LocalTick msgs in one batch
debug:raft: Got error timeout, retrying in 84.45562ms
debug:raft: Getting session for shard 1 on replica 1
2025-03-21 21:30:45.077438 W | dragonboat: [00001:00001] had 4 LocalTick msgs in one batch
2025-03-21 21:30:45.078355 W | dragonboat: [00001:00002] had 3 LocalTick msgs in one batch
debug:raft: Got error timeout, retrying in 104.942557ms
debug:raft: Getting session for shard 1 on replica 1
2025-03-21 21:30:45.338864 W | dragonboat: [00001:00001] had 3 LocalTick msgs in one batch
2025-03-21 21:30:45.338964 W | dragonboat: [00001:00002] had 3 LocalTick msgs in one batch
debug:raft: Got clientID 791949325948064861 for shard 1 on replica 1
debug:raft: Proposing event to shard 1 on replica 1
debug:raft: Getting session for shard 1 on replica 2
debug:raft: Got clientID 12270156672312715099 for shard 1 on replica 2
debug:raft: Proposing event to shard 1 on replica 2
debug:raft: Getting session for shard 2 on replica 1
debug:raft: Got clientID 6849584779843663578 for shard 2 on replica 1
debug:raft: Proposing event to shard 2 on replica 1
debug:raft: Getting session for shard 2 on replica 2
debug:raft: Got clientID 3475752424694548185 for shard 2 on replica 2
debug:raft: Proposing event to shard 2 on replica 2
2025-03-21 21:30:45.841592 W | dragonboat: [00002:00001] had 4 LocalTick msgs in one batch
2025-03-21 21:30:45.844308 W | dragonboat: [00002:00002] had 4 LocalTick msgs in one batch
    /home/runner/work/ftl/ftl/internal/raft/cluster_test.go:80: Did not expect an error but got:
        failed to submit request to shard 2 on replica 1: timeout
2025-03-21 21:30:45.880271 E | transport: send batch failed, target 127.0.0.1:36441 (write tcp 127.0.0.1:53766->127.0.0.1:36441: write: connection reset by peer), 1
2025-03-21 21:30:45.880320 W | transport: breaker 127.0.0.1:35893 to 127.0.0.1:36441 failed, connect and process failed: write tcp 127.0.0.1:53766->127.0.0.1:36441: write: connection reset by peer
2025-03-21 21:30:45.880332 W | transport: 127.0.0.1:36441 became unreachable, affected 1 nodes

DONE 489 tests, 2 skipped, 1 failure in 58.799s
Error: === RUN   TestClusterWith2Shards
info:raft: joining cluster as an initial member
2025-03-21 21:30:43.760288 I | dragonboat: go version: go1.24.1, linux/amd64
2025-03-21 21:30:43.760295 I | dragonboat: dragonboat version: 4.0.0 (Dev)
2025-03-21 21:30:43.760299 W | config: mutual TLS disabled, communication is insecure
2025-03-21 21:30:43.760314 I | config: using default EngineConfig
2025-03-21 21:30:43.760320 I | config: using default LogDBConfig
2025-03-21 21:30:43.760342 I | dragonboat: DeploymentID set to 1
info:raft: joining cluster as an initial member
2025-03-21 21:30:43.760575 I | dragonboat: go version: go1.24.1, linux/amd64
2025-03-21 21:30:43.760581 I | dragonboat: dragonboat version: 4.0.0 (Dev)
2025-03-21 21:30:43.760584 W | config: mutual TLS disabled, communication is insecure
2025-03-21 21:30:43.760596 I | config: using default EngineConfig
2025-03-21 21:30:43.760600 I | config: using default LogDBConfig
2025-03-21 21:30:43.760621 I | dragonboat: DeploymentID set to 1
2025-03-21 21:30:43.790814 I | dragonboat: LogDB info received, shard 0, busy false
2025-03-21 21:30:43.792613 I | dragonboat: LogDB info received, shard 0, busy false
2025-03-21 21:30:43.804508 I | dragonboat: LogDB info received, shard 1, busy false
2025-03-21 21:30:43.806297 I | dragonboat: LogDB info received, shard 1, busy false
2025-03-21 21:30:43.820570 I | dragonboat: LogDB info received, shard 2, busy false
2025-03-21 21:30:43.821285 I | dragonboat: LogDB info received, shard 2, busy false
2025-03-21 21:30:43.828631 I | dragonboat: LogDB info received, shard 3, busy false
2025-03-21 21:30:43.834092 I | dragonboat: LogDB info received, shard 3, busy false
2025-03-21 21:30:43.846601 I | dragonboat: LogDB info received, shard 4, busy false
2025-03-21 21:30:43.850533 I | dragonboat: LogDB info received, shard 4, busy false
2025-03-21 21:30:43.873008 I | dragonboat: LogDB info received, shard 5, busy false
2025-03-21 21:30:43.879310 I | dragonboat: LogDB info received, shard 5, busy false
2025-03-21 21:30:43.884905 I | dragonboat: LogDB info received, shard 6, busy false
2025-03-21 21:30:43.896386 I | dragonboat: LogDB info received, shard 6, busy false
2025-03-21 21:30:43.899873 I | dragonboat: LogDB info received, shard 7, busy false
2025-03-21 21:30:43.909[114](https://github.com/block/ftl/actions/runs/14001211485/job/39207795127?pr=4937#step:6:115) I | dragonboat: LogDB info received, shard 7, busy false
2025-03-21 21:30:43.914755 I | dragonboat: LogDB info received, shard 8, busy false
2025-03-21 21:30:43.918212 I | dragonboat: LogDB info received, shard 8, busy false
2025-03-21 21:30:43.922512 I | dragonboat: LogDB info received, shard 9, busy false
2025-03-21 21:30:43.929259 I | dragonboat: LogDB info received, shard 9, busy false
2025-03-21 21:30:43.932440 I | dragonboat: LogDB info received, shard 10, busy false
2025-03-21 21:30:43.936147 I | dragonboat: LogDB info received, shard 10, busy false
2025-03-21 21:30:43.941298 I | dragonboat: LogDB info received, shard 11, busy false
2025-03-21 21:30:43.948284 I | dragonboat: LogDB info received, shard 11, busy false
2025-03-21 21:30:43.951400 I | dragonboat: LogDB info received, shard 12, busy false
2025-03-21 21:30:43.956200 I | dragonboat: LogDB info received, shard 12, busy false
2025-03-21 21:30:43.958752 I | dragonboat: LogDB info received, shard 13, busy false
2025-03-21 21:30:43.964071 I | dragonboat: LogDB info received, shard 14, busy false
2025-03-21 21:30:43.969565 I | dragonboat: LogDB info received, shard 13, busy false
2025-03-21 21:30:43.974369 I | logdb: using plain logdb
2025-03-21 21:30:43.974674 I | dragonboat: LogDB info received, shard 15, busy false
2025-03-21 21:30:43.976786 I | dragonboat: logdb memory limit: 8192 MBytes
2025-03-21 21:30:43.977951 I | dragonboat: LogDB info received, shard 14, busy false
2025-03-21 21:30:43.978169 I | dragonboat: NodeHost ID: 1d56b54f-f9a6-47fc-805d-7b2e1414352f
2025-03-21 21:30:43.978179 I | dragonboat: using regular node registry
2025-03-21 21:30:43.978197 I | dragonboat: filesystem error injection mode enabled: false
2025-03-21 21:30:43.978597 I | transport: transport type: go-tcp-transport
2025-03-21 21:30:43.9787
Error: Process completed with exit code 1.
@github-actions github-actions bot added the triage Issue needs triaging label Mar 21, 2025
@alecthomas alecthomas mentioned this issue Mar 21, 2025
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
triage Issue needs triaging
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@alecthomas