Skip to content

Fix stale and incorrectly versioned builder preference submissions - #9929

Draft
jimmygchen wants to merge 10 commits into
sigp:stack/ethDreamer/gloas-builder-api-stacked/migrate-validator-client-gloas-builder-api-gloas--aeeaf620from
jimmygchen:codex/fix-builder-preference-submissions
Draft

Fix stale and incorrectly versioned builder preference submissions#9929
jimmygchen wants to merge 10 commits into
sigp:stack/ethDreamer/gloas-builder-api-stacked/migrate-validator-client-gloas-builder-api-gloas--aeeaf620from
jimmygchen:codex/fix-builder-preference-submissions

Conversation

@jimmygchen

@jimmygchen jimmygchen commented Aug 28, 2026

Copy link
Copy Markdown
Member

Description

When Gloas builders are configured, BuilderPreferencesService can sign and submit expired preferences again after cache pruning. Builders reject them, causing repeated requests, signing work and error logs. Before Gloas, future Gloas preferences can also carry the pre-Gloas fork version, which can disrupt delivery around activation.

When a beacon node returns indexed failures, successful entries are submitted again with the failed ones. Combined with JSON fallback, the same entry can be sent four times per beacon node in one poll.

The service now drops expired preferences, submits each proposal fork with the matching Eth-Consensus-Version, and retries only failed entries after validating their indices. Partial-failure handling and JSON fallback use the actual HTTP status: HTTP 400 and HTTP 415 respectively. The JSON error code may be application-specific.

This is a P2 builder-API reliability and interoperability issue, based on code review and local regression tests. Production impact has not been measured. The proposer's configured max_execution_payment still caps bid ranking if preferences are not delivered; no missed-block or consensus impact has been established.

…(Gloas builder API 3/5)

Third PR of the Gloas builder API stack:

- beacon_chain: direct builder bid verification (spawned on the blocking
  executor), gossip-bid refinements, wei-domain bid selection
  (`BidCandidate`/`BidSource`), and Gloas block production that assembles
  local, gossip, and direct-builder candidates
- network: process payload-bid and proposer-preference gossip, including the
  new `PayloadBidError` variants
- client: construct the `Builders` service when the Gloas fork is scheduled
  and wire it into the beacon chain

The HTTP API still serves `GET` produceBlockV4 at this point; the `POST`
conversion and the `Eth-Builder-Url` round-trip land in the next PR.

Change-Id: Ieccaee5db81bf871c19cef1b79fc48283be9dd51
…builder API 4/5)

Fourth PR of the Gloas builder API stack (beacon-APIs sigp#630):

- convert `/eth/v4/validator/blocks/{slot}` to POST with an optional
  `BuilderConfig` body (min_bid, builder_boost_factor, direct builders)
- add `POST /eth/v1/validator/builder_preferences` for forwarding signed
  builder preferences
- set `Eth-Builder-Url` on produceBlockV4 responses when a direct-builder bid
  wins, accept it on `POST /eth/v2/beacon/blocks`, and forward the signed
  block to that builder

The validator client still uses the legacy GET methods at this point; it
migrates in the final PR of this stack.

Change-Id: I0ad30b8f36ad9b588ea1a0398220f92c9597bb95
…API 5/5)

Final PR of the Gloas builder API stack:

- sign builder request-auth and preferences (REQUEST_AUTH signing domain,
  web3signer message type)
- add the builder configuration store (`builder_definitions.yml`) and book
  documentation
- add the builder-preferences service and switch block production to
  `POST` produceBlockV4 with a `BuilderConfig` body, threading the
  `Eth-Builder-Url` header through block publication
- remove the now-unused legacy `GET` produceBlockV4 client methods

Change-Id: Iaeeaf6205a024e4fb9fd11aae6ac6a75978a8320
@jimmygchen jimmygchen added bug Something isn't working ready-for-review The code is ready for review gloas builder API labels Aug 28, 2026
@mergify

mergify Bot commented Aug 28, 2026

Copy link
Copy Markdown

Some required checks have failed. Could you please take a look @jimmygchen? 🙏

@mergify mergify Bot added waiting-on-author The reviewer has suggested changes and awaits thier implementation. and removed ready-for-review The code is ready for review labels Aug 28, 2026
@jimmygchen
jimmygchen force-pushed the codex/fix-builder-preference-submissions branch from 370b815 to 6b1bcef Compare August 28, 2026 00:58
@mergify mergify Bot added ready-for-review The code is ready for review and removed waiting-on-author The reviewer has suggested changes and awaits thier implementation. labels Aug 28, 2026
@ethDreamer
ethDreamer force-pushed the stack/ethDreamer/gloas-builder-api-stacked/migrate-validator-client-gloas-builder-api-gloas--aeeaf620 branch from 44f4424 to 17bcbc2 Compare September 1, 2026 17:18
@ethDreamer
ethDreamer requested a review from jxs as a code owner September 1, 2026 17:18
@mergify

mergify Bot commented Sep 1, 2026

Copy link
Copy Markdown

This pull request has merge conflicts. Could you please resolve them @jimmygchen? 🙏

@mergify mergify Bot added waiting-on-author The reviewer has suggested changes and awaits thier implementation. and removed ready-for-review The code is ready for review labels Sep 1, 2026
@ethDreamer
ethDreamer force-pushed the stack/ethDreamer/gloas-builder-api-stacked/migrate-validator-client-gloas-builder-api-gloas--aeeaf620 branch 6 times, most recently from 9abe9a1 to 58fba0d Compare September 8, 2026 17:21
…builder API 4/5)

Fourth PR of the Gloas builder API stack (beacon-APIs sigp#630):

- convert `/eth/v4/validator/blocks/{slot}` to POST with an optional
  `BuilderConfig` body (min_bid, builder_boost_factor, direct builders)
- add `POST /eth/v1/validator/builder_preferences` for forwarding signed
  builder preferences
- set `Eth-Builder-Url` on produceBlockV4 responses when a direct-builder bid
  wins, accept it on `POST /eth/v2/beacon/blocks`, and forward the signed
  block to that builder

The validator client still uses the legacy GET methods at this point; it
migrates in the final PR of this stack.

Change-Id: I0ad30b8f36ad9b588ea1a0398220f92c9597bb95
…API 5/5)

Final PR of the Gloas builder API stack:

- sign builder request-auth and preferences (REQUEST_AUTH signing domain,
  web3signer message type)
- add the builder configuration store (`builder_definitions.yml`) and book
  documentation
- add the builder-preferences service and switch block production to
  `POST` produceBlockV4 with a `BuilderConfig` body, threading the
  `Eth-Builder-Url` header through block publication
- remove the now-unused legacy `GET` produceBlockV4 client methods

Change-Id: Iaeeaf6205a024e4fb9fd11aae6ac6a75978a8320
@ethDreamer
ethDreamer force-pushed the stack/ethDreamer/gloas-builder-api-stacked/migrate-validator-client-gloas-builder-api-gloas--aeeaf620 branch from 58fba0d to 2a6fc09 Compare September 8, 2026 22:42
@jimmygchen
jimmygchen marked this pull request as draft September 9, 2026 05:15
@ethDreamer
ethDreamer force-pushed the stack/ethDreamer/gloas-builder-api-stacked/migrate-validator-client-gloas-builder-api-gloas--aeeaf620 branch from 2a6fc09 to a434c7d Compare September 9, 2026 14:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug Something isn't working builder API gloas waiting-on-author The reviewer has suggested changes and awaits thier implementation.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants