M5.2

[juliangruber]

Previous milestone:

• M5.1 #213

Next milestone:

• M5.3 #235

High-level goals

• Robust Spark on DDO
• First round of spot checks on SPs to validate Spark scores
• 2 checker subnets deployed to the network (Spark and one other)
• Create Checker leaderboard
• Support PLDG cohort 2 and get contributors this way
• Release Checker litepaper
• Finish rebrand items
• Partition Spark data by allocators

Carried over

• Create Meridian Apple Dev account #159 @patrickwoodhead
• Spark v1.5: limited support for DDO deals #218
• Deal Observer: initial implementation (deal activation events) #172
• Periodically add new deals to spark-api's database of eligible deals spark-deal-observer#26
• Arweave subnet PoC arweave-checker#1
• Complete FIL-RetroPGF-2 process (verify test DRIPS transaction, etc.) #229 @patrickwoodhead

Tasks

• Release Checker litepaper @patrickwoodhead
• Finish rebrand items @juliangruber @patrickwoodhead
  • Rebrand to Checker Node node#676 @juliangruber
  • Rebrand to Checker App desktop#2048 @juliangruber

2 checker subnets deployed to the network

• Create polished Audius subnet PoC #224 ❗NEEDS CLARIFICATION

Create Checker leaderboard

https://www.notion.so/spacemeridian/Checker-Leaderboard-199cdd5cccdb80c7b30af9fa9b5cfd31

• Product work
  • Start document for what we're about to build @juliangruber
  • Lay out rough product plan @juliangruber
  • How to compare storage DePINs @juliangruber
  • What does retrievability mean across DePINs? @juliangruber
  • Sketch leaderboard @juliangruber
  • What is a good 2nd DePIN to add?
  • Can we create the front-end in-house?
• Gather metrics for 2nd DePIN
• Rank 2 DePINs

Support PLDG cohort 2 and get contributors this way

• Support PLDG cohort #225 @patrickwoodhead

Robust Spark on DDO

• Deal Observer research: how to handle deal expiration/extension/slashing #171 @bajtos
• Architecture design for Spark v2 running allongside Spark v1 #227 @bajtos
• Harden the initial deal-observer implementation spark-deal-observer#58 @NikolasHaimerl
• Document requirements for SPs who want their DDO deals to be tested by Spark #232 @NikolasHaimerl

Spark DDO support for Curio

• Define detailed tasks for Spark DDO support for Curio #249
• Support http-path in index provider address piece-indexer#117 @NikolasHaimerl

Spark data quality improvements

• First round of spot checks on SPs to validate Spark scores #226 @pyropy
• Count of desktop app users over time #207 @pyropy

Partition Spark data by allocators

• RSR per client #193 @NikolasHaimerl
• RSR per allocator #216 @NikolasHaimerl [STRETCH GOAL]

Candidates

• Refactor round tracker to not block service startup spark-api#311
• Test HEAD requests before GET spark-checker#104 @juliangruber
• Include minority retrieval results in the output of evaluate-measurements.js script spark-evaluate#458 @juliangruber
• Gather more granular timing info spark-evaluate#460 @juliangruber
• Glif API access-token security #222
• Optimise Filecoin RPC API usage #212
• Document Spark TTFB calculation #223 @pyropy
• Handle SPs changing their PeerID spark-deal-observer#48
• Plan FDS Canada #240
• Plan Prague colo #241
• Research: how to test retrievability of content stored on Walrus #248 @pyropy

Stretch goals from M5.1

• Chart for per-SP Spark Retrieval Result Codes breakdown #188
• Station Public Dashboard - optimise "Leaderboard - FIL Earned" #178
• Enforce a valid access token in Spark Data API requests spark-stats-request-metrics#7

Tech debt repayment (candidates)

• HTML linter spark-dashboard#24
• Setup TS type checking in all spark repositories #80 @pyropy
• Linter: detect unused dependencies #221
• Migrate from standard to neostandard + Prettier #166
• Fix dependabot not deploying on #main spark-stats#158
• Upgrade to Node.js 22 LTS #210
• Validate reported start_at and first_byte_at values during preprocess step spark-evaluate#447 @pyropy
• Self-healing after spark-evaluate restarts spark-evaluate#3
• Remove obsolete mocha types spark-deal-observer#38 @NikolasHaimerl
• Remove use of T.Object for TypeBox spark-deal-observer#43 @NikolasHaimerl
• Enable strict TypeScript checks spark-deal-observer#51 @NikolasHaimerl --> chore: enable strict type checking spark-deal-observer#80
• Upgrade Checker App to React v19 desktop#1997 @juliangruber
• Handle reverted events spark-deal-observer#22 @NikolasHaimerl
• Handle Limit on archive retrievals spark-deal-observer#57 @NikolasHaimerl
• Piece Indexer Missing CIDs spark-deal-observer#30 @NikolasHaimerl --> feat: check for missing payload spark-deal-observer#77