Skip to content

Commit c6694e4

Browse files
Document Istanbul drift-tuning validation in README and public log.
Record the post-tuning demo and public regression gate results so release checks and smoke numbers stay aligned with the new Istanbul preset. Co-authored-by: Cursor <cursoragent@cursor.com>
1 parent f6503d3 commit c6694e4

3 files changed

Lines changed: 60 additions & 5 deletions

File tree

CHANGELOG.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -18,6 +18,7 @@
1818
- add `docs/pose_covariance.md` for `/pcl_pose` covariance semantics (issue #72)
1919
- document Istanbul public demo RMSE run variance; identical seed/map can yield ~`1.2 m` or late-run drift outliers
2020
- tune public Istanbul 60 s preset with `local_map_crop` and `recovery_retry_from_last_pose` (`r3`, `gap<=1 s`, `seed<=15 m`)
21+
- reconfirm public regression suite after drift tuning; Istanbul gate `1.00 m` and HDL IMU checks pass (2026-06-10)
2122
- guard `use_odom` integration until initial pose is valid and keep pose finite for NDT init guess
2223
- ignore non-finite `/initialpose` payloads and stop eager scan replay during pose reset
2324
- v1.1 relocalization is documented as a validated dry-run `/initialpose` command artifact only

README.md

Lines changed: 6 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -61,12 +61,13 @@ What it does:
6161
Typical first-run time: about **15–30 minutes** (network download dominates).
6262
Re-runs with `--resume` are much faster.
6363

64-
Latest local smoke on Autoware Istanbul `60 s` (dataset already present, 2026-06-10):
64+
Latest local smoke on Autoware Istanbul `60 s` (dataset already present, 2026-06-10,
65+
new preset with `local_map_crop` + `recovery_retry_from_last_pose`):
6566

66-
- translation RMSE: `1.21 m` (fresh rerun; outlier run `4.74 m` on same seed/map)
67-
- rotation RMSE: `0.40 deg`
68-
- matched samples: `61`
69-
- wall time: about `70 s`
67+
- public demo best run: translation RMSE `0.95 m`, rotation `2.13 deg`, matched `220`
68+
- public regression gate: translation RMSE `1.00 m`, rotation `2.33 deg`, matched `104`**pass**
69+
- outlier runs still happen on identical seed/map (e.g. `3.31 m`, `19` matched); see variance notes
70+
- wall time: about `70 s` per demo run
7071

7172
Istanbul replay is run-to-run variable; see [docs/benchmarking.md](docs/benchmarking.md)
7273
for the variance notes and prefer `scripts/run_public_regression_suite.sh` for release gates.

docs/public_validation_log.md

Lines changed: 53 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -3,6 +3,59 @@
33
This file records reproducible public-data validation snapshots. It is not a
44
hardware field-test log.
55

6+
## 2026-06-10 Main After Istanbul Drift Tuning
7+
8+
- commit: `f6503d3`
9+
- source branch: `main`
10+
- validation commands:
11+
12+
```bash
13+
source scripts/setup_local_env.sh
14+
scripts/run_public_demo.sh \
15+
--output-dir /tmp/lidarloc_public_demo_post_tune_r2 \
16+
--skip-fetch --skip-build --ros-domain-id 212
17+
scripts/run_public_regression_suite.sh \
18+
--output-dir /tmp/lidarloc_public_regression_post_tune \
19+
--ros-domain-base 220
20+
```
21+
22+
Result:
23+
24+
- public demo (best of two fresh runs): `pass` trajectory eval
25+
- translation RMSE: `0.955 m`
26+
- rotation RMSE: `2.130 deg`
27+
- matched samples: `220`
28+
- pose rows: `222`
29+
- public demo outlier on same preset (same day): translation RMSE `3.308 m`, matched `19`
30+
- public regression suite: `pass`
31+
- Istanbul `60 s`: `pass`
32+
- pose rows: `106`
33+
- matched samples: `104`
34+
- translation RMSE: `1.002 m`
35+
- rotation RMSE: `2.328 deg`
36+
- recovery retry recovered: `1`
37+
- IMU prediction active rows: `0`
38+
- HDL `60 s`: `pass`
39+
- runs: `2 baseline / 2 candidate`
40+
- pose rows median: `559.0 -> 560.0`
41+
- alignment-time median: `0.045634 s -> 0.046194 s`
42+
- IMU prediction active rows median for the IMU-enabled candidate: `6.0`
43+
- max IMU disable fallback events: `1`
44+
45+
Artifacts:
46+
47+
- `artifacts/public/demo/latest/demo_report.md`
48+
- `artifacts/public/public_regression_suite/summary.json`
49+
- `artifacts/public/public_regression_suite/summary.md`
50+
- `/tmp/lidarloc_public_demo_post_tune_r2/run/`
51+
- `/tmp/lidarloc_public_regression_post_tune/`
52+
53+
Interpretation:
54+
55+
- Drift-tuned Istanbul preset clears the public regression gate while still showing
56+
run-to-run variance; prefer the regression suite over single demo runs for release checks.
57+
- HDL IMU safety / throughput behavior remains stable after the Istanbul preset change.
58+
659
## 2026-05-22 Main Release Regression
760

861
- commit: `2a5f11f`

0 commit comments

Comments
 (0)