Skip to content

Convert knowledge base to Open Knowledge Format (OKF) v0.1 - #3

Merged
tbfangel merged 5 commits into
mainfrom
okf-migration
Jul 5, 2026
Merged

tbfangel merged 5 commits into
mainfrom
okf-migration

Conversation

@tbfangel

@tbfangel tbfangel commented Jul 5, 2026

Copy link
Copy Markdown
Owner

Restructures this repo from the overview.md + <cluster>.md layout into an OKF v0.1 bundle: a tree of small Markdown concept cards, one per blog post, with YAML frontmatter and reserved index.md navigation files.

What changed

One post → one concept card. Every per-post entry became a file YYYY-MM-<slug>.md (chronological lex-sort) with frontmatter mapped from the source data:

Source field OKF field
Type: (Article/Presentation/Podcast) type (required)
post title title
1st sentence of summary description (+ > lead line)
post URL resource + ## Links
cluster + Tags/Topics: tags (cluster slug first)
Date: published (YYYY-MM)
Key takeaways: ## Key Facts
extra fields (e.g. Co-author) preserved as custom keys

Clusters → tags + synthesis cards. Each cluster's hand-written ## Key Insights is preserved as one _synthesis-<cluster>.md card (type: synthesis); the cluster name lives on as tags[0].

Navigation. Each overview.md → the site index.md; a new bundle-root index.md declares okf_version: "0.1".

Tooling updated for OKF. /ask (read workflow), /sync (emits cards), web-resource-crawler agent, CLAUDE.md (authoritative card schema), and README.md.

Scale & integrity

  • 396 concept cards + 30 synthesis cards + 4 site indexes (verraes 124, dannorth 38, architecture-weekly 79, lucumr 155).
  • All 396 cards carry a resource: URL — 40 older verraes posts had none in the data; recovered by matching titles to the verraes archive (38 automatic, 2 manual).
  • Validated clean: every card has non-empty type, every resource is a URL, every internal link resolves, no leftover legacy files.
  • Removed 1 pre-existing duplicate (an old bare entry + the recent sync both covered "Submitting talks to a tech conference").

Notes for review

  • Done as deterministic conversion (script) + a URL-recovery pass; migration scaffolding was removed in the final commit (recoverable from history).
  • Filenames use month precision (YYYY-MM-); day is in no post's data. Exact date remains in published.
  • 4 dannorth clusters had 0 posts; their synthesis cards are intro-only stubs (valid, but empty of Related links).

🤖 Generated with Claude Code

tbfangel and others added 5 commits July 5, 2026 17:32
…r files

Deterministic conversion script (_okf-migration/convert.py) parses the
overview+cluster knowledge base and emits one OKF v0.1 concept card per post,
one _synthesis-<cluster> card per cluster, per-site index.md, and a bundle-root
index.md (okf_version 0.1). Old overview/cluster files retained until phase 5.

Report: _okf-migration/report.md. 40 posts still need URL recovery (P3).

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Matched titles to the verraes archive by year + slug-token overlap
(_okf-migration/recover_urls.py, 38/40) plus 2 manual overrides. Every one
of the 397 cards now carries a resource: link.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
ask + sync skills, web-resource-crawler agent, CLAUDE.md (authoritative card
schema), and README.md now describe and operate on OKF concept cards instead of
overview+cluster files.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
- Delete the 34 legacy overview.md/<cluster>.md files (fully superseded by cards).
- Remove 1 duplicate card (Submitting talks…) + its listing refs.
- Fix 4 synthesis cards that linked to a mangled _synthesis-index.md.
- Correct root index card count. Remove migration scaffolding.

Bundle validates clean: 396 concept cards + 30 synthesis cards + 4 site indexes,
0 frontmatter/resource/broken-link errors.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
scripts/validate_okf.py enforces card frontmatter, link integrity, and a strict
1:1 correspondence between concept cards and their site-index and synthesis-card
listings. Runs in CI on every push/PR (.github/workflows/validate-okf.yml) and
is documented in CLAUDE.md; /sync now runs it before committing.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
@tbfangel
tbfangel merged commit f3897c6 into main Jul 5, 2026
2 checks passed
@tbfangel
tbfangel deleted the okf-migration branch July 5, 2026 19:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant