📖 KV-Cache Manager Docs

[vMaroon]

The llm-d-kv-cache-manager has docs that can be ported/reused under the component-architecture page.

[KPRoche]

The llm-d-kv-cache-manager has docs that can be ported/reused under the component-architecture page.

I can port the README in fairly quickly. Do you want the more advanced docs/architecture.md diagram pulled in as well?

[KPRoche]

OK, a preview is available for you at https://kproche.github.io/llm-d.github.io/docs/architecture/Components/kv-cache

If that is acceptable, I will do a PR to merge it into the main site.

[vMaroon]

LGTM - I'll iterate in PRs but this looks like a good base.

[KPRoche]

OK, I'll do the PR

[KPRoche]

This is being addressed by PR #31