Skip to content

Suggested Request: Swap MediaPipe GenAI with LiteRT LM web#8

Open
shivaylamba wants to merge 2 commits into
carrycooldude:mainfrom
shivaylamba:litert-lm-web-implementation
Open

Suggested Request: Swap MediaPipe GenAI with LiteRT LM web#8
shivaylamba wants to merge 2 commits into
carrycooldude:mainfrom
shivaylamba:litert-lm-web-implementation

Conversation

@shivaylamba
Copy link
Copy Markdown

Hi @carrycooldude

LiteRT LM Web was recently launched. This PR swaps the implementation of MediaPipe Web LLM with LiteRT LM. This is just a suggested PR to show LiteRT LM web API in action. Maybe we can have both being shown. Just a suggestion

Copilot AI review requested due to automatic review settings May 25, 2026 14:24
Copy link
Copy Markdown

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Note

Copilot was unable to run its full agentic suite in this review.

This PR migrates Nova IDE’s on-device inference stack from MediaPipe GenAI to LiteRT LM, updating model formats, runtime initialization, and related docs/UI.

Changes:

  • Swap dependency from @mediapipe/tasks-genai to @litert-lm/core and update Vite config accordingly.
  • Rewrite src/ai-engine.js to use LiteRT LM Engine + conversations, plus improved OPFS caching and streaming downloads.
  • Update model URLs/extensions and documentation references from .task/MediaPipe to .litertlm/LiteRT LM.

Reviewed changes

Copilot reviewed 10 out of 11 changed files in this pull request and generated 8 comments.

Show a summary per file
File Description
vite.config.js Adjust asset handling and dependency optimization for LiteRT LM models/runtime.
src/chat.js Update model labels/URLs and restrict uploads to .litertlm.
src/ai-engine.js Replace MediaPipe-based inference with LiteRT LM Engine + streaming + OPFS caching.
packages/web-agent-core/website/src/components/HomepageFeatures/index.js Update marketing copy to reference LiteRT LM.
packages/web-agent-core/website/docs/intro.md Update docs to reference LiteRT LM in examples and descriptions.
packages/web-agent-core/package.json Update keywords from mediapipe to litert-lm.
packages/web-agent-core/README.md Update README references/examples to LiteRT LM.
package.json Replace MediaPipe dependency with @litert-lm/core.
README.md Update root README to reference LiteRT LM and link to correct docs.
BLOG.md Update blog narrative/diagram and model extension references to LiteRT LM.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread src/ai-engine.js
Comment thread src/ai-engine.js Outdated
Comment thread src/ai-engine.js
Comment thread src/ai-engine.js
Comment thread src/ai-engine.js Outdated
Comment thread src/ai-engine.js Outdated
Comment thread src/ai-engine.js Outdated
Comment thread vite.config.js Outdated
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants