Skip to content

fix(student-space): stabilize onboarding and voice capture#68

Merged
rezailmi merged 5 commits into
mainfrom
student-space-capture-voice-flow
May 24, 2026
Merged

fix(student-space): stabilize onboarding and voice capture#68
rezailmi merged 5 commits into
mainfrom
student-space-capture-voice-flow

Conversation

@rezailmi
Copy link
Copy Markdown
Collaborator

Summary

Signed-out students now land on the working sign-in world instead of a blank onboarding state, while the companion stays out of that sign-in scene. The island companion consistently uses the latest finch model, shows clearer hover copy, and keeps its face framed while students open the capture flow.

Voice capture now feels more immediate: tapping record moves straight into the live chat stream, keeps the recording panel stable while the log scrolls, shows a listening indicator in the student's bubble, and pushes OpenAI realtime toward English-only transcription/replies with stricter filtering for noisy background fragments. Short vague turns now invite students to share something from school or after school instead of looping on generic confirmations.

Verification

  • ./node_modules/.bin/biome check src/agents/mirror.prompt.md src/agents/openai-realtime/mirror-payloads.ts src/agents/openai-realtime/mirror-prompt.ts src/agents/openai-realtime/mirror-realtime-live.prompt.md src/components/student-space/EngineHost.tsx src/components/student-space/capture/AskSheet.tsx src/components/student-space/hud/StudentSpaceHud.tsx src/components/student-space/onboarding/EggHatcher.tsx src/components/student-space/world/WorldInteractions.tsx src/components/ui/drawer.tsx src/routes/_app.tsx test/agents/openai-realtime-mirror.test.ts test/components/student-space/EngineHost.test.tsx test/components/student-space/capture/capture-stack.test.tsx test/lib/student-space/realtime-mirror-client.test.ts
  • ./node_modules/.bin/vitest run test/agents/openai-realtime-mirror.test.ts test/components/student-space/EngineHost.test.tsx test/components/student-space/capture/capture-stack.test.tsx test/lib/student-space/realtime-mirror-client.test.ts
  • ./node_modules/.bin/tsc --noEmit
  • git diff --check origin/main...HEAD
  • Computer Use smoke of the local island at 127.0.0.1:3010

Compound Engineering
Codex_GPT--5

Reza Ilmi added 5 commits May 24, 2026 20:49
Restore the signed-out onboarding entry, keep the current GLB companion path, and make capture voice sessions English-only with guarded Realtime replies.
Render the listening state as a white You bubble with typing dots and pin the live dialogue log to the latest turn while recording.
Guide the live companion to ask for school or after-school moments when the student gives only a short or vague opening, instead of assuming a story already exists.
Remove the mood framing from the bird hover card and keep the recording chat log scrollable inside a stable capture panel.
@vercel
Copy link
Copy Markdown

vercel Bot commented May 24, 2026

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
sensemaking-agents Ready Ready Preview, Comment May 24, 2026 12:52pm

@rezailmi rezailmi merged commit 28587bd into main May 24, 2026
4 checks passed
@rezailmi rezailmi deleted the student-space-capture-voice-flow branch May 24, 2026 12:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant