Code

feat: Realtime API support#3722

Code

Draft

mudler wants to merge 24 commits intomastermudler/LocalAI:masterfrom feat/realtimemudler/LocalAI:feat/realtimeCopy head branch name to clipboard

+1,427-6

Commits

Commits on Dec 27, 2024

• WIP

  Show description for 7a6f882
  mudler

  committed
  7a6f882

• WIP

  Show description for fbf4660
  mudler

  committed
  fbf4660

• debug

  Show description for af3f071
  mudler

  committed
  af3f071

• aujdio

  Show description for 622c1dd
  mudler

  committed
  622c1dd

• Add model interface to sessions

  Show description for eb86ba5
  mudler

  committed
  eb86ba5

• setup ws upgrade

  Show description for 3b112de
  mudler

  committed
  3b112de

• Fix route

  Show description for 8052a52
  mudler

  committed
  8052a52

• chore: simplify passing options to ModelOptions

  Show description for bfa5be3
  mudler

  committed
  bfa5be3

• Load wrapper clients

  Show description for 005e2d4
  mudler

  committed
  005e2d4

• refactor

  Show description for a7b06bd
  mudler

  committed
  a7b06bd

• feat: correctly detect when starting the vad server

  Show description for 771b56d
  mudler

  committed
  771b56d

• chore: extract realtime models into two categories

  Show description for 51204f2
  mudler

  committed
  51204f2

• feat(vad): hook vad detection

  Show description for 99e61a7
  mudler

  committed
  99e61a7

• chore(vad): try to hook vad to received data from the API (WIP)

  Show description for 1969d45
  mudler

  committed
  1969d45

• Attach context for VAD

  Show description for 45771a3
  mudler

  committed
  45771a3

• Move to debug calls

  Show description for 800ba1e
  mudler

  committed
  800ba1e

• Fix lock handling

  Show description for 66c9e56
  mudler

  committed
  66c9e56

• wip(vad)

  Show description for 9c45e88
  mudler

  committed
  9c45e88

• gRPC client stubs

  Show description for 5760d7f
  mudler

  committed
  5760d7f

• wip

  Show description for c059c4c
  mudler

  committed
  c059c4c

• WIP

  Show description for aa51cc5
  mudler

  committed
  aa51cc5

• Small adaptations

  Show description for 8db7e86
  mudler

  committed
  8db7e86

• Use template evaluator for preparing LLM prompt in wrapped mode

  Show description for d8ef83f
  mudler

  committed
  d8ef83f

Commits on Dec 28, 2024

• WIP - to drop

  Show description for 2a157cc
  mudler

  committed
  2a157cc