Skip to content

core

Directory actions

More options

Directory actions

More options

Latest commit

 

History

History

core

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
README.md
README.md
 
 
__init__.py
__init__.py
 
 
adk.py
adk.py
 
 
audio.py
audio.py
 
 
audio_io.py
audio_io.py
 
 
constrained_decoding.py
constrained_decoding.py
 
 
drive.py
drive.py
 
 
event_detection.py
event_detection.py
 
 
filesystem.py
filesystem.py
 
 
function_calling.py
function_calling.py
 
 
genai_model.py
genai_model.py
 
 
github.py
github.py
 
 
jinja_template.py
jinja_template.py
 
 
live_model.py
live_model.py
 
 
ollama_model.py
ollama_model.py
 
 
pdf.py
pdf.py
 
 
preamble.py
preamble.py
 
 
rate_limit_audio.py
rate_limit_audio.py
 
 
realtime.py
realtime.py
 
 
speech_events.py
speech_events.py
 
 
speech_to_text.py
speech_to_text.py
 
 
text.py
text.py
 
 
text_to_speech.py
text_to_speech.py
 
 
timestamp.py
timestamp.py
 
 
transformers_model.py
transformers_model.py
 
 
vad.py
vad.py
 
 
video.py
video.py
 
 
web.py
web.py
 
 
window.py
window.py
 
 

README.md

Built-in Processors (genai_processors.core) 🧩

The library includes several pre-built processors:

  • genai_model.GenaiModel: Facilitates standard, turn-based interactions with Google's GenAI models (e.g., Gemini).
  • live_model.LiveProcessor: Enables real-time, streaming interactions with Google's GenAI Live API.
  • event_detection.EventDetection: Uses a GenAI model to detect specific events within a continuous stream of images (like video).
  • rate_limit_audio.RateLimitAudio: Splits and rate-limits audio streams to ensure natural playback speed, crucial for streaming audio output.
  • text.MatchProcessor: Finds and extracts a regex pattern within the input stream.
  • timestamp.Timestamp: Adds ProcessorPart objects containing timestamps to a stream, commonly used with image or video frames.
  • audio_io.PyAudioIn / audio_io.PyAudioOut: For capturing audio from a microphone (PyAudioIn) and playing audio to speakers (PyAudioOut) using PyAudio.
  • video.VideoIn: Generates a stream of image ProcessorPart objects from a camera or screen capture source.
  • preamble.Preamble / preamble.Suffix: Adds fixed content to the beginning (Preamble) or end (Suffix) of a full content stream.
  • drive.Docs / drive.Sheets / drive.Slides: Downloads Google Docs / Sheets / Slides, which can be passed to a GenaiModel for grounding.