Skip to content

[EXPERIMENT][WIP] Add LTX-Video 2.3 OpenVINO notebook#3467

Draft
mlukasze wants to merge 1 commit into
openvinotoolkit:latestfrom
mlukasze:enable/Lightricks-LTX-2.3
Draft

[EXPERIMENT][WIP] Add LTX-Video 2.3 OpenVINO notebook#3467
mlukasze wants to merge 1 commit into
openvinotoolkit:latestfrom
mlukasze:enable/Lightricks-LTX-2.3

Conversation

@mlukasze

Copy link
Copy Markdown

⚠️ AUTOMATICALLY GENERATED BY OMEGA AGENT β€” REQUIRES HUMAN REVIEW ⚠️
This PR was created by an AI agent as part of automated model enablement.
A human maintainer must review and approve it before it can be considered for merge.
Do NOT merge without human review and sign-off.

Summary

This PR adds a Jupyter notebook demonstrating OpenVINO conversion and inference for Lightricks/LTX-Video 2.3.

Model

  • Model: Lightricks/LTX-2.3
  • Architecture: 22B DiT (Diffusion Transformer) for video generation
  • Library: Diffusers (not standard Transformers)
  • Components: transformer, vae_encoder, vae_decoder, text_encoder (Gemma3)

OV Conversion Results

Component Size CPU GPU Inference
transformer 18.88B params βœ… βœ… βœ…
text_encoder Gemma3 βœ… βœ… βœ…
vae_encoder - βœ… - βœ…
vae_decoder - βœ… - βœ…

Conversion Path

Lightricks/LTX-2.3 (42.98 GB safetensors)
  β†’ convert_ltx2_to_diffusers.py (official Lightricks conversion script)
  β†’ diffusers format
  β†’ ov.convert_model()
  β†’ OpenVINO IR

Notes

  • Uses dg845/LTX-2.3-Diffusers (community diffusers format conversion) for easier loading
  • Full end-to-end video generation pipeline wiring still in progress
  • Related issue: intel-sandbox/applications.ai.openvino.meat#903

Status

⚠️ This is an experimental PR. The conversion works but full pipeline wiring (connector β†’ transformer input mapping) needs final validation with real prompts.

Labels: experimental, do-not-merge

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@review-notebook-app

Copy link
Copy Markdown

Check out this pull request onΒ  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.


Powered by ReviewNB

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant