Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add docker compose override file for RTX deployments #337

Draft
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

jdye64
Copy link
Collaborator

@jdye64 jdye64 commented Jan 16, 2025

Description

Provides a Docker compose override file for RTX deployments. This allows for specific NIM versions to be deployed that are optimized to save VRAM usage on RTX cards.

This allows nv-ingest to be deployed like so ...

docker compose -f docker-compose.yaml -f docker-compose.rtx.yaml up

  • Note as of writing the actual NIM URLs have not been determined and this is serving more as a placeholder for when those URLs are ready.

Checklist

  • I am familiar with the Contributing Guidelines.
  • New or existing tests cover these changes.
  • The documentation is up to date with these changes.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant