Skip to content

AgentQnA - Create a CPU specific helm chart for Kubernetes environments #1523

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
mkbhanda opened this issue Feb 11, 2025 · 7 comments · May be fixed by #1601
Closed

AgentQnA - Create a CPU specific helm chart for Kubernetes environments #1523

mkbhanda opened this issue Feb 11, 2025 · 7 comments · May be fixed by #1601
Labels
A1 high prority good first issue Good for newcomers help wanted Extra attention is needed OPEAHack Issue created for OPEA Hackathon v1.3

Comments

@mkbhanda
Copy link
Collaborator

For https://github.com/opea-project/GenAIExamples/tree/main/AgentQnA/kubernetes/helm add vales.yaml that is specific for a CPU deploy. Specify a smaller open source model, 2-3 B size, that can be served using a CPU.
@mkbhanda mkbhanda added good first issue Good for newcomers help wanted Extra attention is needed OPEAHack Issue created for OPEA Hackathon v1.3 labels Feb 11, 2025
@yongfengdu yongfengdu mentioned this issue Feb 26, 2025
Merged
3 tasks
@haoruan
Copy link

haoruan commented Mar 3, 2025

OPEA_Team6 is working on this issue

@haoruan haoruan mentioned this issue Mar 3, 2025
Open
1 task
@letonghan
Copy link
Collaborator

Hi @haoruan, is your team still working on this issue? Is yes, please paste the PR link here, thanks very much!

@haoruan
Copy link

haoruan commented Mar 17, 2025

opea-project/GenAIInfra#837 already created the file in https://github.com/opea-project/GenAIInfra, should I manually copy it to here?

@letonghan
Copy link
Collaborator

letonghan commented Mar 17, 2025 •
edited
Loading

opea-project/GenAIInfra#837 already created the file in https://github.com/opea-project/GenAIInfra, should I manually copy it to here?

Yes, I've checked with @yongfengdu. Please copy the values files in GenAIExample.
You can reopen your old PR and update the files.
Thanks!

@yongfengdu
Copy link
Collaborator

@haoruan Yes, you can help with updating the GenAIExamples repo.
Please also add the cpu-values.yaml here https://github.com/opea-project/GenAIInfra/blob/main/helm-charts/valuefiles.yaml#L28
This is to track duplicated helm chart values files between the 2 repos before we have a better solution(Automatically create PRs).

@haoruan haoruan mentioned this issue Mar 17, 2025
Merged
1 task
@haoruan
Copy link

haoruan commented Mar 17, 2025

@letonghan @yongfengdu Thanks for your guidance, created PRs

@yinghu5 yinghu5 added the A1 high prority label Mar 20, 2025
@yinghu5
Copy link
Collaborator

yinghu5 commented Mar 20, 2025

Hi @haoruan and all thank you a lot for the contribution!

@yinghu5 yinghu5 closed this as completed Mar 20, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
A1 high prority good first issue Good for newcomers help wanted Extra attention is needed OPEAHack Issue created for OPEA Hackathon v1.3
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

add a cpu specific helm chart values file for AgentQnA haoruan/opea-project-GenAIExamples
5 participants
@mkbhanda @haoruan @yongfengdu @yinghu5 @letonghan