Cld2labs/redhat9.6 deployment scripts#73
Cld2labs/redhat9.6 deployment scripts#73HarikaDev296 wants to merge 44 commits intoopea-project:mainfrom
Conversation
HarikaDev296
force-pushed
the
cld2labs/redhat9.6-deployment-scripts
branch
from
f7ee928 to
6f5af9a
Compare
|
Do we need to recreate another copy of the troubleshooting.md, user-guide-apisix.md, and user-guide-genai.md? There's a lot of repeated information compared to the ubuntu22.04 guides. Can we consolidate into one file for each and mention which sections are specific to Ubuntu or Red Hat? |
|
Deployment working with keycloak/APISIX. Still need to test with GenAI Gateway. |
|
@HarikaDev296 why doesn't the implementation include steps to install an ISO with RHEL? Shouldn't this be similar to the ubuntu 22.04 deployment script where it installs an OS? |
Dell wanted seperate documentations for ubuntu22.04 and Redhat, Since Redhat has unique prerequisites keeping them distinct helps maintain consistency and prevents user confusion. |
ISO level implementation is not in the requirements for RedHat. |
psurabh
left a comment
psurabh
left a comment
There was a problem hiding this comment.
@HarikaDev296 Please merge these two guides into one. user-guide-apixsix & genai.md.
|
|
||
| > **Note:** The `litellm_master_key` is located in `core/inventory/metadata/vault.yml`. | ||
|
|
||
| **Run a test query for Gaudi:** |
There was a problem hiding this comment.
When deployed with GenAI Gateway, will inference work immediately? Usually we'd have to follow these additional steps before it works. https://github.com/opea-project/Enterprise-Inference/blob/main/docs/accessing-deployed-models.md#accessing-models-deployed-with-genai-gateway
Are these steps handled in the deployment script?
There was a problem hiding this comment.
We didn't require any additional manual steps after deployment. Once the deployment finished successfull all pods verified and running.
We simply retreived the master key from core/inventory/metadata/vault.yml as mentioned in the guide and Inference worked with the master key.
Signed-off-by: Harika <codewith3@gmail.com>
Signed-off-by: Harika <codewith3@gmail.com>
Signed-off-by: Harika <codewith3@gmail.com>
Co-authored-by: alexsin368 <109180236+alexsin368@users.noreply.github.com> Signed-off-by: Harika <codewith3@gmail.com>
Updated user guide for Intel AI for Enterprise Inference to clarify setup instructions and improve readability. Signed-off-by: Harika <codewith3@gmail.com>
Signed-off-by: Harika <codewith3@gmail.com>
Signed-off-by: Harika <codewith3@gmail.com>
Updated README.md to include new instructions for mounting ISO and clarify mandatory Terraform variables. Signed-off-by: Harika <codewith3@gmail.com>
Added instructions for changing file permissions and running the script. Signed-off-by: Harika <codewith3@gmail.com>
Signed-off-by: Harika <codewith3@gmail.com>
Signed-off-by: Harika <codewith3@gmail.com>
Signed-off-by: Harika <codewith3@gmail.com>
Signed-off-by: Harika <codewith3@gmail.com>
Signed-off-by: Harika <codewith3@gmail.com>
Signed-off-by: Harika <codewith3@gmail.com>
Signed-off-by: Harika <codewith3@gmail.com>
Signed-off-by: Harika <codewith3@gmail.com>
Signed-off-by: Harika <codewith3@gmail.com>
Signed-off-by: Harika <codewith3@gmail.com>
Signed-off-by: Harika <codewith3@gmail.com>
Signed-off-by: Harika <codewith3@gmail.com>
Signed-off-by: Harika <codewith3@gmail.com>
Signed-off-by: Harika <codewith3@gmail.com>
Signed-off-by: Harika <codewith3@gmail.com>
Clarified usage instructions for required script variables and password hash format. Signed-off-by: Harika <codewith3@gmail.com>
Updated README with placeholders for hostname, username, and password hash. Signed-off-by: Harika <codewith3@gmail.com>
Signed-off-by: Harika <codewith3@gmail.com>
Signed-off-by: Harika <codewith3@gmail.com>
Signed-off-by: Harika <codewith3@gmail.com>
Signed-off-by: Harika <codewith3@gmail.com>
Signed-off-by: Harika <codewith3@gmail.com>
Signed-off-by: Harika <codewith3@gmail.com>
Signed-off-by: Harika <codewith3@gmail.com>
Signed-off-by: Harika <codewith3@gmail.com>
Signed-off-by: Harika <codewith3@gmail.com>
Signed-off-by: Harika <codewith3@gmail.com>
Signed-off-by: Harika <codewith3@gmail.com>
Signed-off-by: Harika <codewith3@gmail.com>
Signed-off-by: Harika <codewith3@gmail.com>
Signed-off-by: Harika <codewith3@gmail.com>
Signed-off-by: Harika <codewith3@gmail.com>
Signed-off-by: Harika <codewith3@gmail.com>
Signed-off-by: Harika <codewith3@gmail.com>
HarikaDev296
force-pushed
the
cld2labs/redhat9.6-deployment-scripts
branch
from
511043f to
91e9983
Compare
3 participants
Redhat deployment guides