Xeon and Gaudi Supported Models The following table lists the pre-validated models for Intel® AI for Enterprise Inference. ✅ Model Support Matrix Model Xeon Gaudi deepseek-ai/DeepSeek-R1-Distill-Qwen-32B ✓ ✓ deepseek-ai/DeepSeek-R1-Distill-Llama-8B ✓ ✓ meta-llama/Llama-3.1-8B-Instruct ✓ ✓ meta-llama/Llama-3.2-3B-Instruct ✓ Qwen/Qwen3-1.7B ✓ Qwen/Qwen3-4B-Instruct-2507 ✓ meta-llama/Llama-3.1-70B-Instruct ✓ meta-llama/Llama-3.1-405B-Instruct ✓ (Gaudi3) meta-llama/Llama-4-Scout-17B-16E-Instruct ✓ Qwen/Qwen2.5-32B-Instruct ✓ mistralai/Mixtral-8x7B-Instruct-v0.1 ✓ mistralai/Mistral-7B-Instruct-v0.3 ✓ BAAI/bge-reranker-base ✓ BAAI/bge-base-en-v1.5 ✓