Skip to content

Conversation

@zhaohb
Copy link

@zhaohb zhaohb commented Oct 24, 2025

Just for EXAONE-4.0-1.2B

ticket : 175853

What does this PR do?

Conversion cmd-line for LGAI-EXAONE/EXAONE-4.0-1.2B:

optimum-cli export openvino -m  LGAI-EXAONE/EXAONE-4.0-1.2B EXAONE-4.0-1.2B

Inference of LGAI-EXAONE/EXAONE-4.0-1.2B using OpenVINO backend:

import torch
from transformers import AutoTokenizer
from optimum.intel.openvino import OVModelForCausalLM

model_dir="LGAI-EXAONE/EXAONE-4.0-1.2B"

tokenizer = AutoTokenizer.from_pretrained(model_dir)
model = OVModelForCausalLM.from_pretrained(model_dir)

prompt = "What is the capital of France?"

messages = [
    {"role": "user", "content": prompt}
]
input_ids = tokenizer.apply_chat_template(
    messages,
    tokenize=True,
    add_generation_prompt=True,
    return_tensors="pt"
)

# Run inference
output_ids = model.generate(input_ids, max_new_tokens=10)
output_text = tokenizer.decode(output_ids[0])

print(output_text)

Before submitting

  • [N/A] This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
  • Did you make sure to update the documentation with your changes?
  • Did you write any new necessary tests?

Copy link
Collaborator

@rkazants rkazants left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please provide tests and JIRA ticket.

@HuggingFaceDocBuilderDev

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

@zhaohb
Copy link
Author

zhaohb commented Oct 31, 2025

Please provide tests and JIRA ticket.

Hi, I had add JITA ticket and tests.
Thank you very much.

"feature-extraction-with-past",
"text-generation",
"text-generation-with-past",
"text-classification",
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

OVModelForSequenceClassification is not validated. I see that this task is not validated in precommit.
The same problem is for feature-extraction.

@rkazants
Copy link
Collaborator

rkazants commented Nov 3, 2025

@zhaohb, please provide PR description in a format as here: #1354
Example:
image

@nikita-savelyevv nikita-savelyevv added the openvino-slow Runs OpenVINO slow tests with different versions of transformers label Nov 3, 2025
@zhaohb
Copy link
Author

zhaohb commented Nov 4, 2025

@zhaohb, please provide PR description in a format as here: #1354 Example: image

Done, thanks.

Copy link
Collaborator

@rkazants rkazants left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

openvino-slow Runs OpenVINO slow tests with different versions of transformers

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants