Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[UPDATE] On DUMMY AGENT LIBRARY > Serverless API section - 401 occurs if the HF Token is not set for inference calls #140

Open
RomainBasly opened this issue Feb 15, 2025 · 0 comments
Labels
documentation Improvements or additions to documentation

Comments

@RomainBasly
Copy link

RomainBasly commented Feb 15, 2025

On serverless API on the test when we try to reach Llama-3.2-3B, if the token is not properly set to welcome inferences, it does not work : we get a 401.

I would suggest to add this information on the prerequisite of the token in the comment just above

## You need a token from https://hf.co/settings/tokens **and set it with the property "Make calls to inference providers" on.** If you run this on Google Colab, you can set it up in the "settings" tab under "secrets". Make sure to call it "HF_TOKEN" 
os.environ["HF_TOKEN"]="hf_xxxxxxxxxxxxxx"
@RomainBasly RomainBasly added the documentation Improvements or additions to documentation label Feb 15, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation
Projects
None yet
Development

No branches or pull requests

1 participant