Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Simple Chat gives httpx.ConnectError #397

Open
designcomputer opened this issue Dec 29, 2024 · 4 comments
Open

Simple Chat gives httpx.ConnectError #397

designcomputer opened this issue Dec 29, 2024 · 4 comments

Comments

@designcomputer
Copy link

This simple chat example fails:

from ollama import chat

messages = [
  {
    'role': 'user',
    'content': 'Why is the sky blue?',
  },
]

response = chat('llama3.2:3b', messages=messages)
print(response['message']['content'])

httpx.ConnectError: [WinError 10049] The requested address is not valid in its context

But this works fine:

from ollama import Client
client = Client(
  host='http://localhost:11434',
  headers={'x-some-header': 'some-value'}
)
response = client.chat(model='llama3.2:3b', messages=[
  {
    'role': 'user',
    'content': 'Why is the sky blue?',
  },
])

print(response['message']['content'])
# or access fields directly from the response object
print(response.message.content)

The sky appears blue because of a phenomenon called scattering, which occurs when sunlight interacts with the tiny molecules of gases in the Earth's atmosphere.....

@ParthSareen
Copy link
Contributor

Hi @designcomputer! Possible this is some kind of firewall issue - is this on windows?

@designcomputer
Copy link
Author

designcomputer commented Dec 29, 2024

Hi @designcomputer! Possible this is some kind of firewall issue - is this on windows?

Yes, I am using a Windows computer, as indicated by the error message. Assuming the chat function defaults to http://localhost:11434 when the host is not explicitly defined, I’m curious why explicitly defining the host resolves the issue. Could this point to something specific about how the chat function currently handles the default host configuration? The failing example obviously worked in the past.

@ParthSareen
Copy link
Contributor

Did you have a version at which point this was working? Wondering if this is more so windows related or library related. Don't think there have been any client changes in a while

@designcomputer
Copy link
Author

designcomputer commented Dec 30, 2024

Did you have a version at which point this was working? Wondering if this is more so windows related or library related. Don't think there have been any client changes in a while

I believe it used to function properly. The issue might stem from an update made to httpx or related dependencies.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants