Different coordinates

[ppsirius]

When i run the run_agent.py on the terminal i got

Action result: I clicked at coordinates (302.6, 594.6).

but on browser window i see info

... coordinate [604, 1183]

of course button is not clicked :/

[pmbstyle]

1. AI Model outputs coordinates based on the resized prompt image
2. Debug Overlay shows the raw model response with original coordinates
3. Execution Engine scales those coordinates to match the actual browser viewport
4. App Logs show the scaled/viewport coordinates that were actually clicked

Example Scenario

• AI Model outputs: "coordinate": [500, 300] (based on resized image)
• Debug overlay shows: [500, 300] (original model output)
• Scaling factor: 1.2x (due to image resizing)
• Actual click coordinates: [600, 360] (scaled to viewport)
• App logs show: I clicked at coordinates (600.0, 360.0).

This is intended behavior - the debug overlay shows what the model actually said, while the logs show what was actually executed
in the browser.