Request for Code to Reproduce VisualWebArena and Mind2Web Experiments

[b7277]

Thank you for your awesome work！I am currently working on reproducing the VisualWebArena and Mind2Web experiments. If possible, I would be very grateful if you could provide the code for running these experiments. Thank you for your time and support!

[entslscheia]

Hi,

Thanks for your interest in our work.
Our implementation for VisualWebArena is adapted from search agent's codebase (https://github.com/kohjingyu/search-agents). You can first setup your environment follow their nice instructions.
For necessary changes to make to their codebase, please find under the code/ dir in this link. In addition, I have shared all our old experiment logs (i.e., files under reactive/ and wm/) via the same link.

We are still working to upload a clean version of our code for both VWA and Mind2Web-live with some new results. Please stay tuned!

Best,
Yu Gu

[entslscheia]

Also, we've observed some changes from the OpenAI backend that may affect our experiment results, which is one reason for delaying our release. We're currently conducting new experiments and will ensure full transparency throughout the process.

[b7277]

Thank you for your quick response and for sharing the relevant modifications and logs! I will follow the instructions and start working with the existing codebase. Looking forward to your upcoming release. Thanks again for your help!

[koi953215]

Also, we've observed some changes from the OpenAI backend that may affect our experiment results, which is one reason for delaying our release. We're currently conducting new experiments and will ensure full transparency throughout the process.

Sorry to bother you, but the link you provided seems to be broken. Could you kindly fix it?

[lihua8848]

The link seems to be broken.