Before setup, please:
- set availiable Web Server urls and OPENAI api key for llm judge.
- please see WebArena, build your web server, replace all urls in
setup.shandagentenv-webarena/_init_.pyto your own urls.
conda create -n agentenv-webarena python=3.10.13
conda activate agentenv-webarena
source ./setup.shwebarena --host 0.0.0.0 --port 8000| parallel-run envs | memory utilization |
|---|---|
| 1 env | 1717 MB |
| 5 envs | 4702 MB |
| 10 envs | 8450 MB |
| 20 envs | 16310 MB |
We recommend you preserve 1GB memory per Env(interact client) to make sure it runs without crashes
When try action like goto [url], which url is unable to access, program will crash.
temporarily fixed by adding a url accessible test befor action Added retry to
env.reset()andenv.step(), you can setmax_retriesin./webarena/browser_env/envs.py line 162and./webarena/browser_env/actions.py line 1202to change the retry times. If all retries failed, the env will returnobs['text'] = "TimeoutError"
- If you'd like to build websites by yourself, please see WebArena