Tags: sail-sg/envpool
Tags
Procgen Integration (#197) Procgen library change in https://github.com/Trinkle23897/procgen - Fix Qt library include error - Fix globalGameRegistry == nullptr issue by adding another explicit make_* function (thanks to Yukun!) - Disable auto-reset because envpool has already handled this feature Changes: - Add new dependency `qtdeclarative5-dev`, rebuild docker image - Update pypi wheel from manylinux_2_17_x86_64 to manylinux_2_24_x86_64 because of libstdc++.so.6 symbol - Add 42 procgen envs - Refactor `base_path` Co-authored-by: Jiayi Weng <[email protected]> Co-authored-by: Leo Guo <[email protected]>
improve gym speedup (#210) ## Description Improved speedup in gym by: - added `max_episode_steps` into the base config in c++ - moved `max_episode_steps` from c++ default config per env into `registration.py` - moved `trunc` computation logics from python to c++ This PR also includes a big refactor of calling test env. We use `make_dm` / `make_gym` instead of `envpool_cls(spec_cls(spec_cls.gen_config(...)))`. ## Motivation and Context The computation of `trunc` in `gym_envpool.py` is shown as a bottleneck by `py-spy`. After fix, envpool's speedup in gym improved from ~1.0x to ~1.3x (using make_gym instead of make_dm for the test below): ``` Namespace(domain='cheetah', seed=0, task='run', total_step=200000) 100%|███████████████████████████████████████████████████████████████████████████████████████████████| 200000/200000 [00:17<00:00, 11301.86it/s] FPS(dmc) = 11300.15 100%|███████████████████████████████████████████████████████████████████████████████████████████████| 200000/200000 [00:13<00:00, 14408.97it/s] FPS(envpool) = 14408.43 EnvPool Speedup: 1.28x ``` Co-authored-by: Jiayi Weng <[email protected]>
PreviousNext