A framework to enable multimodal models to play games on a computer.

Using the same inputs and outputs as a human operator, the model plays a game!

• Compatibility: Designed for various multimodal models.
• Integration: Currently integrated with GPT-4
• Future Plans: Support for additional models.

Create venv

python3 -m venv env

Activate it (Mac)

source env/bin/activate

Install requirements

pip install -r requirements.txt

Add OpenAI Key

export OPENAI_API_KEY=yourkeyhere

Run it

python main.py