Name		Name	Last commit message	Last commit date
parent directory ..
README.md		README.md
dashboard.py		dashboard.py
eval.toml		eval.toml
evaluator.py		evaluator.py
requirements.txt		requirements.txt

README.md

Prompt rewriting evaluation tool

Install dependencies

pip install -r requirements.txt

Run backend rewriting script

tweak eval.toml
- tabby binary path
- index repo url (the repo you want tabby to index from)
- sample repo url (the repo you want to generate completion requests from)
- language
- prompt count
run python evaluation.py

Run dashboard to view prompts

streamlit run dashboard.py

Tweak the slider bar to change how many recent prompts you want to review.
Change the language to filter only the specific language you are interested in.