Skip to content

Commit

Permalink
Update evaluation section
Browse files Browse the repository at this point in the history
  • Loading branch information
ssundaram21 authored Nov 11, 2024
1 parent 8459338 commit ef567b8
Showing 1 changed file with 3 additions and 3 deletions.
6 changes: 3 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -190,13 +190,13 @@ python ./training/train.py --config ./configs/train_ensemble_model_lora.yaml
We provide more sample configs in `./configs`, including examples of finetuning with LoRA and with an MLP head. See `./training/train.py` for a full list and description of training options.

### Evaluation
To evaluate a perceptual model on the dataset, run `./training/evaluate.py`. For example, to evaluate dreamsim on the dataset, run:
To evaluate a perceptual model on the dataset, run `./evaluation/eval_percep.py`. For example, to evaluate a trained checkpoint against a baseline model on the dataset, run:

```
python ./training/evaluate.py --config ./configs/eval_baseline.yaml
python ./evaluation/eval_percep.py --config ./configs/eval_ensemble.yaml
```

For an example of evaluating using a trained checkpoint, refer to `./configs/eval_checkpoint.yaml`. See `./training/evaluate.py` for a full list and description of evaluation options.
See `./evaluate/eval_percep.py` for a full list and description of evaluation options.
<!--Experiments-->

<a name="bibtex"></a>
Expand Down

0 comments on commit ef567b8

Please sign in to comment.