Skip to content

Commit

Permalink
Update README.md with pytest installation instructions
Browse files Browse the repository at this point in the history
  • Loading branch information
ViswanathaReddyGajjala authored Feb 17, 2024
1 parent 665b782 commit c86aece
Showing 1 changed file with 7 additions and 0 deletions.
7 changes: 7 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -50,6 +50,13 @@ print(tokenizer.encode(text))

(you'll have to `pip install tiktoken` to run).

## Running Tests
1. To run the unit tests for the tokenizers, you'll need to install `pytest`. If you haven't installed it yet, you can do so using pip: `pip install pytest
`
2. Once pytest is installed, you can run the tests using the following command `pytest .` (or):
```bash
pytest test_tokenizer.py
```
## todos

- move the files into minbpe directory / make a nice small package?
Expand Down

0 comments on commit c86aece

Please sign in to comment.