Commits

Breadcrumbs

History for

onmaster

User selector

All users

Datepicker

All time

Commit History

Commits on Aug 5, 2024

• Update README to reflect move to csv

  alexandermorgan

  committed
  52cbf5d

• Store/read csv instead of json, and clean up train.py

  alexandermorgan

  committed
  c3fe367

Commits on Aug 2, 2024

• Add link to HF dataset and path to json fil

  alexandermorgan

  committed
  93cc4bf

Commits on Jul 31, 2024

• Update base, batch, and README

  alexandermorgan

  committed
  cbe1926

Commits on Jul 25, 2024

• WIP: add more to readme

  Show description for 2de137a
  alexandermorgan

  committed
  2de137a

Commits on Jul 24, 2024

• WIP: begin README rewrite

  alexandermorgan

  committed
  37f7055

Commits on Jun 12, 2024

• Add optimized batch tokenizer

  Show description for fd3eeca
  alexandermorgan

  committed
  fd3eeca

Commits on Apr 22, 2024

• add gnp/minbpe-rs as community extensions in README.md

  shubham0204

  committed
  45a0c2f

Commits on Feb 22, 2024

• text version of the lecture

  karpathy

  committed
  9324a08

Commits on Feb 21, 2024

• update readme.md with video

  richzw

  committed
  4520f7d

Commits on Feb 19, 2024

• create exercise to rewrite minbpe for learners

  karpathy

  committed
  a98e0a5

• change the handling of special tokens inside encode of RegexTokenizer, make the default behavior consistent with tiktoken, i.e. the person has to explicitly declare intent to use or not use special…

  Show description for ade909f
  karpathy

  committed
  ade909f

• refactor the readme file and adjust the API on how special tokens are handled

  karpathy

  committed
  4ccf644

• fix pytest -v, it was printing all of taylor swift text

  karpathy

  committed
  37b63c2

• meaty change: adding special tokens handling, so now we have full parity with the GPT-4 Tokenizer

  karpathy

  committed
  e82c123

Commits on Feb 18, 2024

• maintain todos

  karpathy

  committed
  9ab2500

• major refactor to make this a sensible package with nice tests etc. we almost look legitimate now

  karpathy

  committed
  ac3ca85

• simplify pytest a lot

  karpathy

  committed
  45cb371

Commits on Feb 17, 2024

• Update README.md with pytest installation instructions

  ViswanathaReddyGajjala

  authored
  c86aece

• remove educational as constraint. i think we might be able to make this repo have teeth and have some more optimized versions. but we'd keep the simple reference code

  karpathy

  committed
  3e68413

• major changes and refactoring, creating base class, joining the utility functions, and adding the save/load functionality in the base class

  karpathy

  committed
  2c521cb

• mild improve docs

  karpathy

  committed
  cc7fb34

Commits on Feb 16, 2024

• bunch of changes that just make sense

  karpathy

  committed
  43ffc2f

• add note of caution on parity

  karpathy

  committed
  1c0520f

• add gpt4 compatibility test, that was pretty hairy...

  karpathy

  committed
  dd16086

• add call for action

  karpathy

  committed
  c09ecad

• initial code

  karpathy

  committed
  579340a

Loading