Commits

Branch selector

 main

User selector

wconstab

Datepicker

All time

Commit History

Commits on Jun 5, 2024

• Add 3D support

  Show description for 3bc7678
  wconstab

  committed
  3bc7678

  Copy full SHA for 3bc7678

Commits on Jun 4, 2024

• Make metrics logging work for pipeline parallelism

  Show description for 0594c04
  wconstab

  committed
  0594c04

  Copy full SHA for 0594c04

Commits on Jun 3, 2024

• Fix start/stop layer parsing

  Show description for 8badf7e
  wconstab

  committed
  8badf7e

  Copy full SHA for 8badf7e

• Make seed checkpoint creation work on CPU

  Show description for a0f82d5
  wconstab

  committed
  a0f82d5

  Copy full SHA for a0f82d5

Commits on May 24, 2024

• Add test for PP tracer frontend

  Show description for 1ceaa4e
  wconstab

  committed
  1ceaa4e

  Copy full SHA for 1ceaa4e

Commits on May 23, 2024

• Update pipelining import after change on pytorch

  Show description for c87e8bc
  wconstab

  committed
  c87e8bc

  Copy full SHA for c87e8bc

Commits on May 22, 2024

• Fix bug in PP output layer shape

  Show description for 638ec48
  wconstab

  committed
  638ec48

  Copy full SHA for 638ec48

• Make test_runner use separate logger with default INFO

  Show description for 910662c
  wconstab

  committed
  910662c

  Copy full SHA for 910662c

Commits on May 21, 2024

• Add Pipeline Parallel (and 2D PP+FSDP) support

  Show description for e7c31be
  wconstab

  committed
  e7c31be

  Copy full SHA for e7c31be

• Expose mixed_precision dtype arguments

  Show description for 3bd14ec
  wconstab

  committed
  3bd14ec

  Copy full SHA for 3bd14ec

Commits on May 17, 2024

• Make test_runner.py warn on non-empty output dir

  Show description for f2c3a11
  wconstab

  committed
  f2c3a11

  Copy full SHA for f2c3a11

• Make pip install torch quiet

  Show description for a2ace60
  wconstab

  committed
  a2ace60

  Copy full SHA for a2ace60

Commits on May 15, 2024

• Use torch generic workflow for CI

  Show description for 0973bab
  wconstab

  committed
  0973bab

  Copy full SHA for 0973bab

Commits on May 13, 2024

• Make Transformer tolerate missing layers for PP

  Show description for 7f92f45
  wconstab

  committed
  7f92f45

  Copy full SHA for 7f92f45

• Refactor freqs_cis slice to be safer for PP

  Show description for 3444c4c
  wconstab

  committed
  3444c4c

  Copy full SHA for 3444c4c

Commits on May 2, 2024

• Remove unnecessary .to() inside model forward

  Show description for 787a571
  wconstab

  committed
  787a571

  Copy full SHA for 787a571

• Add support for seed checkpoint creation for meta-init flow

  Show description for 17cda29
  wconstab

  committed
  17cda29

  Copy full SHA for 17cda29

Commits on Apr 29, 2024

• Remove unneeded torchvision/audio deps

  Show description for d442743
  wconstab

  committed
  d442743

  Copy full SHA for d442743

Commits on Apr 10, 2024

• Revert "Separate TransformerEmbedding layer (pytorch#33)"

  Show description for ecdbacc
  wconstab

  committed
  ecdbacc

  Copy full SHA for ecdbacc

Commits on Apr 5, 2024

• Factor out loss_fn to share code with pipeline par

  Show description for d8e64cc
  wconstab

  committed
  d8e64cc

  Copy full SHA for d8e64cc

• Delete grad scaler, which is unsupported/unused

  Show description for 5379282
  wconstab

  committed
  5379282

  Copy full SHA for 5379282

• Make freqs_cis a persistent buffer for pp init

  Show description for 5ac3aa6
  wconstab

  committed
  5ac3aa6

  Copy full SHA for 5ac3aa6

Commits on Mar 20, 2024

• Refactor to clean up parallelisms/__init__.py

  Show description for ae9a966
  wconstab

  committed
  ae9a966

  Copy full SHA for ae9a966

Commits on Mar 15, 2024

• Separate timeout during init and training (pytorch#149)

  Show description for a257bc3
  wconstab

  authored
  a257bc3

  Copy full SHA for a257bc3

• Shorten nccl comm timeout and enable flight recorder dumping (pytorch#103)

  Show description for 073909b
  wconstab

  authored
  073909b

  Copy full SHA for 073909b

Commits on Feb 24, 2024

• Add 4GPU unit test (pytorch#82)

  Show description for ab75dbd
  wconstab

  authored
  ab75dbd

  Copy full SHA for ab75dbd

• Whc/add linter (pytorch#81)

  Show description for bccad90
  wconstab

  authored
  bccad90

  Copy full SHA for bccad90

Commits on Feb 23, 2024

• delete the linter to see if re-adding it helps (pytorch#80)

  wconstab

  authored
  28f431f

  Copy full SHA for 28f431f

Commits on Feb 10, 2024

• Improve run_llama_train.sh args and add local-ranks-filter (pytorch#51)

  Show description for 07fbe13
  wconstab

  authored
  07fbe13

  Copy full SHA for 07fbe13

• Move to cuda unconditionally so pp-only run works (pytorch#50)

  wconstab

  authored
  9dd6ab0

  Copy full SHA for 9dd6ab0

Commits on Feb 2, 2024

• Add pytest and CI workflow from torchtune (pytorch#35)

  wconstab

  authored
  479a571

  Copy full SHA for 479a571

• Apply linter to existing files (pytorch#39)

  wconstab

  authored
  98bb155

  Copy full SHA for 98bb155

• Separate TransformerEmbedding layer (pytorch#33)

  Show description for f30202c
  wconstab

  authored
  f30202c

  Copy full SHA for f30202c

• Correct the text in the license header (pytorch#37)

  wconstab

  authored
  0021a94

  Copy full SHA for 0021a94

• Fix missing license_header.txt (pytorch#36)

  wconstab

  authored
  0a92b98

  Copy full SHA for 0a92b98

Pagination

Previous

Next