Commits

Branch selector

 master

User selector

lucidrains

Datepicker

All time

Commit History

Commits on Jan 10, 2025

• 1.21.2

  lucidrains

  authored
  59a30b6

  Copy full SHA for 59a30b6

• Merge pull request lucidrains#186 from lucasnewman/fsq-noise-dropout

  Show description for 4f0fc17
  lucidrains

  authored
  4f0fc17

  Copy full SHA for 4f0fc17

Commits on Jan 7, 2025

• do not do straight through nor rotation trick if input does not require grad, to make Genie2 cleaner

  lucidrains

  committed
  fa2211d

  Copy full SHA for fa2211d

Commits on Jan 3, 2025

• always practice good credit assignment

  lucidrains

  committed
  c243e83

  Copy full SHA for c243e83

• release the additional research findings for FSQ, out of stability ai, added by @lucasnewman

  lucidrains

  committed
  19f87e3

  Copy full SHA for 19f87e3

• Merge pull request lucidrains#185 from lucasnewman/fsq_preserve_symmetry

  Show description for e2abbe5
  lucidrains

  authored
  e2abbe5

  Copy full SHA for e2abbe5

Commits on Dec 3, 2024

• 1.20.11

  lucidrains

  committed
  8c27a0e

  Copy full SHA for 8c27a0e

• bring back the other half of the commit loss even in the presence of rotation trick, addressing lucidrains#177

  lucidrains

  committed
  3aa6867

  Copy full SHA for 3aa6867

Commits on Nov 28, 2024

• also run tests on pr

  lucidrains

  committed
  7be8916

  Copy full SHA for 7be8916

• 1.20.10

  lucidrains

  committed
  915f3fc

  Copy full SHA for 915f3fc

• Merge pull request lucidrains#176 from EmmettBicker/master

  Show description for b48946f
  lucidrains

  authored
  b48946f

  Copy full SHA for b48946f

Commits on Nov 19, 2024

• update

  lucidrains

  authored
  76ec1de

  Copy full SHA for 76ec1de

Commits on Nov 13, 2024

• fix sim vq autoencoder example

  lucidrains

  committed
  3e4ce16

  Copy full SHA for 3e4ce16

• allow for arbitrary dimensions into SimVQ and ResidualSimVQ (video and beyond)

  lucidrains

  committed
  d92c330

  Copy full SHA for d92c330

Commits on Nov 12, 2024

• document the new SimVQ and ResidualSimVQ

  Show description for 448c4a5
  lucidrains

  committed
  448c4a5

  Copy full SHA for 448c4a5

• add ResidualSimVQ to the special Sequential module

  lucidrains

  committed
  f883a07

  Copy full SHA for f883a07

• complete residual sim vq

  lucidrains

  committed
  81d0f3b

  Copy full SHA for 81d0f3b

Commits on Nov 11, 2024

• more efficient to select out the frozen codes and then do projection in indices_to_codes for SimVQ

  lucidrains

  committed
  8f5b428

  Copy full SHA for 8f5b428

• add .indices_to_codes for SimVQ

  lucidrains

  committed
  a0e8f2c

  Copy full SHA for a0e8f2c

• seems to work even better with a one layer mlp

  lucidrains

  committed
  3bb00f5

  Copy full SHA for 3bb00f5

• cleanup

  lucidrains

  committed
  949b0ba

  Copy full SHA for 949b0ba

• allow for an MLP implicitly parameterized codebook instead of just a single Linear, for SimVQ. seems to converge just fine with rotation trick

  lucidrains

  committed
  80f4e84

  Copy full SHA for 80f4e84

• still need comit loss from quantize to input to optimize linear projection in SimVQ, best combination is rotation trick without straight though and without commit loss from input to quantize

  lucidrains

  committed
  cd0fa8e

  Copy full SHA for cd0fa8e

• Merge pull request lucidrains#172 from lucidrains/simvq

  Show description for 72ede73
  lucidrains

  authored
  72ede73

  Copy full SHA for 72ede73

• add SimVQ with or without rotation trick https://arxiv.org/abs/2411.02038

  lucidrains

  committed
  97b9a87

  Copy full SHA for 97b9a87

• fix commit loss

  lucidrains

  committed
  01b45eb

  Copy full SHA for 01b45eb

• uncomment st

  lucidrains

  committed
  e11a966

  Copy full SHA for e11a966

• update init

  lucidrains

  committed
  007209d

  Copy full SHA for 007209d

• simvq

  lucidrains

  committed
  7959292

  Copy full SHA for 7959292

Commits on Nov 8, 2024

• move the rotation operation from rotation trick to a function for potential reuse for other research

  lucidrains

  committed
  723ea9f

  Copy full SHA for 723ea9f

• take care of a small pain point

  lucidrains

  committed
  e7ff7d7

  Copy full SHA for e7ff7d7

• only sync seed during training

  lucidrains

  committed
  35c4c84

  Copy full SHA for 35c4c84

• address lucidrains#171

  lucidrains

  committed
  cd35a68

  Copy full SHA for cd35a68

Commits on Nov 7, 2024

• misread

  lucidrains

  committed
  8cbdfb4

  Copy full SHA for 8cbdfb4

• add compatibility for the residual VQ proposed in TIGER https://arxiv.org/abs/2305.05065, for building recommendation systems

  lucidrains

  committed
  caf11b7

  Copy full SHA for caf11b7

Pagination

Previous

Next