Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Aug 1, 2024

• Fix dynamic length of stop words. (#50) (#51)

  Raphael-Jin

  authored
  bfe9ae2

  Copy full SHA for bfe9ae2

Commits on Jul 31, 2024

• Add API Key configuration option for authorization (#49)

  sampritipanda

  authored
  136193f

  Copy full SHA for 136193f

Commits on Apr 26, 2024

• Switch to use NGC official docker (#42)

  npuichigo

  authored
  1de8199

  Copy full SHA for 1de8199

• Refine README to include recent changes (#41)

  Show description for 2e694a7
  npuichigo

  authored
  2e694a7

  Copy full SHA for 2e694a7

• Clarify README history-template and add llama3 chat template (#40)

  Show description for 57849ed
  Vokturz

  authored
  57849ed

  Copy full SHA for 57849ed

Commits on Mar 26, 2024

• Use docstring instead of help (#34)

  npuichigo

  authored
  8ddb719

  Copy full SHA for 8ddb719

• Update README.md (#33)

  npuichigo

  authored
  0fcc932

  Copy full SHA for 0fcc932

• Refine help string and document (#32)

  Show description for 8729f4d
  npuichigo

  authored
  8729f4d

  Copy full SHA for 8729f4d

Commits on Mar 20, 2024

• Rich debug info (#29)

  npuichigo

  authored
  8e33ce1

  Copy full SHA for 8e33ce1

Commits on Mar 14, 2024

• Fix baichuan template (#28)

  npuichigo

  authored
  fc37fbb

  Copy full SHA for fc37fbb

• Add history template for baichuan (#27)

  npuichigo

  authored
  89f8a24

  Copy full SHA for 89f8a24

• feat: added functionality to customize prompt (#26)

  pdylanross

  authored
  e29c2a1

  Copy full SHA for e29c2a1

Commits on Mar 12, 2024

• Propagate opentelemetry context to triton inference server for better tracing (#25)

  Show description for 2ec5869
  npuichigo

  authored
  2ec5869

  Copy full SHA for 2ec5869

Commits on Mar 11, 2024

• Remove unnecessary code in TensorRT LLM 0.8.0 (#24)

  npuichigo

  authored
  2bf028a

  Copy full SHA for 2bf028a

Commits on Jan 22, 2024

• Update telemetry.rs (#22)

  npuichigo

  authored
  5b4843d

  Copy full SHA for 5b4843d

Commits on Jan 21, 2024

• Update README.md (#21)

  npuichigo

  authored
  c6df9e4

  Copy full SHA for c6df9e4

• Update to use axum 0.7 and enhance telemetry (#20)

  npuichigo

  authored
  dcc64a4

  Copy full SHA for dcc64a4

Commits on Jan 20, 2024

• Update startup.rs (#19)

  npuichigo

  authored
  b0d031c

  Copy full SHA for b0d031c

Commits on Dec 14, 2023

• Add LICENSE (#17)

  npuichigo

  authored
  6cf2a27

  Copy full SHA for 6cf2a27

Commits on Dec 11, 2023

• Fix triton server launching (#15)

  npuichigo

  authored
  38750af

  Copy full SHA for 38750af

Commits on Dec 10, 2023

• Make it LangChain compatible (#14)

  npuichigo

  authored
  3d9cda3

  Copy full SHA for 3d9cda3

Commits on Dec 7, 2023

• Add more openai compatible parameters (#13)

  Show description for 60cfa2f
  

  npuichigo

  and

  npuzhangyuchao

  authored
  60cfa2f

  Copy full SHA for 60cfa2f

• Add a demo gif in README (#12)

  Show description for 6bba496
  

  npuichigo

  and

  npuzhangyuchao

  authored
  6bba496

  Copy full SHA for 6bba496

• Fix git lfs (#11)

  Show description for fb04401
  

  npuichigo

  and

  npuzhangyuchao

  authored
  fb04401

  Copy full SHA for fb04401

• Disable git lfs and make it simple (#9)

  Show description for cf8e308
  

  npuichigo

  and

  npuzhangyuchao

  authored
  cf8e308

  Copy full SHA for cf8e308

• Add tutorial and example (#7)

  Show description for 46f443d
  

  npuichigo

  and

  npuzhangyuchao

  authored
  46f443d

  Copy full SHA for 46f443d

Commits on Dec 6, 2023

• Add docker build (#6)

  Show description for 69c9071
  

  npuichigo

  and

  npuzhangyuchao

  authored
  69c9071

  Copy full SHA for 69c9071

• Fix trim of partial result of streaming (#5)

  Show description for 6b50d56
  

  npuichigo

  and

  npuzhangyuchao

  authored
  6b50d56

  Copy full SHA for 6b50d56

Commits on Dec 5, 2023

• Implement chat completion (#4)

  Show description for c196362
  

  npuichigo

  and

  npuzhangyuchao

  authored
  c196362

  Copy full SHA for c196362

Commits on Nov 29, 2023

• Implement SSE streaming for completion (#3)

  Show description for faa6105
  

  npuichigo

  and

  npuzhangyuchao

  authored
  faa6105

  Copy full SHA for faa6105

Commits on Nov 27, 2023

• Refactor triton request with builder pattern (#2)

  Show description for 51c3b8b
  

  npuichigo

  and

  npuzhangyuchao

  authored
  51c3b8b

  Copy full SHA for 51c3b8b

Commits on Nov 25, 2023

• Part of implementation of completion endpoint (#1)

  Show description for ca0a32e
  

  npuichigo

  and

  npuzhangyuchao

  authored
  ca0a32e

  Copy full SHA for ca0a32e

Commits on Nov 6, 2023

• first commit

  npuichigo

  committed
  fd5f94a

  Copy full SHA for fd5f94a