Skip to content

npuichigo/openai_trtllm

BranchesTags

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit
README.md
README.md
 
 

Repository files navigation

openai_trtllm

About

OpenAI compatible API for TensorRT LLM triton backend

Topics

triton-inference-server openai-api llm langchain tensorrt-llm

Resources

Readme

License

MIT license
Activity

Stars

188 stars

Watchers

8 watching

Forks

27 forks
Report repository

Releases 2

0.2.1 Latest
Mar 20, 2024
+ 1 release

Packages

No packages published

Contributors 5

Languages