Skip to content

Commit

Permalink
Part of implementation of completion endpoint (#1)
Browse files Browse the repository at this point in the history
* Setup scaffold and utilities

* Start to implement non-streaming completions

* Add triton common dependency

* Succeed to compile with prost

* Succeed to compile with prost

* Setup error handling

* Finish completion endpoint

---------

Co-authored-by: npuzhangyuchao <[email protected]>
  • Loading branch information
npuichigo and npuzhangyuchao authored Nov 25, 2023
1 parent fd5f94a commit ca0a32e
Show file tree
Hide file tree
Showing 16 changed files with 3,088 additions and 0 deletions.
2 changes: 2 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
/target
.idea/
3 changes: 3 additions & 0 deletions .gitmodules
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
[submodule "triton_common"]
path = triton_common
url = https://github.com/triton-inference-server/common.git
Loading

0 comments on commit ca0a32e

Please sign in to comment.