Llama.cpp | npm.io

Control what LLMs can, and can't, say

llm llama.cpp transformers.js llamafile llamacpp transformersjs gbnf grammar

0.0.19 • Published 2 years ago

<a href="https://www.npmjs.com/package/contort"><img alt="Latest Contortionist NPM Version" src="https://badge.fury.io/js/contort.svg" /></a> <a href="https://github.com/thekevinscott/contortionist/blob/master/LICENSE"><img alt="License for contortionist"

llm llama.cpp transformers.js llamafile llamacpp transformersjs gbnf grammar

0.0.8 • Published 2 years ago

Libraries and server to build AI applications. Adapters to various native bindings allowing local inference. Integrate it with your application, or use as a microservice.

local ai inference server model pool gpt4all node-llama-cpp transformers.js llama.cpp chatbot bot llm

1.0.0-beta.31 • Published 11 months ago

llama.cpp gguf file parser for javascript

llama llama.cpp llama-cpp llamacpp llm gguf parser machine learning ml

0.2.2 • Published 2 years ago

serve websocket GGML 4/5bit Quantized LLM's based on Meta's LLaMa model with llama.ccp

llm wrapper huggingface javascript llama.cpp socket.io dalai quantized cpu text

0.1.0 • Published 3 years ago

Node.js bindings for LlamaCPP, a C++ library for running language models.

node language-model c++cpp node-addon-api cmake cmake-js llama llama.cpp 3.1

1.2.0 • Published 1 year ago

use `npm i --save llama.native.js` to run lama.cpp models on your local machine. features a socket.io server and client that can do inference with the host of the model.

llm wrapper huggingface javascript llama.cpp socket.io dalai quantized cpu text

1.1.0 • Published 3 years ago

React Native binding of llama.cpp

react-native ios android large language model LLM Local LLM llama.cpp llama llama-2

0.5.6 • Published 11 months ago

Libraries and server to build AI applications. Adapters to various native bindings allowing local inference. Integrate it with your application, or use as a microservice.

local ai inference server model pool gpt4all node-llama-cpp transformers.js llama.cpp chatbot bot llm

1.0.0-beta.19 • Published 1 year ago

Run AI models locally on your machine with node.js bindings for llama.cpp. Force a JSON schema on the model output on the generation level

llama llama-cpp llama.cpp bindings ai cmake cmake-js prebuilt-binaries llm gguf

0.1.0 • Published 1 year ago

Fork of llama.rn for ChatterUI

react-native ios android large language model LLM Local LLM llama.cpp llama llama-2

1.4.6 • Published 11 months ago

A library for generating syntactically valid code from an LLM.

llm code-generation sql json llama.cpp transformers.js llamafile gbnf grammar

0.0.12 • Published 2 years ago

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level