Lib.rs

› Keywords #language-detection #language-recognition #model-language #openai #bot

#language-model

  1. huggingface/tokenizers-python

    💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

    GitHub 0.22.3-dev.0 #tokenize #bert #word-piece #language-model #training #byte-level #bpe #pad #state-of-the-art #py

  2. cuttle

    A large language model inference engine in Rust

    v0.1.1 #inference-engine #language-model #model-inference #tokenize #tensor #text-generation #performance-monitoring #benchmark

  3. bnf_sampler

    that uses recursive descent algorithm to ensure tokens produced by a large language model follow a Backus Naur Form schema

    v0.3.8 1.2K #language-model #bnf #token #sampler #schema #forms #recursive-descent #model-language #backus #naur

  4. kbnf

    A fast constrained decoding engine based on context free grammar

    v0.5.7 #language-model #constrained-decoding #deep-learning #guided-generation #structured

  5. lingua-english-language-model

    The English language model for Lingua, an accurate natural language detection library

    v1.2.0 104K #language-detection #language-model #language-recognition

  6. lingua-punjabi-language-model

    The Punjabi language model for Lingua, an accurate natural language detection library

    v1.2.0 129K #language-model #language-detection #language-recognition

  7. lingua-somali-language-model

    The Somali language model for Lingua, an accurate natural language detection library

    v1.2.0 129K #language-detection #language-model #language-recognition

  8. lingua-italian-language-model

    The Italian language model for Lingua, an accurate natural language detection library

    v1.2.0 94K #language-detection #language-model #language-recognition

  9. lingua-ukrainian-language-model

    The Ukrainian language model for Lingua, an accurate natural language detection library

    v1.2.0 93K #language-model #language-detection #language-recognition

  10. lingua-russian-language-model

    The Russian language model for Lingua, an accurate natural language detection library

    v1.2.0 76K #language-model #language-detection #language-recognition

  11. lingua-swahili-language-model

    The Swahili language model for Lingua, an accurate natural language detection library

    v1.2.0 89K #language-model #language-detection #language-recognition

  12. lingua-polish-language-model

    The Polish language model for Lingua, an accurate natural language detection library

    v1.2.0 76K #language-detection #language-model #language-recognition

  13. lingua-dutch-language-model

    The Dutch language model for Lingua, an accurate natural language detection library

    v1.2.0 76K #language-model #language-detection #language-recognition

  14. lingua-chinese-language-model

    The Chinese language model for Lingua, an accurate natural language detection library

    v1.2.0 61K #language-detection #language-model #language-recognition

  15. lingua-macedonian-language-model

    The Macedonian language model for Lingua, an accurate natural language detection library

    v1.2.0 89K #language-detection #language-model #language-recognition

  16. lingua-bulgarian-language-model

    The Bulgarian language model for Lingua, an accurate natural language detection library

    v1.2.0 89K #language-model #language-recognition #language-detection #nlp

  17. lingua-georgian-language-model

    The Georgian language model for Lingua, an accurate natural language detection library

    v1.2.0 89K #language-detection #language-model #language-recognition

  18. lingua-bokmal-language-model

    The Bokmal language model for Lingua, an accurate natural language detection library

    v1.2.0 73K #language-model #language-detection #language-recognition

  19. lingua-finnish-language-model

    The Finnish language model for Lingua, an accurate natural language detection library

    v1.2.0 73K #language-detection #language-model #language-recognition

  20. lingua-urdu-language-model

    The Urdu language model for Lingua, an accurate natural language detection library

    v1.2.0 73K #language-detection #language-model #language-recognition

  21. lingua-nynorsk-language-model

    The Nynorsk language model for Lingua, an accurate natural language detection library

    v1.2.0 74K #language-model #language-detection #language-recognition

  22. lingua-korean-language-model

    The Korean language model for Lingua, an accurate natural language detection library

    v1.2.0 60K #language-model #language-detection #language-recognition

  23. lingua-estonian-language-model

    The Estonian language model for Lingua, an accurate natural language detection library

    v1.2.0 73K #language-detection #language-model #language-recognition

  24. lingua-bengali-language-model

    The Bengali language model for Lingua, an accurate natural language detection library

    v1.2.0 73K #language-detection #language-model #language-recognition

  25. lingua-azerbaijani-language-model

    The Azerbaijani language model for Lingua, an accurate natural language detection library

    v1.2.0 74K #language-detection #language-model #language-recognition

  26. lingua-esperanto-language-model

    The Esperanto language model for Lingua, an accurate natural language detection library

    v1.2.0 74K #language-model #language-detection #language-recognition

  27. lingua-tsonga-language-model

    The Tsonga language model for Lingua, an accurate natural language detection library

    v1.2.0 74K #language-model #language-detection #language-recognition

  28. lingua-basque-language-model

    The Basque language model for Lingua, an accurate natural language detection library

    v1.2.0 74K #language-detection #language-model #language-recognition

  29. lingua-greek-language-model

    The Modern Greek language model for Lingua, an accurate natural language detection library

    v1.2.0 59K #language-model #language-detection #language-recognition

  30. lingua-spanish-language-model

    The Spanish language model for Lingua, an accurate natural language detection library

    v1.2.0 45K #language-detection #language-model #language-recognition

  31. n_gram

    training n-gram language models

    v0.1.12 700 #language-model #ngrams #lm #simple

  32. burn_dragon_core

    burn dragon core model and utilities

    v0.4.0 #language-model #burn #bdh #machine-learning #bio

  33. oneiros

    A sqlite-based cognition kit for long-term agent language models

    v0.0.5 #language-model #sqlite #agent #long-term #cognition #thought #introspect #dream #personas

  34. langsan

    sanitizing language model input and output

    v0.0.10 380 #language-model #language #sanitization

  35. oak-uml

    Unified Modeling Language (UML) semantic model for Oak

    v0.0.3 #language-model #modeling-language #uml #oak #semantic

  36. prompts-cli

    A CLI for managing prompts for large language models

    v0.1.19 360 #prompt #language-model #cli-prompt #command-prompt #delete #llm

  37. sapiens

    Core - Sapiens

    v0.10.2 #language-model #bot

  38. interaction-calculus

    A parallel model of computation

    v0.2.4 #lambda-calculus #language-model #computation #interaction #concurrency #model-of-computation #linear-model #higher-order-functions #language-and-model

  39. llmvm-backend-util

    functions for llmvm backends

    v0.1.1 #back-ends #llmvm #language-model #applications #prompt #text-generation

  40. langram_train

    Langram train models

    v0.11.1 #langram #language-model #train #detect #language-detection #nlp

  41. adk

    ADK(Agent Development Kit)

    v0.2.1 #agent #kit #context #language-model #artificial-intelligence #state-management

  42. myself

    building conversational agents powered by OpenAI's language model, providing a simple Agent abstraction to manage interactions and memory

    v0.5.0 #artificial-intelligence #language-model #agent #agent-builder #abstraction #openai #conversational #sql #database #gpt-3

  43. tongrams

    Tons of N-grams

    v0.1.4 #ngrams #language-model #trie #compression

  44. cld3

    Rust binding for Compact Language Detector v3 (CLD3), a neural network model for language identification. the C++ code is from https://github.com/google/cld3

    v0.1.1 #language-model #github #detector #neural-network #bindings #language-detection #model-language

  45. abstract-calculus

    A programming language and model of computation that matches the abstract algorithm perfectly

    v0.1.5 #lambda-calculus #language-model #algorithm #computation #model-of-computation #language-and-model #constant-time-operations

  46. cairo-lang-semantic

    Cairo semantic model

    v2.16.0-rc.0 77K #query #language-model #cairo #stark-net #resolution #zero-knowledge-proofs

  47. sapiens_tools

    The tools - Sapiens

    v0.10.2 #sapiens #language-model #bot

  48. openai-tribe-rs

    APIs for sampling from and fine-tuning language models

    v1.1.0 #language-model #openai #fine-tuning #query #search #fine-tune #delete-file #file-upload #completion-request #fine-tunes

  49. burn_dragon_hatchling

    burn (baby) dragon hatchling inference and training

    v0.2.0 #language-model #burn #bdh #machine-learning #bio

  50. sapiens_exp

    Experiments - Sapiens

    v0.8.2 #language-model #bot #model-language

  51. symmetric-interaction-calculus

    A programming language and model of computation that matches the abstract algorithm perfectly

    v0.1.8 #lambda-calculus #language-model #computation #model-of-computation #algorithm #language-and-model

  52. llama_cpp_sys

    Automatically-generated bindings to llama.cpp's C API

    v0.3.2 1.4K #llama #path #language-model #llm #user-friendly #llama-model #model-context #ml

  53. openai-lib

    APIs for sampling from and fine-tuning language models

    v0.1.0 #openai #language-model #openapi-generator #fine-tuning #search #delete-file #fine-tune #chat-completion #file-upload #completion-request

  54. llmvm-util

    functions for llmvm

    v0.1.1 #language-model #llmvm #applications #text-generation #prompt #model-language

  55. tokengrams

    Compute n-gram statistics and model language over pre-tokenized text corpora used to train large language models

    v0.3.0 #ngrams #language-model #suffix-array #array-index #compute #statistics #python-bindings #corpora #model-language

  56. sapiens_cli

    The cli - Sapiens

    v0.9.2 #language-model #bot #model-language

  57. pddl-ish-parser

    parsing a relaxed version of the Planning Domain Definition Language (PDDL), designed to handle PDDL-like inputs generated by autoregressive language models like ChatGPT

    v0.0.4 #language-model #definition-language #chatgpt #define #domain #structured-text #pddl #autoregressive #parser-context

  58. rl_model-rs

    'Robot Language' parser and rust model

    v0.2.2 500 #language-parser #robot #language-model

  59. sapiens_bot

    The discord bot - Sapiens

    v0.8.1 #discord-bot #language-model #bot

  60. gemini-live-api

    interact with the Gemini live API

    v0.1.1 #gemini #language-model #schema-generation #real-time #response #json-schema #state-management #websocket #function-calling #google-gemini

  61. rml-core

    N-gram language model implementation in Rust

    v0.1.0 #language-model #nlp #text-generation #machine-learning

  62. burn_hatchling

    burn (baby) dragon hatchling inference and training

    v0.1.0 #language-model #burn #machine-learning #bdh #bio

  63. burn_bdh

    burn baby dragon hatchling inference and training

    v0.1.0 #language-model #bdh #burn #machine-learning #bio

  64. ai_functions

    Procedural macro for creating text from a function for use in Large Language Models

    v0.1.1 600 #artificial-intelligence #language-model #proc-macro #ai-function #string

    65. Try searching with DuckDuckGo.

  65. ai_client

    interacting with AI language model APIs

    v0.1.1 #artificial-intelligence #openai #language-model #api-client #chat-completion #metrics #grok #anthropic #llm #lru-cache

  66. aionic

    unified, user-friendly Rust library for seamless integration with various public Language Model APIs, such as openAI

    v0.1.7 #chatgpt #language-model #language-integration #seamless-integration #model-language #openai-api #ai-model #llama #sense #bard

  67. answer

    any question right from your terminal, using the same large language model that powers ChatGPT

    v0.0.1-beta.1 #language-model #chat-bot #power #questions #model-language #openai #building-block

  68. skootrs-model

    module contains the various data structures used by the other Skootrs modules. This is also setup to make it easy to generate schemas from this code for the purposes of easily implementing…

    v0.1.0 #serialization #skootrs #schema #api-client #language-model #data-model #generate-schema

  69. sentinellm_ai

    A custom version for tch 1.18.1 of rust-bert for my personal project

    v0.1.0 #language-model #transformer-models #project

  70. gpt-model

    Pure-Rust inference wrapper for GPT-2 large language models

    v0.1.0 #onnx #gpt-2 #encoder #language-model #vocabulary #byte-pair #openai

  71. minbpe

    Port of Andrej Karpathy's minbpe to Rust

    v0.1.0 #language-model #gpt #codec

  72. scie_model

    Scie is a research about how to build simple code identify engine for different languages

    v0.1.0 #scie #language-model #grammar #build #engine #identifying

  73. ai_function

    Procedural Macro for creating text from a function to use in Large language Models

    v0.1.0 #proc-macro #language-model #text

  74. tool_macro

    Procedural macros for transformers crate

    v0.1.2 #transformer #language-model #python #pipeline #proc-macro #candle #language-interface #text-generation #structured-output #hugging-face

  75. lm-proxy

    A proxy for (large) language models

    v0.1.0 #language-model #proxy #keep-alive #proxy-server #config #openai #model-server #config-toml

  76. sapiens_derive

    The macro - a simple bot to conquer the world

    v0.4.4 #bot #language-model

  77. carton

    Run any ML model from any programming language

    v0.0.1 #language-model #ml-model #interface-model #run #programming-language

  78. mia

    A model inference framework

    v0.0.1 #language-model #deep-learning #language

  79. smart-llamas

    A minimal framework for developing Large Language Models that are able to use tools when appropriate

    v0.0.1 #language-model #framework-development #able

  80. mia-derive

    A model inference framework

    v0.0.1 #language-model #deep-learning #language #model