large-language-models

TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.

A fast Rust based tool to serialize text-based files in a repository or directory for LLM consumption

A git prepare-commit-msg hook for authoring commit messages with LLMs.

Highly Performant, Modular, Memory Safe and Production-ready Inference, Ingestion and Indexing built in Rust 🦀

Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llama/alpaca/gpt4all/vicuna/rwkv model.

Terminal UI to chat with large language models (LLM) using different model backends, and integrations with your favourite editors!

A linguistic linter for Traditional Chinese (zh-TW)

Govern & Secure your AI

Edge full-stack LLM platform. Written in Rust

Simple, Composable, High-Performance, Safe and Web3 Friendly AI Agents and LazAI Gateway for Everyone

A GUI made using iced and rust that allows you to talk to an Ollama AI.

The project covers various aspects, from machine learning advancements to decentralized file sharing, and aims to transform the accessibility and management of files while contributing to the progress of artificial intelligence.

LLMs done the UNIX-y way

skiLL.Md is a structured, open-source collection of reusable, self-contained markdown modules that describe how to perform specific software engineering tasks.

Desktop VLM: Real-time FastVLM analysis of video & textures with live compute shaders

Simple large language model playground app

Language Server Protocol implementation for Large Language Model integration

Local-first AI desktop app — chat, RAG, vision, and image generation powered by llama.cpp. Pair your phone as a PWA over your home Wi-Fi. Nothing leaves your machine.

A project written in the Rust language with the goal of offline load of small LLM Model, specifically RAG (Retrieval Augmented Generation) on mobile devices.

A high-performance, multi-node reinforcement-learning framework for large language models. Written in Rust. Pluggable in Python.