Here are
77 public repositories
matching this topic...
A custom framework for easy use of LLMs, VLMs, etc. supporting various modes and settings via web-ui
Updated
Jun 30, 2024
Jupyter Notebook
Run AI models locally on your machine with node.js bindings for llama.cpp. Force a JSON schema on the model output on the generation level
Updated
Jun 30, 2024
TypeScript
A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.
Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.
Updated
Jun 29, 2024
Dart
Create characters in Unity with LLMs!
PowerShell automation to download large language models (LLMs) from Git repositories and quantize them with llama.cpp into the GGUF format.
Updated
Jun 28, 2024
PowerShell
Booster - open platform for serving LLM models
PowerShell automation to rebuild llama.cpp for a Windows environment.
Updated
Jun 27, 2024
PowerShell
Docker image for the Text Generation Web UI: A Gradio web UI for Large Language Models. Supports Transformers, AWQ, GPTQ, llama.cpp (GGUF), Llama models
Updated
Jun 27, 2024
Python
Updated
Jun 27, 2024
Rust
Local ML voice chat using high-end models.
Simplify and accelerate AI-powered application development with structured interfaces to models and powerful prompt execution environments.
Updated
Jun 24, 2024
JavaScript
Self-evaluating interview for AI coders
Updated
Jun 27, 2024
Python
Run AI ✨ assistant locally! with simple API for Node.js 🚀
Updated
Jun 21, 2024
TypeScript
a flutter llama.cpp chat ui
Updated
Jun 19, 2024
Metal
llama.cpp gguf file parser for javascript
Updated
Jun 18, 2024
JavaScript
workbench for learing&practising AI tech in real scenario on Android device, powered by GGML(Georgi Gerganov Machine Learning) and NCNN(Tencent NCNN) and FFmpeg
Static builds of llama.cpp (Currently only amd64 server builds are available)
Updated
Jun 14, 2024
Dockerfile
Run llama.cpp in a GPU accelerated Docker container
Updated
Jun 13, 2024
Shell
Improve this page
Add a description, image, and links to the
llama-cpp
topic page so that developers can more easily learn about it.
Curate this topic
Add this topic to your repo
To associate your repository with the
llama-cpp
topic, visit your repo's landing page and select "manage topics."
Learn more
You can’t perform that action at this time.