llama.cpp

ggml / open source · since 2023

Efficient LLM inference in C/C++

PricingFree
LevelIntermediate
CategoryML Infrastructure & LLMOps
Best forDevelopers
NoteBackbone of local-LLM ecosystem

Tags: code

Alternatives to llama.cpp

Build your personal AI stack on Toolnaut