llama.cpp
The engine behind a lot of local AI.
New to this? What open source means and how to read this page.
What it is
A C/C++ library for running large language models efficiently on ordinary hardware, including laptops and phones.
Good for
Developers and tinkerers who want to run models locally with control.
The catch
It is a developer tool, not a friendly app. Most people are better served by a front end such as Ollama or Jan.
Facts checked on 12 October 2026. We have not yet run a hands-on test of this tool. When we do, it gets a "Tested" mark here. Approximate US list prices for an individual plan, from third-party price trackers checked on 12 Oct 2026. Monthly billing where it exists. Regions, taxes and promotions change them. Confirm at the vendor before you decide.
More in Local AI
Run AI models on your own computer.
Replaces: ChatGPT Plus
A ChatGPT-style interface for local and API models.
Replaces: ChatGPT
A desktop chat app that runs models offline.
Replaces: ChatGPT