Which open AI models fit your hardware
Open-weight models are AI models you can run on your own computer. New ones appear every few weeks. Tell this page what your machine has and it shows which models run on it, how well each suits the work you want done, and about how fast it will answer. We review the list as new models appear.
Last reviewed: loading.
1. Describe your machine
Your machine: loading (select to hide or show the settings)
I have a graphics card (optional)
2. Models for your machine
Select a column heading to sort by it, and a model name for its details: who made it, release date, country, licence, what it needs and what it is best at. "Tokens per second" is how fast it types its answer; one token is about three quarters of a word. For reference, comfortable reading speed is about 5 to 8 tokens per second.
3. The whole picture at a glance
For each kind of work, the best model that runs at a practical speed at each memory size, using the processor, memory type and graphics card you chose above. "Not practical" means nothing on the list does that job well enough at that size.
| Kind of work | 8 GB | 16 GB | 32 GB | 64 GB | 128 GB |
|---|
How to read this
The speeds are estimates, not measurements. We work them out from how fast your memory can feed the model and how much of the model is used for each word. Real speeds usually land within about a factor of two of the range shown. Reading a long document before the first word appears takes longer on a processor than on a graphics card. We are testing real machines and will replace the estimates with measured figures.
The quality ratings are ours. They come from the model's size and type and from the coding and tool-use results its makers and reviewers publish. They are a starting point, not a benchmark, and the best test is always your own documents.
Office files. A model does not open a Word, Excel or PowerPoint file itself. Agent Blue reads the file and hands the model its text; agents then use tools to make changes. So the models that rate highest for Office work are the ones that follow instructions and call tools reliably.
Memory we hold back. We keep about 5 GB for the operating system and the software around the model, such as Agent Blue's own services, so a model is only shown as fitting when it fits with that left over.
Smaller than you want? Memory is the usual limit. A larger machine, or a graphics card with plenty of memory, moves you up the list. If you are not sure what to buy, we will size it for you.