Marketplace · Text & chat
granite3.1-moe:3b
Call granite3.1-moe:3b through one OpenAI-compatible API. It's served by 1 host on the Inpherio grid, each at a price it sets — your request goes to the cheapest healthy one, and fails over to the next if it's down.
At a glance.
tools
from openai import OpenAI
client = OpenAI(base_url="https://inpherio.co.uk/v1",
api_key=INPHERIO_API_KEY)
reply = client.chat.completions.create(
model="granite3.1-moe:3b",
messages=[{"role": "user", "content": "Hello"}],
)granite3.1-moe:3b in detail.
The IBM Granite 1B and 3B models are long-context mixture of experts (MoE) Granite models from IBM designed for low latency usage.
- Published by
- Ollama library
- Parameters
- 3.3B
- Download size
- 2.0 GB (as packaged for Ollama)
- Quantisation
- Q4_K_M
- Format
- gguf
- Architecture
- granitemoe
- Licence
- Apache
The model card
Published by the model's authors on Ollama — shown as they wrote it, unedited by Inpherio.
Granite mixture of experts models
The IBM Granite 1B and 3B models are long-context mixture of experts (MoE) Granite models from IBM designed for low latency usage.
The models are trained on over 10 trillion tokens of data, the Granite MoE models are ideal for deployment in on-device applications or situations requiring instantaneous inference.
Parameter Sizes
1B:
ollama run granite3.1-moe:1b
3B:
ollama run granite3.1-moe:3b
Supported Languages
English, German, Spanish, French, Japanese, Portuguese, Arabic, Czech, Italian, Korean, Dutch, Chinese (Simplified)
Capabilities
• Summarization
• Text classification
• Text extraction
• Question-answering
• Retrieval Augmented Generation (RAG)
• Code related tasks
• Function-calling tasks
• Multilingual dialog use cases
• Long-context tasks including long document/meeting summarization, long document QA, etc.
Granite dense models
The Granite dense models are available in 2B and 8B parameter sizes designed to support tool-based use cases and for retrieval augmented generation (RAG), streamlining code generation, translation and bug fixing.
See model page
Learn more
• Developers: IBM Research
• GitHub Repository: ibm-granite/granite-language-models
• Website: Granite Docs
• Release Date: December 18th, 2024
• License: Apache 2.0.
Sources: granite3.1-moe:3b on Ollama. Collected from public sources on 14 Nov 2026; the host serving it may run a different build or quantisation — the marketplace shows each host's own measurements.
Who's serving it.
Every host benchmarked this model on its own hardware before serving it. Prices are set by each host; health is scored by the platform from what it observes.
| Host | Tier | Price | Measured speed | Health | State | Rent |
|---|---|---|---|---|---|---|
| GTX 1080 Ti (11G) | L1 | £0.03 in · £0.06 out | 34 tok/s · 34 ms first token | 78 | loads on request | £0.60/h |
Live data, refreshed on every visit. How billing works.
Room on the grid for your machine.
Right now one machine serves granite3.1-moe:3b. If it drops, so does every request for it — a second host is what turns it into failover, and the grid needs that more than another copy. The router weighs price, measured speed, health and whether the model is already loaded — so a host with a sharper price or quicker hardware wins the next call.
Set your own price — you keep 85% of what it earns, and new hosts start with 12 months fee-free (up to £250 of earnings). A payout fee of £2 + 1% per payout to a UK bank account, £2 + 2% to any other country applies when you're paid. Install the connector, load granite3.1-moe:3b, and the platform benchmarks it on your hardware before your first request.