Marketplace · Text & chat
llama3.1:8b
Call llama3.1:8b through one OpenAI-compatible API. It's served by 2 hosts on the Inpherio grid, each at a price it sets — your request goes to the cheapest healthy one, and fails over to the next if it's down.
At a glance.
tools
from openai import OpenAI
client = OpenAI(base_url="https://inpherio.co.uk/v1",
api_key=INPHERIO_API_KEY)
reply = client.chat.completions.create(
model="llama3.1:8b",
messages=[{"role": "user", "content": "Hello"}],
)llama3.1:8b in detail.
Llama 3.1 is a new state-of-the-art model from Meta available in 8B, 70B and 405B parameter sizes.
- Published by
- meta-llama
- Parameters
- 8B
- Download size
- 4.9 GB (as packaged for Ollama)
- Quantisation
- Q4_K_M
- Format
- gguf
- Architecture
- llama
- Licence
- Llama 3.1 licence · access is gated (accept the terms on Hugging Face)
- Based on
- meta-llama/Meta-Llama-3.1-8B
- Task
- text generation
- Library
- transformers
- Languages
- en, de, fr, it, pt, hi, es, th
- First published
- 18 Jul 2024
- Last updated
- 25 Sep 2024
- Downloads (30 days)
- 4.3 million on Hugging Face
- Likes
- 8,836
llama text-generation facebook meta llama-3 en de fr it pt hi es th
The model card
Published by the model's authors on Ollama — shown as they wrote it, unedited by Inpherio.
Meta Llama 3.1
Llama 3.1 family of models available:
• 8B
• 70B
• 405B
Llama 3.1 405B is the first openly available model that rivals the top AI models when it comes to state-of-the-art capabilities in general knowledge, steerability, math, tool use, and multilingual translation.
The upgraded versions of the 8B and 70B models are multilingual and have a significantly longer context length of 128K, state-of-the-art tool use, and overall stronger reasoning capabilities. This enables Meta’s latest models to support advanced use cases, such as long-form text summarization, multilingual conversational agents, and coding assistants.
Meta also has made changes to their license, allowing developers to use the outputs from Llama models, including the 405B model, to improve other models.
Model evaluations
For this release, Meta has evaluation the performance on over 150 benchmark datasets that span a wide range of languages. In addition, Meta performed extensive human evaluations that compare Llama 3.1 with competing models in real-world scenarios. Meta’s experimental evaluation suggests that our flagship model is competitive with leading foundation models across a range of tasks, including GPT-4, GPT-4o, and Claude 3.5 Sonnet. Additionally, Meta’s smaller models are competitive with closed and open models that have a similar number of parameters.
References
• Meta AI Llama 3.1 launch blog post
Sources: meta-llama/Llama-3.1-8B-Instruct on Hugging Face · llama3.1:8b on Ollama. Collected from public sources on 8 Nov 2026; the host serving it may run a different build or quantisation — the marketplace shows each host's own measurements.
Who's serving it.
Every host benchmarked this model on its own hardware before serving it. Prices are set by each host; health is scored by the platform from what it observes.
| Host | Tier | Price | Measured speed | Health | State | Rent |
|---|---|---|---|---|---|---|
| Lumaram-MacMini-M4-001 | L1 | £0.01 in · £0.18 out | 21 tok/s · 51 ms first token | 81 | loads on request | — |
| GTX 1080 Ti (11G) | L1 | £0.038 in · £0.06 out | 4 tok/s · 171 ms first token | 78 | loads on request | £0.60/h |
Live data, refreshed on every visit. How billing works.
Room on the grid for your machine.
2 machines serve llama3.1:8b today. Every extra host is somewhere a request can fail over to when one drops, and spare capacity when demand spikes. The router weighs price, measured speed, health and whether the model is already loaded — so a host with a sharper price or quicker hardware wins the next call.
Set your own price — you keep 85% of what it earns, and new hosts start with 12 months fee-free (up to £250 of earnings). A payout fee of £2 + 1% per payout to a UK bank account, £2 + 2% to any other country applies when you're paid. Install the connector, load llama3.1:8b, and the platform benchmarks it on your hardware before your first request.