Marketplace · Text & chat

llama3.1:8b

Call llama3.1:8b through one OpenAI-compatible API. It's served by 2 hosts on the Inpherio grid, each at a price it sets — your request goes to the cheapest healthy one, and fails over to the next if it's down.

From
£0.06
per 1M output tokens
£1 buys about 17 million tokens (≈ 13 million words)
Hosts
2
Loaded now
0

At a glance.

tools

  • Type: Text & chat
  • Hosts serving it now: 2 (0 with it loaded in memory)
  • Engines: ollama
  • Context window: up to 131,072 tokens
  • Rentable: a whole host from £0.60 an hour (rentals)
python · openai sdk
from openai import OpenAI
client = OpenAI(base_url="https://inpherio.co.uk/v1",
                api_key=INPHERIO_API_KEY)
reply = client.chat.completions.create(
    model="llama3.1:8b",
    messages=[{"role": "user", "content": "Hello"}],
)

llama3.1:8b in detail.

Llama 3.1 is a new state-of-the-art model from Meta available in 8B, 70B and 405B parameter sizes.

Published by
meta-llama
Parameters
8B
Download size
4.9 GB (as packaged for Ollama)
Quantisation
Q4_K_M
Format
gguf
Architecture
llama
Licence
Llama 3.1 licence · access is gated (accept the terms on Hugging Face)
Based on
meta-llama/Meta-Llama-3.1-8B
Task
text generation
Library
transformers
Languages
en, de, fr, it, pt, hi, es, th
First published
18 Jul 2024
Last updated
25 Sep 2024
Downloads (30 days)
4.3 million on Hugging Face
Likes
8,836

llama text-generation facebook meta llama-3 en de fr it pt hi es th

The model card

Published by the model's authors on Ollama — shown as they wrote it, unedited by Inpherio.

Meta Llama 3.1

Llama 3.1 family of models available:

• 8B

• 70B

• 405B

Llama 3.1 405B is the first openly available model that rivals the top AI models when it comes to state-of-the-art capabilities in general knowledge, steerability, math, tool use, and multilingual translation.

The upgraded versions of the 8B and 70B models are multilingual and have a significantly longer context length of 128K, state-of-the-art tool use, and overall stronger reasoning capabilities. This enables Meta’s latest models to support advanced use cases, such as long-form text summarization, multilingual conversational agents, and coding assistants.

Meta also has made changes to their license, allowing developers to use the outputs from Llama models, including the 405B model, to improve other models.

Model evaluations

For this release, Meta has evaluation the performance on over 150 benchmark datasets that span a wide range of languages. In addition, Meta performed extensive human evaluations that compare Llama 3.1 with competing models in real-world scenarios. Meta’s experimental evaluation suggests that our flagship model is competitive with leading foundation models across a range of tasks, including GPT-4, GPT-4o, and Claude 3.5 Sonnet. Additionally, Meta’s smaller models are competitive with closed and open models that have a similar number of parameters.

References

• Meta AI Llama 3.1 launch blog post

Sources: meta-llama/Llama-3.1-8B-Instruct on Hugging Face · llama3.1:8b on Ollama. Collected from public sources on 8 Nov 2026; the host serving it may run a different build or quantisation — the marketplace shows each host's own measurements.

Who's serving it.

Every host benchmarked this model on its own hardware before serving it. Prices are set by each host; health is scored by the platform from what it observes.

Hosts serving llama3.1:8b right now
HostTierPriceMeasured speedHealthStateRent
Lumaram-MacMini-M4-001L1£0.01 in · £0.18 out21 tok/s · 51 ms first token81loads on request—
GTX 1080 Ti (11G)L1£0.038 in · £0.06 out4 tok/s · 171 ms first token78loads on request£0.60/h

Live data, refreshed on every visit. How billing works.

Room on the grid for your machine.

2 machines serve llama3.1:8b today. Every extra host is somewhere a request can fail over to when one drops, and spare capacity when demand spikes. The router weighs price, measured speed, health and whether the model is already loaded — so a host with a sharper price or quicker hardware wins the next call.

Hosts now
2
0 loaded in memory
Price to beat
£0.06
per 1M output tokens
Fastest measured
21 tok/s

Set your own price — you keep 85% of what it earns, and new hosts start with 12 months fee-free (up to £250 of earnings). A payout fee of £2 + 1% per payout to a UK bank account, £2 + 2% to any other country applies when you're paid. Install the connector, load llama3.1:8b, and the platform benchmarks it on your hardware before your first request.