Marketplace · Text & chat
tinyllama:1.1b
Call tinyllama:1.1b through one OpenAI-compatible API, served by independent machines at prices their owners set. There's no host for it on the grid at this moment (last live 16 Jul 2026) — so the next machine that loads it serves every request for it.
The grid is one machine short.
If your machine already runs open models, it can most likely serve tinyllama:1.1b too. Set your own price — you keep 85% of what it earns, and new hosts start with 12 months fee-free (up to £250 of earnings). A payout fee of £2 + 1% per payout to a UK bank account, £2 + 2% to any other country applies when you're paid.
- Install the connector. One command on the machine that runs your models. It dials out over an encrypted link — no ports to open. The connector
- Load
tinyllama:1.1b. It has run here on ollama; any supported engine works. The platform benchmarks it on your hardware first. - Set your price. Developers see your price beside the speed your machine measures.
- Get paid when it's called. Switch it off whenever you like. How hosting works
About tinyllama:1.1b.
- Type: Text & chat
- Size: 1.1B parameters
- Context window: up to 2,048 tokens
- Runs on: ollama
- First on the grid: 16 Jul 2026
- Hosts serving it now: 0
from openai import OpenAI
client = OpenAI(base_url="https://inpherio.co.uk/v1",
api_key=INPHERIO_API_KEY)
reply = client.chat.completions.create(
model="tinyllama:1.1b",
messages=[{"role": "user", "content": "Hello"}],
)tinyllama:1.1b in detail.
The TinyLlama project is an open endeavor to train a compact 1.1B Llama model on 3 trillion tokens.
- Published by
- TinyLlama
- Parameters
- 1.1B
- Download size
- 638 MB (as packaged for Ollama)
- Quantisation
- Q4_0
- Format
- gguf
- Architecture
- llama
- Licence
- Apache 2.0
- Task
- text generation
- Library
- transformers
- Languages
- en
- First published
- 20 Nov 2023
- Last updated
- 20 Nov 2023
- Downloads (30 days)
- 4,286 on Hugging Face
- Likes
- 118
gguf llama text-generation en
The model card
Published by the model's authors on Hugging Face — shown as they wrote it, unedited by Inpherio.
TinyLlama-1.1B
https://github.com/jzhang38/TinyLlama
The TinyLlama project aims to pretrain a 1.1B Llama model on 3 trillion tokens. With some proper optimization, we can achieve this within a span of "just" 90 days using 16 A100-40G GPUs 🚀🚀. The training has started on 2023-09-01.
We adopted exactly the same architecture and tokenizer as Llama 2. This means TinyLlama can be plugged and played in many open-source projects built upon Llama. Besides, TinyLlama is compact with only 1.1B parameters. This compactness allows it to cater to a multitude of applications demanding a restricted computation and memory footprint.
This Model
This is the chat model finetuned on top of TinyLlama/TinyLlama-1.1B-intermediate-step-955k-2T. **We follow HF's Zephyr's training recipe.** The model was " initially fine-tuned on a variant of the UltraChat dataset, which contains a diverse range of synthetic dialogues generated by ChatGPT. We then further aligned the model with 🤗 TRL's DPOTrainer on the openbmb/UltraFeedback dataset, which contain 64k prompts and model completions that are ranked by GPT-4."
How to use
You will need the transformers>=4.34 Do check the TinyLlama github page for more information.
### Install transformers from source - only needed for versions <= v4.34
### pip install git+https://github.com/huggingface/transformers.git
### pip install accelerate
import torch
from transformers import pipeline
pipe = pipeline("text-generation", model="TinyLlama/TinyLlama-1.1B-Chat-v0.6", torch_dtype=torch.bfloat16, device_map="auto")
### We use the tokenizer's chat template to format each message - see https://huggingface.co/docs/transformers/main/en/chat_templating
messages = [
{
"role": "system",
"content": "You are a friendly chatbot who always responds in the style of a pirate",
},
{"role": "user", "content": "How many helicopters can a human eat in one sitting?"},
]
prompt = pipe.tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
outputs = pipe(prompt, max_new_tokens=256, do_sample=True, temperature=0.7, top_k=50, top_p=0.95)
print(outputs[0]["generated_text"])
### <|system|>
### You are a friendly chatbot who always responds in the style of a pirate.
### <|user|>
### How many helicopters can a human eat in one sitting?
### <|assistant|>
### ...Sources: TinyLlama/TinyLlama-1.1B-Chat-v0.6 on Hugging Face · tinyllama:1.1b on Ollama. Collected from public sources on 8 Nov 2026; the host serving it may run a different build or quantisation — the marketplace shows each host's own measurements.
Live now instead.
Similar text & chat models with hosts serving them right now.
- qwen2.5:0.5b — from £0.009 per 1M output tokens · 5 hosts
- functiongemma:latest — from £0.015 per 1M output tokens · 4 hosts
- glm-ocr:latest — from £0.06 per 1M output tokens · 3 hosts
- granite4.2:3b — from £0.06 per 1M output tokens · 3 hosts
- lfm3:latest — from £0.043 per 1M output tokens · 3 hosts
- llama-guard3:1b — from £0.018 per 1M output tokens · 3 hosts
Questions about tinyllama:1.1b.
Can I use tinyllama:1.1b through an API?
Yes. Inpherio serves tinyllama:1.1b through one OpenAI-compatible API whenever a host on the grid is running it — the code on this page works unchanged. With no host right now, a call returns a "not available on any node" error and is never charged, and similar models are live on the marketplace.
How do I host tinyllama:1.1b and get paid?
Install the Inpherio connector on the machine that runs your models, load tinyllama:1.1b in a supported engine, and set a price. The platform benchmarks it on your hardware, then requests for it reach your machine. Set your own price — you keep 85% of what it earns, and new hosts start with 12 months fee-free (up to £250 of earnings). A payout fee of £2 + 1% per payout to a UK bank account, £2 + 2% to any other country applies when you're paid.
Why is tinyllama:1.1b not being served right now?
Hosts on Inpherio are independent machines that come and go. It was last live on 16 Jul 2026. When a host loads it again, this page shows live prices and measured speeds.