Marketplace · Text & chat
falcon3:1b
Call falcon3:1b through one OpenAI-compatible API. It's served by 1 host on the Inpherio grid, each at a price it sets — your request goes to the cheapest healthy one, and fails over to the next if it's down.
At a glance.
from openai import OpenAI
client = OpenAI(base_url="https://inpherio.co.uk/v1",
api_key=INPHERIO_API_KEY)
reply = client.chat.completions.create(
model="falcon3:1b",
messages=[{"role": "user", "content": "Hello"}],
)falcon3:1b in detail.
A family of efficient AI models under 10B parameters performant in science, math, and coding through innovative training techniques.
- Published by
- tiiuae
- Parameters
- 1.7B
- Download size
- 1.8 GB (as packaged for Ollama)
- Quantisation
- Q8_0
- Format
- gguf
- Architecture
- llama
- Licence
- falcon-llm-license
- Based on
- tiiuae/Falcon3-1B-Base
- Task
- text generation
- Library
- transformers
- Languages
- en, fr, es, pt
- First published
- 14 Dec 2024
- Last updated
- 10 Jan 2025
- Downloads (30 days)
- 8,484 on Hugging Face
- Likes
- 46
llama text-generation falcon3 en fr es pt
The model card
Published by the model's authors on Hugging Face — shown as they wrote it, unedited by Inpherio.
Falcon3-1B-Instruct
Falcon3 family of Open Foundation Models is a set of pretrained and instruct LLMs ranging from 1B to 10B parameters.
This repository contains the Falcon3-1B-Instruct. It achieves strong results on reasoning, language understanding, instruction following, code and mathematics tasks. Falcon3-1B-Instruct supports 4 languages (English, French, Spanish, Portuguese) and a context length of up to 8K.
Model Details
- Architecture
- Transformer-based causal decoder-only architecture
- 18 decoder blocks
- Grouped Query Attention (GQA) for faster inference: 8 query heads and 4 key-value heads
- Wider head dimension: 256
- High RoPE value to support long context understanding: 1000042
- Uses SwiGLU and RMSNorm
- 8K context length
- 131K vocab size
- Pruned and healed using larger Falcon models (3B and 7B respectively) on only 80 Gigatokens of datasets comprising of web, code, STEM, high quality and multilingual data using 256 H100 GPU chips
- Posttrained on 1.2 million samples of STEM, conversational, code, safety and function call data
- Supports EN, FR, ES, PT
- Developed by Technology Innovation Institute
- License: TII Falcon-LLM License 2.0
- Model Release Date: December 2024
Getting started
Click to expand
from transformers import AutoTokenizer, AutoModelForCausalLM
model_name = "tiiuae/Falcon3-1B-Instruct"
model = AutoModelForCausalLM.from_pretrained(
model_name,
torch_dtype="auto",
device_map="auto"
)
tokenizer = AutoTokenizer.from_pretrained(model_name)
prompt = "How many hours in one day?"
messages = [
{"role": "system", "content": "You are a helpful friendly assistant Falcon3 from TII, try to follow instructions as much as possible."},
{"role": "user", "content": prompt}
]
text = tokenizer.apply_chat_template(
messages,
tokenize=False,
add_generation_prompt=True
)
model_inputs = tokenizer([text], return_tensors="pt").to(model.device)
generated_ids = model.generate(
**model_inputs,
max_new_tokens=1024
)
generated_ids = [
output_ids[len(input_ids):] for input_ids, output_ids in zip(model_inputs.input_ids, generated_ids)
]
response = tokenizer.batch_decode(generated_ids, skip_special_tokens=True)[0]
print(response)
Benchmarks
We report in the following table our internal pipeline benchmarks.
- We use lm-evaluation harness.
- We report raw scores obtained by applying chat template and fewshot_as_multiturn.
- We use same batch-size across all models.
Category Benchmark Llama-3.2-1B Qwen2.5-1.5B SmolLM2-1.7B Falcon3-1B-Instruct
General MMLU (5-shot) 68.2 59.8 49.2 46.1
MMLU-PRO (5-shot) 16 28.2 20 18.6
IFEval 55.3 44.2 53 54.4
Math GSM8K (5-shot) 82.6 57.8 47.6 43.9
GSM8K (8-shot, COT) 46.6 58.8 46.3 45.8
MATH Lvl-5 (4-shot) 5.2 1.1 3.1 1
Reasoning Arc Challenge (25-shot) 58.6 50.7 49.7 47.7
GPQA (0-shot) 24.4 29.6 28.6 26.5
GPQA (0-shot, COT) 13.2 9.2 16 21.3
MUSR (0-shot) 32 36.5 32.9 40.7
BBH (3-shot) 33.8 39.2 34 35.1
CommonSense Understanding PIQA (0-shot) 72.1 73.2 74.4 72
SciQ (0-shot) 61.8 69.5 71.4 86.8
Winogrande (0-shot) - - - 60.2
OpenbookQA (0-shot) 40.2 40.4 42.8 40
MT-Bench (avg) 5.4 7.1 6.1 5.5
Instructions following Alpaca (WC) 8.6 8.6 5.4 6.1
Read the rest of the model card
Useful links
- View our release blogpost.
- Feel free to join our discord server if you have any questions or to interact with our researchers and developers.
Technical Report
Coming soon....
Citation
If the Falcon3 family of models were helpful to your work, feel free to give us a cite.
@misc{Falcon3,
title = {The Falcon 3 Family of Open Models},
url = {https://huggingface.co/blog/falcon3},
author = {Falcon-LLM Team},
month = {December},
year = {2024}
}Sources: tiiuae/Falcon3-1B-Instruct on Hugging Face · falcon3:1b on Ollama. Collected from public sources on 14 Nov 2026; the host serving it may run a different build or quantisation — the marketplace shows each host's own measurements.
Who's serving it.
Every host benchmarked this model on its own hardware before serving it. Prices are set by each host; health is scored by the platform from what it observes.
| Host | Tier | Price | Measured speed | Health | State | Rent |
|---|---|---|---|---|---|---|
| GTX 1080 Ti (11G) | L1 | £0.03 in · £0.06 out | 24 tok/s · 69 ms first token | 78 | loads on request | £0.60/h |
Live data, refreshed on every visit. How billing works.
Room on the grid for your machine.
Right now one machine serves falcon3:1b. If it drops, so does every request for it — a second host is what turns it into failover, and the grid needs that more than another copy. The router weighs price, measured speed, health and whether the model is already loaded — so a host with a sharper price or quicker hardware wins the next call.
Set your own price — you keep 85% of what it earns, and new hosts start with 12 months fee-free (up to £250 of earnings). A payout fee of £2 + 1% per payout to a UK bank account, £2 + 2% to any other country applies when you're paid. Install the connector, load falcon3:1b, and the platform benchmarks it on your hardware before your first request.