Marketplace · Text & chat
falcon3:7b
Call falcon3:7b through one OpenAI-compatible API. It's served by 1 host on the Inpherio grid, each at a price it sets — your request goes to the cheapest healthy one, and fails over to the next if it's down.
At a glance.
from openai import OpenAI
client = OpenAI(base_url="https://inpherio.co.uk/v1",
api_key=INPHERIO_API_KEY)
reply = client.chat.completions.create(
model="falcon3:7b",
messages=[{"role": "user", "content": "Hello"}],
)falcon3:7b in detail.
A family of efficient AI models under 10B parameters performant in science, math, and coding through innovative training techniques.
- Published by
- tiiuae
- Parameters
- 7.5B
- Download size
- 4.6 GB (as packaged for Ollama)
- Quantisation
- Q4_K_M
- Format
- gguf
- Architecture
- llama
- Licence
- falcon-llm-license
- Based on
- tiiuae/Falcon3-7B-Base
- Task
- text generation
- Library
- transformers
- Languages
- en, fr, es, pt
- First published
- 29 Nov 2024
- Last updated
- 31 May 2025
- Downloads (30 days)
- 10,760 on Hugging Face
- Likes
- 80
llama text-generation falcon3 en fr es pt
The model card
Published by the model's authors on Hugging Face — shown as they wrote it, unedited by Inpherio.
Falcon3-7B-Instruct
Falcon3 family of Open Foundation Models is a set of pretrained and instruct LLMs ranging from 1B to 10B.
This repository contains the Falcon3-7B-Instruct. It achieves state of art results (at the time of release) on reasoning, language understanding, instruction following, code and mathematics tasks. Falcon3-7B-Instruct supports 4 languages (english, french, spanish, portuguese) and a context length up to 32K.
Model Details
- Architecture
- Transformer based causal decoder only architecture
- 28 decoder blocks
- Grouped query attention (GQA) for faster inference: 12 query heads and 4 key value heads
- Wider head dimension: 256
- High RoPE value to support long context understanding: 1000042
- Uses SwiGLU and RMSNorm
- 32K context length
- 131K vocab size
- Pretrained on 14 Teratokens of datasets comprising of web, code, STEM, high quality and mutlilingual data using 1024 H100 GPU chips
- Postrained on 1.2 million samples of STEM, conversations, code, safety and function call data
- Supports EN, FR, ES, PT
- Developed by Technology Innovation Institute
- License: TII Falcon-LLM License 2.0
- Model Release Date: December 2024
Getting started
Click to expand
from transformers import AutoModelForCausalLM, AutoTokenizer
model_name = "tiiuae/Falcon3-7B-Instruct"
model = AutoModelForCausalLM.from_pretrained(
model_name,
torch_dtype="auto",
device_map="auto"
)
tokenizer = AutoTokenizer.from_pretrained(model_name)
prompt = "How many hours in one day?"
messages = [
{"role": "system", "content": "You are a helpful friendly assistant Falcon3 from TII, try to follow instructions as much as possible."},
{"role": "user", "content": prompt}
]
text = tokenizer.apply_chat_template(
messages,
tokenize=False,
add_generation_prompt=True
)
model_inputs = tokenizer([text], return_tensors="pt").to(model.device)
generated_ids = model.generate(
**model_inputs,
max_new_tokens=1024
)
generated_ids = [
output_ids[len(input_ids):] for input_ids, output_ids in zip(model_inputs.input_ids, generated_ids)
]
response = tokenizer.batch_decode(generated_ids, skip_special_tokens=True)[0]
print(response)
Benchmarks
We report the official HuggingFace leaderboard normalized evaluations Open LLM Leaderboard Evaluation Results in the following table.
Benchmark Llama-3.1-8B-Instruct Qwen2.5-7B-Instruct Falcon3-7B-Instruct
IFEval 78.56 75.85 76.12
BBH (3-shot) 29.89 34.89 37.92
MATH Lvl-5 (4-shot) 19.34 0.00 31.87
GPQA (0-shot) 2.35 5.48 8.05
MUSR (0-shot) 8.41 8.45 21.17
MMLU-PRO (5-shot) 30.68 36.52 34.30
Also, we report in the following table our internal pipeline benchmarks.
- We use lm-evaluation harness.
- We report raw scores obtained by applying chat template and fewshot_as_multiturn.
- We use same batch-size across all models.
Category Benchmark Llama-3.1-8B-Instruct Qwen2.5-7B-Instruct Falcon3-7B-Instruct
General MMLU (5-shot) 68.2 73.5 70.5
MMLU-PRO (5-shot) 36.4 43.1 40.7
IFEval 78.8 74.7 76.5
Math GSM8K (5-shot) 82.6 72.0 81.4
GSM8K (8-shot, COT) 85.4 76.6 79.7
MATH Lvl-5 (4-shot) 15.4 - 29.4
Reasoning Arc Challenge (25-shot) 58.6 57.8 62.6
GPQA (0-shot) 33.5 32 31.9
GPQA (0-shot, COT) 9.6 13.8 22.3
MUSR (0-shot) 38.6 41 46.4
BBH (3-shot) 48.6 54.1 52.4
CommonSense Understanding PIQA (0-shot) 78.9 73.7 78.8
SciQ (0-shot) 80.2 50.9 94.7
Winogrande (0-shot) - - 70.4
OpenbookQA (0-shot) 46.2 42.4 45.8
Instructions following MT-Bench (avg) 7.9 8.5 8.4
Alpaca (WC) 26.6 31.5 26.1
Tool use BFCL AST (avg) 90.6 91.4 89.5
Read the rest of the model card
Useful links
- View our release blogpost.
- Feel free to join our discord server if you have any questions or to interact with our researchers and developers.
Technical Report
Coming soon....
Citation
If Falcon3 family were helpful to your work, feel free to give us a cite.
@misc{Falcon3,
title = {The Falcon 3 family of Open Models},
author = {TII Team},
month = {December},
year = {2024}
}Sources: tiiuae/Falcon3-7B-Instruct on Hugging Face · falcon3:7b on Ollama. Collected from public sources on 14 Nov 2026; the host serving it may run a different build or quantisation — the marketplace shows each host's own measurements.
Who's serving it.
Every host benchmarked this model on its own hardware before serving it. Prices are set by each host; health is scored by the platform from what it observes.
| Host | Tier | Price | Measured speed | Health | State | Rent |
|---|---|---|---|---|---|---|
| GTX 1080 Ti (11G) | L1 | £0.03 in · £0.06 out | 6 tok/s · 21088 ms first token | 78 | loads on request | £0.60/h |
Live data, refreshed on every visit. How billing works.
Room on the grid for your machine.
Right now one machine serves falcon3:7b. If it drops, so does every request for it — a second host is what turns it into failover, and the grid needs that more than another copy. The router weighs price, measured speed, health and whether the model is already loaded — so a host with a sharper price or quicker hardware wins the next call.
Set your own price — you keep 85% of what it earns, and new hosts start with 12 months fee-free (up to £250 of earnings). A payout fee of £2 + 1% per payout to a UK bank account, £2 + 2% to any other country applies when you're paid. Install the connector, load falcon3:7b, and the platform benchmarks it on your hardware before your first request.