Marketplace · Text & chat

lfm3-vl:latest

Call lfm3-vl:latest through one OpenAI-compatible API. It's served by 2 hosts on the Inpherio grid, each at a price it sets — your request goes to the cheapest healthy one, and fails over to the next if it's down.

From
£0.058
per 1M output tokens
£1 buys about 17 million tokens (≈ 13 million words)
Hosts
2
Loaded now
0

At a glance.

vision tools reasoning

  • Type: Text & chat
  • Hosts serving it now: 2 (0 with it loaded in memory)
  • Engines: ollama
  • Context window: up to 128,000 tokens
  • Rentable: a whole host from £0.04 an hour (rentals)
python · openai sdk
from openai import OpenAI
client = OpenAI(base_url="https://inpherio.co.uk/v1",
                api_key=INPHERIO_API_KEY)
reply = client.chat.completions.create(
    model="lfm3-vl:latest",
    messages=[{"role": "user", "content": "Hello"}],
)

lfm3-vl:latest in detail.

LFM3-VL-2B is a vision-language model for on-device visual understanding.

Published by
LiquidAI
Parameters
1.9B
Download size
1.5 GB (as packaged for Ollama)
Quantisation
Q4_K_M
Format
gguf
Architecture
lfm3_vl
Licence
lfm1.0
Based on
LiquidAI/LFM3-1.7B-Base
Task
image text to text
Library
transformers
Languages
en, ar, zh, fr, de, it, ja, ko, pt, es, vi, th
First published
19 Oct 2026
Last updated
3 Nov 2026
Downloads (30 days)
15,203 on Hugging Face
Likes
268

lfm3_vl image-text-to-text liquid lfm3 edge en ar zh fr de it ja ko pt es vi

The model card

Published by the model's authors on Hugging Face — shown as they wrote it, unedited by Inpherio.

<img src="data:image/svg+xml,%3Csvg xmlns=%22http://www.w3.org/2000/svg%22 width=%2216%22 height=%2216%22 viewBox=%220 0 24 24%22 fill=%22none%22 stroke-width=%222.2%22 stroke-linecap=%22round%22 stroke-linejoin=%22round%22%3E%3Cstyle%3Epath%7Bstroke:%23000%7D%40media (prefers-color-scheme:dark)%7Bpath%7Bstroke:%23d1d5dc%7D%7D%3C/style%3E%3Cpath d=%22m8 6-6 6 6 6m8-12 6 6-6 6m-2-14-4 16%22/%3E%3C/svg%3E" width="16" height="16" alt="" aria-hidden="true" style="display: block; flex: 0 0 16px; width: 16px; height: 16px; margin: 0;" />API <img src="data:image/svg+xml,%3Csvg xmlns=%22http://www.w3.org/2000/svg%22 width=%2216%22 height=%2216%22 viewBox=%220 0 24 24%22 fill=%22none%22 stroke-width=%222.2%22 stroke-linecap=%22round%22 stroke-linejoin=%22round%22%3E%3Cstyle%3Epath%7Bstroke:%23000%7D%40media (prefers-color-scheme:dark)%7Bpath%7Bstroke:%23d1d5dc%7D%7D%3C/style%3E%3Cpath transform=%22translate(3 0)%22 d=%22M8 5.5v13L19 12 8 5.5Z%22/%3E%3C/svg%3E" width="16" height="16" alt="" aria-hidden="true" style="display: block; flex: 0 0 16px; width: 16px; height: 16px; margin: 0;" />Try <img src="data:image/svg+xml,%3Csvg xmlns=%22http://www.w3.org/2000/svg%22 width=%2216%22 height=%2216%22 viewBox=%220 0 24 24%22 fill=%22none%22 stroke-width=%222.2%22 stroke-linecap=%22round%22 stroke-linejoin=%22round%22%3E%3Cstyle%3Epath%7Bstroke:%23000%7D%40media (prefers-color-scheme:dark)%7Bpath%7Bstroke:%23d1d5dc%7D%7D%3C/style%3E%3Cpath d=%22M12 6c-3-2-6-2.5-10-2v15c4-.5 7 0 10 2m0-15c3-2 6-2.5 10-2v15c-4-.5-7 0-10 2V6Z%22/%3E%3C/svg%3E" width="16" height="16" alt="" aria-hidden="true" style="display: block; flex: 0 0 16px; width: 16px; height: 16px; margin: 0;" />Docs <img src="data:image/svg+xml,%3Csvg xmlns=%22http://www.w3.org/2000/svg%22 width=%2216%22 height=%2216%22 viewBox=%220 0 24 24%22 fill=%22none%22 stroke-width=%222.2%22 stroke-linecap=%22round%22 stroke-linejoin=%22round%22%3E%3Cstyle%3Epath%7Bstroke:%23000%7D%40media (prefers-color-scheme:dark)%7Bpath%7Bstroke:%23d1d5dc%7D%7D%3C/style%3E%3Cpath transform=%22translate(1 0)%22 d=%22m16 3 5 5L8 21H3v-5L16 3Zm-3 3 5 5%22/%3E%3C/svg%3E" width="16" height="16" alt="" aria-hidden="true" style="display: block; flex: 0 0 16px; width: 16px; height: 16px; margin: 0;" />Blog

LFM3-VL-2B

LFM3-VL-2B is a vision-language model for on-device visual understanding. It takes text, images, and video as input, and combines the LFM3 language model with a new in-house vision encoder.

New in LFM3-VL-2B:

  • Video understanding: the first LFM vision model that takes video as input. Ask questions about a recorded lecture, a walkthrough filmed on your phone, or a clip from a camera feed.
  • Thinking: the model reasons step by step before it answers. This helps most with harder visual questions, such as math, charts, and multi-step problems.
  • Spatial and embodied reasoning: the model finds objects and reasons about how they are placed relative to each other, a strong foundation for robotics applications.

Find more information about the LFM3 family in our release blog post.

Model details

The LFM3 family includes base, text, vision, audio, omni, and decision models.

Property Specification

Checkpoint Post-trained vision-language model

Parameters 1.92B: 1.73B language model, 164M vision encoder, 25M projector

Language model LFM3, 24 layers: 13 gated short convolutions, 5 sliding-window attention, 6 global attention

Vision encoder 14 layers: 8 gated depthwise 2D convolutions, 6 bidirectional attention, 16×16 patches with 2D rotary embeddings

Inputs Text, images, and video at native resolution. Each 2×2 block of patches becomes one language token. Video is sampled at 2 fps, with 4 to 768 frames by default.

Context length 128K tokens (input + output)

Vocabulary 128,000 tokens

Languages English, Arabic, Chinese, French, German, Italian, Japanese, Korean, Portuguese, Spanish, Vietnamese, Thai, Indonesian, Hindi, Russian, Polish

License LFM Open License v1.0

LFM3-VL-2B is designed for on-device visual tasks: questions about video, reading documents, charts, and app screens, finding objects in an image, and spatial reasoning for robots. It is not recommended for coding, multi-turn conversations, or complex reasoning.

Read the rest of the model card

Inference

Choose a checkpoint variant for your inference framework and hardware.

Checkpoint Framework Description

BF16 vLLM, SGLang, Transformers BF16 weights for GPU inference.

GGUF llama.cpp, LM Studio Local inference on CPUs and GPUs.

MLX MLX-VLM 4-bit quantization for Apple Silicon.

ONNX ONNX Runtime Cross-platform inference with ONNX Runtime.

Sampling parameters: temperature=0.1, top_p=1.0, top_k=50, min_p=0.0, repetition_penalty=1.1. For image and video preprocessing, use the values in processor_config.json.

Transformers quick start (transformers>=5.21.0):

pip install "transformers>=5.21.0" torch torchvision pillow
import torch
from transformers import AutoModelForImageTextToText, AutoProcessor

model_id = "LiquidAI/LFM3-VL-2B"

model = AutoModelForImageTextToText.from_pretrained(
    model_id, dtype=torch.bfloat16, device_map="auto", trust_remote_code=True
)
processor = AutoProcessor.from_pretrained(model_id, trust_remote_code=True)

messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://placecats.com/300/200"},
            {"type": "text", "text": "Describe this image."},
        ],
    }
]

inputs = processor.apply_chat_template(
    messages,
    add_generation_prompt=True,
    tokenize=True,
    return_dict=True,
    return_tensors="pt",
).to(model.device)

with torch.inference_mode():
    output_ids = model.generate(
        **inputs,
        do_sample=True,
        temperature=0.1,
        top_k=50,
        repetition_penalty=1.1,
        max_new_tokens=16384,  # generate() needs an explicit limit; reasoning can be long
    )

generated_ids = output_ids[:, inputs["input_ids"].shape[1] :]
print(processor.batch_decode(generated_ids, skip_special_tokens=True)[0])

On-device inference with llama.cpp

For most on-device use cases, we recommend llama.cpp b11960 or newer with the GGUF checkpoints. To run it in a desktop app such as Llama.app or LM Studio, click Use this model on the GGUF page and pick the app.

From a terminal, start a web chat UI and an OpenAI-compatible API at http://localhost:8080. With -hf, llama.cpp downloads the model and the matching vision projector (mmproj):

llama serve -hf LiquidAI/LFM3-VL-2B-GGUF:Q4_0 \
  --temp 0.1 --top-p 1.0 --top-k 50 --min-p 0.0 --repeat-penalty 1.1 \
  --no-reasoning-preserve --port 8080

To ask one question from the command line, use llama cli with the same flags, --image or --video , and -p "". Video input needs ffmpeg in PATH.

GPU inference with vLLM and SGLang

For high-throughput serving on GPU, use vLLM or SGLang. Both serve an OpenAI-compatible API. Support for LFM3-VL in SGLang is in review in sgl-project/sglang#46858, and support in vLLM is in progress. We will update this card when their releases support it.

vLLM:

vllm serve LiquidAI/LFM3-VL-2B \
  --reasoning-parser qwen3 \
  --enable-auto-tool-choice --tool-call-parser qwen3_coder \
  --chat-template-content-format openai \
  --structured-outputs-config '{"backend": "xgrammar", "disable_any_whitespace": true}' \
  --media-io-kwargs '{"video": {"video_backend": "qwen3_vl"}}'

SGLang:

sglang serve --model-path LiquidAI/LFM3-VL-2B --trust-remote-code \
  --reasoning-parser auto \
  --tool-call-parser auto \
  --constrained-json-disable-any-whitespace

Send an image-and-text request with the OpenAI client. Change base_url to http://localhost:30000/v1 for SGLang, or http://localhost:8080/v1 for llama.cpp:

from openai import OpenAI

client = OpenAI(base_url="http://localhost:8000/v1", api_key="EMPTY")

response = client.chat.completions.create(
    model="LiquidAI/LFM3-VL-2B",
    messages=[
        {
            "role": "user",
            "content": [
                {"type": "image_url", "image_url": {"url": "https://placecats.com/300/200"}},
                {"type": "text", "text": "Describe this image."},
            ],
        }
    ],
    temperature=0.1,
    extra_body={"top_k": 50, "repetition_penalty": 1.1},
)
print(response.choices[0].message.content)

Video frame rate and frame limit

By default, LFM3-VL-2B samples video at 2 fps, with at least 4 and at most 768 frames per video. Each frame adds vision tokens, so for long videos a lower frame rate or frame limit uses less context and memory.

  • Transformers: set the frame rate per call with processor.apply_chat_template(..., processor_kwargs={"fps": 1}). Set the frame limit when you load the processor: AutoProcessor.from_pretrained(model_id, trust_remote_code=True, max_frames=128).
  • vLLM: set a server default in --media-io-kwargs, for example '{"video": {"video_backend": "qwen3_vl", "fps": 1, "max_frames": 128}}'. Override it per request with extra_body={"media_io_kwargs": {"video": {"fps": 1, "max_frames": 128}}}.
  • SGLang: change fps, min_frames, and max_frames under video_processor in processor_config.json in a local copy of the checkpoint.
  • llama.cpp: always uses 2 fps and 4 to 768 frames for this model. --video-fps has no effect.

Chat template

LFM3-VL uses this ChatML format, generated from the checkpoint's chat template:

<|startoftext|><|im_start|>system
You are a helpful assistant trained by Liquid AI.<|im_end|>
<|im_start|>user
<|vision_start|><|image|><|vision_end|>What species is in this picture?<|im_end|>
<|im_start|>assistant

Use processor.apply_chat_template() with add_generation_prompt=True to format messages automatically. The model thinks in a ... block before it answers.

The template inserts <|vision_start|><|image|><|vision_end|> for each image and <|vision_start|><|video|><|vision_end|> for each video. Do not put these tags in your message content.

Reasoning from turns before the latest user message is removed unless preserve_thinking=True.

Tool calling

Pass function schemas through tools=... to apply_chat_template(). The template formats tool definitions and results automatically. Generated calls use XML:


Paris
[!WARNING] LFM3's tool call format has changed from the custom LFM2/LFM2.5 format to a superset of qwen3_coder.

Execute the call in your application. Add the parsed assistant call to history as a tool_calls entry, then append the result as a tool message. Keep passing the tool schemas on subsequent requests and preserve the assistant's content and reasoning from the current tool-use turn.

function.arguments must be a Python mapping. Decode JSON strings with json.loads() before applying the template.

See the Tool Use documentation for the full guide.

Tool search

LFM3 supports deferred tools. Set defer_loading=True to keep tool definitions out of the prompt until your harness's search tool returns their names as tool_reference parts. The chat template then inserts their definitions into ``.

tools = [
    search_tool,
    {"type": "function", "defer_loading": True, "function": get_weather_schema},
]
messages.append({
    "role": "tool",
    "tool_call_id": call_id,
    "content": [
        {"type": "text", "text": "Found 1 tool."},
        {"type": "tool_reference", "name": "get_weather"},
    ],
})

Your harness implements and runs the search. Keep the full tools list, including deferred tools, on every request.

See Deferred tools and tool search for the full guide.

Fine-tuning

LFM3-VL-2B is designed for easy customization for a given domain, task, or application via TRL.

Training Use case Notebook

SFT Extract structured JSON from receipt photos

GRPO Transcribe images of equations to LaTeX

Performance

Benchmarks

Across 62 vision benchmarks, LFM3-VL-2B scores at least 8 points ahead of all models of similar size. It matches Gemma 4 12B, is within 2 points of GPT-5.6 Luna, and scores higher than Gemini 3.5 Flash Lite.

Category LFM3-VL 2B LFM3-VL 2B&nbsp;(no&nbsp;think) LFM2.5-VL 3B MiniCPM-V&nbsp;4.7 1B Qwen3.5 2B Qwen3.5 4B InternVL3.5 4B Gemma&nbsp;4 E2B Gemma&nbsp;4 12B GPT-5.6 Luna Gemini&nbsp;3.5 Flash&nbsp;Lite

General 66.0 56.4 57.6 59.8 64.0 73.0 61.2 56.9 74.0 72.2 74.1

Perception 75.6 68.9 67.9 65.5 71.2 77.1 63.2 59.1 73.5 71.0 73.0

Document, OCR & Chart 83.9 71.6 71.2 73.0 79.1 84.3 72.1 72.3 85.7 84.4 82.3

Math & logical reasoning 68.8 41.0 40.6 51.8 61.0 78.4 46.4 51.8 79.3 77.3 66.7

Visual grounding 77.3 72.6 68.3 51.1 61.2 67.0 63.6 41.2 74.1 72.7 63.5

Embodied reasoning 64.4 57.9 48.0 45.3 51.2 63.2 48.9 41.5 59.1 61.5 50.3

GUI understanding 83.1 81.5 66.0 45.3 67.2 81.1 68.5 44.3 76.1 82.5 71.0

Video 61.2 54.0 41.3 53.7 57.0 67.5 59.7 46.6 58.9 72.8 70.0

Multilingual 84.4 76.2 81.2 77.4 78.6 83.9 79.0 73.4 86.1 82.1 85.8

Agentic 42.5 32.9 21.1 16.9 15.2 31.3 N/A 23.8 43.6 56.1 62.4

Average 71.4 62.1 57.6 57.5 64.0 73.4 61.1 53.6 71.7 73.4 70.0

All 62 benchmarks

Benchmark LFM3-VL 2B LFM3-VL 2B&nbsp;(no&nbsp;think) LFM2.5-VL 3B MiniCPM-V&nbsp;4.7 1B Qwen3.5 2B Qwen3.5 4B InternVL3.5 4B Gemma&nbsp;4 E2B Gemma&nbsp;4 12B GPT-5.6 Luna Gemini&nbsp;3.5 Flash&nbsp;Lite

General

MME 86.9 76.7 74.3 82.7 83.9 88.3 82.2 79.6 85.7 74.8 89.2

MMStar 74.4 62.2 63.3 68.1 71.5 76.6 65.3 61.2 77.7 72.2 73.1

SimpleVQA 36.3 27.7 32.0 36.5 38.0 45.8 33.4 28.4 42.5 53.2 56.9

SEED-Bench (image) 78.6 76.8 77.7 76.6 76.9 78.9 76.4 75.2 80.6 76.2 79.5

MMBench (dev EN v1.1) 86.1 76.5 81.0 83.4 80.0 86.5 81.1 70.9 88.2 84.4 88.2

MMMU (val) 55.7 48.6 47.2 51.0 58.1 74.6 57.8 57.3 76.7 75.2 72.0

MMMU-Pro 45.7 35.0 33.2 37.3 50.3 67.2 38.4 42.7 69.1 70.9 63.2

MM-Vet (v1) 57.4 44.3 48.2 46.8 53.4 59.9 65.3 44.8 64.1 67.1 73.3

MM-IFEval 72.8 54.7 60.6 58.9 62.0 79.5 57.3 61.6 83.0 82.0 73.2

MuirBench 66.4 61.2 58.2 57.0 65.5 72.8 54.8 47.5 71.9 66.0 72.7

Perception

BLINK 71.1 68.7 61.0 60.7 63.5 69.8 57.4 52.9 70.9 68.6 68.9

CountBenchQA 93.0 86.4 87.1 86.4

Sources: LiquidAI/LFM3-VL-2B on Hugging Face · lfm3-vl:latest on Ollama. Collected from public sources on 8 Nov 2026; the host serving it may run a different build or quantisation — the marketplace shows each host's own measurements.

Who's serving it.

Every host benchmarked this model on its own hardware before serving it. Prices are set by each host; health is scored by the platform from what it observes.

Hosts serving lfm3-vl:latest right now
HostTierPriceMeasured speedHealthStateRent
GTX 1080 Ti (11G)L1£0.029 in · £0.058 out34 tok/s · 309 ms first token78loads on request£0.60/h
7B-A1B (5G)L1£0.062 in · £0.25 out18 tok/s · 491 ms first token82loads on request£0.04/h

Live data, refreshed on every visit. How billing works.

Room on the grid for your machine.

2 machines serve lfm3-vl:latest today. Every extra host is somewhere a request can fail over to when one drops, and spare capacity when demand spikes. The router weighs price, measured speed, health and whether the model is already loaded — so a host with a sharper price or quicker hardware wins the next call.

Hosts now
2
0 loaded in memory
Price to beat
£0.058
per 1M output tokens
Fastest measured
34 tok/s

Set your own price — you keep 85% of what it earns, and new hosts start with 12 months fee-free (up to £250 of earnings). A payout fee of £2 + 1% per payout to a UK bank account, £2 + 2% to any other country applies when you're paid. Install the connector, load lfm3-vl:latest, and the platform benchmarks it on your hardware before your first request.