LFM2.5-VL-3B: A Better and Faster Vision-Language Model for the Edge
Today, we release LFM2.5-VL-3B, our most capable vision-language model. It delivers competitive vision performance against models twice its size, while running faster across a range of CPU and GPU deployments even compared with models that have fewer parameters.
LFM2.5-VL-3B builds on our previous LFM2-VL-3B, with significant improvements in screen understanding, grounding, function calling, and multi-image input. LFM2.5-VL-3B is a non-reasoning model that answers directly, keeping latency low for real-time and on-device applications.
The model is available today on Hugging Face and our Playground. Check out our docs on how to run and fine-tune it locally.
What’s New
LFM2.5-VL-3B extends the vision-language capabilities of our previous release with four major improvements:
Screen/UI understanding. LFM2.5-VL-3B has a strong understanding of digital screens across mobile, web, and desktop. It averages 80.7 on ScreenSpot-v2, far ahead of the much larger Gemma-4-E4B (51.2) and Qwen 3.5 4B (78.5) and close behind the larger InternVL-3.5-4B (84.1)
Function calling. New to our VL line, LFM2.5-VL-3B is significantly stronger at tool use and function calling, for both text-only and vision-text inputs. ToolSandbox more than doubles from 26.4 to 59.5 and BFCL v4 climbs from 20.5 to 32.5, putting it on par with Gemma-4-E2B and ahead of Qwen3.5-2B.
Grounding. LFM2.5-VL-3B significantly improves grounding performance by scaling synthetic grounding data. It raises RefCOCO precision@1 from 57.1 to 87.9, a 30-point gain over our previous release.
Multi-image input. Improved reasoning across multiple images, improving BLINK from 50.2 to 61.5 and MUIRBench from 34.9 to 58.3.
Training
LFM2.5-VL-3B follows the architecture of our previous VLMs, LFM2.5-VL-1.6B and LFM2.5-VL-450M. It builds on the same pre-trained base as our just-released LFM2.5-2.6B text model, and integrates a SigLIP2 400M NaFlex encoder.
Compared to the preceding LFM2-VL-3B release, it is pre-trained on ~34T tokens. To better support non-Latin scripts in LFM2.5, we doubled the vocabulary to 128K by extending the existing tokenizer in place.
Additionally, we scaled our vision pretraining by 4x tokens, while improving its data quality with a large mixture of curated and synthetic image-caption, OCR, grounding, and instruction following data.
The post-training pipeline consists of Supervised Fine-tuning (SFT), including knowledge distillation from a larger teacher model and Antidoom training, followed by multi-reward reinforcement learning (RL).
Vision Benchmarks
We evaluated LFM2.5-VL-3B across 28 benchmarks covering multilingual visual comprehension, instruction following, visual math and scientific reasoning, document understanding, object detection, multi-image understanding, and screen understanding.
LFM2.5-VL-3B is particularly strong at understanding both the physical and digital worlds. It leads its size class on real-world image tasks such as RealWorldQA, POPE, and RefCOCO, while also performing well on digital content, from documents and charts to on-screen UI elements. On average across these benchmarks, LFM2.5-VL-3B significantly outperforms much larger Gemma models and comes within 0.7% of the larger 4.7B Qwen 3.5 model.1
Task | Benchmark | LFM2.5-VL-3B (3.1B) | LFM2-VL-3B (3.1B) | gemma-4-E2B-it (5.1B) | gemma-4-E4B-it (8B) | InternVL 3.5 2B (2.4B) | InternVL 3.5 4B (4.7B) | Qwen3.5-2B (2.3B) | Qwen3.5-4B (4.7B) |
General | MMStar | 63.3 | 57.7 | 45.3 | 52.9 | 57.7 | 65.5 | 55.1 | 59.3 |
MME | 73.1 | 73.0 | 54.9 | 67.6 | 73.6 | 81.0 | 76.2 | 79.5 | |
RealWorldQA | 73.1 | 71.1 | 60.0 | 64.3 | 61.6 | 67.7 | 65.1 | 67.1 | |
SimpleVQA | 35.4 | 33.0 | 27.3 | 30.4 | 30.5 | 33.7 | 35.2 | 40.7 | |
SEED-Bench (image) | 77.7 | 76.6 | 71.4 | 75.3 | 75.4 | 76.4 | 75.8 | 76.1 | |
MMBench (dev EN v1.1) | 81.0 | 80.0 | 64.2 | 71.6 | 76.2 | 81.1 | 73.1 | 78.4 | |
CountBenchQA | 87.3 | 92.2 | 70.4 | 80.5 | 70.4 | 82.5 | 83.8 | 86.7 | |
Multilingual | MMMB | 83.0 | 81.9 | 73.3 | 80.4 | 76.3 | 81.5 | 75.9 | 82.0 |
Multilingual MMBench | 79.5 | 76.3 | 62.8 | 71.2 | 70.9 | 76.6 | 69.9 | 77.0 | |
Multimodal IF | MM-IFEval | 60.6 | 51.4 | 65.6 | 68.2 | 47.1 | 54.5 | 55.4 | 63.1 |
STEM | LogicVista | 37.4 | 32.2 | 29.5 | 34.5 | 30.9 | 36.2 | 34.0 | 37.6 |
MathVista (mini) | 68.5 | 62.1 | 37.8 | 45.2 | 56.8 | 67.1 | 48.7 | 63.6 | |
MMMU-Pro | 30.5 | 28.7 | 26.9 | 32.6 | 21.3 | 22.7 | 24.9 | 36.0 | |
MMMU (val) | 48.4 | 45.6 | 41.1 | 49.3 | 52.0 | 60.7 | 44.1 | 50.3 | |
Document, OCR & Chart | ChartQA (test) | 81.3 | 80.4 | 43.2 | 42.1 | 81.7 | 86.2 | 78.4 | 84.2 |
DocVQA (val) | 91.1 | 89.8 | 85.7 | 87.4 | 88.4 | 91.8 | 92.6 | 94.8 | |
InfographicVQA (val) | 70.2 | 67.8 | 54.4 | 60.9 | 69.3 | 76.9 | 73.5 | 80.3 | |
OCRBench v1 | 84.2 | 81.7 | 70.2 | 73.5 | 83.9 | 82.0 | 84.4 | 85.6 | |
OCRBench v2 (En) | 47.5 | 43.9 | 44.4 | 48.8 | 45.5 | 49.1 | 47.7 | 58.7 | |
TextVQA (val) | 84.3 | 83.0 | 62.5 | 69.0 | 76.6 | 77.5 | 77.3 | 81.2 | |
Grounding | RefCOCO-avg | 87.9 | 57.1 | 67.3 | 72.1 | 82.9 | 88.8 | 78.5 | 86.6 |
Multi-Image | BLINK | 61.5 | 50.2 | 45.2 | 52.2 | 52.0 | 57.2 | 48.6 | 58.7 |
MuirBench | 58.3 | 34.9 | 32.9 | 51.8 | 45.0 | 53.5 | 48.2 | 62.0 | |
Hallucination | HallusionBench | 47.2 | 46.4 | 41.8 | 49.8 | 47.6 | 52.1 | 49.3 | 51.7 |
POPE | 88.7 | 89.2 | 84.0 | 86.9 | 88.0 | 88.9 | 88.6 | 86.0 | |
GUI | ScreenSpot-v2 Desktop | 78.7 | 6.0 | 28.1 | 45.8 | 79.9 | 82.0 | 63.8 | 76.3 |
ScreenSpot-v2 Mobile | 81.2 | 7.6 | 42.9 | 60.3 | 86.2 | 87.8 | 69.7 | 81.4 | |
ScreenSpot-v2 Web | 82.2 | 2.5 | 22.4 | 47.6 | 79.9 | 82.6 | 65.9 | 77.8 | |
Average | - | 69.4 | 57.2 | 52.0 | 59.7 | 64.6 | 69.4 | 63.7 | 70.1 |
Text Benchmarks
We also evaluated LFM2.5-VL-3B on text-only benchmarks for instruction following and tool use against the same set of models. Instruction following climbs across the board, and tool use improves sharply, with ToolSandbox more than doubling from 26.4 to 59.5. On tool use, LFM2.5-VL-3B is on par with Gemma-4-E2B and Qwen3.5-2B.2
Task | Benchmark | LFM2.5-VL-3B (3.1B) | LFM2-VL-3B (3.1B) | gemma-4-E2B-it (5.1B) | gemma-4-E4B-it (8B) | InternVL 3.5 2B (2.4B) | InternVL 3.5 4B (4.7B) | Qwen3.5-2B (2.3B) | Qwen3.5-4B (4.7B) |
Instruction following | IFEval | 82.3 | 72.9 | 83.0 | 87.9 | 32.4 | 35.4 | 73.6 | 86.2 |
IFBench | 25.8 | 20.8 | 34.1 | 39.2 | 24.4 | 24.5 | 28.9 | 33.5 | |
Multi-IF | 59.4 | 46.5 | 69.4 | 77.4 | 16.3 | 16.9 | 53.5 | 66.7 | |
Tool use & function calling | ToolSandbox | 59.5 | 26.4 | 56.5 | 61.6 | N/A | N/A | 47.7 | 65.0 |
BFCL V4 | 32.5 | 20.5 | 33.2 | 40.0 | N/A | N/A | 33.9 | 53.6 |
These results make LFM2.5-VL-3B a strong, well-rounded vision-language model. It performs well across everyday tasks like image captioning, visual question answering, and document understanding, and it is especially strong at taking action, bounding box detection, and reading digital screens and documents.
Fast inference everywhere
LFM2.5-VL-3B ships with day-one support across the inference ecosystem:
- llama.cpp — GGUF checkpoints for efficient edge inference
- MLX — Optimized inference for Apple Silicon
- vLLM — GPU-accelerated serving for production throughput
- SGLang — GPU-accelerated serving for production throughput
- ONNX — Cross-platform inference across diverse accelerators
On-device inference. LFM2.5-VL-3B decodes 228 tokens/s on an Apple M5 Max and 116 tokens/s on an AMD Ryzen AI Max+ 395, while staying in about 3 GB of memory. Its compact vision encoder also keeps it quick to first token, where models with heavier encoders such as InternVL stall on the same image. It even runs on a phone, decoding 20 tokens/s on a Galaxy S26 Ultra, so a capable vision model runs privately on your own device.
GPU inference. LFM2.5-VL-3B is built for fast, responsive inference on GPU. Because it answers directly instead of reasoning, it returns the first token quickly, even on image-heavy inputs. We measure time to first token on a single NVIDIA H100 SXM5 GPU, one request at a time, across three input types: a single 512x512 image, a 512x512 image with a 1,024-token input text, and 5 256x256 5-frame video clip. LFM2.5-VL-3B keeps latency consistently low and pulls far ahead on multi-frame inputs, returning the first token in about 34 ms on a 5-frame video clip where the Gemma models take around 200 ms.
We also measure output throughput (total output tokens / wall time) on a single NVIDIA H100 SXM5 GPU using a sustained-load setting: at each concurrency level, we continuously maintain the target number of in-flight requests, replacing each completed request immediately.
We benchmark each model with vLLM 0.26, using a 512×512 image plus 1,024 input tokens and up to 256 output tokens, in BF16, and report the median of 5 runs per concurrency level. LFM2.5-VL-3B reaches the highest output throughput of any model we tested, about 11K tokens per second at high concurrency. That is roughly 2× the larger 4B-class models and ahead of even the smaller 2B-class models, which adds up to nearly 1B output tokens per day on a single H100.
See LFM2.5-VL-3B in Action
You can try LFM2.5-VL-3B directly in your browser with our WebGPU demo. The model runs entirely on-device with no setup required. You can upload an image or capture a still image from your webcam to see the model in action.
Document understanding. Given a document page, the model analyzes the entire page in a single pass, identifying regions and assigning layout labels.
Screen/UI understanding. Given a high-level goal of finding a specific documentation page, the model navigates the website to satisfy the goal. The model visually analyzes each screen to identify where to click, and repeats this process until it reaches the target page.
Function calling. Given an image of a dish and a request for its recipe, the model identifies the dish and determines that it should call a search tool to find the recipe.
Grounding. Given a natural-language request, the model locates the specified objects in an image and returns a bounding box for each one.
Get Started
Start building today with LFM2.5-VL-3B, available on Hugging Face.
With LFM2.5, we're delivering on our vision of AI that runs anywhere. These models are:
- Open-weight — Download, fine-tune, and deploy without restrictions
- Fast from day one — Native support for llama.cpp, MLX, and vLLM across Apple, AMD, Qualcomm, and Nvidia hardware
- A complete family — From base models for customization to specialized audio and vision variants, one architecture covers diverse use cases
We can't wait to see what you build.
Citation
Please cite this article as:
Liquid AI, "LFM2.5-VL-3B: A Better and Faster Vision-Language Model for the Edge", Liquid AI Blog, Aug 2026.
@article{liquidAI2026VL3B,
author = {Liquid AI},
title = {LFM2.5-VL-3B: A Better and Faster Vision-Language Model for the Edge},
journal = {Liquid AI Blog},
year = {2026},
note = {www.liquid.ai/blog/lfm2-5-vl-3b},
}1 Evaluation is done using vLLM 0.26.0 and each model’s recommended generation parameters when available. Non-reasoning mode is used everywhere, and models are prompted to directly answer without reasoning.
All values in the table are normalized to 0–100. Original benchmarks use 0-2800 for MME, 0-1000 for OCRBench, and 0–1 for DocVQA and InfographicVQA.
RefCOCO-avg is average of P@1 over these 8 splits RefCOCO: val, testA, testB, RefCOCO+: val, testA, testB, RefCOCOg: val, test
POPE is F1 over all examples in adversarial, popular and random subsets
MMMU-Pro uses the 10-choice multiple-choice variant
2 InternVL 3.5 models do not support function-calling.