Earlier this week, the AI startup Liquid, fashioned in 2023 by former MIT pc scientists, debuted LFM2.5-2.6B, a brand new open-weight language mannequin designed particularly for agentic workloads.
In launch supplies and a latest interview with VentureBeat, Liquid's researchers mentioned LFM2.5-2.6B can run completely on native {hardware} — from smartphones and laptops all the way down to a Raspberry Pi — with out counting on cloud inference or GPUs, unlocking edge AI functions and giving extra choices to enterprises working in regulated industries or with delicate data they don't wish to ship as much as the cloud.
It's greatest fitted to high-volume, well-defined agentic duties that run domestically — software calling, doc administration, calendar and workflow automation, and always-on background routines — and for connectivity-limited environments like autos and robotics, although coding-heavy work is best left to bigger fashions.
Even for these companies with out such considerations, the enchantment of operating performant, task-specific brokers at the price of primarily electrical energy, could also be sufficient to make the brand new mannequin fairly interesting.
However the custom open weights license, as with Moonshot's larger frontier model Kimi K3 launched final month, is price a detailed look by enterprise authorized groups.
The fundamentals
LFM2.5-2.6B comprises 2.6 billion parameters, helps a 128,000-token context window, and consists of native software calling. The considerably difficult title is defined by the technology of mannequin (2.5) mixed with the parameter depend (2.6B).
Each the post-trained mannequin and a base checkpoint (LFM2.5-2.6B-Base) for builders who wish to fine-tune it can be found now on Hugging Face, with day-one assist for main inference stacks together with llama.cpp, MLX, vLLM, SGLang, and ONNX — positioning it for deployment throughout client {hardware}, enterprise infrastructure, and embedded methods.
Liquid additionally gives an open supply fine-tuning framework, LEAP.
Reasonably than positioning LFM2.5-2.6B as a competitor to the biggest frontier fashions, the corporate is making a unique argument: {that a} sufficiently succesful small mannequin can unlock classes of enterprise functions the place latency, privateness, deployment flexibility, or inference prices matter greater than absolute benchmark management.
"I do additionally imagine that one of the best fashions can be within the cloud, and there's no drawback with that," Maxime Labonne, Liquid AI's head of post-training, instructed VentureBeat in an interview following the launch. "We wish to make fashions for one more kind of consumer, and one of the simplest ways of describing it’s: you must use [edge AI] when you possibly can't use a cloud mannequin."
Sufficiently small for a Raspberry Pi
Requested in regards to the minimal viable {hardware}, Labonne mentioned the mannequin runs "very, very properly" on CPUs — and that the LFM2 structure underlying the mannequin was explicitly designed round real-world CPU efficiency relatively than GPU benchmarks.
"I feel one of the best instance is a Raspberry Pi," he mentioned. "We have now a variety of demos that present that truly, it really works fairly quick on the Raspberry Pi."
Firm-reported measurements point out decoding throughput of roughly 220 tokens per second on an Apple M5 Max and 113 tokens per second on an AMD Ryzen AI Max+ 395, whereas utilizing lower than 2.5 GB of reminiscence — and round 30 tokens per second on a smartphone. Customers can strive the fashions on their telephones by means of Apollo, Liquid AI's cell app.
On the different finish of the deployment spectrum, Liquid AI stories the mannequin reaches almost 15,000 output tokens per second on a single Nvidia H100 GPU underneath sustained concurrent load — roughly 1.3 billion tokens per day on one card. These figures are vendor benchmarks and haven’t been independently verified.
For Labonne, reminiscence footprint and velocity usually are not conveniences however onerous constraints that decide what could be deployed in any respect.
"What we wish to present is that it's a very good trade-off, since you get the extent of high quality that you just get with a lot larger fashions, however in a tiny, tiny type issue," he mentioned. "You possibly can deploy it in goal gadgets the place you aren’t in a position to deploy the opposite ones in any respect."
Educated for brokers as an alternative of chatbots
Liquid AI says LFM2.5-2.6B was developed across the assumption that language fashions are more and more consumed by means of agent frameworks relatively than conventional conversational interfaces.
"Fashions usually are not consumed in chatbots anymore. They're actually consumed by means of agentic harnesses, like OpenClaw, like Hermes Agent," Labonne mentioned. "We wished to ensure that this mannequin is not only good at math or at code, nevertheless it's good at utilizing instruments."
The mannequin is pretrained on roughly 34 trillion tokens, with a vocabulary doubled to 128K to raised assist non-Latin scripts and a devoted mid-training section to increase the context window to 128K tokens for long-running agent workflows.
Publish-training follows a four-stage pipeline: supervised fine-tuning, trainer specialization (coaching separate knowledgeable fashions for domains like instruction following, math, code, and power use), multi-domain on-policy distillation (MOPD) to merge these consultants' capabilities again right into a single scholar mannequin, and eventually agentic reinforcement studying.
Throughout that final stage, the mannequin was educated immediately inside manufacturing agent harnesses — together with Hermes Agent and OpenClaw — on practical productiveness duties involving analysis, coding, doc administration, software invocation, and workflow automation, exposing it to these harnesses' precise instruments, system prompts, and interplay patterns.
Labonne described the pipeline overhaul as producing a "blissful accident": positive aspects that prolonged properly past the agentic targets.
"Via these new coaching methods, we additionally bought quite a bit higher at all the pieces. We bought higher at math, at instruction following. We've by no means been good at code, really — and with this, we even bought actually good at code," he mentioned.
Constructing the mannequin — and the harness
Notably, Liquid AI additionally constructed its personal agent harness relatively than relying solely on current frameworks, and demonstrated the mannequin operating inside it on a telephone, planning and calling instruments completely on-device.
"It is a harness operating on a telephone, and I don't know if there's every other harness operating on a telephone," Labonne mentioned.
The corporate had two causes, he defined. The primary was necessity — no phone-native harness existed. The second is a unique interplay mannequin: as we speak's harnesses watch for a immediate, and Liquid AI needs assistants that act on their very own.
"We would like proactive brokers. We would like brokers that run within the background, examine what you're doing, examine your calendar, and primarily based on this context, do duties," he mentioned. "That doesn't exist as we speak, actually."
Co-designing the harness and mannequin additionally lets the software program compensate for the mannequin's weak spots. "All the things that the mannequin is dangerous at, the harness ought to assist the mannequin with — present as a lot help as attainable to make it extra dependable," Labonne mentioned. "Finish customers don't care if it's the mannequin or the harness. What they need is that the duty is achieved on the finish of the day."
The mannequin however works out of the field with established harnesses together with Hermes Agent, OpenClaw, and Pi, served behind any OpenAI-compatible endpoint.
Swap the harness, not the mannequin
For enterprise deployment, Labonne argued the discharge marks a shift in what small fashions can be utilized for. Till now, he mentioned, native fashions made financial sense primarily as narrowly fine-tuned specialists — educated to do one factor at cloud-model high quality, a lot sooner and cheaper. Agentic functionality modifications that calculus, as a result of the identical mannequin could be repurposed by altering the instruments round it relatively than the mannequin itself.
"You possibly can have a calendar assistant, and you’ll reuse the identical mannequin and make a gathering assistant that may document what everyone mentioned and summarize it — a bit like Granola, for instance," he mentioned. "You don't change the mannequin; you simply change the harness. You simply change the instruments round it. This provides rather more generalizability, and it's quite a bit simpler to do and quite a bit cheaper as properly."
He nonetheless recommends fine-tuning for manufacturing deployments at any time when possible: "When you don't fine-tune it, you permit some high quality on the desk. When you fine-tune it properly, it's going to match the efficiency of GPT and Claude — actually, in case your job shouldn’t be essentially the most complicated job on the planet," he mentioned, including that the barrier to entry has collapsed: "The bar to have the ability to do fine-tuning now could be tremendous low. It's very accessible to everybody."
The way it stacks up in opposition to DeepSeek-V4-Flash, Google's Gemma and Alibaba's Qwen
Liquid AI launched its personal benchmark comparability charts pitting LFM2.5-2.6B in opposition to the fashions enterprises are most definitely to shortlist for a similar edge deployments: Google's Gemma 4 E2B (5.1B parameters) and E4B (8B), and Alibaba's Qwen3.5-4B (4.7B) and Qwen3.5-9B (9.7B).
A separate check by native AI shopper platform Atomic Chat discovered that LFM2.5-2.6B accomplished 35 software calls to finish three duties (checking climate and native time in six cities, changing one funds into six currencies, checking 4 lodges and reserving for a date) 3.7 instances sooner than DeepSeek-V4-Flash (a whopping 284B parameters), the mannequin has skyrocketed to the highest of OpenRouter since its launch final week.
Gemma 4's small fashions are multimodal generalists, accepting picture and audio enter alongside textual content, and use a Per-Layer Embeddings design that retains solely a fraction of their weights energetic per token — which is why Google markets them by "efficient" dimension (2.3B and 4.5B) regardless of complete footprints of 5.1B and 8B. Alibaba's Qwen3.5 small collection, released in March, is natively multimodal from 4B up and leans on scaled reinforcement studying to chase frontier-style reasoning — Alibaba touts the 9B mannequin as matching or beating OpenAI's far bigger gpt-oss-120B on reasoning benchmarks.
LFM2.5-2.6B takes a narrower path: it’s text-only, dense, and specialised for agentic work, with Liquid AI delivery separate imaginative and prescient and audio variants of the LFM household relatively than folding all the pieces into one checkpoint.
The place Qwen's post-training reinforcement studying targets reasoning, Liquid's targets software use inside actual agent harnesses.
The end result, per the corporate's revealed numbers, is that the smallest mannequin within the comparability leads each instruction-following benchmark (IFBench, Multi-IF, IFStruct) and almost each tool-use benchmark — 77.83 on ToolSandbox versus 76.44 for Qwen3.5-9B, a mannequin almost 4 instances its dimension — trailing solely that 9B mannequin on BFCLv4.
On agentic evaluations it beats each Gemma fashions throughout the board and primarily ties the Qwens: 26.89 on BrowseComp+ versus 27.23 for Qwen3.5-9B. It additionally posts one of the best rating on AA Omniscience, a data benchmark that penalizes hallucination.
The Qwen fashions maintain the sting the place their coaching focus lies: math (Qwen3.5-9B leads AIME25) and coding, the place bigger fashions retain a bonus on LiveCodeBench — although Labonne famous the hole is smaller than the parameter counts would recommend.
"With LiveCodeBench v6, we would not be one of the best amongst these fashions, however we're additionally by far the smallest. Exhibiting that we're aggressive with them is already fairly an enormous win for me," he mentioned.
One differentiator cuts the opposite method: licensing. Gemma 4 and Qwen3.5 ship underneath the permissive Apache 2.0 license — a change Google made specifically to court enterprises. DeepSeek-V4-Flash ships under a similarly permissive MIT License.
In the meantime, Liquid AI's revenue-gated license (detailed under) asks bigger firms to strike a business deal. Enterprises above the brink are successfully buying and selling license friction for footprint and tool-use efficiency.
Licensing displays a business center floor
LFM2.5-2.6B is distributed underneath the LFM Open License v1.0, which allows use, modification, and redistribution — together with business use — for organizations with lower than $10 million in annual income. Industrial use by bigger firms shouldn’t be lined by the license, requiring a separate association with Liquid AI; certified nonprofits are exempt from the brink for non-commercial and analysis functions.
Labonne framed the construction as a strategy to maintain mannequin improvement — "the fashions are actually the moats, so we should be wise in the way in which that we license them; in any other case, we can’t generate income, so we will't make extra fashions" — whereas characterizing the brink as a light-touch mechanism in observe.
Requested how the corporate would even know if a big enterprise quietly deployed the open weights, he was candid: "I feel this can be a query for our authorized crew, however personally, I don't know. And even in case you're above $10 million, the one factor that we ask you is to contact us."
The corporate pairs its licensed mannequin releases with freely revealed analysis, he added, together with new structured-output evaluations and a coaching approach that mitigates the repetition loops widespread in small fashions — a failure mode he famous Qwen fashions are "form of responsible of."
Small mannequin, large enterprise implications
The launch coincided with an announcement from MacPaw, the Ukrainian software program firm behind CleanMyMac and Setapp, of a long-term strategic partnership with Liquid AI to construct an on-device AI stack for the Mac.
Liquid AI will design and fine-tune basis fashions for Eney, MacPaw's macOS assistant, operating domestically on Apple silicon by means of MacPaw's Elix inference engine and Mnemos reminiscence layer, with outcomes anticipated later this yr.
Labonne pointed to the deal as a concrete validation of the scale argument: "One of many the reason why they selected us can be as a result of the mannequin is sort of small, they usually don't have all of the reminiscence funds to run the opposite fashions."
The discharge arrives as {hardware} distributors, working system builders, and enterprise software program firms more and more put money into native AI execution — and as agent harnesses proliferate throughout the trade. Liquid AI's wager is that deployment economics, not uncooked scale, will outline an vital phase of that market: brokers operating repeatedly, in all places, at zero marginal token price.
Whether or not small, extremely optimized agent fashions change into a big phase of enterprise AI will finally rely much less on benchmark scores than on operational reliability. However Liquid AI's newest launch suggests the subsequent aggressive frontier is not merely constructing bigger fashions — it's constructing fashions sufficiently small, and succesful sufficient, to run wherever enterprise workflows already reside.
