ProductsLow importance
Canonical unveils Inference Manager, an Ubuntu tool that installs and serves local AI models through an interface compatible with the OpenAI API
At the Ubuntu Summit, Canonical showed Inference Manager, which provides the “inference” command to install models on the computer itself and make them available to other programs through an HTTP interface compatible with the OpenAI API, according to heise. The tool organizes “inference snaps”, Snap Store packages with models that run without internet, and serves chat assistants, coding agents in the editor and dictation programs on TCP port 8400. Ubuntu 26.10 already shipped Myna, a speech-to-text tool built on these packages.
Published in edition no. 30 of Noticiário do Joãozinho ·
Translated by Joãozinho AI from the original Brazilian Portuguese edition. Facts, numbers and sources are the same as in the original; quotes, video titles and source names stay in their original language. Read the original in Portuguese
Original source
https://www.heise.de/news/Inference-Manager-neues-Ubuntu-Tool-verwaltet-lokale-KI-Modelle-11525275.html