Supported engines

Ollama on Inpherio.

Earn from the Ollama you already run. The Inpherio connector finds it automatically and offers the text & chat and embeddings models you choose to developers through one OpenAI-compatible API — at prices you set.

What it is.

Ollama is a popular open-source tool for running large language models locally, with a simple command line and a large library of ready-to-run models. It runs on Linux, macOS and Windows, on GPUs or CPU.

Ollama gets the fullest control from the Inpherio dashboard: you can pull, load, pin, unload and delete models remotely, and models you load as Pinned are loaded again automatically after Ollama or the machine restarts.

Ollama at a glance
ServesText & chat, Embeddings
Detected on127.0.0.1, port 11434 or 11435
Text & chat/v1/chat/completions (also /v1/messages and /api/chat)
Embeddings/v1/embeddings
Setup changes neededNone — the connector wraps it

Set it up in three steps.

  1. Run Ollama

    Install Ollama and pull a model, e.g. ollama pull qwen2.5:7b. Make sure Ollama is running (it listens on port 11434).

  2. Install the connector

    Run the Inpherio install command from your dashboard on the same machine. The connector finds Ollama on port 11434 or 11435 by itself — and if Ollama isn't installed yet, the installer can install it and a small starter model for you.

  3. Set your prices

    Each model is benchmarked on your hardware, then goes live on the marketplace at the platform's default prices. Change any price, or switch a model off, from your dashboard.

The install command is one line on Linux, macOS, Windows, Raspberry Pi or Docker — see the connector guide.

Control it from your dashboard.

What the Inpherio dashboard can do with Ollama on your machine, remotely and securely:

  • Load a model into memory — with a keep-alive of 5 minutes, 30 minutes, an hour or pinned
  • Unload a model to free memory
  • Unload every model at once
  • Download (pull) a new model from the dashboard
  • Delete a model from disk
  • See live engine detail — loaded models, memory and version

Questions.

Does Inpherio work with Ollama?

Yes. The Inpherio connector detects Ollama running on the same machine automatically and lists its text & chat and embeddings models in your dashboard — the ones you leave switched on are offered on the marketplace, at prices you set. You don't change your Ollama setup.

Do all my Ollama models go on the marketplace?

Only the ones you choose. Every model the connector finds appears in your dashboard, switched on by default; switch any model off (or the whole engine) and it is never routed to, rented or listed — the change applies straight away, no restart. A newly found model also has to pass a benchmark on your machine before anyone can use it.

Which port does Inpherio look for Ollama on?

Port 11434 or 11435 on 127.0.0.1. If yours runs elsewhere, add a port override for Ollama in your connector settings.

Can people reach my Ollama server directly?

No. The connector only talks to your engine on 127.0.0.1 and dials out to Inpherio over an encrypted link — nothing on your machine listens for outside connections.

How are Ollama models priced?

You set the price for each model in pounds — per million tokens for text and embeddings, per hour of audio for speech. Inpherio takes a flat 15% from what you earn, and each payout carries a payout fee of £2 + 1% per payout to a UK bank account, £2 + 2% to any other country. New providers pay no platform fee for their first 12 months or until they have earned £250 fee-free, whichever comes first; the payout fee still applies.