Marketplace · Text & chat
deepseek-coder:6.7b
Call deepseek-coder:6.7b through one OpenAI-compatible API, served by independent machines at prices their owners set. There's no host for it on the grid at this moment (last live 16 Jul 2026) — so the next machine that loads it serves every request for it.
The grid is one machine short.
If your machine already runs open models, it can most likely serve deepseek-coder:6.7b too. Set your own price — you keep 85% of what it earns, and new hosts start with 12 months fee-free (up to £250 of earnings). A payout fee of £2 + 1% per payout to a UK bank account, £2 + 2% to any other country applies when you're paid.
- Install the connector. One command on the machine that runs your models. It dials out over an encrypted link — no ports to open. The connector
- Load
deepseek-coder:6.7b. It has run here on ollama; any supported engine works. The platform benchmarks it on your hardware first. - Set your price. Developers see your price beside the speed your machine measures.
- Get paid when it's called. Switch it off whenever you like. How hosting works
About deepseek-coder:6.7b.
- Type: Text & chat
- Size: 6.7B parameters
- Context window: up to 16,384 tokens
- Runs on: ollama
- First on the grid: 16 Jul 2026
- Hosts serving it now: 0
from openai import OpenAI
client = OpenAI(base_url="https://inpherio.co.uk/v1",
api_key=INPHERIO_API_KEY)
reply = client.chat.completions.create(
model="deepseek-coder:6.7b",
messages=[{"role": "user", "content": "Hello"}],
)deepseek-coder:6.7b in detail.
DeepSeek Coder is a capable coding model trained on two trillion code and natural language tokens.
- Published by
- deepseek-ai
- Parameters
- 6.7B
- Download size
- 3.8 GB (as packaged for Ollama)
- Quantisation
- Q4_0
- Format
- gguf
- Architecture
- llama
- Licence
- deepseek
- Task
- text generation
- Library
- transformers
- First published
- 29 Oct 2023
- Last updated
- 2 Feb 2024
- Downloads (30 days)
- 23,742 on Hugging Face
- Likes
- 536
llama text-generation
The model card
Published by the model's authors on Hugging Face — shown as they wrote it, unedited by Inpherio.
[🏠Homepage] | [🤖 Chat with DeepSeek Coder] | [Discord] | [Wechat(微信)]
1. Introduction of Deepseek Coder
Deepseek Coder is composed of a series of code language models, each trained from scratch on 2T tokens, with a composition of 87% code and 13% natural language in both English and Chinese. We provide various sizes of the code model, ranging from 1B to 33B versions. Each model is pre-trained on project-level code corpus by employing a window size of 16K and a extra fill-in-the-blank task, to support project-level code completion and infilling. For coding capabilities, Deepseek Coder achieves state-of-the-art performance among open-source code models on multiple programming languages and various benchmarks.
- Massive Training Data: Trained from scratch fon 2T tokens, including 87% code and 13% linguistic data in both English and Chinese languages.
- Highly Flexible & Scalable: Offered in model sizes of 1.3B, 5.7B, 6.7B, and 33B, enabling users to choose the setup most suitable for their requirements.
- Superior Model Performance: State-of-the-art performance among publicly available code models on HumanEval, MultiPL-E, MBPP, DS-1000, and APPS benchmarks.
- Advanced Code Completion Capabilities: A window size of 16K and a fill-in-the-blank task, supporting project-level code completion and infilling tasks.
2. Model Summary
deepseek-coder-6.7b-instruct is a 6.7B parameter model initialized from deepseek-coder-6.7b-base and fine-tuned on 2B tokens of instruction data.
- Home Page: DeepSeek
- Repository: deepseek-ai/deepseek-coder
- Chat With DeepSeek Coder: DeepSeek-Coder
3. How to Use
Here give some examples of how to use our model.
Chat Model Inference
from transformers import AutoTokenizer, AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained("deepseek-ai/deepseek-coder-6.7b-instruct", trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained("deepseek-ai/deepseek-coder-6.7b-instruct", trust_remote_code=True, torch_dtype=torch.bfloat16).cuda()
messages=[
{ 'role': 'user', 'content': "write a quick sort algorithm in python."}
]
inputs = tokenizer.apply_chat_template(messages, add_generation_prompt=True, return_tensors="pt").to(model.device)
### tokenizer.eos_token_id is the id of <|EOT|> token
outputs = model.generate(inputs, max_new_tokens=512, do_sample=False, top_k=50, top_p=0.95, num_return_sequences=1, eos_token_id=tokenizer.eos_token_id)
print(tokenizer.decode(outputs[0][len(inputs[0]):], skip_special_tokens=True))
4. License
This code repository is licensed under the MIT License. The use of DeepSeek Coder models is subject to the Model License. DeepSeek Coder supports commercial use.
See the LICENSE-MODEL for more details.
5. Contact
If you have any questions, please raise an issue or contact us at [email protected].
Sources: deepseek-ai/deepseek-coder-6.7b-instruct on Hugging Face · deepseek-coder:6.7b on Ollama. Collected from public sources on 8 Nov 2026; the host serving it may run a different build or quantisation — the marketplace shows each host's own measurements.
Live now instead.
Similar text & chat models with hosts serving them right now.
- qwen2.5:0.5b — from £0.009 per 1M output tokens · 5 hosts
- functiongemma:latest — from £0.015 per 1M output tokens · 4 hosts
- glm-ocr:latest — from £0.06 per 1M output tokens · 3 hosts
- granite4.2:3b — from £0.06 per 1M output tokens · 3 hosts
- lfm3:latest — from £0.043 per 1M output tokens · 3 hosts
- llama-guard3:1b — from £0.018 per 1M output tokens · 3 hosts
Questions about deepseek-coder:6.7b.
Can I use deepseek-coder:6.7b through an API?
Yes. Inpherio serves deepseek-coder:6.7b through one OpenAI-compatible API whenever a host on the grid is running it — the code on this page works unchanged. With no host right now, a call returns a "not available on any node" error and is never charged, and similar models are live on the marketplace.
How do I host deepseek-coder:6.7b and get paid?
Install the Inpherio connector on the machine that runs your models, load deepseek-coder:6.7b in a supported engine, and set a price. The platform benchmarks it on your hardware, then requests for it reach your machine. Set your own price — you keep 85% of what it earns, and new hosts start with 12 months fee-free (up to £250 of earnings). A payout fee of £2 + 1% per payout to a UK bank account, £2 + 2% to any other country applies when you're paid.
Why is deepseek-coder:6.7b not being served right now?
Hosts on Inpherio are independent machines that come and go. It was last live on 16 Jul 2026. When a host loads it again, this page shows live prices and measured speeds.