Marketplace · Text & chat
qwen2.5-coder:14b
Call qwen2.5-coder:14b through one OpenAI-compatible API, served by independent machines at prices their owners set. A host has just loaded qwen2.5-coder:14b and the platform is benchmarking it on their hardware; it goes live when that finishes.
The grid is one machine short.
qwen2.5-coder:14b is about 8.4 GB of weights, so a machine with a little more than that in free memory — a gaming GPU, an Apple-silicon Mac, a well-specced mini PC — can usually serve it. Set your own price — you keep 85% of what it earns, and new hosts start with 12 months fee-free (up to £250 of earnings). A payout fee of £2 + 1% per payout to a UK bank account, £2 + 2% to any other country applies when you're paid.
- Install the connector. One command on the machine that runs your models. It dials out over an encrypted link — no ports to open. The connector
- Load
qwen2.5-coder:14b. It has run here on ollama; any supported engine works. The platform benchmarks it on your hardware first. - Set your price. The last host listed it from £0.18 per 1M output tokens. Developers see your price beside the speed your machine measures.
- Get paid when it's called. Switch it off whenever you like. How hosting works
About qwen2.5-coder:14b.
tools code
- Type: Text & chat
- Size: 14B parameters, about 8.4 GB of weights
- Context window: up to 32,768 tokens
- Runs on: ollama
- Last listed from: £0.18 per 1M output tokens
- First on the grid: 1 Nov 2026
- Hosts serving it now: 0
from openai import OpenAI
client = OpenAI(base_url="https://inpherio.co.uk/v1",
api_key=INPHERIO_API_KEY)
reply = client.chat.completions.create(
model="qwen2.5-coder:14b",
messages=[{"role": "user", "content": "Hello"}],
)qwen2.5-coder:14b in detail.
The latest series of Code-Specific Qwen models, with significant improvements in code generation, code reasoning, and code fixing.
- Published by
- Qwen
- Parameters
- 14.8B
- Download size
- 9.0 GB (as packaged for Ollama)
- Quantisation
- Q4_K_M
- Format
- gguf
- Architecture
- qwen2
- Licence
- Apache 2.0
- Based on
- Qwen/Qwen2.5-Coder-14B
- Task
- text generation
- Library
- transformers
- Languages
- en
- First published
- 6 Nov 2024
- Last updated
- 12 Jan 2025
- Downloads (30 days)
- 2 million on Hugging Face
- Likes
- 213
qwen2 text-generation code codeqwen chat qwen qwen-coder en
The model card
Published by the model's authors on Hugging Face — shown as they wrote it, unedited by Inpherio.
Qwen2.5-Coder-14B-Instruct
Introduction
Qwen2.5-Coder is the latest series of Code-Specific Qwen large language models (formerly known as CodeQwen). As of now, Qwen2.5-Coder has covered six mainstream model sizes, 0.5, 1.5, 3, 7, 14, 32 billion parameters, to meet the needs of different developers. Qwen2.5-Coder brings the following improvements upon CodeQwen1.5:
- Significantly improvements in code generation, code reasoning and code fixing. Base on the strong Qwen2.5, we scale up the training tokens into 5.5 trillion including source code, text-code grounding, Synthetic data, etc. Qwen2.5-Coder-32B has become the current state-of-the-art open-source codeLLM, with its coding abilities matching those of GPT-4o.
- A more comprehensive foundation for real-world applications such as Code Agents. Not only enhancing coding capabilities but also maintaining its strengths in mathematics and general competencies.
- Long-context Support up to 128K tokens.
This repo contains the instruction-tuned 14B Qwen2.5-Coder model, which has the following features:
- Type: Causal Language Models
- Training Stage: Pretraining & Post-training
- Architecture: transformers with RoPE, SwiGLU, RMSNorm, and Attention QKV bias
- Number of Parameters: 14.7B
- Number of Paramaters (Non-Embedding): 13.1B
- Number of Layers: 48
- Number of Attention Heads (GQA): 40 for Q and 8 for KV
- Context Length: Full 131,072 tokens
- Please refer to this section for detailed instructions on how to deploy Qwen2.5 for handling long texts.
For more details, please refer to our blog, GitHub, Documentation, Arxiv.
Requirements
The code of Qwen2.5-Coder has been in the latest Hugging face transformers and we advise you to use the latest version of transformers.
With transformers<4.37.0, you will encounter the following error:
KeyError: 'qwen2'
Quickstart
Here provides a code snippet with apply_chat_template to show you how to load the tokenizer and model and how to generate contents.
from transformers import AutoModelForCausalLM, AutoTokenizer
model_name = "Qwen/Qwen2.5-Coder-14B-Instruct"
model = AutoModelForCausalLM.from_pretrained(
model_name,
torch_dtype="auto",
device_map="auto"
)
tokenizer = AutoTokenizer.from_pretrained(model_name)
prompt = "write a quick sort algorithm."
messages = [
{"role": "system", "content": "You are Qwen, created by Alibaba Cloud. You are a helpful assistant."},
{"role": "user", "content": prompt}
]
text = tokenizer.apply_chat_template(
messages,
tokenize=False,
add_generation_prompt=True
)
model_inputs = tokenizer([text], return_tensors="pt").to(model.device)
generated_ids = model.generate(
**model_inputs,
max_new_tokens=512
)
generated_ids = [
output_ids[len(input_ids):] for input_ids, output_ids in zip(model_inputs.input_ids, generated_ids)
]
response = tokenizer.batch_decode(generated_ids, skip_special_tokens=True)[0]
Processing Long Texts
The current config.json is set for context length up to 32,768 tokens. To handle extensive inputs exceeding 32,768 tokens, we utilize YaRN, a technique for enhancing model length extrapolation, ensuring optimal performance on lengthy texts.
For supported frameworks, you could add the following to config.json to enable YaRN:
{
...,
"rope_scaling": {
"factor": 4.0,
"original_max_position_embeddings": 32768,
"type": "yarn"
}
}
For deployment, we recommend using vLLM. Please refer to our Documentation for usage if you are not familar with vLLM. Presently, vLLM only supports static YARN, which means the scaling factor remains constant regardless of input length, potentially impacting performance on shorter texts. We advise adding the rope_scaling configuration only when processing long contexts is required.
Read the rest of the model card
Evaluation & Performance
Detailed evaluation results are reported in this 📑 blog.
For requirements on GPU memory and the respective throughput, see results here.
Citation
If you find our work helpful, feel free to give us a cite.
@article{hui2024qwen2,
title={Qwen2. 5-Coder Technical Report},
author={Hui, Binyuan and Yang, Jian and Cui, Zeyu and Yang, Jiaxi and Liu, Dayiheng and Zhang, Lei and Liu, Tianyu and Zhang, Jiajun and Yu, Bowen and Dang, Kai and others},
journal={arXiv preprint arXiv:2409.12186},
year={2024}
}
@article{qwen2,
title={Qwen2 Technical Report},
author={An Yang and Baosong Yang and Binyuan Hui and Bo Zheng and Bowen Yu and Chang Zhou and Chengpeng Li and Chengyuan Li and Dayiheng Liu and Fei Huang and Guanting Dong and Haoran Wei and Huan Lin and Jialong Tang and Jialin Wang and Jian Yang and Jianhong Tu and Jianwei Zhang and Jianxin Ma and Jin Xu and Jingren Zhou and Jinze Bai and Jinzheng He and Junyang Lin and Kai Dang and Keming Lu and Keqin Chen and Kexin Yang and Mei Li and Mingfeng Xue and Na Ni and Pei Zhang and Peng Wang and Ru Peng and Rui Men and Ruize Gao and Runji Lin and Shijie Wang and Shuai Bai and Sinan Tan and Tianhang Zhu and Tianhao Li and Tianyu Liu and Wenbin Ge and Xiaodong Deng and Xiaohuan Zhou and Xingzhang Ren and Xinyu Zhang and Xipin Wei and Xuancheng Ren and Yang Fan and Yang Yao and Yichang Zhang and Yu Wan and Yunfei Chu and Yuqiong Liu and Zeyu Cui and Zhenru Zhang and Zhihao Fan},
journal={arXiv preprint arXiv:2407.10671},
year={2024}
}Sources: Qwen/Qwen2.5-Coder-14B-Instruct on Hugging Face · qwen2.5-coder:14b on Ollama. Collected from public sources on 8 Nov 2026; the host serving it may run a different build or quantisation — the marketplace shows each host's own measurements.
Live now instead.
Similar text & chat models with hosts serving them right now.
- qwen2.5-coder:7b — from £0.063 per 1M output tokens · 2 hosts
- qwen2.5:0.5b — from £0.009 per 1M output tokens · 5 hosts
- functiongemma:latest — from £0.015 per 1M output tokens · 4 hosts
- glm-ocr:latest — from £0.06 per 1M output tokens · 3 hosts
- granite4.2:3b — from £0.06 per 1M output tokens · 3 hosts
- lfm3:latest — from £0.043 per 1M output tokens · 3 hosts
Questions about qwen2.5-coder:14b.
Can I use qwen2.5-coder:14b through an API?
Yes. Inpherio serves qwen2.5-coder:14b through one OpenAI-compatible API whenever a host on the grid is running it — the code on this page works unchanged. With no host right now, a call returns a "not available on any node" error and is never charged, and similar models are live on the marketplace.
How do I host qwen2.5-coder:14b and get paid?
Install the Inpherio connector on the machine that runs your models, load qwen2.5-coder:14b in a supported engine, and set a price. The platform benchmarks it on your hardware, then requests for it reach your machine. Set your own price — you keep 85% of what it earns, and new hosts start with 12 months fee-free (up to £250 of earnings). A payout fee of £2 + 1% per payout to a UK bank account, £2 + 2% to any other country applies when you're paid.
What hardware does qwen2.5-coder:14b need?
Its weights are about 8.4 GB, so plan for a little more than that in free GPU or unified memory. Many gaming GPUs, Apple-silicon Macs and mini PCs qualify.
Why is qwen2.5-coder:14b not being served right now?
Hosts on Inpherio are independent machines that come and go. It was last live on 11 Nov 2026. When a host loads it again, this page shows live prices and measured speeds.