Spark-X2.6-4B: Chat, code and plan tasks on your own device
Added · Updated
Made by SparkLLM
View profile on Hugging Face (opens in a new tab)Run a compact language model on your own device for coding, tool-using agents and long inputs; for developers building on-device AI apps.
Model details
Original model XHToken/Spark-X2.6-4B
Input Text Output Text
Ways to use it Run locally
Role in this family: Fine-tuned version.
XHToken/Spark-X2.6-4B-Base (opens in a new tab)What it does
Spark-X2.6-4B is a compact text-generation language model for English and Chinese, made for on-device use. It keeps the same design as Spark-X2.5-4B but was trained further to improve coding, tool use and multi-step planning. You can set its thinking level, meaning how much it reasons before answering, to none, low or high.
How to use it
Download the weights from the Hugging Face page and load them with Transformers, or serve them with SGLang or vLLM as an OpenAI-compatible server, so apps written for OpenAI's API format can send it requests. The card also lists MLX, llama.cpp and Ollama options.
Common use cases
- Start a local OpenAI-compatible server, send a coding question from your app, and get a written answer with code back.
- Turn thinking off for a quick everyday request to get a faster reply, or set it to high for a harder multi-step plan.
Can I use this?
Requirements The card gives setup routes for NVIDIA GPUs and Ascend NPUs (SGLang or vLLM container images) and for Apple silicon, Linux CPU or NVIDIA CUDA on Linux (MLX). Its example server's 1,048,576-token context needs sufficient device memory; reduce it when necessary.
Caveat Exact memory amounts are not documented. Thinking mode is on by default and must be turned off per request.
Worth knowing Thinking mode is on by default and must be turned off per request. llama.cpp needs build b10828 or later. Licensed under Apache License 2.0.
Why it's here
Not trending this week
Last seen on the Hugging Face trending list on 2 November 2026. It stays on BuildTube so you can still find it.
- 1,025 people have liked it on Hugging Face.
- It was downloaded 23,968 times in the last 30 days.
Numbers checked on 8 November 2026; not refreshed since.
Behind it
View model pageBuildTube has not run or verified this project. Everything above is written from what the creator published.
Made this?
Quick questions
- What is Spark-X2.6-4B?
- Spark-X2.6-4B is a compact text-generation language model for English and Chinese, made for on-device use.
- What can I use Spark-X2.6-4B for?
- Start a local OpenAI-compatible server, send a coding question from your app, and get a written answer with code back; Turn thinking off for a quick everyday request to get a faster reply, or set it to high for a harder multi-step plan
- Can I run Spark-X2.6-4B on my computer?
- It runs on your own hardware with a model runtime. The card gives setup routes for NVIDIA GPUs and Ascend NPUs (SGLang or vLLM container images) and for Apple silicon, Linux CPU or NVIDIA CUDA on Linux (MLX). Exact memory amounts are not documented.
- What do I need to use Spark-X2.6-4B?
- A computer with an NVIDIA GPU, an Ascend NPU or Apple silicon (MLX also runs on a Linux CPU) and enough memory for the context length you set. Then one runtime: Transformers 4.57.1, SGLang, vLLM, MLX, llama.cpp (build b10828 or later) or Ollama.
- What license does Spark-X2.6-4B use?
- Licensed under Apache License 2.0.
More from this week
- kimi-k3-in-c Run a 2.78-trillion-parameter model on 8 GB of RAM
Get text answers from the huge Kimi K3 AI model using one CPU and no graphics card.
- P-H3-Image-Comfy Make and edit 8-megapixel images in ComfyUI
Turn short text requests into 8-megapixel images and edit pictures on your own graphics card.
- Idol Turn one picture of an object into a 3D Gaussian splat
Idol turns one photo, render or generated image of an object into a 3D Gaussian splat file.
Explore by topic
Post this
Download share imageFor makers
Made this? Show it’s on BuildTube — add the badge to your README or embed the card on your site.
README badge (Markdown)
[](https://buildtube.app/p/hf-xhtoken-spark-x2-6-4b/)Embed card (HTML)
<iframe src="https://buildtube.app/embed/hf-xhtoken-spark-x2-6-4b/" width="560" height="240" style="border:0;max-width:100%" loading="lazy" title="Spark-X2.6-4B on BuildTube"></iframe>