Skip to content
Home / Services / Custom Models & Fine-tuning

Custom Models & Fine-tuning

Small, fast models trained on your data with LoRA, and private language models that run on your own hardware.

Overview

What it does for you

For a narrow, high-volume task, a small model fine-tuned on your data can be faster, cheaper and more private than a large API model. We prepare the data, train with LoRA or full fine-tuning, measure the results against a test set and deploy the model where you need it, including offline.

Proof

Public demo: a Qwen2.5-0.5B model fine-tuned on 25 hotel intents went from 44% to 99% accuracy on the test set. Code and results are on GitHub.

Outcomes

  • Lower cost per request for high-volume tasks
  • Faster responses from a small model
  • Your data stays in-house
  • Works without an internet connection where required
Scope

What's included

  • Data preparation and labelling plan
  • Fine-tuning with LoRA / PEFT, or full training for small models
  • Evaluation on a held-out test set, reported honestly
  • Serving with vLLM or Ollama, on GPU or CPU
  • Fallback to a larger model for hard cases
  • Retraining plan as your data changes

Good for

  • Intent classification
  • Entity extraction
  • Domain-specific assistants
  • Regulated or offline environments

Typical stack

  • PyTorch, Hugging Face
  • LoRA / PEFT
  • Qwen, Llama, Mistral
  • vLLM, Ollama

How it starts

A free 30-minute call, then a written fixed-price proposal for a pilot of two to four weeks. You own everything we build.

FAQ

Common questions about Custom Models & Fine-tuning

When should we fine-tune instead of prompting?

When the task is narrow and repeated at volume, when latency or cost matter, or when data cannot leave your environment. For broad knowledge questions, retrieval (RAG) is usually the better first step.

How much data do we need?

For classification, a few hundred good examples per class is often enough. We tell you early if your data is not sufficient.

Do we need GPUs?

Training usually runs on rented GPUs for a few hours. Small models can serve on CPU.

Is our data used to train anything else?

No. Your data and your model stay yours.

Next step

Want Custom Models & Fine-tuning in your business?

A free 30-minute call: tell us what eats your team's time, and leave with a clear next step, even if you never hire us.

WhatsApp