Skip to main content

​
Supported Models

dria-node includes a built-in registry of 12 models. All models are served locally using llama.cpp — no Ollama required. Each model is downloaded as a GGUF file from HuggingFace during setup.

​
Model Types

  • Text — Standard text generation and instruction following.
  • Vision — Multimodal models that can process both text and images.
  • Audio — Multimodal models that can process text and audio inputs.
  • MoE — Mixture-of-Experts models that activate only a subset of parameters per token, enabling larger models to run efficiently.

​
How to Choose a Model

1

Check Your RAM

Run dria-node setup — it will automatically detect your available RAM and filter models that fit your system.
2

Consider Demand

Visit dria.co/edge-ai to see which models are getting the most tasks. Running high-demand models means more task assignments and more earnings.
3

Match Your Hardware

Larger models produce higher-quality output but need more RAM and compute. Pick the largest model your hardware can comfortably run. GPU acceleration significantly improves performance for larger models.
4

Run the Benchmark

During dria-node setup, a test inference is run and your TPS (Tokens Per Second) is printed. Higher TPS means faster task completion and better reputation.

​
Quantization

All models default to 4-bit quantization (Q4_K_M or Q4_0) for the best balance of quality and resource usage. If you have extra RAM, you can use 8-bit quantization for better output quality:
8-bit quantization roughly doubles the GGUF file size and RAM usage. Make sure your system has enough resources before switching.

​
Serving Multiple Models

You can serve multiple models from a single node by separating them with commas:
This lets your node handle text, vision, and audio tasks. Make sure your system has enough RAM for all selected models.

​
Dynamic Model Updates

The Dria router can push model registry updates to your node at runtime. When new models are added to the network, your node can download and load them automatically without restarting.