Demonstration catalog. Only models with a verified signed checksum are installable on a SmartStick.
| Model | Publisher | Tier | Params | Quant | Size | Min RAM | Context | License | Verified |
|---|---|---|---|---|---|---|---|---|---|
| Llama 3.2 3B Instruct | Meta / bartowski | compact | 3B | Q4_K_M | 2 GB | 4 GB | 8,192 | Llama 3.2 Community | ✓ |
| Phi 3.5 Mini Instruct | Microsoft / bartowski | compact | 3.8B | Q4_K_M | 2.4 GB | 6 GB | 4,096 | MIT | ✓ |
| Mistral 7B Instruct v0.3 | Mistral / bartowski | standard | 7B | Q4_K_M | 4.4 GB | 8 GB | 32,768 | Apache 2.0 | ✓ |
| Llama 3.1 8B Instruct | Meta / bartowski | standard | 8B | Q4_K_M | 4.9 GB | 10 GB | 128,000 | Llama 3.1 Community | ✓ |
| Qwen 2.5 7B Instruct | Alibaba / bartowski | standard | 7B | Q4_K_M | 4.6 GB | 8 GB | 32,768 | Apache 2.0 | ✓ |
| Qwen 2.5 Coder 7B | Alibaba / bartowski | standard | 7B | Q4_K_M | 4.7 GB | 8 GB | 32,768 | Apache 2.0 | ✓ |
| Gemma 2 9B Instruct | Google / bartowski | standard | 9B | Q4_K_M | 5.4 GB | 12 GB | 8,192 | Gemma Terms | ✓ |
| Mistral Nemo 12B Instruct | Mistral / bartowski | advanced | 12B | Q4_K_M | 7.5 GB | 16 GB | 128,000 | Apache 2.0 | ✓ |
| Phi 4 14B | Microsoft / bartowski | advanced | 14B | Q4_K_M | 8.8 GB | 20 GB | 16,384 | MIT | ✓ |
| Mistral Small 24B Instruct | Mistral / bartowski | professional | 24B | Q4_K_M | 14.3 GB | 32 GB | 32,768 | Apache 2.0 | ✓ |
| Qwen 2.5 32B Instruct | Alibaba / bartowski | professional | 32B | Q4_K_M | 19.2 GB | 40 GB | 32,768 | Apache 2.0 | ✓ |
| Custom GGUF model | You | custom | Any | Any | 0 GB | 0 GB | 0 | Your choice | — |