Gallery of GGML models in GGUF format

Download and save in your device.

TinyLlama-1.1B-Chat-v0.6-GGUF
Disk size: 782 MB
Memory need: 8 GB
TheBloke/Marx-3B-v3-GGUF
Disk size: 1.94 GB
Memory need: 4.44 GB
OpenHermes-2.5-Mistral-7B-GGUF
Disk size: 5 GB
Memory need: 7.50 GB
TheBloke/Mistral-7B-v0.1-GGUF
Disk size: 5 GB
Memory need: 7.50 GB