24 GB accelerator memory
Q4 GGUF · llama.cpp
Q4 consumes most of a 24 GB card, so reduce context and do not assume concurrent sessions.
Qwen
Text model
An efficient multimodal model for capable chat and agent workflows.
Capabilities
The most useful reasons to choose this model, without making you read through its repository first.
General assistants
Coding agents
Vision and tool use
For providers
The provider requirements live here, separate from the information you need to choose and use the model.
24 GB accelerator memory
Q4 GGUF · llama.cpp
Q4 consumes most of a 24 GB card, so reduce context and do not assume concurrent sessions.
48 GB accelerator memory
Q4 GGUF · llama.cpp
A 48 GB class card gives its 21–22 GB Q4 weights useful context and serving headroom.
Source and license
OpenMayhem links back to the source repository so you can inspect the model card, files, license, limitations, and creator guidance directly.