Expected to run with a constrained Q4_K GGUF · reduced context profile.
Edition: Abliterated edition of InternScience Agents-A1
- Model size
- 35B / 3B active · 262K max
- Model format
- Q4_K GGUF · reduced context
- Runs with
- llama.cpp
Weights and projector use about 20.5 GiB before runtime state, so 24 GB requires shorter context and single-session serving.