Skip to content

Instantly share code, notes, and snippets.

@shrwnsan

shrwnsan/Modelfile-gpt-oss-20b

Last active September 13, 2025 05:11
Show Gist options
  • Save shrwnsan/971d409951e793ca4c86738544288422 to your computer and use it in GitHub Desktop.
Save shrwnsan/971d409951e793ca4c86738544288422 to your computer and use it in GitHub Desktop.
Download ZIP
Ollama Modelfile for Unsloth GGUF Q4_K_XL models that can be run on an M4 MacBook Air. Though hit-miss when it comes to agentic coding due to tool usage variance.
Raw
Modelfile-gpt-oss-20b
FROM hf.co/unsloth/gpt-oss-20b-GGUF:Q4_K_XL
PARAMETER num_ctx 32768
Raw
Modelfile-qwen3-2507-instruct
FROM hf.co/unsloth/Qwen3-30B-A3B-Instruct-2507-GGUF:UD-Q4_K_XL
PARAMETER num_ctx 32768
Raw
Modelfile-qwen3-2507-thinking
FROM hf.co/unsloth/Qwen3-30B-A3B-Thinking-2507-GGUF:UD-Q4_K_XL
PARAMETER num_ctx 32768
PARAMETER temperature 0.6
PARAMETER top_p 0.95
Raw
Modelfile-qwen3-coder
FROM hf.co/unsloth/Qwen3-Coder-30B-A3B-Instruct-GGUF:UD-Q4_K_XL
PARAMETER min_p 0.01
PARAMETER num_ctx 65536
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment