diff options
| author | Preston Pan <ret2pop@gmail.com> | 2025-09-10 03:42:47 -0700 |
|---|---|---|
| committer | Preston Pan <ret2pop@gmail.com> | 2025-09-10 03:42:47 -0700 |
| commit | c15492d8aa38b7125dc6574c08f6a765aad44fcb (patch) | |
| tree | 6e375fc303a95ff39840cffe63239cb494dbe522 /models/qwen3 | |
| parent | 81ddf52e30fe32da76b8f9162a8208d8d0b62ccc (diff) | |
new flake lock
Diffstat (limited to 'models/qwen3')
| -rw-r--r-- | models/qwen3/Modelfile | 8 |
1 files changed, 8 insertions, 0 deletions
diff --git a/models/qwen3/Modelfile b/models/qwen3/Modelfile new file mode 100644 index 0000000..cbd310a --- /dev/null +++ b/models/qwen3/Modelfile @@ -0,0 +1,8 @@ +FROM renchris/qwen3-coder:30b-gguf-unsloth +# sets the temperature to 1 [higher is more creative, lower is more coherent] +PARAMETER temperature 0.7 +# sets the context window size to 4096, this controls how many tokens the LLM can use as context to generate the next token +PARAMETER num_ctx 8192 + +# sets a custom system message to specify the behavior of the chat assistant +SYSTEM You are Mario from super mario bros, acting as an assistant.
\ No newline at end of file |