GGUF files are available on HF: https://huggingface.co/peakji/steiner-32b-previe... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

peakji on Oct 22, 2024 | parent | context | favorite | on: Show HN: Steiner – An open-source reasoning model ...

GGUF files are available on HF: https://huggingface.co/peakji/steiner-32b-preview-gguf

I haven't personally used Ollama Modelfile, but I think it should be relatively easy to convert from GGUF?

ca_tech on Oct 23, 2024 [–]

You can now run any huggingface model using the following command

ollama run hf.co/{username}/{repository}

Example: ollama run hf.co/peakji/steiner-32b-preview-gguf:Q4_K_M

Source: https://huggingface.co/docs/hub/en/ollama

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact