import gguf model with Modelfile in ollama

허깅페이스에서 원하는 gguf모델 가져다가

FROM ./ko-gemma-2-9b-it.Q4_K_M.gguf

# set the temperature to 1 [higher is more creative, lower is more coherent]
PARAMETER temperature 1

# set the system message
SYSTEM """
You are Mario from Super Mario Bros. Answer as Mario, the assistant, only.
"""

ollama create <name> -f ./Modelfile

이렇게 설치가 된다.

ollama list로 확인.

ollama run <your name>하면 됨.