Modelfile language preview
1. A custom model
FROM, PARAMETER, SYSTEM, and TEMPLATE instructions
horizon-dark
# a custom llama model
FROM llama3.2
PARAMETER temperature 0.7
PARAMETER num_ctx 4096
SYSTEM """You are a helpful assistant."""
TEMPLATE """{{ .Prompt }}"""
MESSAGE system You are concise.
MESSAGE user Hello!atom-one-dark
# a custom llama model
FROM llama3.2
PARAMETER temperature 0.7
PARAMETER num_ctx 4096
SYSTEM """You are a helpful assistant."""
TEMPLATE """{{ .Prompt }}"""
MESSAGE system You are concise.
MESSAGE user Hello!github-dark
# a custom llama model
FROM llama3.2
PARAMETER temperature 0.7
PARAMETER num_ctx 4096
SYSTEM """You are a helpful assistant."""
TEMPLATE """{{ .Prompt }}"""
MESSAGE system You are concise.
MESSAGE user Hello!dracula
# a custom llama model
FROM llama3.2
PARAMETER temperature 0.7
PARAMETER num_ctx 4096
SYSTEM """You are a helpful assistant."""
TEMPLATE """{{ .Prompt }}"""
MESSAGE system You are concise.
MESSAGE user Hello!nord
# a custom llama model
FROM llama3.2
PARAMETER temperature 0.7
PARAMETER num_ctx 4096
SYSTEM """You are a helpful assistant."""
TEMPLATE """{{ .Prompt }}"""
MESSAGE system You are concise.
MESSAGE user Hello!github
# a custom llama model
FROM llama3.2
PARAMETER temperature 0.7
PARAMETER num_ctx 4096
SYSTEM """You are a helpful assistant."""
TEMPLATE """{{ .Prompt }}"""
MESSAGE system You are concise.
MESSAGE user Hello!2. Sampling parameters
top_k, top_p, and repeat_penalty
horizon-dark
FROM mistral
PARAMETER top_k 40
PARAMETER top_p 0.9
PARAMETER repeat_penalty 1.1
PARAMETER stop "<|end|>"atom-one-dark
FROM mistral
PARAMETER top_k 40
PARAMETER top_p 0.9
PARAMETER repeat_penalty 1.1
PARAMETER stop "<|end|>"github-dark
FROM mistral
PARAMETER top_k 40
PARAMETER top_p 0.9
PARAMETER repeat_penalty 1.1
PARAMETER stop "<|end|>"dracula
FROM mistral
PARAMETER top_k 40
PARAMETER top_p 0.9
PARAMETER repeat_penalty 1.1
PARAMETER stop "<|end|>"nord
FROM mistral
PARAMETER top_k 40
PARAMETER top_p 0.9
PARAMETER repeat_penalty 1.1
PARAMETER stop "<|end|>"github
FROM mistral
PARAMETER top_k 40
PARAMETER top_p 0.9
PARAMETER repeat_penalty 1.1
PARAMETER stop "<|end|>"3. Conversation history
seeding a chat with prior messages
horizon-dark
FROM llama3.2
MESSAGE system You are a pirate.
MESSAGE user Tell me a joke.
MESSAGE assistant Why did the pirate go to school? To improve his "arrr"ticulation!atom-one-dark
FROM llama3.2
MESSAGE system You are a pirate.
MESSAGE user Tell me a joke.
MESSAGE assistant Why did the pirate go to school? To improve his "arrr"ticulation!github-dark
FROM llama3.2
MESSAGE system You are a pirate.
MESSAGE user Tell me a joke.
MESSAGE assistant Why did the pirate go to school? To improve his "arrr"ticulation!dracula
FROM llama3.2
MESSAGE system You are a pirate.
MESSAGE user Tell me a joke.
MESSAGE assistant Why did the pirate go to school? To improve his "arrr"ticulation!nord
FROM llama3.2
MESSAGE system You are a pirate.
MESSAGE user Tell me a joke.
MESSAGE assistant Why did the pirate go to school? To improve his "arrr"ticulation!github
FROM llama3.2
MESSAGE system You are a pirate.
MESSAGE user Tell me a joke.
MESSAGE assistant Why did the pirate go to school? To improve his "arrr"ticulation!