GstLlamaBaseTransform
GObject ╰──GInitiallyUnowned ╰──GstObject ╰──GstElement ╰──GstLlamaBaseTransform
Properties
context-size
“context-size” guint
Size of the context window for the LLM
Flags : Read / Write
Default value : 2048
history-size
“history-size” guint
Number of previous messages to keep in context
Flags : Read / Write
Default value : 5
min-p
“min-p” gfloat
Minimum probability threshold (0.0 = disabled)
Flags : Read / Write
Default value : 0.05
model-path
“model-path” gchararray
Path to the GGUF model file
Flags : Read / Write
Default value : NULL
penalty-freq
“penalty-freq” gfloat
Frequency penalty (0.0 = disabled)
Flags : Read / Write
Default value : 0
penalty-last-n
“penalty-last-n” gint
Last n tokens to penalize (0 = disable, -1 = context size)
Flags : Read / Write
Default value : 64
penalty-present
“penalty-present” gfloat
Presence penalty (0.0 = disabled)
Flags : Read / Write
Default value : 0
penalty-repeat
“penalty-repeat” gfloat
Repetition penalty (1.0 = disabled)
Flags : Read / Write
Default value : 1
system-prompt
“system-prompt” gchararray
System prompt for the LLM
Flags : Read / Write
Default value : NULL
top-k
“top-k” gint
Top-k sampling parameter (<= 0 to use vocab size)
Flags : Read / Write
Default value : 40
top-p
“top-p” gfloat
Top-p sampling parameter (1.0 = disabled)
Flags : Read / Write
Default value : 0.95
The results of the search are