GstLlamaBaseTransform

GObject
    ╰──GInitiallyUnowned
        ╰──GstObject
            ╰──GstElement
                ╰──GstLlamaBaseTransform

Properties

context-size

“context-size” guint

Size of the context window for the LLM

Flags : Read / Write

Default value : 2048


history-size

“history-size” guint

Number of previous messages to keep in context

Flags : Read / Write

Default value : 5


min-p

“min-p” gfloat

Minimum probability threshold (0.0 = disabled)

Flags : Read / Write

Default value : 0.05


model-path

“model-path” gchararray

Path to the GGUF model file

Flags : Read / Write

Default value : NULL


penalty-freq

“penalty-freq” gfloat

Frequency penalty (0.0 = disabled)

Flags : Read / Write

Default value : 0


penalty-last-n

“penalty-last-n” gint

Last n tokens to penalize (0 = disable, -1 = context size)

Flags : Read / Write

Default value : 64


penalty-present

“penalty-present” gfloat

Presence penalty (0.0 = disabled)

Flags : Read / Write

Default value : 0


penalty-repeat

“penalty-repeat” gfloat

Repetition penalty (1.0 = disabled)

Flags : Read / Write

Default value : 1


seed

“seed” guint

Random seed for sampling

Flags : Read / Write

Default value : -1159983106


system-prompt

“system-prompt” gchararray

System prompt for the LLM

Flags : Read / Write

Default value : NULL


temp

“temp” gfloat

Sampling temperature

Flags : Read / Write

Default value : 0.8


top-k

“top-k” gint

Top-k sampling parameter (<= 0 to use vocab size)

Flags : Read / Write

Default value : 40


top-p

“top-p” gfloat

Top-p sampling parameter (1.0 = disabled)

Flags : Read / Write

Default value : 0.95


The results of the search are