ContextSize

AsposeAIModelConfig.ContextSize property

Defines the maximum number of tokens the LLM can use as context during inference. If null, the default context size defined by the model will be used. Larger values allow the model to consider more text but may require more memory.

public int? ContextSize { get; set; }

See Also

AllowAutoDownload DirectoryModelPath