Parameter Compatibility

Which parameters work with which models.

Guaranteed Compatible (all models)

ParameterDescription
modelModel name
messagesMessage array
streamEnable SSE streaming
max_tokens / max_completion_tokensMax output tokens
temperatureSampling temperature
top_pNucleus sampling
stopStop sequences
seedDeterministic sampling

Widely Supported (most models)

ParameterDescription
tools / tool_choiceFunction calling
response_formatJSON mode / structured outputs
frequency_penaltyRepetition reduction
presence_penaltyTopic diversity
logprobs / top_logprobsToken probabilities

Model-Specific

ParameterModels
top_kAnthropic, some open models
repetition_penaltyOpen models (Llama, Mistral)
min_pSome open models

How It Works

The marketplace passes through all parameters to the provider unchanged. Unsupported params are silently ignored by most providers (same behavior as OpenRouter).

The stream_options: {"include_usage": true} param is auto-injected for metering — you don't need to add it.