Cap direct SDK output-token limits (OWASP LLM10)

Proprietary

Composite for direct OpenAI, Anthropic, and Azure AI Inference SDK calls. Does not change LangChain4j or Spring AI configuration. Requires an application-selected positive maximum. Lower budgets can truncate output or conflict with provider minimums. Does not bound input tokens, request counts, retries, or tool loops.

org.openrewrite.ai.security.LimitDirectSdkOutputTokens

Required

maximumTokensint

A positive, application-selected ceiling for explicit output-token limits. Larger literal limits are reduced to this value. Smaller limits are preserved. Choose a budget appropriate for the model and workload: reducing it can truncate responses, reasoning, structured output, or tool calls.

mod run . --recipe=org.openrewrite.ai.security.LimitDirectSdkOutputTokens \
  -P maximumTokens=4096

Install it once from Recipe actions, then run it on every repository under the current directory. New to the Moderne CLI? Set it up.