Skip to content

latent.rate_limiter.backends.disabled

No-op backend — bypasses rate limiting entirely.

Selected via LATENT_RATE_LIMIT_BACKEND=disabled in environments where the rate limiter's overhead isn't justified — typically production hot paths serving real users, where a per-call SQLite round-trip and semaphore wait is unwanted. Eval / batch pipelines leave the default (sqlite_ipc) so they still cap concurrency.

All Protocol methods return immediately. Throttle observation is discarded — operators wanting throttle visibility in disabled-backend environments should rely on latent.flows.agent_inference_flow._BedrockRetryVisibilityHandler (boto3 retry log surfacing), which is independent of the rate limiter.

Classes

DisabledBackend

DisabledBackend()

Rate-limiter backend that does nothing.

Implements :class:latent.rate_limiter.protocol.RateLimiterBackend via no-ops. Returns 0 for all counter queries; list_keys is always empty because nothing is ever tracked.

Methods

DisabledBackend.acquire

acquire(key: str, max_concurrent: int) -> None

DisabledBackend.current_capacity

current_capacity(key: str) -> int

DisabledBackend.list_keys

list_keys() -> list[str]

DisabledBackend.release

release(key: str) -> None

DisabledBackend.report_throttle

report_throttle(key: str) -> None

DisabledBackend.throttle_count

throttle_count(key: str) -> int