feat(devgen/providers): normalize token limit error handling

Add token limit error detection and formatting across all provider modules to surface clear diagnostics when context windows are exceeded, improving error messages and preventing silent failures.

New Features
- Introduce `is_token_limit_error` checks in Anthropic, Gemini, Hugging Face, Ollama, OpenAI, and OpenRouter providers.
- Use `format_token_limit_error` to generate user‑friendly error messages for token limit overs.

Enhancements
- Centralize token limit error handling for consistent diagnostics across providers.
- Explicitly re‑raise `RuntimeError` in Hugging Face to preserve original behavior.

Bug Fixes
- None
This commit is contained in:
sankalp committed 2026-06-06 16:45:05 +05:45
1 parent d991af9c47
commit 8069895bc7
6 files changed
+37 -1

No files matched your search

+6
View File
@@ -2,6 +2,8 @@ import time
from google import genai
from google.genai import types
from devgen.utils import format_token_limit_error, is_token_limit_error
class GeminiProvider:
"""Generates content using Google's Gemini models."""
@@ -40,6 +42,10 @@ class GeminiProvider:
return response.text.strip()
except Exception as e:
error_msg = str(e).upper()
# Token / context-window overflow is not retryable — no point
# backing off, the prompt is just too big.
if is_token_limit_error(e):
raise RuntimeError(format_token_limit_error("Gemini", e)) from e
# Check for 429 or ResourceExhausted in common error formats
if any(
x in error_msg