Skip to content

feat: retry completions according to Retry-After header #444

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
andreiancuta-uipath merged 3 commits into from
Jan 28, 2026
Merged

feat: retry completions according to Retry-After header #444

andreiancuta-uipath merged 3 commits into from
Jan 28, 2026

Conversation

@andreiancuta-uipath
Copy link
Contributor

@andreiancuta-uipath andreiancuta-uipath commented Jan 20, 2026 •
edited
Loading

  • OpenAi SDK already handles Retry-After header
  • Vertex and Bedrock:
    • Added a tenacity retry strategy that unwinds exceptions, attempting to read the Retry-After header
    • Falls back to exponential backoff if header is absent, and status code or exception type is retryable
    • Disables SDK retries, since they do not support reading the Retry-After header
image

@andreiancuta-uipath andreiancuta-uipath force-pushed the feat/rate-limit-retry branch 12 times, most recently from afe66a1 to 2afeb2c Compare January 27, 2026 09:01
andreitava-uip
andreitava-uip reviewed Jan 27, 2026
View reviewed changes
@andreiancuta-uipath andreiancuta-uipath force-pushed the feat/rate-limit-retry branch 2 times, most recently from b8161f7 to 078eec9 Compare January 28, 2026 10:35
@andreiancuta-uipath andreiancuta-uipath merged commit 9e876ed into main Jan 28, 2026
60 of 61 checks passed
@andreiancuta-uipath andreiancuta-uipath deleted the feat/rate-limit-retry branch January 28, 2026 12:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@andreitava-uip andreitava-uip andreitava-uip approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@andreiancuta-uipath @andreitava-uip