If you are building an AI-powered application using the OpenAI SDK or Anthropic Claude API, encountering the dreaded Error 429: Rate Limit Exceeded or sudden connection timeouts is a rite of passage.
This usually happens when your application triggers too many Requests Per Minute (RPM), consumes too many Tokens Per Minute (TPM), or fails to manage asynchronous requests properly inside serverless server environments like Next.js App Router or AWS Lambda.
In this guide, we will implement the industry-standard software engineering patterns to handle these API errors gracefully.
1. The Right Way: Implementing Exponential Backoff with Jitter
The absolute worst way to handle a 429 error is to immediately retry the request in a tight loop. This will quickly get your server’s IP temporarily flagged. Instead, use exponential backoff, which spaces out retries exponentially, combined with random “jitter” to avoid hammering the API endpoints concurrently.
Node.js / JavaScript Example (Using a custom loop or retry library):
JavaScript
async function fetchAIResponseWithRetry(prompt, retries = 3, delay = 1000) {
try {
const response = await openai.chat.completions.create({
model: "gpt-4o-mini",
messages: [{ role: "user", content: prompt }],
});
return response;
} catch (error) {
if (error.status === 429 && retries > 0) {
// Calculate backoff with a bit of randomness (jitter)
const jitter = Math.random() * 200;
const nextDelay = delay * 2 + jitter;
console.warn(`Rate limited. Retrying in ${nextDelay.toFixed(0)}ms...`);
await new Promise(resolve => setTimeout(resolve, nextDelay));
return fetchAIResponseWithRetry(prompt, retries - 1, nextDelay);
}
throw error; // Pass the error along if retries run out
}
}
2. Upgrading to the Modern SDK In-Built Retries
Many developers on Reddit are unaware that the latest versions of the official OpenAI SDKs actually have built-in retry mechanisms that you can configure during instantiation. This significantly cleans up your codebase.
Configuring built-in retries in Node.js:
JavaScript
import OpenAI from 'openai';
const openai = new OpenAI({
apiKey: process.env.OPENAI_API_KEY,
maxRetries: 5, // Automatically defaults to 2, but you can increase it for heavy bulk operations
timeout: 20 * 1000, // 20 seconds timeout limit
});
3. Handling Token Budgets via Tokenizers
If you are hitting TPM (Tokens Per Minute) ceilings, you need to count your tokens locally before making the API call. If a prompt or context window is too large, drop or truncate older system context.
In Python, use the tiktoken library, or in JS, use js-tiktoken to estimate costs locally:
JavaScript
import { getEncoding } from "js-tiktoken";
const enc = getEncoding("cl100k_base");
const tokenCount = enc.encode("Your long prompt string goes here").length;
console.log(`Estimated prompt tokens: ${tokenCount}`);OpenAI splits accounts into Tier levels based on your payment history, not just your current balance. New accounts are capped at low Requests Per Minute (RPM) thresholds. Check your Limits dashboard in the OpenAI developer console to see your specific Tier tier constraints.
RPM stands for Requests Per Minute, which counts the raw number of API calls you send. TPM stands for Tokens Per Minute, which counts the total text volume (prompt + generated response tokens) processed. Hitting either threshold will trigger a 429 error.
Standard serverless functions usually have a 10 to 15-second execution timeout, while large AI models can take longer to reply. To fix this, you must configure your API call to stream responses using ‘stream: true’ and process chunked text iteratively on the client-side.
Whatsapp Stickers are the latest trend in the Social Media Messaging Applicaion. Its extremely easy and fun to send stickers to your contacts, esp in the ocassions of special festivals and Holidays. Here is the step by step procedure to send Whatsapp Stickers to you friends and loved ones…
then choose Stickers
.
.
next to the Whatsapp Sticker pack you want to download. If prompted, tap DOWNLOAD • {file size} (where file size is displayed).
will appear once the download is complete.
.
to view your recently used stickers and resend them.
to view your favorite stickers.
, it’ll show a set of sticker category icons, where stickers are categorized based on the emoji displayed on the icons.
> DELETE. To reorder your sticker packs, tap and drag Reorder
next to a sticker pack.