GPT-4 API timeout and 502 errors with prompt > 3000 tokens
Hello all,
I'm currently playing around with GPT-4 API for a personal, project in python with the official API package, which requires heavy prompts and I'm currently facing an issue, if my prompts are > 3000 tokens long, every time I get either a timeout error or a bad gateway error.
Is there any limitation from the API side? because I can see the requests being accounted on the usage dashboard...
Anyone encountered the same issue?