Cloudflare AI Gateway is broken

Developers Workers AI
1

What is the name of the modal you’re running?

OpenAI

What is the error number?

No specific error number

What is the error message?

invalid_request_error

What is the issue or error you’re encountering

AI Gateway is messing with my requests causing things to fail

What steps have you taken to resolve the issue?

If I change my endpoint back to using OpenAI directly, everything works perfectly. It’s only when it’s going through cloudflare’s AI Gateway there are issues.

What are the steps to reproduce the issue?

Try using things like threads with the AI Gateway. It seems to fail requests maybe 50% of the time. Listing thread messages as well as trying to perform runs.

2

May I ask if you are still experiencing this issue? :thinking:

3

We have the same problem with Cloudflare AI Gateway.
For some threads we receive:
{
“error”: {
“type”: “invalid_request_error”,
“code”: “unknown_url”,
“message”: “Unknown request URL: GET /threads/thread_XXXXXXXXXXXXXXXXXXXXXXX. Please check the URL for typos, or see the docs at https://platform.openai.com/docs/api-reference/.”,
“param”: null
}
}

If we use OpenAI API with the same thread we don´t get errors.

1 Like
4

Yep, exactly what’s happening with me. To be fair, i don’t pay the extra money so i can get help, so this is likely a product i won’t be able to use. If you figure out a workaround i’d love to know.