Higher Worker Max CPU Time Limit than $5 Plan

Developers Workers
1

For Workers & Pages, what is the name of the domain?

private

What is the error number?

none

What is the error message?

none

What is the issue or error you’re encountering

I am running an AI chat app that needs to receive streaming data for more than 30 seconds.

What steps have you taken to resolve the issue?

I upgraded to the $5 plan, but sometimes the chat bot needs to stream very long messages for e.g. 50 seconds.

2

Hi @trf10000,

You may want to look into our Workers AI · Cloudflare Workers AI docs product.

3

Hi bujangnim,
Thanks for your reply.

I am hosting an Application that streams AI responses from a major provider.

The Application, hosted via Cloudflare Workers, simply needs to be able to continue “working” for longer periods of time because the remote AI takes time to generate responses.

For example we all know a fast AI will deliver about 60 tokens/second maximum. My Application needs to receive and stream responses of as many as 8,000 tokens from the AI, which means I need my Application’s Cloudflare Worker to keep working for up to 133.33 seconds in order to receive the remote AI’s full response.

I am willing to upgrade my plan and pay some more for a CPU Time Limit of 135 seconds.

Please provide guidance.