Cloudflare Stream - API limits

Developers Stream
1

What is the name of the domain?

Type

I don’t know

What is the error message?

Hi,We’re currently in the final stages of launching our video platform WEQ (weq.se), which is built around personalized, high-volume video generation.We’re planning to start uploading around 50,000 videos per month through Cloudflare Stream using the API, and we’ve now finalized the technical integration on our side. Each 1min and around 20MbAs we begin testing and production rollout, we’ve identified that the default concurrent video upload/processing limit (~120 videos) could potentially become a bottleneck in our pipeline.To ensure a smooth and scalable launch, we’d like to proactively request an increase in the concurrent upload/processing limit – ideally up to 500–1,000 concurrent uploads.Our platform is fully automated, uses batch logic with API polling, and is built to handle this scale responsibly. Please let us know what information you need from us to evaluate this request.

What is the issue you’re encountering

No issue yet, but this can be a bottleneck!

What steps have you taken to resolve the issue?

Hi,We’re currently in the final stages of launching our video platform WEQ (weq.se), which is built around personalized, high-volume video generation.We’re planning to start uploading around 50,000 videos per month through Cloudflare Stream using the API, and we’ve now finalized the technical integration on our side. Each 1min and around 20MbAs we begin testing and production rollout, we’ve identified that the default concurrent video upload/processing limit (~120 videos) could potentially become a bottleneck in our pipeline.To ensure a smooth and scalable launch, we’d like to proactively request an increase in the concurrent upload/processing limit – ideally up to 500–1,000 concurrent uploads.Our platform is fully automated, uses batch logic with API polling, and is built to handle this scale responsibly. Please let us know what information you need from us to evaluate this request.

2

From the Stream FAQ: https://developers.cloudflare.com/stream/faq/#is-there-a-limit-to-the-amount-of-videos-i-can-upload

  • By default, you can have up to 120 videos queued or being encoded simultaneously. Videos in the ready status are playable but may still be encoding certain quality levels until the pctComplete reaches 100. Videos in the error, ready, or pendingupload state do not count toward this limit. If you need the concurrency limit raised, contact Cloudflare support explaining your use case and why you would like the limit raised.

But the community is not the right place to make such a request. Even if you don’t have a zone with a paid plan, you can still open an Account ticket.

And at the scale we’re shooting for here, you probably should be talking to the Enterprise sales team (if you’re not an Enterprise customer already).

3

You shouldn’t be bottlenecked by that limit, you stated 50,000 videos a month and that’s 1 video upload each minute. If we applied the 120~ videos queued and assumed 5 minute processing, we’d be around 1,000,000 videos uploaded a month with this limitation.

This is 20x your expected use case and if you exceed it you run additional queues or speak to support.

Good luck.