Newer AI Models? Bring Your Own Model?

Hello, it would be nice to know when newer models will be arriving on Cloudflare AI? For example:

  • Stable Diffusion SDXL 1.5 (and LoRAs)
  • Mixtral 8x7b

Wondering also, will be an option for the community to “bring their own model”? Or point at hugging face repos and “magic” happens? Obviously models need to load several gigabytes somewhere, but once this is done once for each data center the model should be available to everyone?

Any chance of getting an authoritative answer on this? @cloonan

It’s likely to occur sooner or later, however, I can imagine scaling is very complicated when you want to host many models on gpu servers and not run out of capacity, distribution is also very challenging. I personally think BYO will be ENT only but time might prove me wrong.

More likely to happen, I believe models are being added as customers request them so… whatever is brought up more often, the team works on adding sooner.

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.