Does Workers AI have streaming responses?

Can the Llama model on the Workers AI reply with streaming responses?

A great Demo with ChatGPT

I have found some references on line wrt Llama 2 and streaming.

@cloonan Hi, I meant using the workers ai Llama model.

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.