Does Workers AI have streaming responses?

Developers Workers
1

Can the Llama model on the Workers AI reply with streaming responses?

3

A great Demo with ChatGPT

I have found some references on line wrt Llama 2 and streaming.

4

@cloonan Hi, I meant using the workers ai Llama model.

5

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.