What is the name of the modal you’re running?
https://playground.ai.cloudflare.com/
What is the error number?
na (it shows nothing)
What is the error message?
[wrangler:err] InferenceUpstreamError: Unknown internal error at Ai._parseError (cloudflare-internal:ai-api:79:20) at async Ai.run (cloudflare-internal:ai-api:57:23)
What is the issue or error you’re encountering
Worker AI works flawlessly without lora, but as soon as you introduce lora, I get above error.
What steps have you taken to resolve the issue?
Putting in “stream”: true, makes the error go away. But it only returns [DONE] and no result
What are the steps to reproduce the issue?
goto playground, select mistral-7b-instruct-v0.2, select any finetune from given 3 finetunes, you will see the issue as soon as you type a message and click run
