Functions all working fine then suddenly: AIError 3028

[joel27]

What is the name of the modal you’re running?

@cf/meta/llama-3.2-3b-instruct

What is the error number?

3028

What is the error message?

{ “message”: [ “Error:”, “AiError: 3028: Unknown internal error” ],

What is the issue or error you’re encountering

I have a function that generates 10 text items, it has been functioning fine for months, now it just throws a random error.

What steps have you taken to resolve the issue?

Not sure.

What are the steps to reproduce the issue?

Help me understand what this error means, something changed this morning…

[fritex]

@joel27

@cf/meta/llama-3.2-3b-instruct

Using Worker Stream or Worker from the example below?

llama-3.2-3b-instruct · Cloudflare Workers AI docs

Would below help?

Unknown internal error for LoRA adapters

Apparently this is a quite generic error. In my case, by digging into the parameters of the model I’m using (@cf/meta/llama-3.2-3b-instruct), I found out that the Workers AI docs are wrong in (at least) one detail, the top_p specs. According to the (CF) docs its valid range is 0-2, but it actually is 0-1. I was trying 1.05, which of course triggered Error: 3028: Unknown internal error. Once I fixed the value, It worked just fine. Recommendation: double-check the config/parameter specs.

Wonder if it’s related to the recent incident:

Degraded availability for @cf/meta/llama-3.2-3b-instruct

Dec 26, 18:30 UTC Resolved - For 2.5 hours starting from 15:35 UTC users may have seen errors when trying to make requests to @cf/meta/llama-3.2-3b-instruct. The model has since recovered. This is a companion discussion topic for the original entry at https://www.cloudflarestatus.com/incidents/rf9gm93ftl8h