What is the name of the modal you’re running?
baai/bge-m3
What is the error number?
401
What is the error message?
{“result”:null,“success”:false,“errors”:[{“code”:10000,“message”:“Authentication error”}],“messages”:}
What is the issue or error you’re encountering
It randomly fail, expecially if doing multiple request at the same time
What steps have you taken to resolve the issue?
Rate limiting, but the error is misleading should be 429 and also tell how many request per second I can send.
The current limit is 3000 per minute, but if I send say 20 per second (which is 1200 per minute) I already start to see errors.