Repository navigation
Replies: 2 comments 1 reply
|
When you say "strict ordering", are we talking about there only being one system message for the entire request? DeepSeek does enforce that, so to that end, their adapter has been built differently to most. Where it can, it extends the OpenAI adapter but has to conform to the API requirements for building out the messages payload. |
|
The error JSON coming back from Qwen looks like:
When I rewrote the handler to put all system messages at the start of the transaction, I was able to get chat completion to work, but then started tripping over tool messages. I'm going to sign up for the free tier of Qwen and reproduce the failure case. |
Uh oh!
There was an error while loading. Please reload this page.
It looks like recent Qwen3 models are enforcing strict ordering on their system messages. This probably means a new module needs to be written that specifically deals with this quirk.
I did a bit of hackery in 1fa74da to try and test out possible solutions but its not really practical to add this exception to the openai module and means that a new Qwen module is likely the best path forward.
All reactions