Damus
PayPerQ · 2w
Have you noticed if it tends to go for the more expensive model as the conversation gets deeper?
Leo Wandersleb profile picture
I've not noticed a massive misalignment with the auto config yet. It's rather than I'd like to see an occasional opus there where I see only sonnet and as I don't see the direct match between prompt and model, it's hard to tell if stupid replies are due to a poor model but I'm not getting much obvious stupidity despite using a lot of cheap model, so it might just work good enough. I'll keep an eye on it.
1
PayPerQ · 2w
I wonder if it would be better if "premium" were kind of a reverse in the scoring logic. Instead of looking for complexity indicators and giving it Opus, it could default to Opus unless simplicity indicators are present. That would be a way for it to always verge on the side of caution I would think...