Mixtral 8x7B and model anxiety

Mixtral 8x7B can spiral into anxious feedback loops, a reminder of the quirks baked into models trained on the internet.

Published: Saturday, February 24th 2024

1 min (79 words)

ajfisher - Gemini / Mistral Logo

It seems that Mixtral 8x7B can get very anxious about lack of feedback on a response that it made in what was otherwise an entirely fine response.

Screenshot of anxious looping

This is just one of the challenges or joys of working with LLMs trained on the internet. Sometimes the rabbit holes the model goes down can be completely bewildering. I dare say if I wanted it to produce that sort of output I’d struggle to get it to do so.