No it’s not ridiculous. I took something like a 25% pay cut and dropped a shit load of benefits including a company car to change jobs away from one that was seriously impacting on my personal life, and as a result my mental health. Yes it wasn’t great to go from a decent and funded car to a Corsa and cut down on lot of luxuries but it probably saved my marriage and my sanity. And as a bonus 8 years on I’m now earning exactly double what I was when I started and there’s little stress compared to my old job. That’s not to bum me up, just show it can work out mid to long term.
if anyone is unhappy, seriously unhappy in their job, I would advise them to change it when possible as soon as they can. You work to live, don’t live to work. Your happiness and mental health is much more important than status and money.