Absolutely - unless you are earning enormous amounts, no one is moving for a few grand a year. And if you are earning enormous amounts, it will be Monaco you leave for, not Carlisle.
And of course, this is what we see through the “lived experience” of differential tax rates.