I disagree. It should be for the elite at each position. Hester is the greatest returner of all time and they changed the return rules, because he was too good.
He should be ahead of WRs that were very good, but not elite. Which includes players like Holt and Andre Johnson.
And absolutely, elite Kickers, Punters, etc, should be Hall of Famers.
Harder to select LS's. You have to look at who didn't do a bad snap in their career I guess.