Yes, I got into the habit of occasionally reviewing my follow list and systematically make changes in order to reduce the volume in my feed. I add or remove people for a variety of reasons though, those who I take the time to interact with, but never or rarely do the same for me, I get rid of. I'm not the type who begs for or chases after friends...here or in real life.
I also remove people who have stopped posting for an extended period of time, but sometimes keep them to possibly catch them in my feed if they start posting again. 'You' I would probably always keep, even if you quit altogether, lol.