There is very specific information in the guides. I suggest you look at the beginning of this very thread, you'll find what you need there.
I know there are a few that you must get the first time through, but most are available the second time through. Check the list here against what you've done.
Regarding Skyrim followers:
Originally Posted by PsychicHorns
She followed me but wouldn't shut up so got rid of her. She kept talking about her mother and we're not even married.