New couples: Whose family do you visit for the holidays?

When you're in a relationship, how do you decide whose family to spend the holidays with?