How do I ask my boss to stop joking about my tough living situation?

Rent increases keep forcing me to move and my boss is joking about how much I change address. How do I get him to stop?