It's important to address issues like this as early as possible. It's harder to get out of a situation that you've been in for so long as you might get used to it and feel that it's normal.