Maybe you can find an activity you enjoy while he is at D&D that you can focus on. If you just are free and unoccupied, you might feel more anxious during that specific time. Make this your time to do something specific for you but make sure it keeps your mind occupied so you don't get depressed.