Personally I would think the best thing to do is stop thinking about things so much and just go with the flow. I've found that the best things in life are those that catch us by surprise and the worst are those that we made that way by worrying to much.

Just enjoy life and enjoy whatever time you have with him regardless of how it's spent...