Yeah that was the worst bit about it for me, I was the same, back at work after a couple of weeks, it was very difficult, I felt like I never seen the baby and the missus felt like all she did was sit with her.
The good definitely outweighs the bad though and it certainly gets easier bud.
What's the wee mans name? John-Paul