My own children watch their father go to work each morning, knowing that he is making money to provide for their needs: food, a comfortable home, clothing. They're excited to see him when he comes home and surely they miss him throughout the day. They know that he is fulfilling his role as a provider for our family. He will occasionally make time for them individually, but it's more of a rare treat than an expectation. He is often home for dinner when it's not a busy season for him, and he's almost always home for evening family prayers.
As wives and mothers, we need to stop making our husbands feel guilty for the lack of time they spend with their children. Instead, we need to teach our children that they are loved by both parents and that each parent is fulfilling their responsibilities to the family.