He doesn't text me much when he has his son?

I don't see a reason to worry. He does love his son, and he's spending time with him. If he wants you to meet him that's a good sign. And as far as not being maternal, just relax as best you can and be calm. His son will sense you're upset or uncomfortable and he'll get upset too.