I am in love with a man nearly twice my age!?

On a trip to Florida my mother and I ran into some difficulties. A very nice truck driver came to our rescue. He paid for our dinner and we exchanged phone numbers so he could make sure that we made it safely to destination. Since he was also from Florida, but on his way to New York at the time, he offered to take us sight seeing upon his return to Fl, but cirstances did not allow us to take him up on his offer. Fast forward two weeks later he and I remained in contact. He is 15 years my senior and was previously married and has children from a previous relationship. I on the other hand, am a 23 year old student completing a master's degree still living at home who has never been in a serious relationship. Although my mother agrees he is a very nice man she is very sceptical of the relationship. It started off as just being friends, but it quickly blossomed into something more. We have had a 3 month long distance relationship and we have only seen each other once. He is willing and ready to wait til my schooling is over before settling down, but I am a little weary of making such a huge commitment. I have strong feelings for him and I love his maturity but he did not complete his education. I feel too young to go ahead with this relationship and my mom has expressed her complete objection about the relatiosnhip as well. We both decided to cut complete contact between the two of us because I was so confused and undecided about the relationship. I am not sure if I should dive head first into this or step back wait a while to see if it was meant to be or should I wait til someone else comes along. He has already told me he loved me, but I am the one who keeps backing away due to the educational difference. Am I a fool to think this could maybe work or is it doom to fail.