Don't feel too out of place. Just try living with a vegetarian for a while! Now that is really weird.
Many may not know that the early Church fasted every Wednesday and Friday. During the Middle Ages, that decreased to fasting every Friday, and all of Advent, Lent, and Ember Days. Somewhere in there we lost Wednesdays, Advent and Ember Days. Then after Vatican II, Friday fasts were thrown out and Lenten fasts reduced to just Fridays in Lent instead of all Lent, plus Ash Wed and Good Fri. Another fast we've forgotten is the fast from midnight until communion on Sunday. When my folks were growing up they had last call for drinks just before midnight in Catholic towns because anyone going to communion the next day had to stop drinking at midnight on Saturday....like cinderella. Perhaps, that is where the fairy tale had its origen? That was reduced to 3 hours and then 1 hour after VII, so that now there is essentially no fast except you have to finish breakfast 15 minutes before you leave for Mass and can't eat during the service...although I saw gum chewing last sunday. But, I digress.
People also forget that fasting often included fasting from sex in the olden days. Made Lent rather long, I gather!
Anyway, don't feel bad about keeping up an old tradition. You are setting a good example for the rest of us.
On Sunday morning, I eat nothing until after mass. I agree that "Break Fast" should be the meal after Holy Communion. Fasting is something you add over time to the little sacrifices that you do for the Lord. And no one has to know that you are fasting when you are doing it.