Alarica: I can tell you from experience that that's not really a big deal. My mom had me when she was 39. I honestly didn't care that folks sometimes thought she was my grandmother, and other folks I've met who grew up in similar circumstances didn't care either.
It -did- slightly annoy me that folks thought my sister [18 years my senior almost on the dot] was my mom. :P