I understand your fear, but i don't think it is such a big problem.
>we talked about it kind of early on that he was only really attracted to kids like i dunno not babies but like 8-15
Pedophilia normally is defined as attraction to PREpubescent. Attraction to pubescent is called hebephilia. But the definitions are fuzzy. And even if he is attracted to children, this attraction might aswell be non-exclusive. Attraction can change, and contrary to popular belief, if a pedophile falls in love to a loli, that love not mandatory goes away just because she is no loli anymore.
You are in a relationship since … when? Did you already had a developed body? If the answer is yes, where is the problem?
I had a three-year-relationship with a ~19 year old girl, we was in the same age. I honestly loved her, she had a tomboy-ish character and little developed breasts. The relationship ended for "regular" reasons (arguments, jealousness), it had nothing to do with a loss of attraction to her. But my attraction to little girls is 90% emotional and not sexual, of course i can only speak for myself.
One savage advice: If you know he is into little girls, you can give him a pleasure with thorough shaving your body. And try ageplay (roleplay sex where you act as a little girl), he might like it.