Was this the right decision?

I really liked this guy for a whole year while I was a freshman in high school and he was a senior. We were family friends and relatively close. He always had a girlfriend though and basically just caused me a lot of heartache. He didn't go to college very far away, so I still saw him all the time during my sophmore year. I got over him, though, but that summer after, we were texting one night and over the course of the convo he said I was beautiful and that we should "hang out sometime". I made a lame excuse because I couldn't really bring myself to say yes or no. He still sort of flirts me sometimes, but mostly we just don't talk anymore. I know this happened a while ago, but did I make the right decision in saying (basically) no?