I've had experiences with long distance relationships and they all never went anywhere. It's quite hard to not physically see/touch/speak to them in person. Its something i always had a problem with. I'm not saying it never works, it can but there's so much more effort to put into it on both sides.
Though in my opinion you should tell him how you feel.

You should always talk about your feelings no matter the cost !..It helps the situation and who knows something good might come up after this

I agree with saying how you feel... it'll get everything out and then you can go from there...

Long Distance IS HARD, but as long as you two love each other and are committed to making it work then it will. Communicate always and don't let your mind get the best of you.

I would say..it's better to discuss with the other person. But long distance relationship is a bit hard to rely on. If you both have strong feelings towards each other, hope for the better!
 If you think YOU won't be able to wait with patience..Your family may be...it's better to move on.

He's sending you mixed messages.  First of all where does his ex live? Is she closer to him, does she live in the same city?  Do either one of you plan on moving in the near future? How well do you really know each other?  Is he lonely and in need of someone to fill that void? Where do you see this relationship going a year from now, 5 years from now?  If neither one of you are really serious about this friendship then call it a day and move on.  Because at this moment even though you claim you both love each other and tell each other that all the time.  If this is meant to be and you both go your separate ways you both will find way back with each other, but this time the circumstances will be different and the proximity will be closer. Sometime when you don't focus on something all the time life have a funny way of bringing that exact thing or person right to you.  Check this article (lasting love relationships) there is an article that talk about long distance relationships you might fine interesting...