Rude Unexpected Visitors..UGH?

an old guy friend from about 7 years ago got in contact with me and every time he goes into town (which is OFTEN) he stops by my house unexpected because "its on the way" and he figured he would stop Its extremely annoying to me because first of all Im pregnant and like to lounge around in my pj's and take naps throughout my day I also find it really disrespectful towards my fiance as I would probably be really upset if some girl was stopping by to see him while I was out working NOT COOL how do I GET RID OF THIS GUY OR EVEN JUST GET HIM TO CALL B4 HE COMES OVER?