Can he really do this?? Long so sorry....

My son's father and I have been split since 3/2007. He took my son with him, I did nothing when I came home and no one was there. Maybe cause I felt that I knew I wouldnt have a place to go when he left. Well anyways, its now 2011, I have been with my bf for 4 years this July. We are expecting our first child together. I am considered High Risk, 7 months along (not that its his issue) Moving north to the Daytona area. Which is about 45-1 hr drive.
My ex is being a complete JERK!!! he insists on seeing the place before my son sleeps there, and asked who all will be living there, where is it located, telling me im responsible for the driving him to and fromm home. as far as i know its a meet half way. I come from split home I know how this works, asking how are we gonig to afford it, where am i going to be working, so on and so forth and blah blah blah. My bf had playd nice for to long and is about to say something cause this man is still tring to control my life, and uses my son as a pawn. He seems to be trying to find anyway possible to make every situation as difficult as it can be. originally I was moving to NH, that fell through (which is when he said since your abandoning your son im filing for custody") which im not but ok. so it fell through and we staying in Fla. This past weekend we went to get the place cleaned and such to move in. Did not sleep there. my son had a BLAST, and each time did not want to leave.
I get a text on the way to bring him to his dad, asking where we are. I said heading your way to bring him home and there is started. It be nice to be able to see where my son will be sleeping before he goes there and so on. I guess that just went out the window. I came back with, im not doing this with you right now. we are not moved in so relax. last thing he said was "all will be taken care of" WTF does that mean?!?! Who are you to tell or act like you can tell me where I can and cannot live. I am 28 yrs old. I am not a child. you have controled my life for tooooo effin long you manipulative SOB.. so i want and need to be prepared for this. I tried callin legal aid for 3 hours following prompts and getting hung up on.. I dont know what else to do. i know he is going to file for custody but if anything I want full or 50/50... thats not much to ask. he been getting child support from me since sept 2008, I been donig what I was told and need to do as his mother. he LOVES being with me and NIck.. so what is the deal?? Im not dong anything wrong. but he is tring to do whatever to make me look unfit. its just not fair and i am out of options... I dont know what to do. i cant afford an attorney without the states help. and seems like i cant even get that :*(