Mediation Follow Up

So my DD's father & I went to mediation & we just received the recommendation she is sending to the judge .. She is recommending supervised visits until my DD is done breast-feeding which was the most important to me, however because her father is uncomfortable to come to my house 1 day out of the 3 visits a week .. She is recommending I bring my DD over there ALL 3 visits which I think is totally unfair .. I'm uncomfortable going to his place as well however I do it for my DD .. Furthermore it is going to be a financial hardship on me being that I raise both of my children 100% on my own & not that my unemployment has ended, my income is really $0 at this time .. Luckily we reside with my parents at this time & I have been looking for jobs but now have to drive 30 mins a day round trip 3 times a week is going to be a hardship ..

My question is .. Would you give up & find a way to make it all 3 times or would you fight it before the judge ?? I agreed to 2 days a week I would bring her there & 1 day he should come here .. I'm only scared because it is what the mediator recommended .. Please help !