Baby issues with my boyfriend!?

I have a situation that I'm not really sure how to deal with. I am expecting my first child, a girl with my boyfriend Jey. Anyways, my mom died when I was very young (I am now 18) so the only grandparent she will have on my side is my dad. Well my dad just got out of jail a couple months ago (he was in jail for stupid crap, nothing major) and I want him to be a part of my daughters life but my boyfriend is hell bent on keeping her away from him. The thing is, he hasn't even met my dad yet but he wants him to have nothing to do with our daughter because of stupid things he did in his past and because he has been an a*shole in the past. Anyways, he has finally came to terms with my wanting his to meet his granddaughter but he says that he won't leave her alone with him and that anytime my dads around her he's gonna be there to watch him or he doesn't get to see her at all. I don't know how to get him to lay off of him and lighten up. My dad isn't going to hurt or do anything to her.