Is it bad to prefer fantasy over reality?

I've been single for many years now so I'm fine being on my own. The times I got lonely when my friends weren't around I would get through it with fantasy, by writing romance stories. Well, recently I was asked out and I felt really reluctant to say yes. I like the girl, but I kept wanting to defer back to fantasy. It felt safe. I get the feeling this is a bad thing and it's keeping me from experiencing real life...