You mentioned that you are not trying to live out some father figure fantasy.
I'm not saying it couldn't work; I'm just asking you to think beyond the immediate comfort and initial honeymoon phase, evaluate your doubts and the source of those doubts, and ask yourself if this is what you really want.
Sure, we had the same kind of connection you speak about and I really did feel like we were kindred sprits in a lot of ways; however, the unavoidable truth was that we were at very different points of our lives.
Dating an older man can be an ego boost since being wanted by someone older makes you feel more mature.
Some say love is blind and ageless, but a sustainable relationship is built on a lot more than just love alone. Just think about having children in your thirties, and chasing around toddlers with a man in his late forties.
It takes a certain amount of compatibility to carry you through the decades ahead. I hear that you are an old soul, but that doesn't necessarily mean you have to date someone significantly older to meet your "soul-match." I say go for a five to seven year age difference.