Personally I think a hospital visit, however brief, is a bit much for only your second meet.

Did he know all the details that you're sharing with us now? Was he rude in the way he declined?

How do you know he's not phobic about hospitals or illness? I know plenty of men who say the only way they're going into a hospital is unconcious.