"I've been in love with her from the minute I saw her, it's so weird," the musician previously told PEOPLE of his partner ...