The musical couple had a romantic evening out together while in New York City, nearly three months after welcoming their son.