"I don't know how well some of them truly know me," Lydia says of her family after facing backlash for her relationship with ...