Why Bridgerton's Katie Leung shied away after Harry Potter