Fake It to Break It!