The football-themed installation outside the iconic stadium had drawn criticism from fans and political leaders alike