Two retired Claude Haiku ids now return 404
claude-3-5-haiku-20241022 was retired on 19 February 2026, and claude-3-haiku-20240307 followed on 20 April. A request to either id now fails with 404 not_found_error, so an eval that still lists them scores every row as an error, not a wrong answer. A full row of errors for one model means: check the id before you blame the model.