And while the result that afternoon may still hurt to this day, the run-up to that afternoon was one of the finest events in the club's history.
It started off with a trip to the south coast for a 2-1 victory over Southampton. Having dispatched the Saints, Palace were dealt a cruel draw to face Stoke City and then Tottenham Hotspur - three consecutive top flight sides.
As league form dipped, belief began to grow in the cup when Martin Kelly netted the game's solitary goal against Spurs, landing Palace in their first FA Cup quarter-final for over 20 years.
The first game of the run against a side not in the Premier League threw up an away battle with Reading, in which Alan Pardew's men triumphed 2-0.
For the second time in three years, the arch of Wembley beckoned.
A thrilling semi-final against Watford saw Palace book a spot in the final with a 2-1 win and the rest is bittersweet history.