James McArthur said Palace need to rectify the mistakes which cost them in a high-scoring, intense game against Liverpool on Saturday evening.
"It was frantic. They put us under a lot of pressure. They pressed us well and it was hard to get out at times, but at the end of the day the goals have cost us," said the midfielder, who scored twice for the Eagles in the 4-2 defeat.
"It's not just the defence [that needs to improve], it's all over. We need to get better shapes to stop them playing through us. Set pieces are something we're usually very good at, so we need to rectify that after we've conceded a couple today."
Liverpool capitalised on the Eagles' hesitancy at the back and managed to pull out of sight after an impressive start to the second period by Palace, when Jordan Henderson released Roberto Firmino to add the Reds' fourth.
Next up Alan Pardew's men travel to newly-promoted Burnley, hoping to turn results around after three consecutive Premier League defeats.
"Every game's big in the Premier League," said McArthur. "We'll go there, even though we're not on a great run, with a belief that we can get the three points."