"The first goal was tough on us because it looked like the incident was outside the box, then the second goal was offside. That call should have been made. A minute before half-time you've got to get that call right."
The manager though did feel his side should take plenty of credit from how they came back into the game and so close to getting something from the contest.
"We took a tactical decision to take the game to Arsenal, we continued with the game-plan and I was very pleased with the reaction. It’s probably the best we've played since I've been manager.
"The chance when it hit that post and it fell in to the goalkeeper's hands summed our day up. I thought it was going to spin into the net.
"There was some great team play and probably the best players were on our team. But we've lost and sometimes that happens. Our final moment in that box needs to improve but we are not far away from being a decent team."
Defender Pape Souare made his Premier League debut but was soon disappointed after giving away that penalty for the opening goal. His manager though was quick to say it’s part of a learning process playing at this level.
“It’s an individual error from Pape. He’s coming out of Ligue One in France and it’s a difficult adjustment but he just got caught out, just dwelled on it a little bit and he needs to learn from that.
“I was pleased with his reaction though because if you make a mistake that creates a goal, you have to show good character from what he did from after that period.”
WATCH ALAN PARDEW'S PRESS CONFERENCE.