Milivojević scored twice from the spot following penalties won by Cheikhou Kouyate and Wilfried Zaha, having missed from 12 yards against Everton seven days ago.
He said after the game: "I didn't have doubts, but you feel more pressure after last week when I missed. I think I decided well, I put good power into the ball and scored twice. But these two goals I will dedicate to my team.
"It's not easy straight after the Everton game with a penalty in front of your fans. The pressure is not the same but I think I shot both penalties very well. I think their keeper didn't have a chance to save them."
Reflecting upon the game, Milivojevic suggested his Palace side deserved the point after a strong response to Arsenal's back-to-back goals.
"As I said before the game, it's going to be tough for both teams. I think we played very well in the first half. In the second half, the first ten minutes they scored two goals and we'd tried in the first 10 to 15 minutes not to concede.
"They scored twice but after that we pushed, we try and then we scored the second goal and I think we deserved at least a point from the game."
For extensive post-match reaction, head to Palace TV. Or, in you're reading on the app, click 'Palace TV'.