All the goals came in a six minute second half spell as Welling United inflicted a narrow defeat on Dougie Freedman's side.
A 52nd minute effort from Jack Obersteller beat Julian Speroni at the second attempt and it was not long before the home support were celebrating another goal.
Speroni was unable to do anything about a speculative shot from 25 yards out by Harry Baker.
It was not long though before Palace were back in the game as Kagisho Dikgacoi netted with a low drive from the edge of the box.
Chances were few and far between in the first half but the pick of them were a penalty claim for handball by Welling but the official turned down the appeals and the visitors best opportunity from Jonathan Parr was denied as goalkeeper Jamie Turner saved the effort from Palace's player of the year in the last campaign.
After the goals in the second half a couple of late chances from Kwesi Appiah were the best opportunity for the visitors to get back on level terms but it was not to be and the Blue Square South side claimed victory.
Palace: Speroni, Tiago (Wynter 72), Parsons, Wright (Garvan 45), Yogo, Ramage (Marrow 52), Baxter (Appiah 60), Dikgacoi (Sekajja 72), Murray (Proctor 52), Jedinak (Fenwick 60), Parr (Williams 45).