Paraguay fought back after the break, Nelson Valdez halving the deficit with a long-distance shot.
Lucas Barrios then drove in late on to snatch a point.
The result means Argentina and Paraguay are level on one point in Group B, two points behind defending champions Uruguay, who beat Jamaica 1-0. It was a stunning response by Paraguay, who had little answer to Argentina's relentless attacks in the first half.
