Nicolas Nkoulou made his first league start of the season for the Granata, whilst Simone Verdi was preferred to Simone Zaza in attack.
The Granata made the worst possible start as they were behind after only two minutes when Gervinho crossed for Dejan Kulusevski to tap in from close range.
However, the Granata responded well and were level ten minutes later when Simone Verdi crossed for Cristian Ansaldi to head home.
The match turned on the half hour mark when Toro defender Bremer received a second yellow card for handball, and the hosts were awarded a penalty. However, Gervinho's penalty was saved magnificently by Salvatore Sirigu.
Incredibly, and despite having one player less, Toro were awarded a penalty of their own just before half time when Vincent Laurini elbowed Andrea Belotti in the area. The Toro captain stepped and sent Luigi Sepe the wrong way to give Toro the lead
However, in first half injury time, Parma scored an equaliser as the Toro offside trap failed and allowed Andreas Cornelius to finish emphatically.
Parma capitalised on their man advantage as they dominated the second half, with only another outstanding save from Sirigu denying Gervinho a goal.
Toro's attacks were limited, but Armando Izzo did force a save from Sepe from a set piece at the same end that he had scored the winning goal v Atalanta a month previously.
However, just when it seemed as though Toro had done enough to earn a point, Gervinho fired a cross into the area that the Toro defence could not deal with, and that allowed substitute Roberto Inglese to score with only two minutes remaining.