The 32-year-old former Ghana midfielder asked Daniele Minelli to stop Sunday's Serie A game at Cagliari.
But he was instead booked for dissent in the 89th minute, prompting the former Portsmouth and Sunderland player to leave the pitch in protest.
He angrily confronted Cagliari fans, shouting: "This is my colour."
Speaking after the game, Muntari said: "The referee should not just stay on the field and blow the whistle, he must do everything.
"He should be aware of these things and set an example.
