Fury appeared to push fellow Briton Whyte after landing a devastating uppercut with one second to go in the round, eventually forcing referee Mark Lyson to stop the fight.
"I was buzzed but obviously I was trying to regather my senses and he proper pushed me and I fell over and hit my head on the canvas which is illegal," Whyte told Sky Sports on Monday.
"This isn't wrestling, this is boxing. I should have been allowed extra time to recover and then carried on fighting. I got caught, no doubt about it ... (but) terrible job from the referee there."
