Back in 2009, Brown pleaded guilty to committing felony assault against his then-girlfriend, and Rihanna's dad was furious when he first learned his little girl was punched and bitten by the Deuces singer.
"It was a very difficult time for the whole family," Fenty told UK newspaper The Mirror. "Nobody wants to see their daughter hurt.
"I remember I had a phone call from one of her old security guards, he told me he and a biker gang were going to ride to Chris for revenge.
"I was angry but it's a long way to go, I wanted to go.
"I told them to give me a few days because I felt like doing it myself, you know? I was going to fly in, get picked up from LAX (Los Angeles International Airport) and ride to Chris' place so I could do it myself.
"When I called him the next day to arrange everything I cooled down and put a stop to it. She doesn't know about this, she was going through enough."
Over the years Fenty has found it in his heart to forgive Brown for the attack and he has a lot of love for the Look at Me Now star.
"He respects me, calls me Pops and I like him – despite what happened," Rihanna's dad shares.
"He's very talented and always humble. I'd support them being together.
"Chris will always have a place in our family and my heart."
Rihanna just released her eighth studio albumAnti last month. Love On the Brain, a track on the new LP, is a song about an addictive and catastrophic relationship which is thought to be inspired by her former romance with Brown.
And hearing Love On the Brain was very challenging for her dad.
"I like her stories but this song was tough to listen to," Fenty confessed.