South African police said they had rescued men, women and children from a "hostage situation" on the outskirts of Johannesburg on Saturday morning.
They have also arrested at least 40 people, and seized dozens of weapons.
Eyewitnesses say the men who stormed the International Pentecostal Holiness Church were part of a splinter group.
The church's leadership has reportedly been the subject of infighting since its former leader died in 2016. Police had previously been called to the church following a shoot out between members in 2018, South Africa's IOL reports.