An American pastor who addressed an anti-Protocol rally in Lurgan has in the past claimed feminism brings a "curse of God upon your nation".
Rusty Thomas also previously branded Craigavon Area Hospital the "gates of hell" as part of his campaigning against abortion.
He was among the speakers at a protest on Friday against post-Brexit trade arrangements, alongside DUP leader Sir Jeffrey Donaldson, TUV leader Jim Allister and loyalist activist Jamie Bryson.
Read more: Doug Beattie condemns “mindless idiots” who put noose around neck on election poster
The demonstration has faced criticism after a poster of Ulster Unionist leader Doug Beattie was displayed with a noose around his neck.
Sir Jeffrey and Mr Allister removed the poster and condemned the display, which came after Mr Beattie withdrew from the rallies over claims they are being used to raise tensions.
Mr Thomas was applauded as he told protesters that people in the US are praying for them and "asking the Lord to defend your sovereignty".
Previously the pastor, who according to his social media profile is from Texas, has spoken against feminism and the decriminalisation of abortion in Northern Ireland.
In a past speech he said that "good, Godly men" were being "marginalised".
He added: "So whenever a nation exchanges patriarchy for feminism, you are going deeper and deeper into the curse of God upon your nation."
Mr Thomas also claimed the Black Lives Matter movement was being fuelled by "white, progressive, Marxist young women," adding: "Women will rule over you."
On Craigavon hospital as part of anti-abortion campaigning, he previously said: "Brothers and sisters I want to welcome you to the actual gates of hell.
"Now I know when you look at this place on the outside it looks like a hospital. But now because of this unjust law this hospital houses the ancient evils."
His past comments were reported on BBC Radio Ulster's Nolan Show.
Mr Beattie said he did not know anything about the pastor but described his previous remarks as "absolutely abhorrent".
He told the programme: "I cannot understand why he would have been put on that stage at an anti-Protocol rally."
Mr Allister said he was invited to speak at the rally but was not involved in the organisation of the event.
He said: "I didn't know anything about this gentleman until he appeared on the stage.
"He didn't say anything on the stage that offended me. He was obviously invited there by someone, I don't know who, and I do not carry responsibility for that."
The TUV leader accepted the pastor was not a suitable person to speak at the rally, but he said he would not allow people to "cast a slur on the event".
He added: "The unfortunate thing about what you are now talking about and the ridiculous poster which was there, was that it has distracted from the very clear message and the very great success of that rally, and the mindless idiots who put up that poster have a lot to answer for in that regard."
Mr Allister also distanced himself from the comments at the rally of Roy Ferguson, a former TUV election candidate, who branded Mr Beattie a "Lundy" and "traitor".
The TUV leader said: "I think that was wholly wrong. Lundy has a particular pernicious meaning in loyalist circles and there was nothing to justify calling Doug Beattie a Lundy or a traitor."
A series of rallies have been taking place across Northern Ireland outlining unionist and loyalist opposition to the Northern Ireland Protocol, which sees additional checks on goods arriving into Northern Ireland from Great Britain.
It is strongly opposed by unionists who regard it as creating a border in the Irish Sea with the rest of the UK.
There is no suggestion the organisers of Friday's protest are connected to the Mr Beattie poster.
A DUP spokesman said: "Sir Jeffrey was invited to address this event by the organisers. We are not responsible for others.
"Our focus is on speaking to the many thousands of ordinary people who attended this event to demonstrate their opposition to the Northern Ireland Protocol."
Read more: Doug Beattie condemns “mindless idiots” who put noose around neck on election poster
Read more: Lurgan anti-Protocol rally told there is "unwavering support" for unified unionist opposition
For the latest politics news straight to your inbox, sign up to our newsletter here.
