Marvin Sotorizo helped out at a small Protestant Evangelical church located on 25th Street near Potrero Avenue.
The church pastor and members of the congregation appeared in court on Wednesday in a show of support for Sotorizo.
Prosecutors say he invited the brothers to stay at his home after they ran into family issues. They took him up on the offer.
Sotorizo is accused of sexually assaulting the men after they consumed drugs and fell unconscious at his home.
"Anyone who uses their place of trust to further a crime is very concerning to us. So we take these charges very seriously," San Francisco District Attorney's Office's Max Szabo said.
Sotorizo was arrested on June 27. He did not make bail of $750,000 and remains in custody.