Police arrested Anthony Waiters Tuesday. He is scheduled to make his first court appearance Thursday.
Waiters lives next door to the house in Tracy where police say a boy was held and abused for more than a year.
Neighbors say Waiters spent time inside the house, but his mother says Waiters did not know the boy lived in the home.
Waiters faces the same charges as his neighbors and the boy's legal guardian, who lived with them.