The man told officials at Sterling Community School that he didn't realize he had the wrong child until he got home. He immediately brought the boy back.
The boy's family says they have no reason to believe the child was harmed but still, a lot of questions remain.
"He hasn't really said a lot about it, very very scared the day of, once he got home. And he's only 5-years-old, so it's very hard to extract information," said the boy's uncle Paul Stone.
The school immediately made changes to its pick-up procedure, but that's not nearly enough for the family. They're demanding a full investigation by police, including a background check of the man who took their child home.