Browns coach Hue Jackson also said the interview with Robert Griffin III in Cleveland was part of what will be an exhaustive effort to find a quarterback, but no immediate or fast action should be anticipated.
"I think we're going to continue to investigate it," Jackson said at a meeting with the Cleveland media. "It's what we do. We don't just jump into something just to jump in."
Brown said the Kaepernick trade talks were "way over-reported."
"Not actively engaged with San Francisco and at this point don't anticipate being actively engaged with San Francisco," Brown said. "But I know it's that time of year when something can catch a headline."
A league source said Kaepernick's agent called the Browns to gauge the team's interest. He would have needed permission from the 49ers to do so.
"Had some very preliminary discussions, and it didn't go much further than that," Brown said.
As for Griffin, Jackson said the team will do its "due diligence on everybody."
"One thing Sashi said a long time ago, we're going to take every shot we can to improve the position," Jackson said. "So, we're doing that. We're just in the process of gathering information and see how it fits."
Jackson reiterated that the team had a good visit with Griffin.
"He's had success," Jackson said. "Obviously unquestionable success. His first year he was rookie of the year. There's a reason he was drafted in the first round, second player.
"Ability. He's intelligent. He's got a lot of characteristics that you look for. Everybody's looking for where's the hook?
"Obviously things didn't go as well on the end part of his career there. But as we all know those things happen with players. Sometimes it's environment, sometimes it's change in environment, sometimes change in situations.
"He's talented. And he's a good guy, and I think he likes to play."
Brown said adding a quarterback with experience in no way precludes the team from drafting a quarterback. Cleveland owns the No. 2 overall pick and is expected to consider drafting a young quarterback with it.
Kaepernick warming to idea of staying with 49ers?
Despite interest in playing for other teams, John Clayton explains why Colin Kaepernick could remain with the 49ers.