Officers responded to a report of a person shot in the 900 block of Gilchrist Drive at about 9:40 p.m., Sgt. Heather Randol said.
When they arrived, they found a man suffering from at least one gunshot wound. The man, whose name has not yet been released, was pronounced dead at the scene, Randol said.
Police have not yet identified or apprehended a suspect, and the shooting remains under investigation, the sergeant said.
It is unknown if the incident was gang-related, Randol said.
The homicide is San Jose's 35th of the year.