The victim, whose name was not immediately being released, was found in the 200 block of Lewis Road with at least one bullet wound after officers responded to an emergency call at 9:26 a.m., police said.
Emergency crews arrived and attempted to revive the man but he died at the scene, police said.
The motive and suspect in the shooting are under investigation by the Police Department's homicide unit.
The man's death was the 46th homicide in San Jose during 2012, police said.