Around 9:45 p.m., police got a report of a person shot in the 1300 block in San Jose's Alviso neighborhood, Sgt. Jason Dwyer said.
Officers arriving on the scene found the victim, who was suffering from gunshot wounds.
The man was taken to Valley Medical Center, where he was pronounced dead around 10:30 p.m., according to police.
Dwyer said no suspects have been identified or apprehended in connection with the killing.
Investigators have not determined a motive for the murder and do not know if it was gang-related.
The killing is the city's 27th homicide of 2013.
On Wednesday, a man was found stabbed to death at the Julian Street Inn homeless shelter.
Another resident of the shelter was arrested in connection with that murder.