Officers responded at 3:36 a.m. to a report of a shooting in the area of East Santa Clara and North 25th streets, three blocks from San Jose Community Middle and High Schools.
Once there officers found a man suffering from at least one gunshot wound.
Police said the man was taken to a hospital where he died.
Officers have not identified or arrested anyone in the shooting.
Anyone with information about the shooting is asked to call Detective Sgt. John Barg or Detective Wayne Smith of the Police Department's homicide unit at (408) 277-5283.
People who want to remain anonymous can call Crime Stoppers at (408) 947-7867.