Officers were called to the 700 block of South 2nd Street on a report of a person stabbed.
When they arrived they found a man with at least one stab wound. The man was taken to the hospital where he was later pronounced dead.
San Jose police's homicide unit is investigating the incident. A motive and circumstances around the stabbing are not known at this time.
The Coroner's office will release the name of the victim once he is identified by next of kin.