The man, who was not being identified, was reported shot a number of times at about 9:33 p.m. on Old Gilroy Street at Alexander Street less than a block south of Forest Street Park, police said.
Paramedics from the Gilroy Fire Department and the Rural/Metro Corporation arrived to find the man suffering from life-threatening injuries from shots fired from an unknown type of gun, police said.
The victim was placed into an ambulance but died before it reached a local hospital, police said.
After an investigation, police learned that a dark-colored sedan was seen driving away rapidly from the scene of the shooting, police said.
The inquiry into the homicide is continuing and police are asking that anyone with information about the shooting contact Detective Michael Bolton at (408) 846-0350.