Officer units arrested Enrique Martinez, 20, and Ceasar Torres, 18, in San Jose last Wednesday on suspicion of murder, police said.
Two days later, officers took a 17-year-old juvenile into custody in San Jose, police said.
The fourth suspect, Joel Madrigal, 27, was arrested while in custody at the Santa Clara County Mail Jail for an unrelated case, police said.
On Jan. 24, Harvey, a San Jose resident, was walking by himself in the area of Southside Drive and Hope Street when several males attacked him, police said.
Someone called police at about 8:25 p.m., and responding officers found Harvey suffering from multiple stab wounds.
Emergency responders took him to a hospital, where he was pronounced dead at about 9:30 p.m., police said.
"Unfortunately, this was another case where the suspects robbed an innocent victim walking down the street who was minding his own business," police Lt. Mike Kihmm said.
Investigators believe the suspects are gang members, police said. The killing marked San Jose's third homicide of 2013.
Kihmm said detectives from the department's gang investigations unit were instrumental in helping locate and arrest the suspects.
