The hiker was found near Lover's Leap off Highway 152, east of Gilroy.
Officials say the man and a friend both fell.
One man was able to walk to a ranch where he alerted people to what had happened.
Rescuers eventually found the other hiker's body after dark. It will be retrieved on Monday.