The settlement was reached Thursday night, and will reduce pensions for new officers.
The two sides are meeting Friday to formalize the deal.
The city says retirement benefits have more than tripled in the last decade.
Voters approved a series of ballot measures aimed at reducing those costs, but the issue has created major tensions between police and the city.
San Jose still has to reach a deal with the firefighters' union.