The San Jose Municipal Rose Garden beat out more than 130 other public gardens across the country.
The award will be given out by a non-profit association of rose growers.
Volunteers and park staff worked to restore the garden over the past few years since it was placed on probation because it had fallen into such disrepair.
The Morcom Rose Garden in Oakland placed 10th in the competition.