We visited many years ago. I wouldn't agree that it is the finest garden in England - there wasn't much except for the trees and the rhododendrons (which were spectacular). You had to go at the right time of year to see them in flower, or course.
I would suggest the Garden House at Buckland Monachorum as a garden well worth a long trip to visit.