A distributed parameter update procedure is provided for updating parameters that do not have discrete values. When a parameter value is changed, a search is conducted of a parameter space to find a new parameter value minimizes some cost function. The cost function is derived based on the current parameter settings in neighboring nodes. The distributed parameter update procedure may simplify the search process by localizing the search of the parameter space for a new parameter value to the vicinity of the current parameter setting. In some embodiments, the search is conducted along a line of steepest descent emanating from the current parameter setting.