A camera system may include one or more controllers to perform in-field monitoring of autofocus performance and instability mitigation. The controllers may monitor one or more parameters associated with adjustment of a relative position between a lens group and an image sensor and/or one or more images. The controllers may analyze the parameters and/or images to calculate various metrics. The controllers may evaluate the metrics with respect to corresponding thresholds. The controllers may detect, based at least in part of the evaluation the metrics, one or more instability events associated with controller performance degradation. In response to detecting the instability events, the controllers may perform one or more remedial actions to mitigate the controller performance degradation.