Disclosed herein are methods and systems for anomaly detection within a field using images or sensor data. An anomaly detection process determines whether a pixel or a cluster of pixels fit within calculated or modeled expectations to identify an anomaly. The process can further analyze the anomaly to determine a likely cause. Example anomaly detection techniques account for intra-field inhomogeneity and for non-crop regions. Example anomaly detection techniques also can identify anomalous regions.