Distributed machine learning inference includes acquiring, by an input device, an input frame, executing, by an embedded processor of the input device, a model feature extractor on the input frame to obtain extracted features of the input frame, and transmitting the extracted features from the input device to a processing device. The processing device executes a model feature aggregator to process the plurality of extracted features and obtain a model result.