The present disclosure provides for improved hot word detection in electronic devices, particularly small form factor devices such as wearables. The electronic device includes an accelerometer onboard to pick up voice in noisy conditions, and utilizes the accelerometer to confirm that a particular user intended to activate the hot word detection, thereby reducing false detection of other people's voices.