A method for authenticating users is provided that includes capturing, by an electronic device, audio data of a pass phrase spoken by a user and obtaining record audio data of the pass phrase spoken by the user. Moreover, the method includes creating a first activation sequence from the captured audio data and a second activation sequence from the record audio data, creating a tensor using the first activation sequence and the second activation sequence, and calculating a first weighted activation sequence and a second weighted activation sequence using the tensor. Furthermore, the method includes calculating an embedding for the first weighted activation sequence and an embedding for the second weighted activation sequence and calculating a similarity score between the calculated embeddings. In response to determining the similarity score satisfies a threshold score, the method includes simultaneously successfully authenticating the user and the pass phrase spoken by the user.