A head-mounted wearable device (HMWD) includes a bone conduction speaker (BCS) to provide audio output to a user wearing the HMWD. The BCS may be mounted within a recess of a temple of the HMWD. During wear a portion of the BCS is in physical contact with a head of the user. In one implementation, a head contact piece may be mounted to the side of the BCS that is proximate to the head. The head contact piece is contoured to maximize the contact area with the head, and may have a cross section that is approximately wedge shaped, with a thicker portion of the wedge proximate to the front of the HMWD. The BCS may include low damping elements to provide protection to the BCS from damage and improve performance, as well as high damping elements to reduce the transfer of vibrations from the BCS to the temple.