A power tool includes a housing in which a motor is supported and an output shaft coupled to the motor that extends from the housing. A tool holder is secured to the end portion of the output shaft which is configured to releasably retain an accessory tool. The power tool includes an accessory change tool having a driver portion and a handle portion. The driver portion is used to install and remove the accessory change tool from the tool holder. The handle portion and the driver portion are configured to pivot into a folded position at which the handle portion is located adjacent the driver portion. A retainer assembly is incorporated into the housing that is configured to releasably retain the accessory change tool on the housing with the accessory change tool in the folded configuration.