A muzzle loading firearm has a barrel with a bore defining a bore axis. The barrel has a muzzle end and a breech end, with a breech plug removably attached to the barrel and having a rear surface. An extractor is connected to the barrel and has a portion positioned rearward of the plug, and movable away from a position rearward of the plug, so that the plug may be removed without removing the extractor. The extractor may pivot, and may have a cylindrical portion received in a bore parallel to the barrel bore. The rear face of the extractor may be flush with the rear face of the breech plug.