Numerous delivery devices for delivery of a stented prosthesis, such as a stented prosthetic heart valve. Various delivery devices include a capsule that is advanced proximally to retain the stented prosthesis, which is secured over an inner shaft assembly of the delivery device. The delivery device further includes a bumper or bumper assembly to provide a smooth transition of the capsule over the stented prosthesis. In some alternate disclosed embodiments, the bumper further serves to connect various elements of the inner shaft assembly. Additional embodiments include a bumper assembly arranged and configured to longitudinally expand and contract to substantially fill any open space as the capsule is retracted from the stented prosthesis, which prevents kinking in the capsule. Additional embodiments include proximal and/or distal bumpers for temporarily covering and smoothing the ends of the stented prosthesis as part of a delivery device that does not include a capsule.