Embodiments of a radially collapsible and expandable prosthetic heart valve are disclosed. A valve frame can have a tapered profile when mounted on a delivery shaft, with an inflow end portion having a smaller diameter than an outflow end portion. The valve can comprise generally V-shaped leaflets, reducing material within the inflow end of the frame. An outer skirt can be secured to the outside of the inflow end portion of the frame, the outer skirt having longitudinal slack when the valve is expanded and lying flat against the frame when the valve is collapsed. A diagonally woven inner skirt can elongate axially with the frame. Side tabs of adjacent leaflets can extend through and be secured to window frame portions of the frame to form commissures. The window frame portions can be depressed radially inward relative to surrounding frame portions when the valve is crimped onto a delivery shaft.