Methods and apparatus for performing intra prediction in an encoder or a decoder for non-square blocks enable a combination of reference samples from a row above the non-square block and a row to the left of the non-square block to be used for the prediction. In one embodiment, a weighted combination of reference samples are used. In another embodiment, the angles of prediction are extended in the longer direction of the non-square block, such that less angles of prediction are used in the shorter direction.