A method and apparatus of releasing a connection in a wireless communication system is provided. A user equipment (UE) establishes a radio resource control (RRC) connection with a specific establishment cause, receiving paging indicating connection release and release information including an establishment cause or a logical channel priority, and releasing the RRC connection depending on the establishment cause or the logical channel priority included in the release information.