The present disclosure relates to a pre-5th-Generation (5G) or 5G communication system to be provided for supporting higher data rates Beyond 4th-Generation (4G) communication system such as Long Term Evolution (LTE). The present disclosure provides a method of operating a base station in a wireless communication system includes receiving, from a terminal, a first random access signal transmitted by a plurality of transmit beams of the terminal, determining a receive beam based on a signal strength of the first random access signal, receiving, from the terminal, a second random access signal transmitted by the plurality of transmit beams of the terminal using the receive beam, and establishing a connection between the terminal and the base station based on a signal strength of the second random access signal.