A wireless communication device includes: 1st to Mth communication processors, respectively corresponding to 1st to Mth sectors (where M is an integer equal to or greater than 2), that communicate with a wireless terminal by using a beam in any of N directions (where N is an integer equal to or greater than 2) in one of the 1st to Mth sectors; and a handover controller that determines whether or not to perform handover of the 1st communication processor, according to a position in a 1st sector of the beam used by the 1st communication processor, a communication quality between the 1st communication processor and the wireless terminal, and a value related to traffic on the 2nd communication processor in a 2nd sector adjacent to the 1st sector.