A flexible multi-channel diversity wireless audio receiver system for routing, processing, and combining multiple radio frequency (RF) signals containing audio signals received on respective antennas is provided. The wireless audio receiver system provides flexible routing of multiple RF signals in different selectable modes, and low latency uninterrupted reception of signals in harsh RF environments by combining multiple RF signals to maximize signal-to-noise ratio. The audio output may be generated in an uninterrupted fashion and mitigate multipath fading, interference, and asymmetrical noise issues. Received RF signals may also be cascaded by the wireless audio receiver system to allow daisy chaining.