Embodiments of the present invention provide a media library controller that can communicate with multiple physical libraries that are physically separate from each other (i.e., that cannot pass media back and forth). The media library controller can maintain a virtualized aggregate media library representing the physical media libraries with which it is in communication. From the physical media libraries, the media library controller can establish a virtual media library and associate a host with the virtual media library. The virtual media library can represent the portions of a physical media library to which the host is allowed access.