A container retainer (5) is provided in which a locking member (11) which can be mounted on the neck of a bottle (3) is itself rotatably held in a bore (8) of a body part (9). The body part (9) is mountable on a suitable surface, such as a wall. With such an arrangement, it is possible to secure the locking member (11) to the bottle (3) by rotation, without having to rotate the bottle (3) itself, or the body part (9). The container retainer (5) then will normally be wall mounted, to form a liquid dispenser to dispense liquid from the bottle (3) or other container (3).