The invention relates to a composite container (1), comprising a form-retaining outer container (2) and a flexible inner container (3) received therein, which inner container comprises a dispensing opening (4) which is mounted in a neck (5) of the outer container, wherein the inner container is further connected by an adhesive or weld connection (8) over (a part of) its periphery to the outer container. The adhesive or weld connection can take the form of an adhesive strip or a weld extending transversely of, parallel to or at a non-right angle to a longitudinal axis (L) running from the dispensing opening to an opposite bottom (9) of the container. The adhesive or weld connection can be adapted to detach in controlled manner under the influence of pressures occurring in the container. The invention further relates to a method for manufacturing a composite container, wherein the inner container is connected over (a part of) its periphery thereto by means of adhesion or welding.