Provided is an asphalt binder composition, and more particularly, an asphalt binder composition capable of improving mixability between an asphalt binder and an aggregate, and compactibility and water resistance of an asphalt paving mixture. More particularly, the present invention relates to an asphalt binder composition capable of being used in hot mix asphalt for improving workability and/or stripping-resistance, warm-mix asphalt, recycling of reclaimed asphalt pavement, or the like.