A method and system for image segmentation by evolving radial basis functions (RBFs) is disclosed. A set of RBFs define a contour on an image. The contour is the zero level set of an implicit function defined by the RBFs. The RBFs are weighted and parameterized by multiple parameters, such as center point, standard deviation, and orientation. The contour is iteratively deformed by updating the weight and each of the parameters of each of the RBFs based on each pixel of the contour, until the contour converges. The parameters and the weight of each RBF is updated using coupled set of differential equations derived based from a region-based or boundary-based image segmentation energy formulation. The final contour at a convergence defines boundaries of a target object or region in the image.