Segmenting ultrasound images is a challenging problem where standard unsupervised segmentation methods such as the well-known Chan-Vese method fail. We propose in this paper an efficient segmentation method for this class of images. Our proposed algorithm is based on a semi-supervised approach (user labels) and the use of image patches as data features. We also consider the Pearson distance between patches, which has been shown to be robust w.r.t speckle noise present in ultrasound images. Our results on phantom and clinical data show a very high similarity agreement with the ground truth provided by a medical expert.