As Danilo stated you first should segment the lips with a 'classical' colour segnentation method, e.g. transforming your images in an HSI-colour space and after that applying a Hue ans Saturation segmentation. This will give you the segmented lips. After this pre-processing step you probably can use/apply 'sift' or better 'surf' to create a robust edge/corner feature vector. The rest depends on your concrete application.