Toward the unsupervised clustering for color logo images corrupted by noise, we propose a novel framework in which the logo images are described by a model called singular values based region covariance matrices (SVRCM), and the mean shift algorithm is performed on Lie groups for clustering covariance matrices. To decrease the influence of noise, we choose the larger singular values, which can better represent the original image and discard the smaller singular values. Therefore, the chosen singular values are grouped and fused by a covariance matrix to form a SVRCM model that can represent the correlation and variance between different singular value features to enhance the discriminating ability of the model. In order to cluster covariance matrices, which do not lie on Euclidean space, the mean shift algorithm is performed on manifolds by iteratively transforming points between the Lie group and Lie algebra. Experimental results on 38 categories of logo images demonstrate the superior performance of the proposed method whose clustering rate can be achieved at 88.55%.