In this paper, we present a system for handwriting digit recognition using different invariant features extraction and multiple classifiers. In the feature extraction we use four types: cavities, Zernike moments, Hu moments, Histogram of Gradient (HOG). Firstly, the features are used independently by five classifiers: K-nearest neighbor (KNN), Support Vector Machines (SVM) one versus one, SVM one versus all, Decision Tree, MLP. Then to achieve the best possible classification performance in terms of recognition rate, three methods of classifiers Combination rule employed: majority vote, Borda count and maximum rule. Experiments are performed on the well-known MNIST database of handwritten digits. The results demonstrated that the combination of KNN using HOG features with SVMOVA using Zernike moments by Borda count rule have considered to be good based on a geometric transformation invariance.