Herbs are used in traditional medicine. There are so many herbs are spread across the world, it is difficult to memorize it all. This paper describes an android application to recognize herbs by their leaf characteristics (shape, veins, and keypoints). Shape and veins of leaves are recognized by Invariant Moment Method as the feature extraction. City Block Distance used to calculate the distance between the features. Whereas for detection and keypoints extraction using Oriented FAST and Rotated BRIEF on OpenCV library. This keypoints distance calculation using Brute-Force Hamming. Matching is done by calculating the shortest distance between test image and reference image. If the result is less than or equal to threshold then image is match. Experiment result show this application can achieve 79% of success rate by using keypoints. This result is influenced by glossy leaf surface, so there is many reflected light that become noise.