Being a near end to a confident life, there is no simple test to diagnose stages of patients with Parkinson's disease (PD) for a patient. In order to estimate whether the disease is in control and to check if medications are regulated, the stage of the disease must be able to be determined at each point. Clinical techniques like the specific single-photon emission computerized tomography (SPECT) scan called a dopamine transporter (DAT) scan is expensive to perform regularly and may limit the patient from getting regular progress of his body. The proposed approach is a lightweight computer vision method to simplify the detection of PD from spirals drawn by the patients. The customized architecture of convolutional neural network (CNN) and the histogram of oriented gradients (HoG) based feature extraction. This can progressively aid early detection of the disease provisioning to improve the future quality of life despite the threatening symptoms by ensuring that the right medication dosages are administered in time. The proposed lightweight model can be readily deployed on embedded and hand-held devices and can be made available to patients for a quick self-examination.