Glaucoma are the leading cause of blindness in the working age population all over the world. Glaucoma through colour fundus images requires experienced clinicians to identify the presence and significance of many small features which, along with complex grading system, makes this difficult and time consuming task. Here we propose a CNN approach to diagnosing Glaucoma from fundus images and accurately classifying its severity. We develop a network with Convolutional Neural Network(CNN) architecture and data augmentation which can identify the intricate features involved in the classification task such as micro aneurysms, exudate and haemorrhages on the retina. We train this network using a high-end graphics processor unit (GPU). An open source Kaggle dataset is used as an input for DRand RIGA dataset is used as an input for Glaucoma. Total number of 25000 images are used for diabetic retinopathy and the testing accuracy for DR is 86%. Total number of 2664 images are used in glaucoma and the testing accuracy for glaucoma is 94%.