Not filing

Dear Sir
I worked in a private Steel manufacture companies from 1996 to 2012. Salary were good but no parmanant job, I worked in all States after fedup I left job and settled in my native doing agriculture in my ancient land. During 1996 to 2012 I didn't file ITR, and I started filing since 2014 but I told tax consultant to file all above years but he told only 3 years is possible so that I filed since 2014 till continue but now IT department sent notice and imposed huge penalties due to Bank transactions, even I closed many bank accounts because regular job change, so I want know how can I save from huge penalties. kindly give me good suggestion.
thanku sir