Yes it becomes important to file agriculture income in case your non-agri income is more than 2.5L. It changes the tax for your non-agri income if that is greater than 2.5L, even when agriculture income itself is tax free. So non inclusion can make your return defective.