Notice u/s 200a

Recently I have purchased a property(apartment) worth Rs.6170000 and paid 1% TDS on behalf of the seller.Now I have received a notice telling me to pay 20% TDS. I checked with a tax consultant and came to know that seller's PAN is not linked with Aadhar and this is the reason may be he is being treated as NRI.As suggested by tax consultant, I informed seller to link PAN with Aadhar, but still he has not done it saying that Name in PAN and Aadhar is not matching and because of that they are unable to do that.Now seller is telling me to handle it as its showing to my PAN number.Can anyone advise me how I can proceed.20% of property value is coming around 12Lakhs which is a huge amount for me.