NRI house property buying

Nri buys house property in india for which advance payment 20lakh is made.Tds 20000 dedicted and paid to govt.If due to some problem he cancells the agreement and decided not to buy the property. He asks seller to return the money of 20 lakh.While seller credits 20 lakh to buyer does buyer needs to submit or explain with IT for not getting queries?. How to get back 20000 tds which buyer has paid ?