Tds on Transportation Debit Note

Who has to deduct & pay tds to govt , when the payment is made to vendor after deducting the transportation charges paid by us on such goods.?

We are deducting the tds from transporters payment & pay the same to government. but Vendor is asking the TDS deduction on the transport charges deducted by us from his payment

Please Clarify!