The change comes at a time when India and Pakistan relations have been soured by the recent murder and mutilation of two Indian soldiers - which comes on the heels of Kulbhushan Jadhav, the Indian man who has been sentenced to death by Pakistan on charges of spying.
Mr Basit was not elevated as Pakistan Foreign secretary - the post went to Tehmina Janjua. It was seen as an indication that Mr Basit, known to be hawkish on Jammu and Kashmir, was not someone whom Prime Minister Nawaz Sharif was keen to continue with. His next posting is likely to be the head of foreign service academy in Islamabad or High Commissioner to an European country.
Mr Basit's three-year tenure in New Delhi had started on a high note, with Prime Minister Narendra Modi accepting his Pakistani counterpart Nawaz Sharif's invitation to visit Lahore. But he failed to deliver as a go-between for India and Pakistan.
Fifty-five-year-old Mr Mahmood -- known for his fluency in Turkish language -- is currently Pakistan's envoy to Turkey. He joined the foreign service in 1985, but had had no direct role in India-Pakistan relations. Pakistan's earlier envoys - including Mr Basit and his predecessors Salman Bashir - had no role in India either before taking over the job.
Get Breaking news, live coverage, and Latest News from India and around the world on NDTV.com. Catch all the Live TV action on NDTV 24x7 and NDTV India. Like us on Facebook or follow us on Twitter and Instagram for latest news and live news updates.