Both the victim Shivaji Shinde (45), a head constable at the local crime branch, and accused Pulja Singh Thakur lived in Datta Nagar area under the Shivaji Nagar police station limits, a senior police official said.
Earlier, four cases were registered against Thakur at various police stations.
According to the officer, Thakur, who was out on bail, was suspicious that Mr Shinde was responsible for his arrests in the past.
Shivaji Shinde was killed on the spot. A murder case was registered and efforts are on to catch the accused, the officer added.
Get the latest election news, live updates and election schedule for Lok Sabha Elections 2019 on ndtv.com/elections. Like us on Facebook or follow us on Twitter and Instagram for updates from each of the 543 parliamentary seats for the 2019 Indian general elections.