Tunaram Singh, a resident of Nilagiri, said he had taken the child, Krishna, to a local hospital in a trolley rickshaw after the boy was bitten by a snake as he was denied an ambulance for the purpose.
However, the boy was declared dead at the hospital, he said.
After the post-mortem was conducted, he again had to carry his son's body on a trolley rickshaw to reach his home for his last rites.
Mr Tunaram alleged that on both the occasions he had contacted the hospital authorities to provide an ambulance but he was refused due to its non availability.
The incident drew sharp reaction from different quarters following which the Balasore district collector was asked to conduct a probe into the episode by the health department, official sources said.
Nilagiri sub-collector Ghasiram Murmu said, "the incident has came to my notice and inquiry is on. He said Rs 2,000 has been paid under Harish Chandra Yojna to the family of Mr Tunaram for the burial of his child's body.
The incident brought back memories of Dana Majhi, who carried his dead wife on his back last year in Odisha when he was allegedly denied a hearse by a hospital.
Get the latest election news, live updates and election schedule for Lok Sabha Elections 2019 on ndtv.com/elections. Like us on Facebook or follow us on Twitter and Instagram for updates from each of the 543 parliamentary seats for the 2019 Indian general elections.