The incident had taken place yesterday evening in the premises of the hospital, they said.
The police arrested the security guard.
Police said the girl was with her mother and younger sister, who are undergoing treatment at the Mother and Child Health Care Centre (MCH) of the District Headquarters Hospital.
However, she went outside the ward with the security guard in the evening when the doctor visited the ward. The girl's mother searched for her after the doctor finished the round and found her outside with the security guard.
Sambalpur District Collector, Samarth Verma said, the police have already apprehended the accused.
"We are now inquiring whether the private security agency, which has engaged the security guards at the hospital, is verifying the background and documents of the security guards properly before appointing them. If any discrepancy is found in that regard, action will be taken against the agency also," the collector said.
Chief District Medical Officer, KK Gupta said: "We will recommend the Rogi Kalyan Samiti (RKS) to withdraw the private security agency from service. Moreover, we have also written for a police outpost at the hospital. He also informed that they were contemplating on deploying ex-servicemen for the security in the hospital."
Get the latest election news, live updates and election schedule for Lok Sabha Elections 2019 on ndtv.com/elections. Like us on Facebook or follow us on Twitter and Instagram for updates from each of the 543 parliamentary seats for the 2019 Indian general elections.