The drastic measure was taken because, according to the child protective services, the couple were not bringing the children up properly. What did they do wrong? They fed the children with their hands and the infants slept in the same bed as the parents.
"My son was sleeping with my husband. They said he should sleep separately from your son," said Mrs Bhattacharya.
"Feeding a child with the hand is normal in Indian tradition and when the mother is feeding with a spoon there could be phases when she was overfeeding the child. They said it was force feeding. These are basically cultural differences," said Mr Bhattacharya.
Recently, the Indian Embassy in Oslo stepped in and an officer even met the children, though the parents were not allowed to.
Norway's Child Protective Service is a powerful body charged with protecting the rights of children living in difficult family situations. But there are many reports of excesses.
The Bhattacharyas' visas expire in March. If they don't get their children by then, the couple will be forced to stay on.
"What we have thought is we are not going to apply for visa for my children. But if the case doesn't get sorted we have to apply because we cannot come back to India without our children," said Mr Bhattacharya.
It's a nightmare that, at this moment, seems without end.
Get the latest election news, live updates and election schedule for Lok Sabha Elections 2019 on ndtv.com/elections. Like us on Facebook or follow us on Twitter and Instagram for updates from each of the 543 parliamentary seats for the 2019 Indian general elections.