Swami Ganeshananda, or Hari swami, was shifted to a 'police cell' at the hospital after a magistrate remanded him in custody till June 3, they said.
The 54-year-old accused, who suffered critical injuries in the private parts and underwent an emergency surgery after the woman attacked him with a knife, is now recovering, police said.
The 23-year-old law student, who attacked the swami to defend herself, has been shifted to the state-run Nirbhaya home.
She told police that she had been raped by the man, who claims to be a 'sanyasi', for the last six years and she was forced to take the extreme step after he tried to repeat the offence once again on the night of May 19.
Hari swami, known to the girl's family, had been frequenting her house in Pettah in the city for several years to perform 'pujas' aimed at bringing "relief" to her paralysed and bed-ridden father, police said, quoting the victim.
A case had been registered against him under various sections of the law.
City Police Commissioner Sparjan Kumar said the woman's parents had alleged that the man had cheated them of money to the tune of several lakhs of rupees.
"But they are yet to give any written complaint in this regard. So, no action has been taken so far", he said.
Asked about media reports stating that the mother was aware of the attacks on her daughter, Mr Kumar said the young woman had not given any statements against her mother to police so far. He also dismissed reports that the mother had been taken into custody in connection with the incident.
Get the latest election news, live updates and election schedule for Lok Sabha Elections 2019 on ndtv.com/elections. Like us on Facebook or follow us on Twitter and Instagram for updates from each of the 543 parliamentary seats for the 2019 Indian general elections.