The 75-year-old Ms Kazi arrived on a wheelchair accompanied by her daughter and surrendered in the Terrorist and Disruptive Activities (TADA) special court.
Ms Kazi's surrender came after the special court issued non-bailable warrants against her and co-accused Sharif Dada Parkar, who is over 80 years old, after they failed to appear before it within the deadline set by the Supreme Court.
Her lawyer said that she required to undergo certain medical tests and needed time till May 20 before she could surrender, but the court declined the plea.
Soon after her arrival, Ms Kazi was mobbed by media-persons and she broke down, pleading "mercy and forgiveness" from the government.
"At my age and my present health condition, it is not possible for me to undergo this punishment... I have suffered enough... I urge the government to pardon me and save me from this predicament," Ms Kazi said.
"I simply cannot sit on the floor, how will I manage in the jail? At home my daughter looks after me, I don't know what will happen in the jail," she cried.
Though she has claimed innocence, Ms Kazi was convicted under the Arms Act and the TADA Act and sentenced to five years' jail.
In March, Ms Kazi, through her daughter (who has declined to be identified), had appealed to Press Council of India chairman Markandey Katju to take up her case with the Maharashtra governor for a pardon.
Get Breaking news, live coverage, and Latest News from India and around the world on NDTV.com. Catch all the Live TV action on NDTV 24x7 and NDTV India. Like us on Facebook or follow us on Twitter and Instagram for latest news and live news updates.