The social justice and empowerment minister's regret came after the issue was raised by Congress members, who also gave notice over the remark made on Thursday in parliament.
Parliamentary Affairs Minister M Venkaiah Naidu said the expression used by the minister was not right. But Congress members insisted that Mr Gehlot, who was not initially present in the house, should apologize.
Congress leader Mallikarjun Kharge insisted on the minister's presence. He urged Speaker Sumitra Mahajan to adjourn the house briefly. His demand was opposed by Mr Naidu.
As Congress members trooped near the speaker's podium and raised slogans, Mr Gehlot made an entry.
He said he respected the two Congress leaders as prime ministers. "If feelings of anyone have been hurt (because of what I said), I express my regret," Mr Gehlot said.
The issue was raised on Thursday by Congress member KC Venugopal who demanded that Mr Gehlot's remarks should be expunged.
Get Breaking news, live coverage, and Latest News from India and around the world on NDTV.com. Catch all the Live TV action on NDTV 24x7 and NDTV India. Like us on Facebook or follow us on Twitter and Instagram for latest news and live news updates.