Mr Ansari's strong remarks came at an all-party meeting called to discuss how Rajya Sabha can do business without disruptions.
"The sad and deeply disturbing truth is that adjournments have been taking place with disturbing frequency," Mr Ansari said.
He said members cannot expect the people to be law-abiding if they break rules themselves. "Members have rights, but there are no rights outside the rules," Mr Ansari said.
After a chaotic first part, the second part of the Budget session begins on Monday and will continue till May 10.
Mani Shankar Aiyar, Congress member in the Rajya Sabha, blamed the BJP for blocking proceedings. "It's because the BJP has been so irresponsible in 2010, 2011 and much of 2012 that the smaller parties have started imitating their behaviour. If the BJP wishes to make disruptions part of our proceedings, let them change the rules," he said to NDTV.
The BJP's Venkaiah Naidu countered him: "If the government does not show accountability, members sometimes take the extreme step of disruptions."
Today's meeting, which was attended by the Prime Minister and senior leaders of parties, failed to reach a consensus on measures proposed by Mr Ansari to discipline members, such as automatic suspension if they cause too much disorder and a deferred telecast of Question Hour.
Trinamool Congress leader Derek O'Brien said a deferred telecast of proceedings was not practical. He suggested that cameras could be turned off if the situation inside the House goes beyond control.
CPI(M) leader Sitaram Yechury agreed with Mr O'Brien. "People have right to know what is happening in the House," he said after the meeting.