"If the ruling party has power, opposition must at least have its say. But at the end of the day, democracy says that opposition must have its say and the government must have its way because it is as per the mandate of the people," Mr Naidu said in his first speech as the Rajya Sabha Chairman.
The former BJP President said he was "an all-party man" now and his role was "above politics".
"I will meet your expectations. Everyone among you will get an opportunity but everyone must follow the rules and regulations (of Parliament," Mr Naidu said in response to welcome speeches by Rajya Sabha members.
He said politicians must not look at each other as enemies but as "rivals" in their common endeavour of "working hard to strengthen the country and help people".
Mr Naidu, 68, earlier took oath as India's 13th Vice President, succeeding Mr Hamid Ansari, who finished his decade-long two terms as Vice President and Rajya Sabha Chairman on Thursday.
In his address to the Upper House, Mr Naidu recalled his "humble background" coming from a peasant's family.
He credited his political success to the "might" and "beauty" of the Indian Constitution.
Get the latest election news, live updates and election schedule for Lok Sabha Elections 2019 on ndtv.com/elections. Like us on Facebook or follow us on Twitter and Instagram for updates from each of the 543 parliamentary seats for the 2019 Indian general elections.