The initiative is the latest by the government to ensure more reliable power supplies in the country where a quarter of households have no electricity supply.
The centre launched a $2.3 billion project in September to provide the whole population with power by the end of 2018.
Mr Singh said distributors would be fined if they cut power to customers unless the shutdown was caused by factors such as the weather or a disaster that was beyond a company's control.
The fines would be imposed in the financial year starting April 1, 2019, he said, without giving further details.
Distribution firms sometimes cut power saying they do not have the cash to pay generating firms. The government says this could be solved by better bill collection and by reducing power theft by those using unauthorised and unmetered grid links.
"Some states are not able to bill the consumers effectively," Mr Singh said, adding some states were failing to collect payments for about 50 per cent of power they supplied.
Mr Singh wants to curb power theft as part of an effort to fix the finances of debt-laden power distribution companies, known as discoms, in states that have struggled to buy and supply enough electricity to consumers.
As part of its efforts to expand electricity supply, the government aims to distribute solar panels with battery packs to households in areas that are too remote for transmission lines.
India wants renewable power sources excluding major hydropower plants to account for 40 per cent of installed capacity by 2030. It would also push other nations to deliver on commitments to supply power from clean sources, Mr Singh said.
Wind, solar, biofuels and small hydropower projects account for about 18 per cent of installed capacity now, while about 66 per cent is generated from coal, diesel and gas. The remainder comes from nuclear and major hydropower plants.
(Reporting by Sudarshan Varadhan; Editing by Edmund Blair)
Get Breaking news, live coverage, and Latest News from India and around the world on NDTV.com. Catch all the Live TV action on NDTV 24x7 and NDTV India. Like us on Facebook or follow us on Twitter and Instagram for latest news and live news updates.