Mr Ramesh, known as a maverick with often outspoken views, stressed that 70 per cent of spending on health was out of people's own pockets, making it the single most important reason for indebtedness in rural areas.
"We all know that the health system in India has collapsed," he told a forum in New Delhi.
"India is a unique country in the world where 70 per cent of expenditure is private expenditure at a time when most other countries are having a debate on how to increase public investment in health," he added.
"In many poor areas of India, the public health system simply does not exist."
India's Prime Minister Manmohan Singh, in power since 2004, pledged earlier this month that health spending would triple in a five-year plan adopted by the government.
Mr Ramesh said the other important factor pushing people into poverty in India, where 40 per cent of the population live on less than $1.5 a day, was degradation of the environment.
"The last 25-30 years, with accelerated economic growth and the pressure that economic growth has brought to bear on our natural resources, it has created this new animal of ecological poverty that we have to now address," he said.
Mr Ramesh also stressed the poor had "a disproportionate dependence" on forests, rivers and farm land, which are being steadily degraded under the pressure of the country's rising 1.2 billion population and economic development.
Get Breaking news, live coverage, and Latest News from India and around the world on NDTV.com. Catch all the Live TV action on NDTV 24x7 and NDTV India. Like us on Facebook or follow us on Twitter and Instagram for latest news and live news updates.