Mr Ramesh, known as a maverick with often outspoken views, stressed that 70 per cent of spending on health was out of people's own pockets, making it the single most important reason for indebtedness in rural areas.
"We all know that the health system in India has collapsed," he told a forum in New Delhi.
"India is a unique country in the world where 70 per cent of expenditure is private expenditure at a time when most other countries are having a debate on how to increase public investment in health," he added.
"In many poor areas of India, the public health system simply does not exist."
India's Prime Minister Manmohan Singh, in power since 2004, pledged earlier this month that health spending would triple in a five-year plan adopted by the government.
Spending in 2010 was four per cent of gross domestic product, according to the World Health Organization - less than many African countries or Afghanistan and a fraction of developed nations, which spend around 10 per cent.
Mr Ramesh said the other important factor pushing people into poverty in India, where 40 per cent of the population live on less than $1.5 a day, was degradation of the environment.
"The last 25-30 years, with accelerated economic growth and the pressure that economic growth has brought to bear on our natural resources, it has created this new animal of ecological poverty that we have to now address," he said.
Mr Ramesh also stressed the poor had "a disproportionate dependence" on forests, rivers and farm land, which are being steadily degraded under the pressure of the country's rising 1.2 billion population and economic development.