Referring to Pakistan-sponsored terrorism in Kashmir and the continuing infiltration attempts from across the border, Mr Singh said that India does not have the capacity to bear more "infiltrators", therefore the Rohingya Muslims will have to leave.
The minister reiterated the government's stand that Rohingyas are illegal migrants who pose a threat to India's internal security.
Humanity is not above the law, Mr Singh said, in remarks that come in the backdrop of criticism of the government decision to deport the Rohingyas, who have fled the violence- hit Rakhine state of Myanmar.
"There are some politicians in India as well who are standing in support of Rohingyas.
"They should also be told to send them (Rohingyas) to Pakistan. If Pakistan's terrorist leader (Azhar) backed by its government is saying this, then the Pakistani government should take them (Rohingyas) away," Mr Singh told reporters on the sidelines of a summit organised by the CII.
The government had told Parliament on August 9 that more than 14,000 Rohingyas are at present staying in India.
However, some inputs indicate that around 40,000 undocumented Rohingyas were staying in India, mostly in Jammu, Hyderabad, Haryana, Uttar Pradesh, Delhi-NCR and Rajasthan regions.
Mr Singh had earlier triggered a row with his statement that "those trying to stop Narendra Modi from coming to power have no place in India and should go to Pakistan".
Addressing the summit today, the minister for micro, small and medium enterprises said the government plans to establish agro technology clusters as part of a new scheme to tackle the food security challenges posed by a growing population.