"Taj Mahal ek khoobsurat kabristan hai (Taj Mahal is a beautiful graveyard)," the Minister for health and sports in the BJP government in Haryana tweeted.
Mr Vij has courted controversy several times in the past with his remarks.
His tweet on Taj Mahal came in the backdrop of Mr Som, BJP legislator from Sardhana, Uttar Pradesh, questioning the monument's place in India's heritage.
However, another senior BJP leader Vinay Katiyar had claimed that the Taj Mahal was a Lord Shiva temple called 'Tejo Mahal' which was converted into a mausoleum by Mughal emperor Shah Jahan.
The 17th century marble monument was built by Shah Jahan for his wife Mumtaz Mahal. Both were buried there.
Get Breaking news, live coverage, and Latest News from India and around the world on NDTV.com. Catch all the Live TV action on NDTV 24x7 and NDTV India. Like us on Facebook or follow us on Twitter and Instagram for latest news and live news updates.