The protesters gathered outside Mr Singh's house at around 9 AM and started the protests raising slogans - "Rajnath Singh Ji nyay Karo" (Rajnath Singh ensure justice for us).
They also shouted slogans against the Union Public Service Commission (UPSC).
"With the introduction of C-SAT, UPSC has degraded the value of Hindi medium students and aspirants. Several aspirants have been on indefinite hunger strike in Mukherjee Nagar area against this test. We would not be silent till our demand is met," said a protestor.
Protestors also demanded a four-year relaxation in age for appearing in the examinations of these services.
As protestors refused to budge, police took them to Parliament Street Police station where they were later freed.
Get Breaking news, live coverage, and Latest News from India and around the world on NDTV.com. Catch all the Live TV action on NDTV 24x7 and NDTV India. Like us on Facebook or follow us on Twitter and Instagram for latest news and live news updates.