The organisation had installed the 32-inch tall bust at its Daulatganj office in Gwalior on November 15 -- the day Godse was hanged at the Ambala Jail 68 years ago, and consecrated it with rituals.
The bust was removed as the notice sent to the Mahasabha failed to elicit a "satisfactory" reply.
Mahasabha national vice president Jaiveer Bharadwaj had said they had established Godse's 'temple' at its office as the administration had denied them permission to construct a proper temple on November 9.
The administration had issued a notice to the Mahasabha five days ago under the Madhya Pradesh Public Place Regulation (religious place) Act, asking it to remove the bust.
"As we couldn't get a satisfactory reply to our notice we asked them (Mahasabha) to remove the bust in an hour this afternoon. As they failed to respond, we confiscated the bust this evening," Gwalior Collector Rahul Jain told PTI.
The group observes November 15 as Balidan Diwas (sacrifice day).
The Congress had demanded that the outfit be booked for sedition for installing Godse's bust.
Get Breaking news, live coverage, and Latest News from India and around the world on NDTV.com. Catch all the Live TV action on NDTV 24x7 and NDTV India. Like us on Facebook or follow us on Twitter and Instagram for latest news and live news updates.