Mr Chouhan offered prayers at the Priyakant Ju temple Saturday evening.
He also inaugurated a gallery portraying various activities of Lord Krishna as a child.
Founder of the temple Devkinandan Thakur said, "After listening to a few devotional songs, the chief minister took the mike from me, and to my astonishment, started singing 'bhajans'."
The chief minister did not interact with reporters during his stay here. "I am on pilgrimage," he told reporters.
Get the latest election news, live updates and election schedule for Lok Sabha Elections 2019 on ndtv.com/elections. Like us on Facebook or follow us on Twitter and Instagram for updates from each of the 543 parliamentary seats for the 2019 Indian general elections.