After receiving Mr Abe at the airport and taking him on an open jeep roadshow to Mahatma Gandhi's Sabarmati ashram, PM Modi escorted him to the iconic mosque built in the 16th century.
According to clerics at the mosque, PM Modi explained the history and importance of the mosque to Mr Abe. The two Prime Ministers were also photographed against the picturesque monument against the fading sunlight.
The mosque was built by an Abyssinian, Sidi Saiyyed, who was from Yemen. It is said that about 45 craftsmen worked with him. Under the British, the monument mostly served the purpose of a government office.
In recent years, the 10-tone latticework windows have earned renown among historians and archeologists across the world. Officials see it as a symbol of the fusion of Hindu and Muslim cultures.
PM Modi has in the past visited the Sarkhej Roza mosque and tomb complex on the outskirts of Ahmedabad.
On a visit to Abu Dhabi two years ago, he visited the Grand Mosque, the largest in the UAE.