"From here I make a call to all Muslims. Anyone who has the opportunity should visit Jerusalem, Al-Aqsa mosque," Erdogan said in Ankara. "Come, let's all protect Jerusalem."
He was referring to the site, known to Jews as the Temple Mount, which is central to the Israeli-Palestinian conflict.
Israel installed metal detectors at entrances to the site, which also includes the Dome of the Rock, following an attack on July 14 that killed two Israeli police officers.
Palestinians viewed the security measures as Israel asserting further control over the site and deadly clashes erupted during protests.
He said Israel's legitimacy rested on the extent of the respect it showed to Palestinians and their rights.
Erdogan also denounced attacks on synagogues in Turkey, referring to reports that an ultra-nationalist group threw stones at a synagogue in Istanbul last week.
"It does not make sense to attack synagogues here because something has happened at Al-Aqsa mosque. This does not suit our religion and it is not allowed," he said.