The claim was included in a list of "racial micro- aggressions" in an equality and diversity unit newsletter.
But the prestigious university was criticised for being "insensitive" to autistic people who can struggle making eye contact.
It said it had made a mistake and not taken disabilities into account, the BBC reported.
The university originally said "racial micro-aggressions" might include: "Not making eye contact or speaking directly to people."
It described the behaviours as "subtle, everyday racism" which can be alienating.
David M Davis tweeted: "This is just discrimination against autistic people. One sign of autism is avoiding eye contact. How dare Oxford be so insensitive."
In a series of tweets, the university replied: "We made a mistake. Our newsletter was too brief to deal adequately and sensibly with the issue. We are sorry that we took no account of other reasons for difference in eye contact and social interaction, including disability."
"Oxford deeply values and works hard to support students and staff with disabilities, including those with autism or social anxiety disorder."
Emeritus professor of sociology at the University of Kent, Prof Frank Furedi, said the newsletter's authors "need a reality check".
Get Breaking news, live coverage, and Latest News from India and around the world on NDTV.com. Catch all the Live TV action on NDTV 24x7 and NDTV India. Like us on Facebook or follow us on Twitter and Instagram for latest news and live news updates.