Oil erased earlier gains, pressured by persistent global oversupply and a bleak demand outlook. They have lost about 70 per cent since mid-2014.
Exxon and Chevron fell about 1.5 per cent weighing the most on the Dow and S&P 500.
Stocks had been higher earlier in the day as market tumult in China eased and data showed robust US job growth.
Nonfarm payrolls surged in December and unemployment rate held steady at 5 per cent. October and November payrolls were revised sharply higher.
The upbeat report suggested that a recent manufacturing-led slowdown in economic growth would be temporary.
Investors have been jittery as markets got off to their worst four-day start to a year and economists slashed fourth-quarter US growth estimates.
"The market's reaction is something between curious and concerning," said Richard Scalone, co-head of foreign exchange at TJM Brokerage in Chicago.
"You are not getting that much of a lasting reaction in markets. The week has witnessed some of the most concerning phenomenon in some time. People are skittish in holding positions."
At 1431 GMT (8:31 p.m. in India), the Dow Jones industrial average was down 44.14 points, or 0.27 per cent, at 16,469.96, the S&P 500 was down 5.5 points, or 0.28 per cent, at 1,937.59 and the Nasdaq Composite was down 13.05 points, or 0.28 per cent, at 4,676.38.
Nine of the 10 major S&P 500 sectors were lower, with the energy index's 1.34 per cent loss making it the top decliner.
Apple shares snapped their three-day losing streak and were up 0.8 per cent. They rose as much as 2.8 per cent earlier in the session.
Friday's jobs report was the first since the Federal Reserve raised interest rates last month for the first time in nearly a decade, highlighting the strength of the US domestic economy.
While various Fed officials have said four rate hikes in 2016 could be possible, economists and traders are pricing in two hikes, while reducing bets on a third hike by December. The US central bank meets next on January 26-27.
China nudged the yuan higher for the first time in nine days, while traders welcomed the country's decision to suspend a circuit breaker that halted trading twice this week.
The CSI300 index and the Shanghai Composite index both closed up 2 per cent, capping off a week of tumult.
Shares of Qorvo were down 4.2 per cent at $43.70, a day after the Apple supplier cut its revenue estimate for the third quarter.
Gap was down 11.6 per cent at $23.64 after the apparel retailer reported a larger-than-expected drop in December same-store sales.
Container Store slumped 39.8 per cent to $4.32, a day after storage products retailer's fourth-quarter profit forecast missed estimates.
Declining issues outnumbered advancing ones on the NYSE by 1,858 to 1,056. On the Nasdaq, 1,673 issues fell and 988 advanced.
The S&P 500 index showed one new 52-week high and 57 new lows, while the Nasdaq recorded 9 new highs and 203 new lows.
© Thomson Reuters 2016