“For both sides, there has been one twist in the road after another,” said Daniel Yergin, the energy historian and vice chairman of IHS Markit, an energy research consultancy. For prices to rise again, “inventories have to be seen as coming down, and there needs to be a tempering in the growth of U.S. shale production,” he said. “Those are the two things that are defining the market right now.”
But neither is happening.
This week oil traders were shaken by a report by the International Energy Agency that global supplies rose by 585,000 barrels a day in May as both OPEC countries and non-OPEC countries increased production. Oil stocks for the 35 industrialized economies, the agency noted, are not only well above the historical average but higher than when OPEC decided late last year to cut output.
United States oil production, which averaged 8.9 million barrels a day in 2016, will rise to 9.3 million barrels a day this year, according to the Energy Department. The department is projecting production of 10 million barrels a day in 2018, exceeding the record set in 1970. Last week domestic crude inventories eased a bit, but gasoline stockpiles rose by 2.1 million barrels.
OPEC set the latest market cycle in motion in late 2014, when the Saudis and their allies decided to swing cartel policy in an unexpected direction. Instead of cutting production to support prices, as it had done so often in the past, OPEC decided to let market forces loose and then even raised production.
The goal was a sharp but brief price slump that would drive independent American producers out of business to guarantee continued OPEC dominance of international markets.
American drilling did drop precipitously, as companies decommissioned more than half their rigs and neglected to complete wells already drilled through 2015 and part of last year.
But the American producers proved durable. They pushed innovation to produce more oil at lower costs by drilling longer lateral wells through shale fields. Their effort was helped along by cost reductions for drilling and production made possible in part by new technologies, including robotics and sensors to improve efficiencies.
Companies generally lost money through much of 2015 and 2016, and while some are beginning to earn a profit again, others risk being taken over or going out of business altogether.
“Nobody wants to come to grips with the fact the days of $70 and $80 oil are over,” said Fadel Gheit, a senior oil company analyst at Oppenheimer & Company. “The shale producers continue to cut costs, and that gives them the hope to survive. But if oil prices don’t rise significantly from the current level, 50 percent of the shale producers will go out of business.”
The exception may be the companies operating in the Permian Basin of West Texas and New Mexico, with its layer cake of shale strands that make multiple wells cheaper to drill. The building of pipelines across Texas is pushing new American energy exports to Europe, Asia and Latin America.
“The unexpected resilience and revival of U.S. shale production is already frustrating OPEC’s efforts to draw down global stocks,” said Badr Jafar, president of Crescent Petroleum, based in the United Arab Emirates, “and threatening its market share at the same time.”
The failure to stem American production led OPEC to change tactics late last year and finally cut production. Last month, the cartel extended its cuts through March 2018. It succeeded in getting Russia and a few other important producers to follow suit.
The new tack helped stabilize the market for a time, raising the oil price, which had dropped below $30 a barrel in early 2016, to over $50 a barrel during much of the first half of 2017. At that point many oil companies operating in the United States raised production and locked in higher sale prices with hedges.
But OPEC’s cuts were partly a mirage. Its production actually rose by 290,000 barrels a day in May, to the highest level of the year, because Libya and Nigeria were exempted from the cuts and were gushing crude onto world markets.
Political instability could throttle production from either country at any moment, but both continue to surprise the markets with their robust exports.
The low oil and gasoline prices are nice for consumers, but they also hurt the competitiveness of cleaner electric cars. They could also damage the prospects for an initial public offering by the state-owned oil company Saudi Aramco — a move central to King Salman’s efforts to remake the economy.
But another twist may lie ahead in the battle for markets. Lower prices could force companies to slash production again. Already, some are cutting back on exploration and new projects in fields where it is expensive to operate, like the Canadian oil sands.
“It remains to be seen if drilling can continue at the same pace in a sub-$50 environment once price hedges expire,” Mr. Jafar said, referring to the American shale producers. “But if it does, I believe OPEC producers will have no choice but to revert to preservation of market share once again, which could see prices nose-dive. And the cycle will continue.”