The Chancellor will meet investment banks on Wednesday following days of turmoil.
The pound has plummeted and Government borrowing costs increased after Mr Kwarteng's mini-budget spooked markets with its package of tax cuts.
In an extraordinary statement, the IMF said it was “closely monitoring” developments in the UK and was in touch with the authorities, urging the Chancellor to “reevaluate the tax measures”.
It warned the current plans, including the abolition of the 45p rate of income tax for people on more than £150,000, are likely to increase inequality.
The move came as the Bank of England signalled it was ready to significantly ramp up interest rates to shore up the pound and guard against increased inflation.
The Chancellor insisted he was “confident” his tax-cutting strategy will deliver the promised economic growth.
Sterling slumped to a record low against the dollar on Monday before recovering and Mr Kwarteng has sought to convince City investors he has a “credible plan” to start reducing the UK’s debt mountain.
But the IMF said in a statement: “We understand that the sizeable fiscal package announced aims at helping families and businesses deal with the energy shock and at boosting growth via tax cuts and supply measures.
“However, given elevated inflation pressures in many countries, including the UK, we do not recommend large and untargeted fiscal packages at this juncture, as it is important that fiscal policy does not work at cross purposes to monetary policy.
“Furthermore, the nature of the UK measures will likely increase inequality.”
It urged Mr Kwarteng to change course when he comes back to Parliament in November with a package intended to show how he will get the public finances back on track.
The IMF said: "The November 23 budget will present an early opportunity for the UK Government to consider ways to provide support that is more targeted and reevaluate the tax measures, especially those that benefit high income earners."
In response to the criticism a Treasury spokeswoman said: “We have acted at speed to protect households and businesses through this winter and the next, following the unprecedented energy price rise caused by (Vladimir) Putin’s illegal actions in Ukraine.”
The Government was “focused on growing the economy to raise living standards for everyone” and the Chancellor’s statement on November 23 “will set out further details on the Government’s fiscal rules, including ensuring that debt falls as a share of GDP (gross domestic product) in the medium term”.
Shadow Chancellor Rachel Reeves said: “The Government must urgently lay out how it will fix the problems it created through its reckless decisions to waste money in an untargeted cut in the top rate of tax.
“Waiting until November is not an option. The Government must urgently review the plans made in their fiscal statement last week.”
The Bank of England’s chief economist Huw Pill warned Threadneedle Street “cannot be indifferent” to the developments of the past days, seen as a signal the cost of borrowing will have to go up to protect the pound and keep a lid on inflation.
Mr Pill said: “It is hard not to draw the conclusion that all this will require significant monetary policy response."
Interest rate rises could lead to increased mortgage costs and make business borrowing more expensive.
With some analysts predicting the Bank of England’s base rate, currently standing at 2.25 percent, will have to rise to as high as six percent next year, some lenders began withdrawing mortgage products amid the uncertainty.
At meetings on Wednesday with investment banks, the Chancellor is expected to emphasised the importance of the reforms ministers will be setting out in the coming weeks to boost growth, including his “Big Bang 2.0” measures to further liberalise financial market regulation.
Chancellor of the Exchequer Kwasi Kwarteng leaves 11 Downing Street
Aaron Chown
Prime Minister Liz Truss and Chancellor of the Exchequer Kwasi Kwarteng
Dylan Martinez