That is what competition is about. If the tariffs go, someone will lower their prices to gain market share from other companies.
Isn't this what a lot of people were upset about during the last US election - that prices didn't drop back to pre-pandemic levels after the pandemic (and related supply issues) was over? One of the big factors in Trump's election win.
If one company lowers prices today because no more tariffs, everyone else in the market can react by lowering theirs tomorrow to protect market share. Market shares stay the same, all players reduce potential revenues.
I could see a situation where there's a form of passive collusion which leaves prices at their new inflated levels. Market shares stay the same, all players increase revenues and profits.
Or perhaps all players lower their prices to please consumers, but keep prices above pre-tariff levels in order to increase revenues and profits. In this scenario some companies could lower their prices more than others hoping to gain market share, which brings me back to your post in a nice, circular way.
Tariffs and trade wars are complicated. Lotta ins, lotta outs, lotta what have yous.