The finance ministers of France, Germany, Italy and Spain said in a letter seen by Reuters: "We should no longer accept that these companies do business in Europe while paying minimal amounts of tax to our treasuries."
Signed by French Finance Minister Bruno Le Maire, Wolfgang Schaeuble of Germany, Pier-Carlo Padoan of Italy and Luis de Guindos of Spain, the letter was sent to the EU’s Estonian presidency with a copy to the group's executive Commission.
The push to curb tax avoidance by such companies has been led by France which has received strong support from other countries that are also annoyed about the small amount of tax that these companies pay under existing rules.
Apple appealed against the order in February.
The four finance ministers asked the EU to devise a solution so that an "equalisation tax" on turnover would result in corporate tax paid in the EU being the same as in the country where the money was earned.
They said they would present the idea to their EU colleagues at a meeting scheduled for 15 and 16 September.
The EU presidency has on its agenda for the meeting an item to discuss making it possible for firms to be taxed where the create value and not only where they are resident for tax purposes.
In July, Google won a case in France against a €1.2 billion tax bill, with a court ruling that the search company had not abused tax loopholes to avoid paying its fair share of taxes.