Organisers of the Tokyo Olympics will hold a gathering of executive board members later this week, the Tokyo 2020 Organising Committee has confirmed.

The meeting on Friday is for the members to express their opinions on comments by Tokyo 2020 President Yoshiro Mori that women talk too much, the Tokyo 2020 Organising Committee said, remarks that attracted widespread criticism and calls for Mori's resignation.

Mori apologised and retracted his comments, but the public outcry over them continues.

Despite the condemnation, the 83-year-old former prime minister in Japan remains insulated within the organisation he leads, with officials fearing that his resignation would imperil the Tokyo Games.

Executive board members will also discuss gender equality initiatives at Friday's gathering, the Tokyo 2020 OrganisingCommittee said.

The International Olympic Committee had earlier said that Mori's comments about women were "absolutely inappropriate".

"The recent comments of Tokyo 2020 President Mori were absolutely inappropriate and in contradiction to the IOC's commitments and the reforms of its Olympic Agenda 2020," the Olympic body said in a statement.

Following Mori's remarks, about 440 Games volunteers have quit and local organisers have received more than 5,500 complaints, according to local media.

Mori came under fire for saying last week that meetings with female participants take a long time, adding that they "get competitive" with each other.

The comments were made at a recent Japanese Olympic Committee (JOC) board of trustees meeting.

"If we increase the number of female board members, we have to make sure their speaking time is restricted somewhat, they have difficulty finishing, which is annoying," said Mori, according to local media.

"We have about seven women at the organising committee but everyone understands their place."