Minister defends plans to abolish town councils