Public servants face prospect of longer working hours