Irish population in serious decline before Vikings arrived, research finds