To the extent that people overpay as a result of the Libor manipulation, they should be able to get their money back. Individuals who have mortgages, pension funds who had pensioner investments - whoever was ripped off is entitled to get their money back.
