Restriction of payday loans would hit the poorest the hardest