The money they perceive to be saving for the taxpayer, will be paid by the taxpayer in other ways when the person is in debt after getting out and needs public assistance.
Is there any proof this reduces recidivism? I would doubt so. It only makes things worse.