We cut our magic erasers into 1/4's. That's usually plenty for a quickie cleaning task and doesn't waste the rest of the eraser.
According to Homemade Mama's, Magic Erasers are actually just melamine foam, a soundproofing material and can be purchased at Amazon.com for much less than the original Magic Erasers cost, making them an even better frugal choice.