3 ms·Penny candy. Penny press. Penny stocks. These things used to literally cost one penny, hence their name.by kthejoker2 8y agoPenny candy. Penny press. Penny stocks. These things used to literally cost one penny, hence their name.