I gave this a try today, and found that every time I re-entered the shop, I had one less of every stamp type, without using any. I also confirmed this is not an AP-exclusive bug. Steps to reproduce:
Start a new game, grind hands until you score a point.
Buy any stamp, exit the shop without using it.
Enter the shop, your stamp has now been removed but the cost increase is still present.