Story Points should not be numbers.
Earlier I introduced the concept of Planning Poker for estimation. (Part One. Part Two.) This has continued to be a very good tool for our team, and specifically our project manager. While most notably used for estimation, that is only part of the benefit that is received by using a process similar to Planning Poker. To our team the interaction between the team and the product owner coupled with the team wide understanding of upcoming user stories are bigger benefits.
When I first introduced this new form of estimation to the group I made a mistake. I did explain the concept of story points to the group and even had cards made to represent them. The cards all had graphics backing the central number to help frame them as relative effort. Boxes play heavily into the product we develop, so I had single boxes, groups of boxes, and pallets of boxes for the story points. I also created a separate set of cards for estimating tasks and bugs. They were to be done in hours, so they had cards with numbers and no background. The mistake is that the story points were set up with the same set of values as the hours.

