Arithmophobia is the fear of numbers.
arithmophobia Some fears of particular numbers, such as the number thirteen. There are some phobics who fear the tendency to give so many things a number instead of a name. They may be anxious about being nameless or being a no body.