I tend to consider mathematics the body of axioms, definitions, systems of logic, and their results. If you're not adding to this body, you're not doing mathematics.
Arithmetic, calculating, solving, and so on, just seem more like accounting than mathematics. If anything, I would call these things "calculus" after the original Latin root word, referring to a stone used for counting.
Maybe it's pedantic. But I don't think so. A lot of people who "hate math" really hate "calculus." And honestly, being good at mathematics, at constructing proofs, etc is so different from being good at working with numbers. I'm decent at the former. I'm horrible when it comes to the latter.