Linguists: Mathematical writing vs. Typical written language, what's the difference?

I remember reading somewhere that mathematical symbols make up an "incomplete" written language (or something like that). I commonly formulate problems, or complete sentences using only mathematical symbols. From a linguistic perspective, what separates mathematical symbols from "complete" writing systems?