As someone with a pretty strong Math background, I certainly didn't take that from his comment. I took it to mean he understands Math fairly strongly as well, and that most of your grievances with him have more to do with your lack of familiarity with the deeper underpinnings of Mathematics.