Vectors, matrices, transformations (these three comprise linear algebra) , floating point error, collision detection, physics (so some knowledge of calculus), trigonometry...
I would recommend two books to help with these:
3D Math Primer for Graphics and Game Development
Real-time Collision Detection
and if you think you'll be working all alone, you might also want to get:
They fall under the Physics band, but I would added differentiation and integration to that list. Namely, the solving of second order differential equations. They're useful for various branches of Newtonian mechanics. On that note, if you're not already familiar with Newton's laws, it wouldn't hurt to brush up on those either.
Other stuff: With matrices it's good to understand eigenvectors and eigenvalues. Good to have knowledge of complex numbers and familiarity with Cartesian and polar coordinates (and the conversion between the two).