Can Eigen use multiple cores/servers or do I have to program it to do so?

If OpenMP is enabled (compile with -fopenmp if using gcc), then Eigen 3.0 will use this for matrix-matrix products. I think that's the only place where parallellism is used automatically.