Black Phosphorus (BP) is presently attracting immense research interest on the global level due to its high mobility and suitable band gap for potential application in optoelectronics and flexible devices. It was theoretically predicted that BP has a large direction-dependent electrical and magnetotransport anisotropy. Investigations on magnetotransport of BP may therefore provide a new platform for studying the nature of electron transport in layered materials. However, to the best of our knowledge, magnetotransport studies, especially the anisotropic magnetoresistance (MR) effect in layered BP, are rarely reported. Here, we report a large linear MR up to 510% at a magnetic field of 7 Tesla in single crystals of BP. Analysis of the temperature and angle dependence of MR revealed that the large linear MR in our sample originates from mobility fluctuations. Furthermore, we reveal that the large linear MR of layered BP in fact follows a three-dimensional behavior rather than a two-dimensional one. Our results have implications to both the fundamental understanding and magnetoresistive device applications of BP.