The temperature dependence of magnetocrystalline anisotropy was investigated in detail for the polycrystalline Ni50Mn25Ga25, Ni50Mn25Ga20Ti5 and Ni50Mn25Ga20Gd5 ferromagnetic shape memory alloys in the temperature range of 50–400 K. The effective anisotropy constant was estimated from a series of high field magnetization curves based on the fitting procedure according to the law of approach to magnetic saturation. The low temperature martensitic phase was found to have a significantly higher anisotropy energy in comparison to a high temperature austenitic phase, which was observed through a sudden, distinct drop of anisotropy energy. The calculated values of the effective anisotropy constant were comparable to the results published by other authors. Moreover, the strong influence of chemical composition on the first-order phase transition and the second-order ferromagnetic to the paramagnetic transition was revealed. Finally, the strong coupling between the temperature dependence of the coercive field and the temperature dependence of magnetocrystalline anisotropy was also shown and discussed in the present study.