In this paper, referring to the uneven distribution of the grinding harden layer along the grinding direction and the deformation of the workpiece surface after grinding, a kind of grinding method was put forward based on the temperature compensation to improve the uniformity of the grinding harden layer. The workpiece was electrically heated by a copper electrode with a 304 stainless steel gasket mounted at the cut-in zone of the workpiece, and a closed loop was formed after electrifying. Because the 304 stainless steel is of the high resistivity and low thermal conductivity, the high temperature on the cut-in zone appeared. Thus, the increased harden layer was formed on the cut-in zone, and the uniformity for the grinding harden layer distribution can be also improved. The distribution of grind-hardening layer and the workpiece deformation were studied under the different preheating temperature and different thickness of the 304 stainless steel. The results show that the grinding force and the grinding harden layer depth can be increased under the preheating condition. With the increasing thickness of the stainless steel gasket at the cut-in zone of the workpiece, the deformation of the ground workpiece is reduced. At the same time, the uniformity for the harden layer depth distribution is also improved.