The existing studies show that reinforced concrete beams strengthened with prestressed near-surface mounted (NSM) CFRP are easy to fail by concrete cover separation due to the stress concentration at the bonded end of CFRP. In this paper, the construction details of applying gradient prestress at the end of CFRP were proposed, and a series of experiments were carried out to study the load-carrying behavior of the strengthened beams under static and fatigue loads. The test results show that under static load, the ultimate load of beams strengthened with gradually anchored prestressed NSM CFRP was increased up to 35.06%, compared with the beam strengthened with prestressed NSM CFRP. And the failure mode was changed from the concrete cover separation at bonded end into the combined failure of the concrete cover and CFRP fracture. These indicate that the strengthen method with gradually anchored prestressed NSM CFRP can significantly improve the monotonic behavior of beams, and there is an obvious bond stress peak transfer phenomenon. In addition, the fatigue life of beams strengthened with gradually anchored prestressed NSM CFRP was significantly increased, and the fatigue failure mode is changed from the concrete cover separation to the fatigue fracture of longitudinal steel bars. The details of applying gradient prestress enhances the ability of strengthened beams to resist the failure of end concrete cover, and thus improves the fatigue performance.