In order to study the fracture behavior of asphalt concrete under pure modeⅠand mixed-modeⅠ-Ⅱ, an Extended Finite Element Method (XFEM) was employed to simulate the fracture process of single-edge notched beam specimen (SEB). Based on the comparison of numerical results and experimental records, it can be concluded that XFEM can serve as an efficient tool for the simulation of crack path and calculating mechanical response. Moreover, the fracture of SEB can be divided into four stages. The beam has already been under damage accumulation stage when the load reaches the peak value and crack initiates after the peak load. Fracture behavior can be considered as a process in which tensile stress decreases in the damaged zone and increases in the undamaged zone. Meanwhile, the length of the damaged zone is increasing. The critical offset coefficient obtained through numerical analysis is 0.45~0.51, which shows good agreement with the test result. Unloading behavior occurs near the mid-span section when offset coefficient is equal to 0.45, which inhibits the damage growth and the initiation of secondary cracks.