Abstract: The rock burst frequently occurs in the roadways with top coal, and the roof disasters are particularly severe under dynamic stress in China. In order to explore the classification and instability mechanisms of anchoring structures in the roadways with top-coal, analog simulation experiments, theoretical analysis, and data statistics were used under the engineering background of the large-area rock burst roof failure in the Working Face 301 of a mine in Shaanxi Province, China. The dynamic load response characteristics of the stress, displacement, and surface acceleration of the surrounding rock in the roadways with top coal were analyzed. The classification characteristics of the roof anchoring structure under the influence of top coal thickness and cables were studied. The stress response mechanism of the roadways with top coal under elastic waves was explored, and the instability mechanism of the anchoring “beam arch” structure was proposed. The rock burst resistance of the air-return roadway in the Working Face 301 was evaluated, and the corresponding optimization schemes for the “beam-arch” composite structure were proposed. The results show that ① the monitoring data of stress and displacement of the surrounding rock in the roadways with top coal under dynamic stress verify the existence of internal and external beam or arch anchoring structures in the roof. Due to the increase in the thickness of top coal, there is a transition from “beam” to “arch” in the anchoring structure of the inner layer of the roof; ② based on the relative relationship between the thickness of the top coal and the cables, the roof anchoring structure is divided into “superimposed-beam and arch” for thin top coal, “composite-beam and arch” for thick top coal, and “combined arch” for extra thick top coal. A critical thickness index for the transformation of thick coal beams from “beam” to “arch” is established; ③ the instability mechanism of the beam structure and the arch structure is that they fail after reaching their tensile and shear strength limits under dynamic and static stress, respectively. The amplification effect of the “beam-arch” composite structure on the load stress is significantly affected by its size; ④ the bearing strength of the inner arch in the "combined arch" structure is relatively low. Increasing the length of cables can increase the thickness of the inner arch, and the corresponding “combined arch” structure’s bearing strength increases significantly, which is consistent with the evaluation results of the rock burst resistance.