Under the project of ‘1∶5 000 Regional Geological and Mineral Survey of the Hazhu, Hazhudongshan, Hazhunanshan and Lishitan Map-sheet’ by China Geological Survey, this dataset was compiled though rock analysis and tests based on detailed geological field surveys. This paper presents the test data of Late Paleozoic granite samples in the Hazhu area in Beishan, Inner Mongolia. The rock types include tonalite, granodiorite, monzonitic granite and alkaline feldspar granite. Zircon chronological data show that the formative era of these kind of rocks are Carboniferous-Permian. The whole-rock macroelement and trace element data show that Carboniferous granitoids are of the metaluminous-weak peraluminous and medium-K calc-alkaline series. The distribution curve of rare earth elements displays right-leaning characteristics. Trace elements are rich in large-ion lithophile elements including Rb, Ba and K; and deficient in high field-strength elements including Nb, Ta and Ti; thus, indicating that magma was formed in a continental marginal arc environment related to the subduction belt. In contrast, Permian granitoids display high-silicon, alkali-rich, metaluminous and magnesium-deficient features, and constitute a medium-high-K calc-alkaline series. They are also rich in large-ion lithophile elements and deficient in high-field strength elements. However, graphic texture is developed within alkaline feldspar granite and crystal caves are developed on a large scale in granodiorite, indicating that the Permian rock mass is situated in an extensional environment. The combination of the two can provide a basis and fundamental data support for studying the subduction polarity and tectonic evolution of the Hongshishan-Baiheshan Ocean in the Beishan area. This dataset is presented in the form of Excel tables, including two. xls files (Geochemistry data_HZ. Xls and Zircon U-Pb dating data_HZ. xls), which record the 27 samples’ geochemical data and 11 samples’ zircon U-Pb dating results of the samples, respectively. The samples of this dataset were all tested at the Tianjin Center laboratory of China Geological Survey, with reliable data quality.