Rational cropping maintains high soil fertility and a healthy ecosystem. Soil microorganism is the controller of soil fertility. Meanwhile, soil microbial communities also respond to different cropping patterns. The mechanisms by which biotic and abiotic factors were affected by different cropping sequences remain unclear in the major grain-producing regions of northeastern China. To evaluate the effects of different cropping sequences under conventional fertilization practices on soil properties, microbial communities, and crop yield, six types of plant cropping systems were performed, including soybean monoculture, wheat-soybean rotation, wheatmaize-soybean rotation, soybean-maize-maize rotation, maize-soybean-soybean rotation and maize monoculture. Our results showed that compared with the single cropping system, soybean and maize crop rotation in different combinations or sequences can increase soil total organic carbon and nutrients, and promote soybean and maize yield, especially using soybean-maize-maize and maizesoybean-soybean planting system. The 16S rRNA and internal transcribed spacer (ITS) amplicon sequencing showed that different cropping systems had different effects on bacterial and fungal communities. The bacterial and fungal communities of soybean monoculture were less diverse when compared to the other crop rotation planting system. Among the different cropping sequences, the number of observed bacterial species was greater in soybean-maize-maize planting setup and fungal species in maize-soybean-soybean planting setup. Some dominant and functional bacterial and fungal taxa in the rotation soils were observed. Network-based analysis suggests that bacterial phyla Acidobacteria and Actinobacteria while fungal phylum Ascomycota showed a positive correlation with other microbial communities. The phylogenetic investigation of communities by reconstruction of unobserved states (PICRUSt) result showed the presence of various metabolic pathways. Besides, the soybean-maize-maize significantly increased the proportion of some beneficial microorganisms in the soil and reduced the soil-borne animal and plant pathogens. These results warrant further investigation into the mechanisms driving responses of beneficial microbial communities and their capacity on improving soil fertility during legume cropping. The present study extends our understanding of how different crop rotations effect soil parameters, microbial diversity, and metabolic functions, and reveals the importance of crop rotation sequences. These findings could be used to guide decision-making from the microbial perspective for annual crop planting and soil management approaches.