Mechanical properties are among the most concerned issues for artificial bone grafting materials. The scaffolds used for bone grafts are either too brittle (glass) or too weak (polymer), and therefore composite scaffolds are naturally expected as the solution. However, despite the intensive studies on composite bone grafting materials, there still lacks a material that could be matched to the natural cancellous bones. In this study, nanosized bioactive particles (BP) with controllable size and good colloidal stability were used to composite with gelatin, forming macroporous scaffolds. It was found that the mechanical properties of obtained composite scaffolds, in terms of elastic modulus, compressive strength, and strain at failure, could match to that of natural cancellous bones. This is ascribed to the good distribution of particle in matrix and strong interaction between particle and gelatin. Furthermore, the incorporation of BPs endues the composite scaffolds with bioactivity, forming HA upon reacting with simulated body fluid (SBF) within days, thus stimulating preosteoblasts attachment, growth, and proliferation in these scaffolds. Together with their good mechanical properties, these composite scaffolds are promising artificial bone grating materials.