Cervical cancer, caused by high oncogenic risk Human Papillomavirus (HPV) infection, continues to be a public health problem, mainly in developing countries. Using peptide phage display as a tool to identify potential molecular targets in HPV associated tumors, we identified α-mannosidase, among other enriched sequences. This enzyme is expressed in both tumor and inflammatory compartment of the tumor microenvironment. Several studies in experimental models have shown that its inhibition by swainsonine (SW) led to inhibition of tumor growth and metastasis directly and indirectly, through activation of macrophages and NK cells, promoting anti-tumor activity. Therefore, the aim of this work was to test if swainsonine treatment could modulate anti-tumor immune responses and therefore interfere in HPV associated tumor growth. Validation of our biopanning results showed that cervical tumors, both tumor cells and leukocytes, expressed α-mannosidase. Ex vivo experiments with tumor associated macrophages showed that SW could partially modulate macrophage phenotype, decreasing CCL2 secretion and impairing IL-10 and IL-6 upregulation, which prompted us to proceed to in vivo tests. However, in vivo, SW treatment increased tumor growth. Investigation of the mechanisms leading to this result showed that SW treatment significantly induced the accumulation of myeloid derived suppressor cells in the spleen of tumor bearing mice, which inhibited T cell activation. Our results suggested that SW contributes to cervical cancer progression by favoring proliferation and accumulation of myeloid cells in the spleen, thus exacerbating these tumors systemic effects on the immune system, therefore facilitating tumor growth.