International scientific cooperation in public health: A performance measurement framework based on the “Syphilis No!” Project in Brazil
In this article, we aim to propose indicators to evaluate the performance of international scientific cooperation in public health, based on the operation experience in Brazil’s “Syphilis No!” Project. This is an action research project, based upon Kaplan and Norton’s Balanced Scorecard Method, developed in five stages: (i) Reorganization of the indicators, (ii) validation of the new indicators, (iii) construction of the dimensions of the indicators, (iv) data collection for the indicators, (v) development of the framework for the “Syphilis No!” Project. The metrics and 34 indicators are presented and grouped into four dimensions: technical-scientific, investment, products, and impact. The cooperation that emerged from the project has built an international research network that has the potential to transcend syphilis research. The framework demonstrated that international scientific cooperations, focused on research and product development, have contributed to the promotion of public health policies and have enabled the exchange of knowledge, techniques, experiences, and technologies, fundamental to the international scientific cooperation of Brazilian universities. This contribution will have implications for studies in the field of international relations in health and education.
Andrade, P.A., & De Carvalho, D.B.B. (2015). International cooperation for science and technology development: A way forward for equity in health. História, Ciências, Saúde- Manguinhos, 22(1):49-67. https://doi.org/10.1590/S0104-59702015000100004
Barros, G.M.C., Carvalho, D.D.A., Cruz, A.S., Morais, E.K.L., Sales-Moioli, A.I.L., Pinto, T.K.B., et al. (2022). Development of a cyclic voltammetry-based method for the detection of antigens and antibodies as a novel strategy for syphilis diagnosis. International Journal of Environmental Research and Public Health, 19(23):16206. https://doi.org/10.3390/IJERPH192316206
Bititci, U.S., Turner, T., & Begemann, C. (2000). Dynamics of performance measurement systems. International Journal of Operations and Production Management, 20(6):692-704. https://doi.org/10.1108/01443570010321676/FULL/PDF
Brasil. (2018). ODS - Metas Nacionais dos Objetivos de Desenvolvimento Sustentável. Available from: https:// repositorio.ipea.gov.br/bitstream/11058/8855/1/ agenda_2030_ods_metas_nac_dos_obj_de_desenv_susten_ propos_de_adequa.pdf [Last accessed on 2024 Feb 15].
Brasil. (2019). Cadernos ODS: O Que Mostra o Retrato do Brasil?. Available from: https://www.ipea.gov.br/portal/ images/stories/pdfs/livros/livros/190829_cadernos_ods_ objetivo_3.pdf [Last accessed on 2024 Feb 15].
Brasil. (2020). Cadernos ODS: O Que Mostra o Retrato do Brasil? Available from: https://www.ipea.gov.br/portal/images/ stories/PDFs/livros/livros/200408_Cadernos_ODS_17.pdf [Last accessed on 2024 Feb 15].
Brito, T., Lima, T., Cunha-Oliveira, A., Noronha, A., Brito, C., Farias, F., et al. (2023). Salus platform: A digital health solution tool for managing syphilis cases in Brazil-a comparative analysis. International Journal of Environmental Research and Public Health, 20(7):5258. https://doi.org/10.3390/IJERPH20075258
Broniatowski, D.A., Cardin, M.A., Dong, S., Hale, M.J., Jordan, N.C., Laufer, D.R., et al. (2008). A framework for evaluating international cooperation in space exploration. Space Policy, 24(4):181-189. https://doi.org/10.1016/J.SPACEPOL.2008.09.012
Caitano, A.R., Gusmão, C.M.G., Dias-Trindade, S., Barbalho, I.M.P., Morais, P.S.G., Caldeira-Silva, G.J.P., et al. (2022). Massive health education through technological mediation: Analyses and impacts on the syphilis epidemic in Brazil. Frontiers in Public Health, 10:944213. https://doi.org/10.3389/FPUBH.2022.944213/BIBTEX
Fernández-Portillo, L.A., Sianes, A., & Santos-Carrillo, F. (2020). How will COVID-19 impact on the governance of global health in the 2030 Agenda framework? The opinion of experts. Healthcare (Basel), 8(4):356. https://doi.org/10.3390/HEALTHCARE8040356
Ferreira, M.A.C., Carvalho, D.D.A., Cruz, A.S., Coutinho, K.D., Oliveira, C.A.P., Morais, A.H.F., et al. (2023). Development of technologies to support the diagnosis of infectious diseases and cancer to support the primary health care. Research on Biomedical Engineering, 39(1):27-35. https://doi.org/10.1007/S42600-022-00247-7/TABLES/2
Freitas, I.M.A. (2021). Medição de Desempenho Para Cooperação Internacional: Proposta De Modelo a Partir do Projeto “Sífilis Não!. Available from: https://repositorio.ufrn.br/ handle/123456789/45145 [Last accessed on 2024 Feb 15].
Freitas, I.M.A., Teixeira, L.D., González, M.O.A., Lima, T.G.F.M.S., Coutinho, K.D., & Valentim, R.A.M. (2019). Global Health: How to contribute to the challenge of leaving no one behind? International Journal of Engineering, Applied and Management Sciences Paradigms, 46-52.
Kaplan, R.S., & Norton, D.P. (1997). A Estratégia em Ação: Balanced Scorecard. Texas: Gulf Professional Publishing.
Lara, M. (2021). SUS Fornece Teste e Tratamento Para Sífilis. Ministério Da Saúde. Available from: https://www. gov.br/saude/pt-br/assuntos/noticias/2021/junho/sus-fornece-teste-e-tratamento-para-sifilis#:~:text=A%20 s % C 3 % A D f i l i s % 2 0 % C 3 % A 9 % 2 0 u m a % 2 0 Infec%C3%A7%C3%A3o,hepat ite%20B%20e%20 hepatite%20C [Last accessed on 2024 Feb 15].
Lee, D., Heo, Y., & Kim, K. (2020). A strategy for international cooperation in the COVID-19 pandemic era: Focusing on national scientific funding data. Healthcare, 8(3):204. https://doi.org/10.3390/HEALTHCARE8030204
Lima, J.B.B. (2011). On the formulation of evaluation indicators. Revista Desafios Do Desenvolvimento, 8(65):1-2.
Loyola, M.A., Corrêa, M.C.D.V., & Guimarães, E.R.B. (2010). International cooperation at Public Health: proposals to a debate. Ciência and Saúde Coletiva, 15(4):2007-2020. https://doi.org/10.1590/S1413-81232010000400015
Luo, Z., Ding, Y., Yuan, J., Wu, Q., Tian, L., Zhang, L., et al. (2021). Predictors of seronegative conversion after centralized management of syphilis patients in Shenzhen, China. Frontiers in Public Health, 9:755037. https://doi.org/10.3389/FPUBH.2021.755037/BIBTEX
Mareco, T.C.S., Lima, T.G.F.M.S., Ramos, M.N.P., Santos, M.M., Silva, J.A., Priamo, V., et al. (2023). Analyzing a national health surveillance strategy to reduce mother-to-child transmission of syphilis: The case of Brazilian investigation committees. IJID Regions, 8:164-171. https://doi.org/10.1016/J.IJREGI.2023.07.008
Marrara, T. (2007). The internationalization of the graduate study: objectives, forms and evaluation. Revista Brasileira de Pós-Graduação, 4(8):245-262. https://doi.org/10.21713/2358-2332.2007.v4.132
Moseley, P., Bamford, A., Eisen, S., Lyall, H., Kingston, M., Thorne, C., et al. (2024). Resurgence of congenital syphilis: New strategies against an old foe. The Lancet Infectious Diseases, 24(1):e24-e35. https://doi.org/10.1016/S1473-3099(23)00314-6
Ornelas, A.M., & Gaspar, P. (2019). Processo Licitatório para Aquisição de Testes Rápidos. Ministério Da Saúde - Departamento de Doenças de Condições Crônicas e Infecções Sexualmente Transmissíveis. Available from: https:// antigo.aids.gov.br/pt-br/pub/2019/processo-licitatorio-para-aquisicao-de-testes-rapidos-aleteia-de-melo-ornelas-e-pamela [Last accessed on 2024 Feb 15].
Ossiannilsson, E. (2023). Open educational resources (OER) and some of the United Nations sustainable development goals. International Journal of Information and Learning Technology, 40(5):548-561. https://doi.org/10.1108/IJILT-01-2023-0002/FULL/PDF
Pereira, M.A., Marques, R.C., & Ferreira, D.C. (2021). An incentive-based framework for analyzing the alignment of institutional interventions in the public primary healthcare sector: The Portuguese case. Healthcare, 9(7):904. https://doi.org/10.3390/HEALTHCARE9070904
Pinto, R., Valentim, R., Fernandes da Silva, L., Fontoura de Souza, G., Góis Farias de Moura Santos Lima, T., Pereira de Oliveira, C. A., et al. (2022). Use of interrupted time series analysis in understanding the course of the congenital syphilis epidemic in Brazil. The Lancet Regional Health- Americas, 7:100163. https://doi.org/10.1016/j.lana.2021.100163
Ramos, N., Lacerda, J., Sousa, S., & Almeida, A. (2023). Perspectivas comunicacional, (inter) cultural e educacional e competências na promoção da saúde sexual e na prevenção da Sífilis e outras IST em contextos interculturais. In: Valentim, R., Lacerda, J., Coutinho, K., Dias, A.P., Alberto, C., Rêgo, C., et al., (Eds.), Sífilis: Resposta a Partir de Abordagens por Múltiplas Dimensões. EDUFRN, p.297-321. Available from: https://repositorioaberto.uab.pt/handle/10400.2/13506 [Last accessed on 2024 Feb 15].
Santos, A.I.D. (2013). Recursos Educacionais Abertos no Brasil: o Estado da arte, Desafios e Perspectivas Para o Desenvolvimento e Inovação. São Paulo: Comitê Gestor Da Internet No Brasil.
Spiteri, G., Unemo, M., Mårdh, O., & Amato-Gauci, A.J. (2019). The resurgence of syphilis in high-income countries in the 2000s: A focus on Europe. Epidemiology and Infection, 147:e143. https://doi.org/10.1017/S0950268819000281
Thiollent, M. (2022). Metodologia da Pesquisa-Ação. São Paulo: Cortez Editora.
Tripp, D. (2005). Pesquisa-Ação: Uma introdução metodológica. Educação e Pesquisa, 31(3):443-466. https://doi.org/10.1590/S1517-97022005000300009
United Nations Educational, Scientific and Cultural Organization. (2019). Recommendation on Open Educational Resources (OER) - Legal Affairs. Available from: https://www.unesco. org/en/legal-affairs/recommendation-open-educational-resources-oer [Last accessed on 2024 Feb 15].
United Nations, & Department of Economic and Social Affairs. (2015). Transforming Our World: The 2030 Agenda for Sustainable Development. Available from: https://sdgs. un.org/2030agenda [Last accessed on 2024 Feb 15].
United Nations. (2015). Take Action for the Sustainable Development Goals - United Nations Sustainable Development. Available from: https://www.un.org/ sustainabledevelopment/sustainable-development-goals [Last accessed on 2024 Feb 15].
Universidade Federal do Rio Grande do Norte. (2021). Plano de Desenvolvimento Institucional 2020-2029. EDUFRN. Available from: https://www.ufrn.br/resources/documentos/ pdi/PDI-2020-2029.pdf [Last accessed on 2024 Feb 15].
Valentim, J.L.R.S., Dias-Trindade, S., Oliveira, E.S.G., Romão, M.H., Fernandes, F., Caitano, A.R., et al. (2023). Evaluation of massive education in prison health: A perspective of health care for the person deprived of freedom in Brazil. Frontiers in Public Health, 11:1239769. https://doi.org/10.3389/FPUBH.2023.1239769
Valentim, R.A.M., de Oliveira, C.A.P., Oliveira, E.S.G., Ribeiro, E.L., da Costa, S.M., Morais, I.R.D., et al. (2022). Virtual learning environment of the Brazilian health system (AVASUS): Efficiency of results, impacts, and contributions. Frontiers in Medicine (Lausanne), 9:896208. https://doi.org/10.3389/FMED.2022.896208/BIBTEX
Ventura, D.F.L., Ribeiro, H., di Giulio, G.M., Jaime, P.C., Nunes, J., Bógus, C.M., et al. (2020). Challenges of the COVID-19 pandemic: for a Brazilian research agenda in global health and sustainability. Cadernos de Saúde Pública, 36(4):e00040620. https://doi.org/10.1590/0102-311X00040620
World Health Organization. (2016). Global Health Sector Strategy on Sexually Transmitted Infections 2016-2021: Toward Ending STIs. Available from: https://iris.who.int/bitstream/ handle/10665/246296/?sequence=1 [Last accessed on 2024 Feb 15].
World Health Organization. (2021). Global Guidance on Criteria and Processes for Validation: Elimination of Mother-to-child Transmission of HIV, Syphilis and Hepatitis B Virus. Available from: [https://iris.who.int/handle/10665/349550 Last accessed on 2024 Feb 15].