{"ID":108315,"post_author":"9412100","post_date":"2023-06-30 11:20:47","post_date_gmt":"0000-00-00 00:00:00","post_content":"","post_title":"LIMSjournal - Summer 2023","post_excerpt":"","post_status":"draft","comment_status":"closed","ping_status":"closed","post_password":"","post_name":"","to_ping":"","pinged":"","post_modified":"2023-06-30 11:20:47","post_modified_gmt":"2023-06-30 15:20:47","post_content_filtered":"","post_parent":0,"guid":"https:\/\/www.limsforum.com\/?post_type=ebook&p=108315","menu_order":0,"post_type":"ebook","post_mime_type":"","comment_count":"0","filter":"","holland":null,"_ebook_metadata":{"enabled":"on","private":"0","guid":"B61E43B6-B311-4E69-AC22-4E7D53D6F9E6","title":"LIMSjournal - Summer 2023","subtitle":"Volume 9, Issue 2","cover_theme":"nico_21","cover_image":"https:\/\/www.limsforum.com\/wp-content\/plugins\/rdp-ebook-builder\/pl\/cover.php?cover_style=nico_21&subtitle=Volume+9%2C+Issue+2&editor=Shawn+Douglas&title=LIMSjournal+-+Summer+2023&title_image=https%3A%2F%2Fs3.limswiki.org%2Fwww.limswiki.org%2Fimages%2F8%2F86%2FFig1_Gonzales_PLOSComBio22_18-8.png&publisher=LabLynx+Press","editor":"Shawn Douglas","publisher":"LabLynx Press","author_id":"26","image_url":"","items":{"09a05cec486b0e795821acfbb792b350_type":"article","09a05cec486b0e795821acfbb792b350_title":"Development and national scale implementation of an open-source electronic laboratory information system (OpenELIS) in C\u00f4te d\u2019Ivoire: Sustainability lessons from the first 13 years (He et al. 2023)","09a05cec486b0e795821acfbb792b350_url":"https:\/\/www.limswiki.org\/index.php\/Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years","09a05cec486b0e795821acfbb792b350_plaintext":"\n\nJournal:Development and national scale implementation of an open-source electronic laboratory information system (OpenELIS) in C\u00f4te d\u2019Ivoire: Sustainability lessons from the first 13 yearsFrom LIMSWikiJump to navigationJump to searchFull article title\n \nDevelopment and national scale implementation of an open-source electronic laboratory information system (OpenELIS) in C\u00f4te d\u2019Ivoire: Sustainability lessons from the first 13 yearsJournal\n \nInternational Journal of Medical InformaticsAuthor(s)\n \nHe, Yao; Liams-Hauser, Casey; Assoa, Paul H.; Kouabenan, Yves-Rolland; Komena, Pascal; Pongathie, Adama; Kouakou, Alain; Kirn, Mary; Antilla, Jennifer; Rogosin, Carli; Ngatchou, Patricia S.; Kohemun, Natacha; Koffi, Jean B.; Flowers, Jan; Abiola, Nadine; Adj\u00e9-Tour\u00e9, Christiane; Puttkammer, Nancy; Perrone, Luca A.Author affiliation(s)\n \nUniversity of Washington, I-TECH C\u00f4te d\u2019Ivoire, Ministry of Health and Public Hygiene, U.S. Centers for Disease Control and PreventionPrimary contact\n \nlucy dot perrone at ubc dot caYear published\n \n2023Volume and issue\n \n170Article #\n \n104977DOI\n \n10.1016\/j.ijmedinf.2022.104977ISSN\n \n1872-8243Distribution license\n \nCreative Commons Attribution-NonCommercial-NoDerivatives 4.0 InternationalWebsite\n \nhttps:\/\/www.sciencedirect.com\/science\/article\/pii\/S138650562200291XDownload\n \nhttps:\/\/www.sciencedirect.com\/science\/article\/pii\/S138650562200291X\/pdfft\n\nContents \n\n1 Abstract \n2 Introduction \n3 Materials and methods \n4 Results \n\n4.1 Design and development \n4.2 Deploy, scale-up, and support \n4.3 Strengthening local leadership and ownership \n4.4 Building local capacity \n4.5 Supporting data-driven decision-making in HIV\/AIDS \n4.6 Networking, interoperability between systems, and expansion \n\n\n5 Discussion \n\n5.1 Open-source design and CoPs-supported software adoption, implementation, sustainability, and innovation \n5.2 Collaboration, capacity building, and local ownership are the key to sustainable implementation \n5.3 Limitations \n\n\n6 Conclusions \n7 Abbreviations, acronyms, and initialisms \n8 Acknowledgements \n\n8.1 Funding \n8.2 Conflict of interest \n\n\n9 References \n10 Notes \n\n\n\nAbstract \nPurpose: C\u00f4te d'Ivoire has a tiered public health laboratory system of nine reference laboratories, 77 laboratories at regional and general hospitals, and 100 laboratories among 1,486 district health centers. Prior to 2009, nearly all of these laboratories used paper registers and reports to collect and report laboratory data to clinicians and national disease monitoring programs.\nProject: Since 2009 the Ministry of Health (MOH) in C\u00f4te d'Ivoire has sought to implement a comprehensive set of activities aimed at strengthening the laboratory system. One of these activities is the sustainable development, expansion, and technical support of an open-source electronic laboratory information system (LIS) called OpenELIS, with the long-term goal of Ivorian technical support and managerial sustainment of the system. This project has addressed the need for a comprehensive, customizable, low- to no-cost, open-source LIS to serve the public health systems, with initial attention to HIV clients and later expansion to cover the general population. This descriptive case study presents the first published summary of original work which has been ongoing since 2009 in C\u00f4te d\u2019Ivoire to transform the information management systems and processes in laboratories nationally.\nImpact: OpenELIS is now in use at 106 laboratories across C\u00f4te d\u2019Ivoire. This article describes the iterative planning, design, and implementation process of OpenELIS in C\u00f4te d'Ivoire, and the evolving leadership, ownership, and capacity of the Ivorian MOH in sustaining the system. This original work synthesizes lessons learned from this 13-year experience towards strengthening LISs in other low-resource settings.\nHighlights of this work:\r\n\n\nFactors for scaling and sustaining an electronic LIS (eLIS) in low- and middle-income countries (LMICs) have not been previously described in the literature.\nSuccessful adoption, scaling, and sustainment of OpenELIS in C\u00f4te d'Ivoire relied on early collaboration with partners, regulatory agencies, and technical experts into every step of the design, implementation, and evaluation phases.\nEntities planning to nationally scale an eLIS should plan for 1) workforce development in both end users and system administrators; 2) financial sustainability; and 3) institutionalization of government ownership and technical leadership.\nAn open-source eLIS can increase accuracy and timeliness of clinical laboratory data, supporting diagnostic testing and monitoring in a resource-limited setting such as Cote d\u2019Ivoire.\nKeywords: electronic information systems, laboratory information systems, quality, low-resource country\n\nIntroduction \nIn low- and middle-income countries (LMICs), inadequate infrastructure\u2014including limited availability and use of electronic laboratory information systems (LISs)\u2014has hindered quality laboratory service delivery for communities.[1] International development efforts such as the U.S. President's Emergency Fund for AIDS Relief (PEPFAR) have aimed to strengthen national laboratory systems by modernizing infrastructure and diagnostic testing methods, including automated analyzers that require computer connectivity for data management. The increase in the quantity and complexity of data generated from high-throughput analyzers and sophisticated diagnostics necessitates the transition from paper records to LIS.\nCompared to paper-based systems, LIS are more efficient and enable better quality control (QC) in collecting, processing, managing, synthesizing, and reporting large amounts of data (Table 1).[1][2] The COVID-19 pandemic has highlighted the acute importance of digital health, including LIS, in providing data and enabling rapid data exchange and sharing to facilitate public health surveillance and data-driven decision-making.[3]\n\n\n\n\n\n\n\nTable 1. Strengths of laboratory information systems (LISs) compared to paper-based processes.\n\n\nLab aspect\n\nLIS feature(s)\n\nActions\n\nImpact\n\n\nReception\n\nBatch entry; referral workflows\n\nAccelerate the processing and recording of incoming work\n\nReduce turnaround time (TAT)\n\n\nResults generation\n\nWork plans\n\nHelp managers monitor workload and supply management\n\nEnsure efficient operation of laboratories\n\n\nAnalyzer interfaces\n\nRelay results quickly and accurately\n\nReduce TAT\n\n\nReporting\n\nInterface with electronic medical record (EMR)\n\nCommunicate client laboratory history rapidly to clinicians in referral networks\n\nEnable faster clinical decision-making regarding diagnosis, treatment, and prognosis; reduce TAT\n\n\nInterface with client notification systems via Short Message Service (SMS) or email\n\nCommunicate test results to clients rapidly\n\nPrompt immediate behavior augmentation and achieve better health outcomes (e.g., initiate self-quarantine in the case of COVID-19).\n\n\nInterface with routine health information systems at the district, regional, and national levels\n\nEnable faster aggregate data reporting\n\nFacilitate data-driven policy making; reduce TAT\n\n\nReports of quality indicators such as turnaround time\n\nHelp managers monitor quality performance\n\nFacilitate continuous quality improvement; increase testing quality\n\n\nOverarching\n\nGraphic widgets (e.g., drop-down menus, checkboxes), active logic and value checks, flags and reminders for potential issues, and automation\n\nReduce errors\n\nFacilitate quality control; increase testing quality\n\n\nData storage and data query tools\n\nAllow secure, long-term data retainment and easy data retrieval based on specific needs\n\nImprove client privacy, long-term data availability, and data usage\n\n\n\nHowever, LIS uptake and routine usage in LMICs remains low due to several barriers. LIS ownership, development, and maintenance can be perceived as bearing high costs of financial and human resources. Numerous proprietary LIS exist but may not be ideally suited for LMICs, where financial resources are limited and, most often, ongoing software support relies on long-term service contracts with private companies. Although some LMICs have implemented proprietary systems[4][5][6], these systems are vulnerable to market changes and can leave users unsupported if a company suspends its operations or modifies its service terms. Health information systems (HIS), including LIS, that use open-source code and are supported by communities of practice (CoPs) offer an attractive alternative in LMICs. Open-source CoPs have a vested interest in capacity building of software developers and users, including those from LMICs.[7] Implementation time and effort aside, there are no licensing fees, and all software code created is in public ownership, which enables others to customize and improve functionality.[8] Several open-source LISs are currently in use in LMICs in Africa and Asia, with varied scale.[9]\nAnother barrier to sustained, wide-scale usage of LIS is that LIS initiatives are often international-donor-driven and may lack close collaborations with ministries of health (MOHs) in LMICs. Engaging the MOH in the initial design and feature prioritization stage, building local capacity to own and maintain the software, and securing resource commitment after phase-out of donor support are time- and labor-intensive.[10] Additionally, power asymmetries between donors and LMIC stakeholders may discount local priorities, requirements, and innovations.[11] However, successful experiences of implementing an LIS in LMICs at the national scale have shown that strengthening MOH leadership and cultivating mutually beneficial partnerships are essential to impactful and sustainable laboratory system strengthening.[4][12]\nSince 2009, the University of Washington\u2019s (UW) International Training and Education Center for Health (I-TECH) has worked in partnership with the C\u00f4te d'Ivoire Ministry of Health and Public Hygiene (Minist\u00e8re de la Sant\u00e9 et de l\u2019Hygi\u00e8ne Publique, or MSHP) to implement a comprehensive set of activities aimed at strengthening the laboratory system. PEPFAR and the U.S. Centers for Disease Control and Prevention (CDC) have funded the partnership. One of the key activities is the sustainable development, expansion, and technical support of an open-source enterprise-level LIS, the OpenELIS system, with the long-term goal of Ivorian technical support and managerial sustainment of the system. The software serves as both an effective laboratory information management solution and a business operations framework for the laboratory service units (Fig. 1). The collaboration has addressed the need for a comprehensive, customizable, low- to no-cost, open-source LIS to serve the public health systems, with initial attention to HIV clients and later expansion to cover the general population.\n\r\n\n\n\n\n\n\n\n\n\n\nFigure 1. OpenELIS laboratory software solution and business process framework. (Color should be used in print).\n\n\n\nC\u00f4te d'Ivoire has a tiered public health laboratory system of nine reference laboratories, 77 laboratories at regional and general hospitals, and 100 laboratories among 1,486 district health centers. Prior to 2009, most laboratories used paper registers and reports to collect and report laboratory data to clinicians and national disease monitoring programs. The only LIS was a bespoke database located at the national HIV reference laboratory (called rETRO-CI), and this system was paired with commercial software.\nThe objectives of this case study are to: 1) present the iterative implementation process of OpenELIS in C\u00f4te d'Ivoire; 2) describe the evolving leadership, ownership, and capacity of the C\u00f4te d'Ivoire MSHP in sustaining routine use of OpenELIS; and 3) synthesize lessons learned for strengthening LIS in other LMICs.\n\nMaterials and methods \nWe used qualitative methods in this case study to describe the implementation and collaboration around OpenELIS and its supporting activities.[12][13] We reviewed monthly and annual project reports from the implementers; activity and trip reports from technical experts, as well as from government and donor representatives; and software development roadmap and technical documentation from 2009 to 2020. This project was determined to be non-research by the University of Washington and has been approved by C\u00f4te d'Ivoire Comit\u00e9 National d'Ethique des Sciences de la Vie et de la Sant\u00e9 (CNESVS, Ivorian Institutional Review Board; reference number 006\u201321\/MSHP\/CNESVS-km) and the U.S. CDC.\nInformation abstracted from the project documents was initially summarized in chronological order and later coded deductively and inductively. Next, we coded the summaries deductively using the components of the Stages of Continuous Improvement (SOCI) Framework for Health Information Systems.[14] The SOCI Framework has previously been used in Uganda and Cameroon to assess the maturity of digital health tools.[14][15][16] In addition to deductive codes, we also created new codes inductively where the SOCI Framework did not apply. Inductive codes captured the different steps of OpenELIS implementation and evolving collaboration among stakeholders. When coding was complete, codes and their corresponding excerpts from the summaries were organized into themes. YH coded the summaries. The other co-authors reviewed and verified the coding and analysis to ensure accuracy. The coding and thematic analysis took place in ATLAS.ti 8 Windows.\nTo ensure that LIS implementation translates into high-quality health services and population health benefits[17], it is important to monitor how data systems mature over time. As such, the SOCI Framework outlines 13 components and 39 subcomponents within five domains, i.e., HIS leadership and governance, management and workforce, infrastructure, standards and interoperability, and data quality and use.[18][19]\n\nResults \nDesign and development \nOpenELIS was initially designed and implemented by a group of six U.S. state public health laboratories.[20] Its implementation in global health began as part of a collaborative effort between the U.S. CDC and the Government of Vietnam to strengthen HIV service delivery and laboratory systems in 2005.[12] As part of the open-source medical record system (OpenMRS) consortium of partners[21], UW I-TECH received the OpenELIS source code and joined the development of the OpenELIS codebase in 2009.\nAn agile software design and development methodology was adopted by UW I-TECH for OpenELIS to enable an inclusive, iterative approach to software creation together with the local stakeholders in C\u00f4te d'Ivoire.[22] Since its introduction and adaptation in C\u00f4te d'Ivoire in 2009, OpenELIS has evolved through multiple iterations of improving functionality and flexibility, and through new releases twice per year. The first versions of OpenELIS were limited in scope and focused primarily on HIV care. They provided pre-defined forms and reports for common HIV-related tests such as early infant diagnosis of HIV (EID), CD4 counts, and HIV genotyping.\nIn 2011, UW I-TECH merged all versions of OpenELIS for different laboratories into one core, i.e., OpenELIS Global 1.4, greatly reducing the burden of maintenance and update. Before 2011, we created a customized copy of OpenELIS for each laboratory. This approach was manageable when OpenELIS was implemented in four national laboratories in C\u00f4te d'Ivoire and Haiti. However, as OpenELIS expanded to new laboratories, the time burden of maintaining and updating the software across different versions became excessive. The shift to a common code base shortened the software testing cycle for each new version from approximately 200 hours to 40 hours and permitted a more thorough software testing process and a higher-quality final release.\nThe core software improvements also enabled greater customizability and made it possible for a lab to install and configure OpenELIS without engaging a software developer to customize elements. We added test catalog management features, allowing laboratories to modify catalogs between version releases. Laboratories could make changes to existing tests or add new tests or panels without a software developer adding them manually to the system. New analyzer interfaces were added so that laboratories could import data from analyzers beyond those related to HIV. The core software could be deployed without impacting previous local customizations and further adapted to any setting without code re-write or maintenance. This allowed for countries and laboratories to have more control over what features to include in the software.\nIn 2018, UW I-TECH began an extensive review of the OpenELIS application and identified where the older technology had become obsolete and presented data security risks. OpenELIS Global 2.0, completed in 2019, upgraded the core framework to mitigate security risks (Table 2).\n\n\n\n\n\n\n\nTable 2. Open-source components in OpenELIS. HL7 = Health Level 7; FHIR = Fast Healthcare Interoperability Resources; ASTM = American Society of Testing and Materials\n\n\nComponent\n\nOpenELIS Global 1.X series\n\nOpenELIS Global 2.X series\n\n\nTimeframe\n\nBefore 2011\n\nAfter 2011\n\n\nOperating system\n\nUbuntu 12\n\nUbuntu 20\n\n\nProgramming framework\n\nJava Struts 1\n\nJava Spring\n\n\nWeb application\n\nTomcat\n\nTomcat\n\n\nDatabase\n\nPostgreSQL\n\nPostgreSQL\n\n\nInteroperability\n\nMirth, HL7 2.5.1\n\nFHIR R4, HL7 2.5.1, ASTM\n\n\nCustomization\n\nHard-coded multiple forks by developers for each use case\n\nCore software with flexible customization by users\n\n\n\nMany expansions and improvements in later iterations of OpenELIS stemmed from close collaboration between UW I-TECH and the multi-stakeholder OpenELIS technical working group (TWG) in C\u00f4te d'Ivoire, convened in 2015. The TWG consists of representatives from the MSHP, I-TECH C\u00f4te d'Ivoire, PEPFAR's NGO implementing partners (IPs), and the CDC. UW I-TECH and the design team within the TWG would lead design workshops that start with needs gathering at regional and district hospitals and laboratories using a standardized questionnaire. After reconvening, group members would share the findings on identified needs and gaps in LIS functionality and reporting, prioritizing design features, adding the designs to the roadmap[23], and writing software specifications.\nThe software development process followed a similar collaborative trajectory as the design process. Before 2014, UW I-TECH conducted all software development, mostly by one senior software developer and joined later by a second developer. All reports, enhancements, and changes relied on the two developers and was dependent on the next release. Starting in 2015, UW I-TECH has provided software development training in C\u00f4te d'Ivoire and created a more collaborative workflow with Ivorian developers so that both design and development have become more localized.\n\n Deploy, scale-up, and support \nOpenELIS deployment and scale-up took place in several stages since 2009 (Table 3), and the respective roles of the MSHP and I-TECH in the process evolved over time. Before 2015, I-TECH led the deployment process. The deployment at a laboratory began with a team of I-TECH staff from C\u00f4te d'Ivoire and Seattle conducting an initial laboratory assessment. Then, during a second visit, the team deployed a customized version. By the end of 2015, OpenELIS had been deployed at 11 laboratories, covering the entire network of laboratories performing viral load testing at the time (Fig. 2).\n\n\n\n\n\n\n\nTable 3. Timeline of the OpenELIS scale-up in C\u00f4te d'Ivoire.\n\n\nYear\n\nNumber of laboratories implementing OpenELIS\n\n\nNew\n\nCumulative\n\n\n2009\u20132012\n\n3\n\n3\n\n\n2013\u20132015\n\n8\n\n11\n\n\n2016\n\n1\n\n12\n\n\n2017\n\n31\n\n43\n\n\n2018\n\n12\n\n55\n\n\n2019\n\n13\n\n68\n\n\n2020\n\n28\n\n93\n\n\n2021\n\n15\n\n111\n\n\n\n\r\n\n\n\n\n\n\n\n\n\n\nFigure 2. Laboratories in C\u00f4te d'Ivoire that implement OpenELIS before and after 2015. (Color should be used in print).\n\n\n\nIn 2015, after the MSHP defined and ratified LIS requirements, they determined that OpenELIS satisfied most of these requirements and would be the system deployed at laboratories throughout the country. The MSHP became the owner of OpenELIS in C\u00f4te d'Ivoire and started collaborating with I-TECH closely in deployment to roll out OpenELIS. The scale-up first prioritized regional referral laboratories that newly started providing viral load testing as part of a MSHP- and CDC-led initiative to scale-up viral load testing. OpenELIS was then deployed in hospitals at the district and local level to support their collection and management of data on routine laboratory testing for both HIV and non-HIV clients. As of 2021, 111 laboratories in C\u00f4te d'Ivoire had implemented OpenELIS (Fig. 2). OpenELIS currently supports testing of hematology, biochemistry, molecular biology, serology, and testing of microbiology, pathology, and immunohistochemistry will be available in January 2023.\nThe collaborative deployment and scale-up process started with a series of deployment workshops with relevant stakeholders from the OpenELIS TWG in 2015. Participants received hands-on training on setting up servers and workstations, conducting maintenance and updates, and troubleshooting. During the deployment wave each year, starting from 2015, a team of MSHP implementation, I-TECH C\u00f4te d'Ivoire staff, and IP representatives would organize a week-long implementation trip to deploy the software and perform the initial training of laboratory staff. The team would follow up with the laboratories by phone weekly and conduct a coaching and review visit pne to three months after the deployment and training.\nStarting in 2020, the MSHP began leading the deployment process with minimal support from I-TECH. The MSHP team conducts all follow-up visits, and the training is facilitated by MSHP trainers with co-facilitation by I-TECH C\u00f4te d\u2019Ivoire. The MSHP also independently operates the OpenELIS Technical Assistance Unit (Cellule d'Assistance Technique de OpenELIS, or CATOE), the technical support call center for OpenELIS. Established in 2016 within the MSHP, CATOE provides direct, real-time technical support to OpenELIS users. CATOE technicians hold bidirectional call services with laboratories to conduct monthly check-ins that proactively probe for issues and to respond to technical assistance requests. CATOE consists of four MSHP staff members who were recruited from the participants of the first OpenELIS implementers' workshop in 2015. The technicians received targeted training on providing real-time support, equipment, phone credits, and a six-month mentorship with the primary support and development staff at I-TECH. CATOE meets monthly with the OpenELIS TWG to review activities and findings from the support calls, feeding information into the software roadmap.\n\nStrengthening local leadership and ownership \nThe C\u00f4te d'Ivoire MSHP started collaborating with I-TECH in OpenELIS implementation more actively in 2015. The MSHP initiated a reorganization process in 2014 that spurred the creation of the Department of Informatics and Health Information (Direction de l'Informatique et de l'Information Sanitaire, or DIIS) in 2015 to consolidate and coordinate health informatics activities in the country. This designation signaled a leadership commitment to ownership of HIS development, implementation, and management activities nationally. In 2017 the MSHP incorporated the designation of OpenELIS and its scale-up in the National Strategic Plan for the Development of Medical Biology Laboratories 2017\u20132020.[24]\nThe continuous strengthening of MSHP leadership demonstrates comprehensive ownership of not only the software and hardware but also the essential knowledge, skills, and processes to sustain routine OpenELIS implementation. Before 2015, the MSHP was only involved in site selection for OpenELIS. After the formation of DIIS, the MSHP joined I-TECH throughout the implementation process from forming the TWG, gathering needs, and training developers and technicians to deploying the software and providing technical support. By 2020, the DIIS was conducting follow-up visits and operating CATOE independently, leading the deployment process, configuration of servers, and training of new and existing users.\n\nBuilding local capacity \nIn addition to providing the software and hardware and strengthening local leadership, building local capacity for implementing OpenELIS in C\u00f4te d'Ivoire is also critical. Training on various topics along the software development pipeline and in various formats has equipped Ivorian policymakers and technicians with necessary knowledge and skills for routine OpenELIS implementation and maintenance.\nBefore 2015, UW I-TECH staff initially provided on-the-job training (OJT) on OpenELIS deployment and upgrade to selected staff at the MSHP, national laboratories, and IPs. In 2014, a targeted month-long training on OpenELIS development took place in Seattle for software developers with background in Java from the MSHP, Institut Pasteur C\u00f4te d'Ivoire, Institut National Polytechnique F\u00e9lix Houphou\u00ebt-Boigny (INPHB; a public polytechnic institute of higher education), and I-TECH C\u00f4te d'Ivoire. After participants returned to C\u00f4te d'Ivoire, UW I-TECH staff provided remote mentoring and exercises. While the results of the OJT and targeted training were promising, the time and resources for replicating these formats became unsustainably high as the OpenELIS scale-up started in 2015.\nIn response, UW I-TECH started collaborating with the MSHP in 2015 to develop a full suite of materials for OpenELIS, including a package for trainers and users, and to lead a series of training of trainers (TOT) sessions within C\u00f4te d'Ivoire. The week-long TOTs used theoretical and practical activities and took a holistic technical approach covering a range of topics from design, planning, development, and programming to implementation and support. Among the participants at the first TOT, one became the deputy director of DIIS, and most joined the OpenELIS TWG. The TOT participants later conducted cascade training led by the MSHP during the OpenELIS scale-up. Cascade training participants provided largely positive ratings, appreciating the theoretical and practical exercises. The TOTs and cascade trainings have been an integral part of the deployment and scale-up process since 2015, and they have formed a cadre of trained teams in C\u00f4te d'Ivoire to ensure sustainable OpenELIS deployment and support.\nThe collaboration between I-TECH and INPHB incorporated OpenELIS into the computer science curriculum and started the OpenELIS internship at INPHB. In 2016, two INPHB faculty received training on OpenELIS software development from UW I-TECH, and they started using OpenELIS as an example LIS to teach students in computer science. In 2018, the OpenELIS internship program started with three students studying at INPHB and working with I-TECH C\u00f4te d'Ivoire simultaneously to practice OpenELIS software development, deployment, and technical support. The training program and assessment process became standardized in 2019, and two interns per year embedded with I-TECH or MSHP teams for one year. Ten interns have graduated from the program, and one was eventually hired as I-TECH C\u00f4te d'Ivoire staff.\nIn addition to periodic training and the internship program, software developer retreats and opportunities to attend and present at international and regional conferences for HIV\/AIDS or health informatics have also been part of capacity building.\n\n Supporting data-driven decision-making in HIV\/AIDS \nTo transform data stored in OpenELIS into information that is meaningful for decision-making, I-TECH built the online data dashboards that display aggregate data on viral load testing and EID imported from OpenELIS.[25] The dashboards import data from OpenELIS and create visualizations that help the MSHP, IPs, and CDC monitor performance along the HIV care cascade and make programmatic decisions to improve quality of care. For example, the viral load dashboard helped discover a large group of clients who only had initial HIV diagnostic and viral load tests but no follow-up tests across multiple regions in C\u00f4te d'Ivoire. This issue would have been hidden before the dashboarding process cleaned, consolidated, and visualized the data. The MSHP and CDC based their directions for the regions and IPs on the discovery from the dashboard.\nI-TECH also developed the pediatric HIV case management tool that combined OpenELIS data of pediatric HIV clients with those from the HIV electronic medical records (EMR) system in C\u00f4te d'Ivoire. This tool helped health facilities and districts identify and follow up with lost-to-follow-up pediatric clients and parents and those whose viral load test results indicated a decline in antiretroviral regimen effectiveness. OpenELIS's pivotal role as an essential public health tool was solidified.\n\n Networking, interoperability between systems, and expansion \nTo respond to emerging needs from the MSHP and laboratories, the OpenELIS project will always have room for adaptation and growth. Current activities include transitioning from a series of individual instances of OpenELIS to a more interconnected national laboratory information system through system networking. The pilot of a consolidated server for the national laboratory data warehouse began in 2021, bringing all laboratory data to one central location for reporting and real-time decision-making by the MSHP. The continuous demands from laboratories to add more testing modules to OpenELIS motivated the project to start developing modules for tuberculosis, COVID-19, and enhanced support for molecular biology and bidirectional analyzer interfacing. A reference testing workflow has been developed, allowing results to be sent between OpenELIS instances and providing laboratory results instantly between laboratories and reference laboratories to aid diagnosis and allow for faster treatment. Programmatically, I-TECH will continue to work with the C\u00f4te d'Ivoire MSHP to provide necessary assistance for the full transition.\n\nDiscussion \nTo our knowledge, this is the first case study of best practices and lessons learned from the implementation of a LIS in a tiered laboratory system in West Africa. This case study illustrates the development, implementation, and capacity building process for OpenELIS in C\u00f4te d'Ivoire since 2009, with support from PEPFAR, as part of an initiative to strengthen the national laboratory system. The open-source nature of OpenELIS coupled with the close partnership between the MSHP and I-TECH have facilitated the collaborative, iterative process of designing, developing, deploying, and scaling up OpenELIS in C\u00f4te d'Ivoire. Strong local leadership and ownership of OpenELIS implementation contributed to the scaling and sustainment of routine use of OpenELIS at laboratories nationwide beyond the first 13 years. The improved capacity and talent pool for OpenELIS implementation and support, resulting from continuous training efforts, also facilitated scaling and sustainment. OpenELIS and its dependent data dashboards have already demonstrated value in supporting the MSHP and other stakeholders in data-driven decision-making.\n\n Open-source design and CoPs-supported software adoption, implementation, sustainability, and innovation \nThe open-source nature and the resulting potential for in-country capacity building and ownership of OpenELIS were the main reasons why the C\u00f4te d'Ivoire MSHP decided to adopt it. Reports from open-source LIS software projects in other settings, including the OpenELIS project in Vietnam[12], a LIS pilot for tuberculosis in Peru[26], and a LIS pilot for HIV in Malawi[27], have also underscored the value of open-source software in LMICs. Open-source software provide flexibility and agility so that governments can start with a pilot project and gradually build in more functions as use cases evolve and expand. The open-source nature invites collaboration and cultivates local capacity so that costs of development and maintenance will decrease over time, contributing to sustainability. Digital Square, a global consortium for promoting health equity through digital health, designated OpenELIS in 2018 as a digital \u201cglobal good.\u201d[28] A CoP was also developed to support the advancement and implementation of OpenELIS globally. As of October 2020, over 270 laboratories in 18 LMICs in sub-Saharan Africa, Asia, and the Caribbean use OpenELIS.\nContinuous maintenance and funding support for software is crucial after the initial launch[29], and the OpenELIS CoP worldwide is a model that facilitates sustainable implementation, meaningful collaboration, and local ownership. There are three common models for implementing open-source software in LMICs, namely software as a service (SaaS)[30], donor investment in the core global good[31][32], and CoP.[33] The first two models keep the knowledge and maintenance responsibility with the developers who are usually in high-income countries, and funding can be highly donor-driven. On the contrary, the CoP model brings a variety of actors and resources to a shared table to support the core stewardship and maintenance of the global good. The large-scale adoption of OpenELIS through different funding streams, not just PEPFAR, has led to a broader set of features and more sustainable cost-sharing, including recent co-investment from LMICs and the U.S. in 2021. Each implementing country benefits from features developed for other use cases due to the single code base and flexible administrative options. The OpenELIS CoP continuously supports the development of innovations and flexible design that can be used across use cases.[7]\n\n Collaboration, capacity building, and local ownership are the key to sustainable implementation \nNumerous global health projects have struggled to continue beyond the pilot or trial phase, and one of the key barriers to scale-up and sustainability is lack of local ownership and leadership at each level of the system.[34][35] The collaboration between the MSHP and I-TECH is the nurturing ground for the decade-long OpenELIS project in C\u00f4te d'Ivoire. The open-source and global CoP of software such as OpenELIS naturally support technical collaboration and exchange.[36] However, without committed engagement and close partnership with the MSHP, the OpenELIS design and development process in C\u00f4te d'Ivoire would likely have been less participatory, less successful, and less sustainable.[37]\nThe improved local capacity of software development and maintenance for OpenELIS is an important contribution toward the vision of long-term, locally sustained implementation. Providing information technology (IT) without investing in human resources or building capacity would still be inadequate in addressing the gaps in the laboratory system.[2] Therefore, the policymakers and technicians trained in OpenELIS development and deployment, as well as the interns embedded in MSHP teams to support OpenELIS implementation, will ensure the medium- and long-term success of the project.\nThe collaboration has also strengthened local ownership of OpenELIS and leadership of relevant software development and support activities to achieve routine usage and nationwide scale. Although the OpenELIS project in C\u00f4te d'Ivoire is still receiving funding by the U.S. government as part of PEPFAR, and the C\u00f4te d'Ivoire MSHP has not committed to completely taking over the continuous implementation of OpenELIS, there has at least been progress towards this goal. Transition of all OpenELIS-related planning, design, development, and implementation to the MSHP has been underway as of March 2022.\n\nLimitations \nThis case study represents the experiences of one LIS project in C\u00f4te d'Ivoire and thus may not be generalizable to other settings, though the lessons learned are relevant to many HIS strengthening projects in LMICs. Evaluation research that uses rigorous quantitative, qualitative, or mixed methods is necessary to assess and demonstrate the reach, effectiveness, adoption, implementation, and maintenance of the project.[38] For example, one could evaluate the use of a quasi-experimental design to assess the effectiveness of improving laboratory testing data quality (e.g., data timeliness, data completeness, data validity) and service quality (e.g., TAT, testing validity) by comparing LIS to paper records, or the use of a qualitative study to interview laboratory staff about the facilitators and barriers to LIS implementation.\n\nConclusions \nThe development and nationwide scale-up of OpenELIS in C\u00f4te d\u2019Ivoire for over a decade have relied on the open-source software design, CoP support, close collaboration with the C\u00f4te d\u2019Ivoire MSHP, and cultivation of local ownership and capacity since inception. Other countries and supporting partners planning to adapt and nationally scale LIS may consider the importance of HIS workforce development, financial sustainability, and institutionalization of government ownership and technical leadership.\nBefore this study, the following was already known:\n\nLIS has the potential to increase accuracy and timeliness of laboratory data, supporting diagnostic testing and clinical monitoring.\nFactors for scaling and sustaining LIS in LMICs have not been previously described.\nThis study added the following to our knowledge:\n\nOpenELIS, an open-source electronic LIS, has been implemented in C\u00f4te d'Ivoire since 2009 and scaled nationwide to 111 clinical and reference laboratories.\nSuccessful adoption, scaling, and sustainment of OpenELIS has relied on active collaboration starting in the earliest planning phases and integrating local partners, regulatory agencies, and technical experts into every step of the design, implementation, and evaluation phases.\nOther countries and supporting partners planning to adapt and nationally scale LIS may consider the importance of carefully developing plans for 1) workforce development in both end users and system administrators; 2) financial sustainability; and 3) institutionalization of government ownership and technical leadership.\n Abbreviations, acronyms, and initialisms \nASTM: American Society of Testing and Materials\nCATOE: Cellule d'Assistance Technique de OpenELIS\nCDC: Centers for Disease Control and Prevention\nCNESVS: C\u00f4te d'Ivoire Comit\u00e9 National d'Ethique des Sciences de la Vie et de la Sant\u00e9\nCoP: community of practice\nDIIS: Direction de l'Informatique et de l'Information Sanitaire\neLIS: electronic laboratory information system\nEID: early infant diagnosis\nEMR: electronic medical record\nFHIR: Fast Healthcare Interoperability Resources\nHIS: health information system\nHL7: Health Level 7\nI-TECH: International Training and Education Center for Health\nINPHB: Institut Pasteur C\u00f4te d'Ivoire, Institut National Polytechnique F\u00e9lix Houphou\u00ebt-Boigny\nIP: implementing partner\nLIS: laboratory information system\nLMIC: low- and middle-income country\nMOH: Ministry of Health\nMSHP: Minist\u00e8re de la Sant\u00e9 et de l\u2019Hygi\u00e8ne Publique\nOJT: on-the-job training\nOpenELIS: Open-source Electronic Laboratory Information System\nPEPFAR: U.S. President's Emergency Fund for AIDS Relief\nSMS: Short Message Service\nSOCI: Stages of Continuous Improvement\nTAT: turnaround time\nTOT: training of trainers\nTWG: technical working group\nUW: University of Washington\nAcknowledgements \nWe thank the C\u00f4te d'Ivoire MSHP and all implementing laboratories for the continuous collaboration. We thank Oliver Defawe, Paul Schwartz, Justin Sogo, Emily DeRiel for their programming and project planning support early in this work. We thank the CDC and our fellow PEPFAR IPs (ACONDA, Ariel Glaser Foundation, Elizabeth Glaser Pediatric AIDS Foundation, ICAP, SEV-CI, and Health Alliance International) for their collaboration in the implementation and optimization of OpenELIS in C\u00f4te d'Ivoire.\n\nFunding \nFunding for this work was provided by the U.S. Health Services and Resources Administration (#6U91HA06801) and CDC (#NU2GGH001968-05-00) awarded to the University of Washington.\n\nConflict of interest \nThe authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.\n\nReferences \n\n\n\u2191 1.0 1.1 Wilson, Michael L; Fleming, Kenneth A; Kuti, Modupe A; Looi, Lai Meng; Lago, Nestor; Ru, Kun (1 May 2018). \"Access to pathology and laboratory medicine services: a crucial gap\" (in en). The Lancet 391 (10133): 1927\u20131938. doi:10.1016\/S0140-6736(18)30458-6. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0140673618304586 .   \n \n\n\u2191 2.0 2.1 Sayed, Shahin; Cherniak, William; Lawler, Mark; Tan, Soo Yong; El Sadr, Wafaa; Wolf, Nicholas; Silkensen, Shannon; Brand, Nathan et al. (1 May 2018). \"Improving pathology and laboratory medicine in low-income and middle-income countries: roadmap to solutions\" (in en). The Lancet 391 (10133): 1939\u20131952. doi:10.1016\/S0140-6736(18)30459-8. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0140673618304598 .   \n \n\n\u2191 Al Knawy, Bandar; McKillop, Mollie Marian; Abduljawad, Joud; Tarkoma, Sasu; Adil, Mahmood; Schaper, Louise; Chee, Adam; Bates, David W. et al. (23 February 2022). \"Successfully Implementing Digital Health to Ensure Future Global Health Security During Pandemics: A Consensus Statement\" (in en). JAMA Network Open 5 (2): e220214. doi:10.1001\/jamanetworkopen.2022.0214. ISSN 2574-3805. https:\/\/jamanetwork.com\/journals\/jamanetworkopen\/fullarticle\/2789277 .   \n \n\n\u2191 4.0 4.1 National Health Laboratory Service (May 2020). \"National Health Laboratory Service Annual Report 2018\/19\" (PDF). https:\/\/www.nhls.ac.za\/wp-content\/uploads\/2020\/05\/NHLS_Annual_Report_2019_Revised_00000004.pdf . Retrieved 20 February 2021 .   \n \n\n\u2191 Namibia Institute of Pathology Limited (November 2019). \"Namibia Institute of Pathology Limited Annual Report 2017\u201318\" (PDF). https:\/\/nip.com.na\/wp-content\/uploads\/2019\/11\/NIP-Annual-Report-2018_updated-6-3.pdf . Retrieved 20 February 2021 .   \n \n\n\u2191 Abera, W.S. (June 2013). \"Data Exchnage Interoprability Framework for Laboratory Information System (Lis) and Electronic Health Record (Ehr) of Two Hospitals in Addis Ababa\". Addis Ababa University Libraries. http:\/\/etd.aau.edu.et\/handle\/123456789\/14825 . Retrieved 20 February 2021 .   \n \n\n\u2191 7.0 7.1 Pyrko, Igor; D\u00f6rfler, Viktor; Eden, Colin (1 April 2017). \"Thinking together: What makes Communities of Practice work?\" (in en). Human Relations 70 (4): 389\u2013409. doi:10.1177\/0018726716661040. ISSN 0018-7267. PMC PMC5305036. PMID 28232754. http:\/\/journals.sagepub.com\/doi\/10.1177\/0018726716661040 .   \n \n\n\u2191 Syzdykova, Assel; Malta, Andr\u00e9; Zolfo, Maria; Diro, Ermias; Oliveira, Jos\u00e9 Luis (13 November 2017). \"Open-Source Electronic Health Record Systems for Low-Resource Settings: Systematic Review\" (in en). JMIR Medical Informatics 5 (4): e44. doi:10.2196\/medinform.8131. ISSN 2291-9694. PMC PMC5703976. PMID 29133283. http:\/\/medinform.jmir.org\/2017\/4\/e44\/ .   \n \n\n\u2191 Flowers, J. (6 April 2021). \"Open Source Lab Information Systems and Tools\". OpenHIE. https:\/\/wiki.ohie.org\/display\/SUB\/Open%2bSource%2bLab%2bInformation%2bSystems%2band%2bTools . Retrieved 22 May 2022 .   \n \n\n\u2191 McKay, Mary M.; Sensoy Bahar, Ozge; Ssewamala, Fred M. (1 January 2020). \"Implementation science in global health settings: Collaborating with governmental & community partners in Uganda\" (in en). Psychiatry Research 283: 112585. doi:10.1016\/j.psychres.2019.112585. PMC PMC6954316. PMID 31590906. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0165178119308224 .   \n \n\n\u2191 Abimbola, Seye; Asthana, Sumegha; Montenegro, Cristian; Guinto, Renzo R.; Jumbam, Desmond Tanko; Louskieter, Lance; Kabubei, Kenneth Munge; Munshi, Shehnaz et al. (22 April 2021). \"Addressing power asymmetries in global health: Imperatives in the wake of the COVID-19 pandemic\" (in en). PLOS Medicine 18 (4): e1003604. doi:10.1371\/journal.pmed.1003604. ISSN 1549-1676. PMC PMC8101997. PMID 33886540. https:\/\/dx.plos.org\/10.1371\/journal.pmed.1003604 .   \n \n\n\u2191 12.0 12.1 12.2 12.3 Landgraf, Kenneth M.; Kakkar, Reshma; Meigs, Michelle; Jankauskas, Paul T.; Phan, Thi Thu Huong; Nguyen, Viet Nga; Nguyen, Duy Thai; Duong, Thanh Tung et al. (1 September 2016). \"Open-source LIMS in Vietnam: The path toward sustainability and host country ownership\" (in en). International Journal of Medical Informatics 93: 92\u2013102. doi:10.1016\/j.ijmedinf.2016.06.010. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1386505616301393 .   \n \n\n\u2191 Kaplan, Bonnie; Maxwell, Joseph A. (2005), Anderson, James G.; Aydin, Carolyn E., eds., \"Qualitative Research Methods for Evaluating Computer Information Systems\" (in en), Evaluating the Organizational Impact of Healthcare Information Systems (New York: Springer-Verlag): 30\u201355, doi:10.1007\/0-387-30329-4_2, ISBN 978-0-387-24558-4, http:\/\/link.springer.com\/10.1007\/0-387-30329-4_2 . Retrieved 2023-06-06   \n \n\n\u2191 14.0 14.1 MEASURE Evaluation (2019). \"Health Information System Stages of Continuous Improvement Toolkit: User Guide\". MEASURE Evaluation. https:\/\/www.measureevaluation.org\/resources\/publications\/ms-19-158.html . Retrieved 22 May 2022 .   \n \n\n\u2191 MEASURE Evaluation (2019). \"Mapping a Path to Improve Uganda\u2019s Health Information System Using the Stages of Continuous Improvement Toolkit\". MEASURE Evaluation. https:\/\/www.measureevaluation.org\/resources\/publications\/ws-19-52.html . Retrieved 22 May 2022 .   \n \n\n\u2191 Minist\u00e8re de la Sant\u00e9 Publique (2019). \"Plan Strat\u00e9gique National de Sant\u00e9 Num\u00e9rique 2020 - 2024\" (PDF). Archived from the original on 12 May 2022. https:\/\/web.archive.org\/web\/20220512211831\/https:\/\/www.minsante.cm\/site\/sites\/default\/files\/FR_DOCUMENT_PLAN%20STRATEGIQUE%20NATIONAL%20DE%20SANTE%20NUMERIQUE_R%C3%A9duit.pdf . Retrieved 22 May 2022 .   \n \n\n\u2191 Flott, Kelsey; Callahan, Ryan; Darzi, Ara; Mayer, Erik (14 April 2016). \"A Patient-Centered Framework for Evaluating Digital Maturity of Health Services: A Systematic Review\" (in en). Journal of Medical Internet Research 18 (4): e75. doi:10.2196\/jmir.5047. ISSN 1438-8871. PMC PMC4850277. PMID 27080852. http:\/\/www.jmir.org\/2016\/4\/e75\/ .   \n \n\n\u2191 Gomes, Jorge; Rom\u00e3o, M\u00e1rio (1 December 2018). \"Information System Maturity Models in Healthcare\" (in en). Journal of Medical Systems 42 (12): 235. doi:10.1007\/s10916-018-1097-0. ISSN 0148-5598. http:\/\/link.springer.com\/10.1007\/s10916-018-1097-0 .   \n \n\n\u2191 Carvalho, Jo\u00e3o Vidal; Rocha, \u00c1lvaro; Abreu, Ant\u00f3nio (1 June 2016). \"Maturity Models of Healthcare Information Systems and Technologies: a Literature Review\" (in en). Journal of Medical Systems 40 (6): 131. doi:10.1007\/s10916-016-0486-5. ISSN 0148-5598. http:\/\/link.springer.com\/10.1007\/s10916-016-0486-5 .   \n \n\n\u2191 \"OpenELIS comes home\". Lab Link (State Hygienic Laboratory at The University of Iowa) 4 (1). January 2012. http:\/\/www.shl.uiowa.edu\/publications\/lablink\/201201\/openelis.xml .   \n \n\n\u2191 \"OpenMRS\". OpenMRS Community. https:\/\/openmrs.org\/ . Retrieved 22 May 2022 .   \n \n\n\u2191 Dings\u00f8yr, Torgeir; Nerur, Sridhar; Balijepally, VenuGopal; Moe, Nils Brede (1 June 2012). \"A decade of agile methodologies: Towards explaining agile software development\" (in en). Journal of Systems and Software 85 (6): 1213\u20131221. doi:10.1016\/j.jss.2012.02.033. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0164121212000532 .   \n \n\n\u2191 Liams-Hauser,C. (10 December 2014). \"Software Release Roadmap\". OpenELIS Global. https:\/\/openelis-global.org\/tools\/roadmap\/ . Retrieved 22 May 2022 .   \n \n\n\u2191 C\u00f4te d\u2019Ivoire Minist\u00e8re de la Sant\u00e9 et de l\u2019Hygi\u00e8ne Publique (2019). \"Plan Strat\u00e9gique National Pour Le D\u00e9veloppement Des Laboratoires de Biologie M\u00e9dicale 2017-2020\".   \n \n\n\u2191 Kirk, Mary; Assoa, Paul H.; Iiams-Hauser, Casey; Kouabenan, Yves-Rolland; Antilla, Jennifer; Steele-Lane, Caleb; Rossum, Greg; Komena, Pascal et al. (17 May 2021). \"Adaptation of an electronic dashboard to monitor HIV viral load testing in C\u00f4te d\u2019Ivoire\" (in en). African Journal of Laboratory Medicine 10 (1). doi:10.4102\/ajlm.v10i1.1284. ISSN 2225-2010. PMC PMC8182557. PMID 34192117. http:\/\/www.ajlmonline.org\/index.php\/AJLM\/article\/view\/1284 .   \n \n\n\u2191 Blaya, Joaqu\u00edn A.; Shin, Sonya S.; Yagui, Martin; Contreras, Carmen; Cegielski, Peter; Yale, Gloria; Suarez, Carmen; Asencios, Luis et al. (10 April 2014). Pai, Madhukar. ed. \"Reducing Communication Delays and Improving Quality of Care with a Tuberculosis Laboratory Information System in Resource Poor Environments: A Cluster Randomized Controlled Trial\" (in en). PLoS ONE 9 (4): e90110. doi:10.1371\/journal.pone.0090110. ISSN 1932-6203. PMC PMC3982951. PMID 24721980. https:\/\/dx.plos.org\/10.1371\/journal.pone.0090110 .   \n \n\n\u2191 Mtonga, Timothy M.; Choonara, Faheema E.; Espino, Jeremy U.; Kachaje, Chimwemwe; Kapundi, Kenneth; Mengezi, Takondwa E.; Mumba, Soyapi L.; Douglas, Gerald P. (28 October 2019). \"Design and implementation of a clinical laboratory information system in a low-resource setting\" (in en). African Journal of Laboratory Medicine 8 (1). doi:10.4102\/ajlm.v8i1.841. ISSN 2225-2010. PMC PMC6852617. PMID 31745456. http:\/\/www.ajlmonline.org\/index.php\/AJLM\/article\/view\/841 .   \n \n\n\u2191 \"Digital Square Investments in Global Goods:Approved Global Goods\". Digital Square Wiki. Digital Square. 2021. https:\/\/wiki.digitalsquare.io\/index.php\/Digital_Square_Investments_in_Global_Goods:Approved_Global_Goods#OpenELIS . Retrieved 22 May 2022 .   \n \n\n\u2191 Nowogrodzki, Anna (1 July 2019). \"How to support open-source software and stay sane\" (in en). Nature 571 (7763): 133\u2013134. doi:10.1038\/d41586-019-02046-0. ISSN 0028-0836. https:\/\/www.nature.com\/articles\/d41586-019-02046-0 .   \n \n\n\u2191 Ekie, Jesus; Gueye, Bassirou; Ekie, Tresor; Niang, Ibrahima (1 June 2021). \"An Evidence-Based Approach on Public Health Decisions in Low-Middle Income Countries: Use Case of Senegal at the Verge of COVID-19\". 2021 International Conference on Digital Age & Technological Advances for Sustainable Development (ICDATA) (Marrakech, Morocco: IEEE): 193\u2013200. doi:10.1109\/ICDATA52997.2021.00046. ISBN 978-1-6654-2901-6. https:\/\/ieeexplore.ieee.org\/document\/9588192\/ .   \n \n\n\u2191 \"Funder\". OpenLIMS. https:\/\/openlmis.org\/get-started\/partner\/ . Retrieved 22 May 2022 .   \n \n\n\u2191 \"Community Health Toolkit\". Community Health Toolkit. https:\/\/communityhealthtoolkit.org\/ . Retrieved 22 May 2022 .   \n \n\n\u2191 Thomas, J. (2021). \"Lab Information Systems Community\". OpenHIE Wiki. OpenHIE. https:\/\/wiki.ohie.org\/display\/SUB\/Lab%2bInformation%2bSystems%2bCommunity . Retrieved 22 May 2022 .   \n \n\n\u2191 Yamey, Gavin (2012). \"What are the barriers to scaling up health interventions in low and middle income countries? A qualitative study of academic leaders in implementation science\" (in en). Globalization and Health 8 (1): 11. doi:10.1186\/1744-8603-8-11. ISSN 1744-8603. PMC PMC3514334. PMID 22643120. http:\/\/globalizationandhealth.biomedcentral.com\/articles\/10.1186\/1744-8603-8-11 .   \n \n\n\u2191 Olusanya, Jacob O.; Ubogu, Olufunmilayo I.; Njokanma, Fidelis O.; Olusanya, Bolajoko O. (1 July 2021). \"Transforming global health through equity-driven funding\" (in en). Nature Medicine 27 (7): 1136\u20131138. doi:10.1038\/s41591-021-01422-6. ISSN 1078-8956. https:\/\/www.nature.com\/articles\/s41591-021-01422-6 .   \n \n\n\u2191 Men\u00e9ndez-Caravaca, Elo\u00edsa; Bueno, Salvador; Gallego, M. Dolores (1 December 2021). \"Exploring the link between free and open source software and the collaborative economy: A Delphi-based scenario for the year 2025\" (in en). Technological Forecasting and Social Change 173: 121087. doi:10.1016\/j.techfore.2021.121087. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0040162521005205 .   \n \n\n\u2191 Abimbola, Seye (1 October 2019). \"The foreign gaze: authorship in academic global health\" (in en). BMJ Global Health 4 (5): e002068. doi:10.1136\/bmjgh-2019-002068. ISSN 2059-7908. PMC PMC6830280. PMID 31750005. https:\/\/gh.bmj.com\/lookup\/doi\/10.1136\/bmjgh-2019-002068 .   \n \n\n\u2191 Glasgow, Russell E.; Harden, Samantha M.; Gaglio, Bridget; Rabin, Borsika; Smith, Matthew Lee; Porter, Gwenndolyn C.; Ory, Marcia G.; Estabrooks, Paul A. (2019). \"RE-AIM Planning and Evaluation Framework: Adapting to New Science and Practice With a 20-Year Review\". Frontiers in Public Health 7. doi:10.3389\/fpubh.2019.00064. ISSN 2296-2565. PMC PMC6450067. PMID 30984733. https:\/\/www.frontiersin.org\/articles\/10.3389\/fpubh.2019.00064 .   \n \n\n\nNotes \nThis presentation is faithful to the original, with only a few minor changes to presentation. Grammar was cleaned up for smoother reading. In some cases important information was missing from the references, and that information was added. The original cites this wiki as a source of information about the origins of OpenELIS, but the original article's statement of Iowa and Minnesota being involved was shortsighted; for this version, we mention that other public health labs were involved and we use the original source used on the OpenELIS wiki page, not the wiki page itself. No other changes were made in accordance with the \"NoDerivatives\" portion of the content license.\n\n\n\n\n\nSource: <a rel=\"external_link\" class=\"external\" href=\"https:\/\/www.limswiki.org\/index.php\/Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\">https:\/\/www.limswiki.org\/index.php\/Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years<\/a>\nCategories: LIMSwiki journal articles (added in 2023)LIMSwiki journal articles (all)LIMSwiki journal articles on laboratory informaticsNavigation menuPage actionsJournalDiscussionView sourceHistoryPage actionsJournalDiscussionMoreToolsIn other languagesPersonal toolsLog inNavigationMain pageEncyclopedic articlesRecent changesRandom pageHelp about MediaWikiSearch\u00a0 ToolsWhat links hereRelated changesSpecial pagesPermanent linkPage informationPopular publications\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\nPrint\/exportCreate a bookDownload as PDFDownload as PDFDownload as Plain textPrintable version This page was last edited on 6 June 2023, at 21:24.Content is available under a Creative Commons Attribution-ShareAlike 4.0 International License unless otherwise noted.This page has been accessed 88 times.Privacy policyAbout LIMSWikiDisclaimers\n\n\n\n","09a05cec486b0e795821acfbb792b350_html":"<body class=\"mediawiki ltr sitedir-ltr mw-hide-empty-elt ns-206 ns-subject page-Journal_Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_OpenELIS_in_C\u00f4te_d\u2019Ivoire_Sustainability_lessons_from_the_first_13_years rootpage-Journal_Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_OpenELIS_in_C\u00f4te_d\u2019Ivoire_Sustainability_lessons_from_the_first_13_years skin-monobook action-view skin--responsive\"><div id=\"rdp-ebb-globalWrapper\"><div id=\"rdp-ebb-column-content\"><div id=\"rdp-ebb-content\" class=\"mw-body\" role=\"main\"><a id=\"rdp-ebb-top\"><\/a>\n<h1 id=\"rdp-ebb-firstHeading\" class=\"firstHeading\" lang=\"en\">Journal:Development and national scale implementation of an open-source electronic laboratory information system (OpenELIS) in C\u00f4te d\u2019Ivoire: Sustainability lessons from the first 13 years<\/h1><div id=\"rdp-ebb-bodyContent\" class=\"mw-body-content\"><!-- start content --><div id=\"rdp-ebb-mw-content-text\" lang=\"en\" dir=\"ltr\" class=\"mw-content-ltr\"><div class=\"mw-parser-output\">\n\n\n<h2><span class=\"mw-headline\" id=\"Abstract\">Abstract<\/span><\/h2>\n<p><b>Purpose<\/b>: C\u00f4te d'Ivoire has a tiered <a href=\"https:\/\/www.limswiki.org\/index.php\/Public_health_laboratory\" title=\"Public health laboratory\" class=\"wiki-link\" data-key=\"34ffb658cb79bf322c65efaad95996f5\">public health laboratory<\/a> system of nine <a href=\"https:\/\/www.limswiki.org\/index.php\/Reference_laboratory\" title=\"Reference laboratory\" class=\"wiki-link\" data-key=\"f719f408e1660f86b53857eef2f13f32\">reference laboratories<\/a>, 77 <a href=\"https:\/\/www.limswiki.org\/index.php\/Laboratory\" title=\"Laboratory\" class=\"wiki-link\" data-key=\"c57fc5aac9e4abf31dccae81df664c33\">laboratories<\/a> at regional and general <a href=\"https:\/\/www.limswiki.org\/index.php\/Hospital\" title=\"Hospital\" class=\"wiki-link\" data-key=\"b8f070c66d8123fe91063594befebdff\">hospitals<\/a>, and 100 laboratories among 1,486 district health centers. Prior to 2009, nearly all of these laboratories used paper registers and reports to collect and report laboratory data to clinicians and national disease monitoring programs.\n<\/p><p><b>Project<\/b>: Since 2009 the Ministry of Health (MOH) in C\u00f4te d'Ivoire has sought to implement a comprehensive set of activities aimed at strengthening the laboratory system. One of these activities is the sustainable development, expansion, and technical support of an open-source electronic <a href=\"https:\/\/www.limswiki.org\/index.php\/Laboratory_information_system\" title=\"Laboratory information system\" class=\"wiki-link\" data-key=\"37add65b4d1c678b382a7d4817a9cf64\">laboratory information system<\/a> (LIS) called <a href=\"https:\/\/www.limswiki.org\/index.php\/OpenELIS\" title=\"OpenELIS\" class=\"wiki-link\" data-key=\"b11b00d1e7409d55b58e9f82204cc2a3\">OpenELIS<\/a>, with the long-term goal of Ivorian technical support and managerial sustainment of the system. This project has addressed the need for a comprehensive, customizable, low- to no-cost, open-source LIS to serve the <a href=\"https:\/\/www.limswiki.org\/index.php\/Public_health\" title=\"Public health\" class=\"wiki-link\" data-key=\"81092e25c0bd359cedd1b9f9dc350c86\">public health<\/a> systems, with initial attention to HIV clients and later expansion to cover the general population. This descriptive case study presents the first published summary of original work which has been ongoing since 2009 in C\u00f4te d\u2019Ivoire to transform the <a href=\"https:\/\/www.limswiki.org\/index.php\/Information_management\" title=\"Information management\" class=\"wiki-link\" data-key=\"f8672d270c0750a858ed940158ca0a73\">information management<\/a> systems and processes in laboratories nationally.\n<\/p><p><b>Impact<\/b>: OpenELIS is now in use at 106 laboratories across C\u00f4te d\u2019Ivoire. This article describes the iterative planning, design, and implementation process of OpenELIS in C\u00f4te d'Ivoire, and the evolving leadership, ownership, and capacity of the Ivorian MOH in sustaining the system. This original work synthesizes lessons learned from this 13-year experience towards strengthening LISs in other low-resource settings.\n<\/p><p><b>Highlights of this work<\/b>:<br \/>\n<\/p>\n<ul><li>Factors for scaling and sustaining an electronic LIS (eLIS) in low- and middle-income countries (LMICs) have not been previously described in the literature.<\/li>\n<li>Successful adoption, scaling, and sustainment of OpenELIS in C\u00f4te d'Ivoire relied on early collaboration with partners, regulatory agencies, and technical experts into every step of the design, implementation, and evaluation phases.<\/li>\n<li>Entities planning to nationally scale an eLIS should plan for 1) workforce development in both end users and system administrators; 2) financial sustainability; and 3) institutionalization of government ownership and technical leadership.<\/li>\n<li>An open-source eLIS can increase accuracy and timeliness of clinical laboratory data, supporting diagnostic testing and monitoring in a resource-limited setting such as Cote d\u2019Ivoire.<\/li><\/ul>\n<p><b>Keywords<\/b>: electronic information systems, laboratory information systems, quality, low-resource country\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Introduction\">Introduction<\/span><\/h2>\n<p>In low- and middle-income countries (LMICs), inadequate infrastructure\u2014including limited availability and use of electronic <a href=\"https:\/\/www.limswiki.org\/index.php\/Laboratory_information_system\" title=\"Laboratory information system\" class=\"wiki-link\" data-key=\"37add65b4d1c678b382a7d4817a9cf64\">laboratory information systems<\/a> (LISs)\u2014has hindered quality <a href=\"https:\/\/www.limswiki.org\/index.php\/Laboratory\" title=\"Laboratory\" class=\"wiki-link\" data-key=\"c57fc5aac9e4abf31dccae81df664c33\">laboratory<\/a> service delivery for communities.<sup id=\"rdp-ebb-cite_ref-:0_1-0\" class=\"reference\"><a href=\"#cite_note-:0-1\">[1]<\/a><\/sup> International development efforts such as the U.S. President's Emergency Fund for AIDS Relief (PEPFAR) have aimed to strengthen national laboratory systems by modernizing infrastructure and diagnostic testing methods, including automated analyzers that require computer connectivity for <a href=\"https:\/\/www.limswiki.org\/index.php\/Information_management\" title=\"Information management\" class=\"wiki-link\" data-key=\"f8672d270c0750a858ed940158ca0a73\">data management<\/a>. The increase in the quantity and complexity of data generated from high-throughput analyzers and sophisticated diagnostics necessitates the transition from paper records to LIS.\n<\/p><p>Compared to paper-based systems, LIS are more efficient and enable better <a href=\"https:\/\/www.limswiki.org\/index.php\/Quality_control\" title=\"Quality control\" class=\"wiki-link\" data-key=\"1e0e0c2eb3e45aff02f5d61799821f0f\">quality control<\/a> (QC) in collecting, processing, managing, synthesizing, and reporting large amounts of data (Table 1).<sup id=\"rdp-ebb-cite_ref-:0_1-1\" class=\"reference\"><a href=\"#cite_note-:0-1\">[1]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-:4_2-0\" class=\"reference\"><a href=\"#cite_note-:4-2\">[2]<\/a><\/sup> The <a href=\"https:\/\/www.limswiki.org\/index.php\/COVID-19\" class=\"mw-redirect wiki-link\" title=\"COVID-19\" data-key=\"da9bd20c492b2a17074ad66c2fe25652\">COVID-19<\/a> <a href=\"https:\/\/www.limswiki.org\/index.php\/Pandemic\" title=\"Pandemic\" class=\"wiki-link\" data-key=\"bd9a48e6c6e41b6d603ee703836b01f1\">pandemic<\/a> has highlighted the acute importance of digital health, including LIS, in providing data and enabling rapid data exchange and sharing to facilitate <a href=\"https:\/\/www.limswiki.org\/index.php\/Public_health\" title=\"Public health\" class=\"wiki-link\" data-key=\"81092e25c0bd359cedd1b9f9dc350c86\">public health<\/a> surveillance and data-driven decision-making.<sup id=\"rdp-ebb-cite_ref-3\" class=\"reference\"><a href=\"#cite_note-3\">[3]<\/a><\/sup>\n<\/p>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table class=\"wikitable\" border=\"1\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td colspan=\"4\" style=\"background-color:white; padding-left:10px; padding-right:10px;\"><b>Table 1.<\/b> Strengths of laboratory information systems (LISs) compared to paper-based processes.\n<\/td><\/tr>\n<tr>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Lab aspect\n<\/th>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">LIS feature(s)\n<\/th>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Actions\n<\/th>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Impact\n<\/th><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><b>Reception<\/b>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Batch entry; referral workflows\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Accelerate the processing and recording of incoming work\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Reduce turnaround time (TAT)\n<\/td><\/tr>\n<tr>\n<td rowspan=\"2\" style=\"background-color:white; padding-left:10px; padding-right:10px;\"><b>Results generation<\/b>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Work plans\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Help managers monitor workload and supply management\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Ensure efficient operation of laboratories\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Analyzer interfaces\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Relay results quickly and accurately\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Reduce TAT\n<\/td><\/tr>\n<tr>\n<td rowspan=\"4\" style=\"background-color:white; padding-left:10px; padding-right:10px;\"><b>Reporting<\/b>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Interface with <a href=\"https:\/\/www.limswiki.org\/index.php\/Electronic_medical_record\" title=\"Electronic medical record\" class=\"wiki-link\" data-key=\"99a695d2af23397807da0537d29d0be7\">electronic medical record<\/a> (EMR)\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Communicate client laboratory history rapidly to clinicians in referral networks\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Enable faster clinical decision-making regarding diagnosis, treatment, and prognosis; reduce TAT\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Interface with client notification systems via Short Message Service (SMS) or email\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Communicate test results to clients rapidly\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Prompt immediate behavior augmentation and achieve better health outcomes (e.g., initiate self-quarantine in the case of COVID-19).\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Interface with routine health information systems at the district, regional, and national levels\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Enable faster aggregate data reporting\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Facilitate data-driven policy making; reduce TAT\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Reports of quality indicators such as turnaround time\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Help managers monitor quality performance\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Facilitate continuous quality improvement; increase testing quality\n<\/td><\/tr>\n<tr>\n<td rowspan=\"2\" style=\"background-color:white; padding-left:10px; padding-right:10px;\"><b>Overarching<\/b>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Graphic widgets (e.g., drop-down menus, checkboxes), active logic and value checks, flags and reminders for potential issues, and automation\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Reduce errors\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Facilitate quality control; increase testing quality\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Data storage and data query tools\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Allow secure, long-term <a href=\"https:\/\/www.limswiki.org\/index.php\/Data_retention\" title=\"Data retention\" class=\"wiki-link\" data-key=\"d77533b92d003d39cee958a82b62391a\">data retainment<\/a> and easy data retrieval based on specific needs\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Improve client privacy, long-term data availability, and data usage\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<p>However, LIS uptake and routine usage in LMICs remains low due to several barriers. LIS ownership, development, and maintenance can be perceived as bearing high costs of financial and human resources. Numerous proprietary LIS exist but may not be ideally suited for LMICs, where financial resources are limited and, most often, ongoing software support relies on long-term service contracts with private companies. Although some LMICs have implemented proprietary systems<sup id=\"rdp-ebb-cite_ref-:1_4-0\" class=\"reference\"><a href=\"#cite_note-:1-4\">[4]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-5\" class=\"reference\"><a href=\"#cite_note-5\">[5]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-6\" class=\"reference\"><a href=\"#cite_note-6\">[6]<\/a><\/sup>, these systems are vulnerable to market changes and can leave users unsupported if a company suspends its operations or modifies its service terms. Health information systems (HIS), including LIS, that use open-source code and are supported by communities of practice (CoPs) offer an attractive alternative in LMICs. Open-source CoPs have a vested interest in capacity building of software developers and users, including those from LMICs.<sup id=\"rdp-ebb-cite_ref-:5_7-0\" class=\"reference\"><a href=\"#cite_note-:5-7\">[7]<\/a><\/sup> Implementation time and effort aside, there are no licensing fees, and all software code created is in public ownership, which enables others to customize and improve functionality.<sup id=\"rdp-ebb-cite_ref-8\" class=\"reference\"><a href=\"#cite_note-8\">[8]<\/a><\/sup> Several open-source LISs are currently in use in LMICs in Africa and Asia, with varied scale.<sup id=\"rdp-ebb-cite_ref-9\" class=\"reference\"><a href=\"#cite_note-9\">[9]<\/a><\/sup>\n<\/p><p>Another barrier to sustained, wide-scale usage of LIS is that LIS initiatives are often international-donor-driven and may lack close collaborations with ministries of health (MOHs) in LMICs. Engaging the MOH in the initial design and feature prioritization stage, building local capacity to own and maintain the software, and securing resource commitment after phase-out of donor support are time- and labor-intensive.<sup id=\"rdp-ebb-cite_ref-10\" class=\"reference\"><a href=\"#cite_note-10\">[10]<\/a><\/sup> Additionally, power asymmetries between donors and LMIC stakeholders may discount local priorities, requirements, and innovations.<sup id=\"rdp-ebb-cite_ref-11\" class=\"reference\"><a href=\"#cite_note-11\">[11]<\/a><\/sup> However, successful experiences of implementing an LIS in LMICs at the national scale have shown that strengthening MOH leadership and cultivating mutually beneficial partnerships are essential to impactful and sustainable laboratory system strengthening.<sup id=\"rdp-ebb-cite_ref-:1_4-1\" class=\"reference\"><a href=\"#cite_note-:1-4\">[4]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-:2_12-0\" class=\"reference\"><a href=\"#cite_note-:2-12\">[12]<\/a><\/sup>\n<\/p><p>Since 2009, the University of Washington\u2019s (UW) International Training and Education Center for Health (I-TECH) has worked in partnership with the C\u00f4te d'Ivoire Ministry of Health and Public Hygiene (Minist\u00e8re de la Sant\u00e9 et de l\u2019Hygi\u00e8ne Publique, or MSHP) to implement a comprehensive set of activities aimed at strengthening the laboratory system. PEPFAR and the U.S. <a href=\"https:\/\/www.limswiki.org\/index.php\/Centers_for_Disease_Control_and_Prevention\" title=\"Centers for Disease Control and Prevention\" class=\"wiki-link\" data-key=\"176aa9c9513251c328d864d1e724e814\">Centers for Disease Control and Prevention<\/a> (CDC) have funded the partnership. One of the key activities is the sustainable development, expansion, and technical support of an open-source enterprise-level LIS, the <a href=\"https:\/\/www.limswiki.org\/index.php\/OpenELIS\" title=\"OpenELIS\" class=\"wiki-link\" data-key=\"b11b00d1e7409d55b58e9f82204cc2a3\">OpenELIS<\/a> system, with the long-term goal of Ivorian technical support and managerial sustainment of the system. The software serves as both an effective laboratory information management solution and a business operations framework for the laboratory service units (Fig. 1). The collaboration has addressed the need for a comprehensive, customizable, low- to no-cost, open-source LIS to serve the public health systems, with initial attention to HIV clients and later expansion to cover the general population.\n<\/p><p><br \/>\n<a href=\"https:\/\/www.limswiki.org\/index.php\/File:Fig1_He_IntJofMedInfo2023_170.jpg\" class=\"image wiki-link\" data-key=\"dc94fab2e518bdc32435ac6dba74ca49\"><img alt=\"Fig1 He IntJofMedInfo2023 170.jpg\" src=\"https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/f\/fa\/Fig1_He_IntJofMedInfo2023_170.jpg\" decoding=\"async\" style=\"width: 100%;max-width: 400px;height: auto;\" \/><\/a>\n<\/p>\n<div style=\"clear:both;\"><\/div>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table border=\"0\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><blockquote><p><b>Figure 1.<\/b> OpenELIS laboratory software solution and business process framework. (Color should be used in print).<\/p><\/blockquote>\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<p>C\u00f4te d'Ivoire has a tiered <a href=\"https:\/\/www.limswiki.org\/index.php\/Public_health_laboratory\" title=\"Public health laboratory\" class=\"wiki-link\" data-key=\"34ffb658cb79bf322c65efaad95996f5\">public health laboratory<\/a> system of nine <a href=\"https:\/\/www.limswiki.org\/index.php\/Reference_laboratory\" title=\"Reference laboratory\" class=\"wiki-link\" data-key=\"f719f408e1660f86b53857eef2f13f32\">reference laboratories<\/a>, 77 laboratories at regional and general <a href=\"https:\/\/www.limswiki.org\/index.php\/Hospital\" title=\"Hospital\" class=\"wiki-link\" data-key=\"b8f070c66d8123fe91063594befebdff\">hospitals<\/a>, and 100 laboratories among 1,486 district health centers. Prior to 2009, most laboratories used paper registers and reports to collect and report laboratory data to clinicians and national disease monitoring programs. The only LIS was a bespoke database located at the national HIV reference laboratory (called rETRO-CI), and this system was paired with commercial software.\n<\/p><p>The objectives of this case study are to: 1) present the iterative implementation process of OpenELIS in C\u00f4te d'Ivoire; 2) describe the evolving leadership, ownership, and capacity of the C\u00f4te d'Ivoire MSHP in sustaining routine use of OpenELIS; and 3) synthesize lessons learned for strengthening LIS in other LMICs.\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Materials_and_methods\">Materials and methods<\/span><\/h2>\n<p>We used qualitative methods in this case study to describe the implementation and collaboration around OpenELIS and its supporting activities.<sup id=\"rdp-ebb-cite_ref-:2_12-1\" class=\"reference\"><a href=\"#cite_note-:2-12\">[12]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-13\" class=\"reference\"><a href=\"#cite_note-13\">[13]<\/a><\/sup> We reviewed monthly and annual project reports from the implementers; activity and trip reports from technical experts, as well as from government and donor representatives; and software development roadmap and technical documentation from 2009 to 2020. This project was determined to be non-research by the University of Washington and has been approved by C\u00f4te d'Ivoire Comit\u00e9 National d'Ethique des Sciences de la Vie et de la Sant\u00e9 (CNESVS, Ivorian Institutional Review Board; reference number 006\u201321\/MSHP\/CNESVS-km) and the U.S. CDC.\n<\/p><p>Information abstracted from the project documents was initially summarized in chronological order and later coded deductively and inductively. Next, we coded the summaries deductively using the components of the Stages of Continuous Improvement (SOCI) Framework for Health Information Systems.<sup id=\"rdp-ebb-cite_ref-:3_14-0\" class=\"reference\"><a href=\"#cite_note-:3-14\">[14]<\/a><\/sup> The SOCI Framework has previously been used in Uganda and Cameroon to assess the maturity of digital health tools.<sup id=\"rdp-ebb-cite_ref-:3_14-1\" class=\"reference\"><a href=\"#cite_note-:3-14\">[14]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-15\" class=\"reference\"><a href=\"#cite_note-15\">[15]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-16\" class=\"reference\"><a href=\"#cite_note-16\">[16]<\/a><\/sup> In addition to deductive codes, we also created new codes inductively where the SOCI Framework did not apply. Inductive codes captured the different steps of OpenELIS implementation and evolving collaboration among stakeholders. When coding was complete, codes and their corresponding excerpts from the summaries were organized into themes. YH coded the summaries. The other co-authors reviewed and verified the coding and analysis to ensure accuracy. The coding and thematic analysis took place in ATLAS.ti 8 Windows.\n<\/p><p>To ensure that LIS implementation translates into high-quality health services and population health benefits<sup id=\"rdp-ebb-cite_ref-17\" class=\"reference\"><a href=\"#cite_note-17\">[17]<\/a><\/sup>, it is important to monitor how data systems mature over time. As such, the SOCI Framework outlines 13 components and 39 subcomponents within five domains, i.e., HIS leadership and governance, management and workforce, infrastructure, standards and interoperability, and <a href=\"https:\/\/www.limswiki.org\/index.php\/Data_quality\" title=\"Data quality\" class=\"wiki-link\" data-key=\"7fe43b05eae4dfa9b5c0547cc8cfcceb\">data quality<\/a> and use.<sup id=\"rdp-ebb-cite_ref-18\" class=\"reference\"><a href=\"#cite_note-18\">[18]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-19\" class=\"reference\"><a href=\"#cite_note-19\">[19]<\/a><\/sup>\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Results\">Results<\/span><\/h2>\n<h3><span class=\"mw-headline\" id=\"Design_and_development\">Design and development<\/span><\/h3>\n<p>OpenELIS was initially designed and implemented by a group of six U.S. state public health laboratories.<sup id=\"rdp-ebb-cite_ref-SHLUIOpenELIS12_20-0\" class=\"reference\"><a href=\"#cite_note-SHLUIOpenELIS12-20\">[20]<\/a><\/sup> Its implementation in global health began as part of a collaborative effort between the U.S. CDC and the Government of Vietnam to strengthen HIV service delivery and laboratory systems in 2005.<sup id=\"rdp-ebb-cite_ref-:2_12-2\" class=\"reference\"><a href=\"#cite_note-:2-12\">[12]<\/a><\/sup> As part of the open-source medical record system (<a href=\"https:\/\/www.limswiki.org\/index.php\/OpenMRS\" title=\"OpenMRS\" class=\"wiki-link\" data-key=\"bdb797cd304c9ac66336f395c2bb6dbd\">OpenMRS<\/a>) consortium of partners<sup id=\"rdp-ebb-cite_ref-21\" class=\"reference\"><a href=\"#cite_note-21\">[21]<\/a><\/sup>, UW I-TECH received the OpenELIS source code and joined the development of the OpenELIS codebase in 2009.\n<\/p><p>An agile software design and development methodology was adopted by UW I-TECH for OpenELIS to enable an inclusive, iterative approach to software creation together with the local stakeholders in C\u00f4te d'Ivoire.<sup id=\"rdp-ebb-cite_ref-22\" class=\"reference\"><a href=\"#cite_note-22\">[22]<\/a><\/sup> Since its introduction and adaptation in C\u00f4te d'Ivoire in 2009, OpenELIS has evolved through multiple iterations of improving functionality and flexibility, and through new releases twice per year. The first versions of OpenELIS were limited in scope and focused primarily on HIV care. They provided pre-defined forms and reports for common HIV-related tests such as early infant diagnosis of HIV (EID), CD4 counts, and HIV genotyping.\n<\/p><p>In 2011, UW I-TECH merged all versions of OpenELIS for different laboratories into one core, i.e., OpenELIS Global 1.4, greatly reducing the burden of maintenance and update. Before 2011, we created a customized copy of OpenELIS for each laboratory. This approach was manageable when OpenELIS was implemented in four national laboratories in C\u00f4te d'Ivoire and Haiti. However, as OpenELIS expanded to new laboratories, the time burden of maintaining and updating the software across different versions became excessive. The shift to a common code base shortened the software testing cycle for each new version from approximately 200 hours to 40 hours and permitted a more thorough software testing process and a higher-quality final release.\n<\/p><p>The core software improvements also enabled greater customizability and made it possible for a lab to install and configure OpenELIS without engaging a software developer to customize elements. We added test catalog management features, allowing laboratories to modify catalogs between version releases. Laboratories could make changes to existing tests or add new tests or panels without a software developer adding them manually to the system. New analyzer interfaces were added so that laboratories could import data from analyzers beyond those related to HIV. The core software could be deployed without impacting previous local customizations and further adapted to any setting without code re-write or maintenance. This allowed for countries and laboratories to have more control over what features to include in the software.\n<\/p><p>In 2018, UW I-TECH began an extensive review of the OpenELIS application and identified where the older technology had become obsolete and presented data security risks. OpenELIS Global 2.0, completed in 2019, upgraded the core framework to mitigate security risks (Table 2).\n<\/p>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table class=\"wikitable\" border=\"1\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td colspan=\"3\" style=\"background-color:white; padding-left:10px; padding-right:10px;\"><b>Table 2.<\/b> Open-source components in OpenELIS. HL7 = <a href=\"https:\/\/www.limswiki.org\/index.php\/Health_Level_7\" title=\"Health Level 7\" class=\"wiki-link\" data-key=\"e0bf845fb58d2bae05a846b47629e86f\">Health Level 7<\/a>; FHIR = <a href=\"https:\/\/www.limswiki.org\/index.php\/Fast_Healthcare_Interoperability_Resources\" title=\"Fast Healthcare Interoperability Resources\" class=\"wiki-link\" data-key=\"65dd2a848285f9151006e17e036d596d\">Fast Healthcare Interoperability Resources<\/a>; ASTM = American Society of Testing and Materials\n<\/td><\/tr>\n<tr>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Component\n<\/th>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">OpenELIS Global 1.X series\n<\/th>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">OpenELIS Global 2.X series\n<\/th><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><b>Timeframe<\/b>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Before 2011\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">After 2011\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><b>Operating system<\/b>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Ubuntu 12\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Ubuntu 20\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><b>Programming framework<\/b>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Java Struts 1\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Java Spring\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><b>Web application<\/b>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Tomcat\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Tomcat\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><b>Database<\/b>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><a href=\"https:\/\/www.limswiki.org\/index.php\/PostgreSQL\" title=\"PostgreSQL\" class=\"wiki-link\" data-key=\"a5dd945cdcb63e2d8f7a5edb3a896d82\">PostgreSQL<\/a>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">PostgreSQL\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><b>Interoperability<\/b>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Mirth, HL7 2.5.1\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">FHIR R4, HL7 2.5.1, ASTM\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><b>Customization<\/b>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Hard-coded multiple forks by developers for each use case\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Core software with flexible customization by users\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<p>Many expansions and improvements in later iterations of OpenELIS stemmed from close collaboration between UW I-TECH and the multi-stakeholder OpenELIS technical working group (TWG) in C\u00f4te d'Ivoire, convened in 2015. The TWG consists of representatives from the MSHP, I-TECH C\u00f4te d'Ivoire, PEPFAR's NGO implementing partners (IPs), and the CDC. UW I-TECH and the design team within the TWG would lead design workshops that start with needs gathering at regional and district hospitals and laboratories using a standardized questionnaire. After reconvening, group members would share the findings on identified needs and gaps in LIS functionality and reporting, prioritizing design features, adding the designs to the roadmap<sup id=\"rdp-ebb-cite_ref-23\" class=\"reference\"><a href=\"#cite_note-23\">[23]<\/a><\/sup>, and writing software specifications.\n<\/p><p>The software development process followed a similar collaborative trajectory as the design process. Before 2014, UW I-TECH conducted all software development, mostly by one senior software developer and joined later by a second developer. All reports, enhancements, and changes relied on the two developers and was dependent on the next release. Starting in 2015, UW I-TECH has provided software development training in C\u00f4te d'Ivoire and created a more collaborative workflow with Ivorian developers so that both design and development have become more localized.\n<\/p>\n<h3><span id=\"rdp-ebb-Deploy,_scale-up,_and_support\"><\/span><span class=\"mw-headline\" id=\"Deploy.2C_scale-up.2C_and_support\">Deploy, scale-up, and support<\/span><\/h3>\n<p>OpenELIS deployment and scale-up took place in several stages since 2009 (Table 3), and the respective roles of the MSHP and I-TECH in the process evolved over time. Before 2015, I-TECH led the deployment process. The deployment at a laboratory began with a team of I-TECH staff from C\u00f4te d'Ivoire and Seattle conducting an initial laboratory assessment. Then, during a second visit, the team deployed a customized version. By the end of 2015, OpenELIS had been deployed at 11 laboratories, covering the entire network of laboratories performing viral load testing at the time (Fig. 2).\n<\/p>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table class=\"wikitable\" border=\"1\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td colspan=\"3\" style=\"background-color:white; padding-left:10px; padding-right:10px;\"><b>Table 3.<\/b> Timeline of the OpenELIS scale-up in C\u00f4te d'Ivoire.\n<\/td><\/tr>\n<tr>\n<th rowspan=\"2\" style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Year\n<\/th>\n<th colspan=\"2\" style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Number of laboratories implementing OpenELIS\n<\/th><\/tr>\n<tr>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">New\n<\/th>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Cumulative\n<\/th><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">2009\u20132012\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">3\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">3\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">2013\u20132015\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">8\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">11\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">2016\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">1\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">12\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">2017\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">31\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">43\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">2018\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">12\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">55\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">2019\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">13\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">68\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">2020\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">28\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">93\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">2021\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">15\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">111\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<p><br \/>\n<a href=\"https:\/\/www.limswiki.org\/index.php\/File:Fig2_He_IntJofMedInfo2023_170.jpg\" class=\"image wiki-link\" data-key=\"9ff953cb01ca9fc60c2b58ed6eb35b05\"><img alt=\"Fig2 He IntJofMedInfo2023 170.jpg\" src=\"https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/d\/db\/Fig2_He_IntJofMedInfo2023_170.jpg\" decoding=\"async\" style=\"width: 100%;max-width: 400px;height: auto;\" \/><\/a>\n<\/p>\n<div style=\"clear:both;\"><\/div>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table border=\"0\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><blockquote><p><b>Figure 2.<\/b> Laboratories in C\u00f4te d'Ivoire that implement OpenELIS before and after 2015. (Color should be used in print).<\/p><\/blockquote>\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<p>In 2015, after the MSHP defined and ratified LIS requirements, they determined that OpenELIS satisfied most of these requirements and would be the system deployed at laboratories throughout the country. The MSHP became the owner of OpenELIS in C\u00f4te d'Ivoire and started collaborating with I-TECH closely in deployment to roll out OpenELIS. The scale-up first prioritized regional referral laboratories that newly started providing viral load testing as part of a MSHP- and CDC-led initiative to scale-up viral load testing. OpenELIS was then deployed in hospitals at the district and local level to support their collection and management of data on routine laboratory testing for both HIV and non-HIV clients. As of 2021, 111 laboratories in C\u00f4te d'Ivoire had implemented OpenELIS (Fig. 2). OpenELIS currently supports testing of <a href=\"https:\/\/www.limswiki.org\/index.php\/Hematology\" title=\"Hematology\" class=\"wiki-link\" data-key=\"de8b49c7b0be3cec33af362e763b9b0c\">hematology<\/a>, <a href=\"https:\/\/www.limswiki.org\/index.php\/Biochemistry\" title=\"Biochemistry\" class=\"wiki-link\" data-key=\"17365d4e36341ee64e5637b81c21fc08\">biochemistry<\/a>, <a href=\"https:\/\/www.limswiki.org\/index.php\/Molecular_biology\" title=\"Molecular biology\" class=\"wiki-link\" data-key=\"c1b2586b4cd56652a8868e37f38c1c3d\">molecular biology<\/a>, serology, and testing of <a href=\"https:\/\/www.limswiki.org\/index.php\/Microbiology\" title=\"Microbiology\" class=\"wiki-link\" data-key=\"920bf32dc9c9cf492c58c4c5484df41f\">microbiology<\/a>, <a href=\"https:\/\/www.limswiki.org\/index.php\/Pathology\" title=\"Pathology\" class=\"wiki-link\" data-key=\"5d8e2230b55d8760dcb729fc7dcd3dc1\">pathology<\/a>, and immunohistochemistry will be available in January 2023.\n<\/p><p>The collaborative deployment and scale-up process started with a series of deployment workshops with relevant stakeholders from the OpenELIS TWG in 2015. Participants received hands-on training on setting up servers and workstations, conducting maintenance and updates, and troubleshooting. During the deployment wave each year, starting from 2015, a team of MSHP implementation, I-TECH C\u00f4te d'Ivoire staff, and IP representatives would organize a week-long implementation trip to deploy the software and perform the initial training of laboratory staff. The team would follow up with the laboratories by phone weekly and conduct a coaching and review visit pne to three months after the deployment and training.\n<\/p><p>Starting in 2020, the MSHP began leading the deployment process with minimal support from I-TECH. The MSHP team conducts all follow-up visits, and the training is facilitated by MSHP trainers with co-facilitation by I-TECH C\u00f4te d\u2019Ivoire. The MSHP also independently operates the OpenELIS Technical Assistance Unit (Cellule d'Assistance Technique de OpenELIS, or CATOE), the technical support call center for OpenELIS. Established in 2016 within the MSHP, CATOE provides direct, real-time technical support to OpenELIS users. CATOE technicians hold bidirectional call services with laboratories to conduct monthly check-ins that proactively probe for issues and to respond to technical assistance requests. CATOE consists of four MSHP staff members who were recruited from the participants of the first OpenELIS implementers' workshop in 2015. The technicians received targeted training on providing real-time support, equipment, phone credits, and a six-month mentorship with the primary support and development staff at I-TECH. CATOE meets monthly with the OpenELIS TWG to review activities and findings from the support calls, feeding information into the software roadmap.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Strengthening_local_leadership_and_ownership\">Strengthening local leadership and ownership<\/span><\/h3>\n<p>The C\u00f4te d'Ivoire MSHP started collaborating with I-TECH in OpenELIS implementation more actively in 2015. The MSHP initiated a reorganization process in 2014 that spurred the creation of the Department of Informatics and Health Information (Direction de l'Informatique et de l'Information Sanitaire, or DIIS) in 2015 to consolidate and coordinate health informatics activities in the country. This designation signaled a leadership commitment to ownership of HIS development, implementation, and management activities nationally. In 2017 the MSHP incorporated the designation of OpenELIS and its scale-up in the National Strategic Plan for the Development of Medical Biology Laboratories 2017\u20132020.<sup id=\"rdp-ebb-cite_ref-24\" class=\"reference\"><a href=\"#cite_note-24\">[24]<\/a><\/sup>\n<\/p><p>The continuous strengthening of MSHP leadership demonstrates comprehensive ownership of not only the software and hardware but also the essential knowledge, skills, and processes to sustain routine OpenELIS implementation. Before 2015, the MSHP was only involved in site selection for OpenELIS. After the formation of DIIS, the MSHP joined I-TECH throughout the implementation process from forming the TWG, gathering needs, and training developers and technicians to deploying the software and providing technical support. By 2020, the DIIS was conducting follow-up visits and operating CATOE independently, leading the deployment process, configuration of servers, and training of new and existing users.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Building_local_capacity\">Building local capacity<\/span><\/h3>\n<p>In addition to providing the software and hardware and strengthening local leadership, building local capacity for implementing OpenELIS in C\u00f4te d'Ivoire is also critical. Training on various topics along the software development pipeline and in various formats has equipped Ivorian policymakers and technicians with necessary knowledge and skills for routine OpenELIS implementation and maintenance.\n<\/p><p>Before 2015, UW I-TECH staff initially provided on-the-job training (OJT) on OpenELIS deployment and upgrade to selected staff at the MSHP, national laboratories, and IPs. In 2014, a targeted month-long training on OpenELIS development took place in Seattle for software developers with background in Java from the MSHP, Institut Pasteur C\u00f4te d'Ivoire, Institut National Polytechnique F\u00e9lix Houphou\u00ebt-Boigny (INPHB; a public polytechnic institute of higher education), and I-TECH C\u00f4te d'Ivoire. After participants returned to C\u00f4te d'Ivoire, UW I-TECH staff provided remote mentoring and exercises. While the results of the OJT and targeted training were promising, the time and resources for replicating these formats became unsustainably high as the OpenELIS scale-up started in 2015.\n<\/p><p>In response, UW I-TECH started collaborating with the MSHP in 2015 to develop a full suite of materials for OpenELIS, including a package for trainers and users, and to lead a series of training of trainers (TOT) sessions within C\u00f4te d'Ivoire. The week-long TOTs used theoretical and practical activities and took a holistic technical approach covering a range of topics from design, planning, development, and programming to implementation and support. Among the participants at the first TOT, one became the deputy director of DIIS, and most joined the OpenELIS TWG. The TOT participants later conducted cascade training led by the MSHP during the OpenELIS scale-up. Cascade training participants provided largely positive ratings, appreciating the theoretical and practical exercises. The TOTs and cascade trainings have been an integral part of the deployment and scale-up process since 2015, and they have formed a cadre of trained teams in C\u00f4te d'Ivoire to ensure sustainable OpenELIS deployment and support.\n<\/p><p>The collaboration between I-TECH and INPHB incorporated OpenELIS into the computer science curriculum and started the OpenELIS internship at INPHB. In 2016, two INPHB faculty received training on OpenELIS software development from UW I-TECH, and they started using OpenELIS as an example LIS to teach students in computer science. In 2018, the OpenELIS internship program started with three students studying at INPHB and working with I-TECH C\u00f4te d'Ivoire simultaneously to practice OpenELIS software development, deployment, and technical support. The training program and assessment process became standardized in 2019, and two interns per year embedded with I-TECH or MSHP teams for one year. Ten interns have graduated from the program, and one was eventually hired as I-TECH C\u00f4te d'Ivoire staff.\n<\/p><p>In addition to periodic training and the internship program, software developer retreats and opportunities to attend and present at international and regional conferences for HIV\/AIDS or <a href=\"https:\/\/www.limswiki.org\/index.php\/Health_informatics\" title=\"Health informatics\" class=\"wiki-link\" data-key=\"055eb51f53cfdbacc08ed150b266c9f4\">health informatics<\/a> have also been part of capacity building.\n<\/p>\n<h3><span id=\"rdp-ebb-Supporting_data-driven_decision-making_in_HIV\/AIDS\"><\/span><span class=\"mw-headline\" id=\"Supporting_data-driven_decision-making_in_HIV.2FAIDS\">Supporting data-driven decision-making in HIV\/AIDS<\/span><\/h3>\n<p>To transform data stored in OpenELIS into <a href=\"https:\/\/www.limswiki.org\/index.php\/Information\" title=\"Information\" class=\"wiki-link\" data-key=\"6300a14d9c2776dcca0999b5ed940e7d\">information<\/a> that is meaningful for decision-making, I-TECH built the online data dashboards that display aggregate data on viral load testing and EID imported from OpenELIS.<sup id=\"rdp-ebb-cite_ref-25\" class=\"reference\"><a href=\"#cite_note-25\">[25]<\/a><\/sup> The dashboards import data from OpenELIS and create visualizations that help the MSHP, IPs, and CDC monitor performance along the HIV care cascade and make programmatic decisions to improve quality of care. For example, the viral load dashboard helped discover a large group of clients who only had initial HIV diagnostic and viral load tests but no follow-up tests across multiple regions in C\u00f4te d'Ivoire. This issue would have been hidden before the dashboarding process cleaned, consolidated, and visualized the data. The MSHP and CDC based their directions for the regions and IPs on the discovery from the dashboard.\n<\/p><p>I-TECH also developed the pediatric HIV case management tool that combined OpenELIS data of pediatric HIV clients with those from the HIV <a href=\"https:\/\/www.limswiki.org\/index.php\/Electronic_medical_record\" title=\"Electronic medical record\" class=\"wiki-link\" data-key=\"99a695d2af23397807da0537d29d0be7\">electronic medical records<\/a> (EMR) system in C\u00f4te d'Ivoire. This tool helped health facilities and districts identify and follow up with lost-to-follow-up pediatric clients and parents and those whose viral load test results indicated a decline in antiretroviral regimen effectiveness. OpenELIS's pivotal role as an essential public health tool was solidified.\n<\/p>\n<h3><span id=\"rdp-ebb-Networking,_interoperability_between_systems,_and_expansion\"><\/span><span class=\"mw-headline\" id=\"Networking.2C_interoperability_between_systems.2C_and_expansion\">Networking, interoperability between systems, and expansion<\/span><\/h3>\n<p>To respond to emerging needs from the MSHP and laboratories, the OpenELIS project will always have room for adaptation and growth. Current activities include transitioning from a series of individual instances of OpenELIS to a more interconnected national laboratory information system through system networking. The pilot of a consolidated server for the national laboratory data warehouse began in 2021, bringing all laboratory data to one central location for reporting and real-time decision-making by the MSHP. The continuous demands from laboratories to add more testing modules to OpenELIS motivated the project to start developing modules for tuberculosis, COVID-19, and enhanced support for molecular biology and bidirectional analyzer interfacing. A reference testing workflow has been developed, allowing results to be sent between OpenELIS instances and providing laboratory results instantly between laboratories and reference laboratories to aid diagnosis and allow for faster treatment. Programmatically, I-TECH will continue to work with the C\u00f4te d'Ivoire MSHP to provide necessary assistance for the full transition.\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Discussion\">Discussion<\/span><\/h2>\n<p>To our knowledge, this is the first case study of best practices and lessons learned from the implementation of a LIS in a tiered laboratory system in West Africa. This case study illustrates the development, implementation, and capacity building process for OpenELIS in C\u00f4te d'Ivoire since 2009, with support from PEPFAR, as part of an initiative to strengthen the national laboratory system. The open-source nature of OpenELIS coupled with the close partnership between the MSHP and I-TECH have facilitated the collaborative, iterative process of designing, developing, deploying, and scaling up OpenELIS in C\u00f4te d'Ivoire. Strong local leadership and ownership of OpenELIS implementation contributed to the scaling and sustainment of routine use of OpenELIS at laboratories nationwide beyond the first 13 years. The improved capacity and talent pool for OpenELIS implementation and support, resulting from continuous training efforts, also facilitated scaling and sustainment. OpenELIS and its dependent data dashboards have already demonstrated value in supporting the MSHP and other stakeholders in data-driven decision-making.\n<\/p>\n<h3><span id=\"rdp-ebb-Open-source_design_and_CoPs-supported_software_adoption,_implementation,_sustainability,_and_innovation\"><\/span><span class=\"mw-headline\" id=\"Open-source_design_and_CoPs-supported_software_adoption.2C_implementation.2C_sustainability.2C_and_innovation\">Open-source design and CoPs-supported software adoption, implementation, sustainability, and innovation<\/span><\/h3>\n<p>The open-source nature and the resulting potential for in-country capacity building and ownership of OpenELIS were the main reasons why the C\u00f4te d'Ivoire MSHP decided to adopt it. Reports from open-source LIS software projects in other settings, including the OpenELIS project in Vietnam<sup id=\"rdp-ebb-cite_ref-:2_12-3\" class=\"reference\"><a href=\"#cite_note-:2-12\">[12]<\/a><\/sup>, a LIS pilot for tuberculosis in Peru<sup id=\"rdp-ebb-cite_ref-26\" class=\"reference\"><a href=\"#cite_note-26\">[26]<\/a><\/sup>, and a LIS pilot for HIV in Malawi<sup id=\"rdp-ebb-cite_ref-27\" class=\"reference\"><a href=\"#cite_note-27\">[27]<\/a><\/sup>, have also underscored the value of open-source software in LMICs. Open-source software provide flexibility and agility so that governments can start with a pilot project and gradually build in more functions as use cases evolve and expand. The open-source nature invites collaboration and cultivates local capacity so that costs of development and maintenance will decrease over time, contributing to sustainability. Digital Square, a global consortium for promoting health equity through digital health, designated OpenELIS in 2018 as a digital \u201cglobal good.\u201d<sup id=\"rdp-ebb-cite_ref-28\" class=\"reference\"><a href=\"#cite_note-28\">[28]<\/a><\/sup> A CoP was also developed to support the advancement and implementation of OpenELIS globally. As of October 2020, over 270 laboratories in 18 LMICs in sub-Saharan Africa, Asia, and the Caribbean use OpenELIS.\n<\/p><p>Continuous maintenance and funding support for software is crucial after the initial launch<sup id=\"rdp-ebb-cite_ref-29\" class=\"reference\"><a href=\"#cite_note-29\">[29]<\/a><\/sup>, and the OpenELIS CoP worldwide is a model that facilitates sustainable implementation, meaningful collaboration, and local ownership. There are three common models for implementing open-source software in LMICs, namely <a href=\"https:\/\/www.limswiki.org\/index.php\/Software_as_a_service\" title=\"Software as a service\" class=\"wiki-link\" data-key=\"ae8c8a7cd5ee1a264f4f0bbd4a4caedd\">software as a service<\/a> (SaaS)<sup id=\"rdp-ebb-cite_ref-30\" class=\"reference\"><a href=\"#cite_note-30\">[30]<\/a><\/sup>, donor investment in the core global good<sup id=\"rdp-ebb-cite_ref-31\" class=\"reference\"><a href=\"#cite_note-31\">[31]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-32\" class=\"reference\"><a href=\"#cite_note-32\">[32]<\/a><\/sup>, and CoP.<sup id=\"rdp-ebb-cite_ref-33\" class=\"reference\"><a href=\"#cite_note-33\">[33]<\/a><\/sup> The first two models keep the knowledge and maintenance responsibility with the developers who are usually in high-income countries, and funding can be highly donor-driven. On the contrary, the CoP model brings a variety of actors and resources to a shared table to support the core stewardship and maintenance of the global good. The large-scale adoption of OpenELIS through different funding streams, not just PEPFAR, has led to a broader set of features and more sustainable cost-sharing, including recent co-investment from LMICs and the U.S. in 2021. Each implementing country benefits from features developed for other use cases due to the single code base and flexible administrative options. The OpenELIS CoP continuously supports the development of innovations and flexible design that can be used across use cases.<sup id=\"rdp-ebb-cite_ref-:5_7-1\" class=\"reference\"><a href=\"#cite_note-:5-7\">[7]<\/a><\/sup>\n<\/p>\n<h3><span id=\"rdp-ebb-Collaboration,_capacity_building,_and_local_ownership_are_the_key_to_sustainable_implementation\"><\/span><span class=\"mw-headline\" id=\"Collaboration.2C_capacity_building.2C_and_local_ownership_are_the_key_to_sustainable_implementation\">Collaboration, capacity building, and local ownership are the key to sustainable implementation<\/span><\/h3>\n<p>Numerous global health projects have struggled to continue beyond the pilot or trial phase, and one of the key barriers to scale-up and sustainability is lack of local ownership and leadership at each level of the system.<sup id=\"rdp-ebb-cite_ref-34\" class=\"reference\"><a href=\"#cite_note-34\">[34]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-35\" class=\"reference\"><a href=\"#cite_note-35\">[35]<\/a><\/sup> The collaboration between the MSHP and I-TECH is the nurturing ground for the decade-long OpenELIS project in C\u00f4te d'Ivoire. The open-source and global CoP of software such as OpenELIS naturally support technical collaboration and exchange.<sup id=\"rdp-ebb-cite_ref-36\" class=\"reference\"><a href=\"#cite_note-36\">[36]<\/a><\/sup> However, without committed engagement and close partnership with the MSHP, the OpenELIS design and development process in C\u00f4te d'Ivoire would likely have been less participatory, less successful, and less sustainable.<sup id=\"rdp-ebb-cite_ref-37\" class=\"reference\"><a href=\"#cite_note-37\">[37]<\/a><\/sup>\n<\/p><p>The improved local capacity of software development and maintenance for OpenELIS is an important contribution toward the vision of long-term, locally sustained implementation. Providing information technology (IT) without investing in human resources or building capacity would still be inadequate in addressing the gaps in the laboratory system.<sup id=\"rdp-ebb-cite_ref-:4_2-1\" class=\"reference\"><a href=\"#cite_note-:4-2\">[2]<\/a><\/sup> Therefore, the policymakers and technicians trained in OpenELIS development and deployment, as well as the interns embedded in MSHP teams to support OpenELIS implementation, will ensure the medium- and long-term success of the project.\n<\/p><p>The collaboration has also strengthened local ownership of OpenELIS and leadership of relevant software development and support activities to achieve routine usage and nationwide scale. Although the OpenELIS project in C\u00f4te d'Ivoire is still receiving funding by the U.S. government as part of PEPFAR, and the C\u00f4te d'Ivoire MSHP has not committed to completely taking over the continuous implementation of OpenELIS, there has at least been progress towards this goal. Transition of all OpenELIS-related planning, design, development, and implementation to the MSHP has been underway as of March 2022.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Limitations\">Limitations<\/span><\/h3>\n<p>This case study represents the experiences of one LIS project in C\u00f4te d'Ivoire and thus may not be generalizable to other settings, though the lessons learned are relevant to many HIS strengthening projects in LMICs. Evaluation research that uses rigorous quantitative, qualitative, or mixed methods is necessary to assess and demonstrate the reach, effectiveness, adoption, implementation, and maintenance of the project.<sup id=\"rdp-ebb-cite_ref-38\" class=\"reference\"><a href=\"#cite_note-38\">[38]<\/a><\/sup> For example, one could evaluate the use of a quasi-experimental design to assess the effectiveness of improving laboratory testing data quality (e.g., data timeliness, data completeness, data validity) and service quality (e.g., TAT, testing validity) by comparing LIS to paper records, or the use of a qualitative study to interview laboratory staff about the facilitators and barriers to LIS implementation.\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Conclusions\">Conclusions<\/span><\/h2>\n<p>The development and nationwide scale-up of OpenELIS in C\u00f4te d\u2019Ivoire for over a decade have relied on the open-source software design, CoP support, close collaboration with the C\u00f4te d\u2019Ivoire MSHP, and cultivation of local ownership and capacity since inception. Other countries and supporting partners planning to adapt and nationally scale LIS may consider the importance of HIS workforce development, financial sustainability, and institutionalization of government ownership and technical leadership.\n<\/p><p>Before this study, the following was already known:\n<\/p>\n<ul><li>LIS has the potential to increase accuracy and timeliness of laboratory data, supporting diagnostic testing and clinical monitoring.<\/li>\n<li>Factors for scaling and sustaining LIS in LMICs have not been previously described.<\/li><\/ul>\n<p>This study added the following to our knowledge:\n<\/p>\n<ul><li>OpenELIS, an open-source electronic LIS, has been implemented in C\u00f4te d'Ivoire since 2009 and scaled nationwide to 111 clinical and reference laboratories.<\/li>\n<li>Successful adoption, scaling, and sustainment of OpenELIS has relied on active collaboration starting in the earliest planning phases and integrating local partners, regulatory agencies, and technical experts into every step of the design, implementation, and evaluation phases.<\/li>\n<li>Other countries and supporting partners planning to adapt and nationally scale LIS may consider the importance of carefully developing plans for 1) workforce development in both end users and system administrators; 2) financial sustainability; and 3) institutionalization of government ownership and technical leadership.<\/li><\/ul>\n<h2><span id=\"rdp-ebb-Abbreviations,_acronyms,_and_initialisms\"><\/span><span class=\"mw-headline\" id=\"Abbreviations.2C_acronyms.2C_and_initialisms\">Abbreviations, acronyms, and initialisms<\/span><\/h2>\n<ul><li><b>ASTM<\/b>: American Society of Testing and Materials<\/li>\n<li><b>CATOE<\/b>: Cellule d'Assistance Technique de OpenELIS<\/li>\n<li><b>CDC<\/b>: Centers for Disease Control and Prevention<\/li>\n<li><b>CNESVS<\/b>: C\u00f4te d'Ivoire Comit\u00e9 National d'Ethique des Sciences de la Vie et de la Sant\u00e9<\/li>\n<li><b>CoP<\/b>: community of practice<\/li>\n<li><b>DIIS<\/b>: Direction de l'Informatique et de l'Information Sanitaire<\/li>\n<li><b>eLIS<\/b>: electronic laboratory information system<\/li>\n<li><b>EID<\/b>: early infant diagnosis<\/li>\n<li><b>EMR<\/b>: electronic medical record<\/li>\n<li><b>FHIR<\/b>: Fast Healthcare Interoperability Resources<\/li>\n<li><b>HIS<\/b>: health information system<\/li>\n<li><b>HL7<\/b>: Health Level 7<\/li>\n<li><b>I-TECH<\/b>: International Training and Education Center for Health<\/li>\n<li><b>INPHB<\/b>: Institut Pasteur C\u00f4te d'Ivoire, Institut National Polytechnique F\u00e9lix Houphou\u00ebt-Boigny<\/li>\n<li><b>IP<\/b>: implementing partner<\/li>\n<li><b>LIS<\/b>: laboratory information system<\/li>\n<li><b>LMIC<\/b>: low- and middle-income country<\/li>\n<li><b>MOH<\/b>: Ministry of Health<\/li>\n<li><b>MSHP<\/b>: Minist\u00e8re de la Sant\u00e9 et de l\u2019Hygi\u00e8ne Publique<\/li>\n<li><b>OJT<\/b>: on-the-job training<\/li>\n<li><b>OpenELIS<\/b>: Open-source Electronic Laboratory Information System<\/li>\n<li><b>PEPFAR<\/b>: U.S. President's Emergency Fund for AIDS Relief<\/li>\n<li><b>SMS<\/b>: Short Message Service<\/li>\n<li><b>SOCI<\/b>: Stages of Continuous Improvement<\/li>\n<li><b>TAT<\/b>: turnaround time<\/li>\n<li><b>TOT<\/b>: training of trainers<\/li>\n<li><b>TWG<\/b>: technical working group<\/li>\n<li><b>UW<\/b>: University of Washington<\/li><\/ul>\n<h2><span class=\"mw-headline\" id=\"Acknowledgements\">Acknowledgements<\/span><\/h2>\n<p>We thank the C\u00f4te d'Ivoire MSHP and all implementing laboratories for the continuous collaboration. We thank Oliver Defawe, Paul Schwartz, Justin Sogo, Emily DeRiel for their programming and project planning support early in this work. We thank the CDC and our fellow PEPFAR IPs (ACONDA, Ariel Glaser Foundation, Elizabeth Glaser Pediatric AIDS Foundation, ICAP, SEV-CI, and Health Alliance International) for their collaboration in the implementation and optimization of OpenELIS in C\u00f4te d'Ivoire.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Funding\">Funding<\/span><\/h3>\n<p>Funding for this work was provided by the U.S. Health Services and Resources Administration (#6U91HA06801) and CDC (#NU2GGH001968-05-00) awarded to the University of Washington.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Conflict_of_interest\">Conflict of interest<\/span><\/h3>\n<p>The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.\n<\/p>\n<h2><span class=\"mw-headline\" id=\"References\">References<\/span><\/h2>\n<div class=\"reflist references-column-width\" style=\"-moz-column-width: 30em; -webkit-column-width: 30em; column-width: 30em; list-style-type: decimal;\">\n<div class=\"mw-references-wrap mw-references-columns\"><ol class=\"references\">\n<li id=\"cite_note-:0-1\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:0_1-0\">1.0<\/a><\/sup> <sup><a href=\"#cite_ref-:0_1-1\">1.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Wilson, Michael L; Fleming, Kenneth A; Kuti, Modupe A; Looi, Lai Meng; Lago, Nestor; Ru, Kun (1 May 2018). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0140673618304586\" target=\"_blank\">\"Access to pathology and laboratory medicine services: a crucial gap\"<\/a> (in en). <i>The Lancet<\/i> <b>391<\/b> (10133): 1927\u20131938. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2FS0140-6736%2818%2930458-6\" target=\"_blank\">10.1016\/S0140-6736(18)30458-6<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0140673618304586\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0140673618304586<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Access+to+pathology+and+laboratory+medicine+services%3A+a+crucial+gap&rft.jtitle=The+Lancet&rft.aulast=Wilson&rft.aufirst=Michael+L&rft.au=Wilson%2C%26%2332%3BMichael+L&rft.au=Fleming%2C%26%2332%3BKenneth+A&rft.au=Kuti%2C%26%2332%3BModupe+A&rft.au=Looi%2C%26%2332%3BLai+Meng&rft.au=Lago%2C%26%2332%3BNestor&rft.au=Ru%2C%26%2332%3BKun&rft.date=1+May+2018&rft.volume=391&rft.issue=10133&rft.pages=1927%E2%80%931938&rft_id=info:doi\/10.1016%2FS0140-6736%2818%2930458-6&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS0140673618304586&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:4-2\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:4_2-0\">2.0<\/a><\/sup> <sup><a href=\"#cite_ref-:4_2-1\">2.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Sayed, Shahin; Cherniak, William; Lawler, Mark; Tan, Soo Yong; El Sadr, Wafaa; Wolf, Nicholas; Silkensen, Shannon; Brand, Nathan <i>et al.<\/i> (1 May 2018). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0140673618304598\" target=\"_blank\">\"Improving pathology and laboratory medicine in low-income and middle-income countries: roadmap to solutions\"<\/a> (in en). <i>The Lancet<\/i> <b>391<\/b> (10133): 1939\u20131952. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2FS0140-6736%2818%2930459-8\" target=\"_blank\">10.1016\/S0140-6736(18)30459-8<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0140673618304598\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0140673618304598<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Improving+pathology+and+laboratory+medicine+in+low-income+and+middle-income+countries%3A+roadmap+to+solutions&rft.jtitle=The+Lancet&rft.aulast=Sayed&rft.aufirst=Shahin&rft.au=Sayed%2C%26%2332%3BShahin&rft.au=Cherniak%2C%26%2332%3BWilliam&rft.au=Lawler%2C%26%2332%3BMark&rft.au=Tan%2C%26%2332%3BSoo+Yong&rft.au=El+Sadr%2C%26%2332%3BWafaa&rft.au=Wolf%2C%26%2332%3BNicholas&rft.au=Silkensen%2C%26%2332%3BShannon&rft.au=Brand%2C%26%2332%3BNathan&rft.au=Looi%2C%26%2332%3BLai+Meng&rft.date=1+May+2018&rft.volume=391&rft.issue=10133&rft.pages=1939%E2%80%931952&rft_id=info:doi\/10.1016%2FS0140-6736%2818%2930459-8&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS0140673618304598&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-3\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-3\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Al Knawy, Bandar; McKillop, Mollie Marian; Abduljawad, Joud; Tarkoma, Sasu; Adil, Mahmood; Schaper, Louise; Chee, Adam; Bates, David W. <i>et al.<\/i> (23 February 2022). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/jamanetwork.com\/journals\/jamanetworkopen\/fullarticle\/2789277\" target=\"_blank\">\"Successfully Implementing Digital Health to Ensure Future Global Health Security During Pandemics: A Consensus Statement\"<\/a> (in en). <i>JAMA Network Open<\/i> <b>5<\/b> (2): e220214. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1001%2Fjamanetworkopen.2022.0214\" target=\"_blank\">10.1001\/jamanetworkopen.2022.0214<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2574-3805\" target=\"_blank\">2574-3805<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/jamanetwork.com\/journals\/jamanetworkopen\/fullarticle\/2789277\" target=\"_blank\">https:\/\/jamanetwork.com\/journals\/jamanetworkopen\/fullarticle\/2789277<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Successfully+Implementing+Digital+Health+to+Ensure+Future+Global+Health+Security+During+Pandemics%3A+A+Consensus+Statement&rft.jtitle=JAMA+Network+Open&rft.aulast=Al+Knawy&rft.aufirst=Bandar&rft.au=Al+Knawy%2C%26%2332%3BBandar&rft.au=McKillop%2C%26%2332%3BMollie+Marian&rft.au=Abduljawad%2C%26%2332%3BJoud&rft.au=Tarkoma%2C%26%2332%3BSasu&rft.au=Adil%2C%26%2332%3BMahmood&rft.au=Schaper%2C%26%2332%3BLouise&rft.au=Chee%2C%26%2332%3BAdam&rft.au=Bates%2C%26%2332%3BDavid+W.&rft.au=Klag%2C%26%2332%3BMichael&rft.date=23+February+2022&rft.volume=5&rft.issue=2&rft.pages=e220214&rft_id=info:doi\/10.1001%2Fjamanetworkopen.2022.0214&rft.issn=2574-3805&rft_id=https%3A%2F%2Fjamanetwork.com%2Fjournals%2Fjamanetworkopen%2Ffullarticle%2F2789277&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:1-4\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:1_4-0\">4.0<\/a><\/sup> <sup><a href=\"#cite_ref-:1_4-1\">4.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation web\">National Health Laboratory Service (May 2020). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.nhls.ac.za\/wp-content\/uploads\/2020\/05\/NHLS_Annual_Report_2019_Revised_00000004.pdf\" target=\"_blank\">\"National Health Laboratory Service Annual Report 2018\/19\"<\/a> (PDF)<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.nhls.ac.za\/wp-content\/uploads\/2020\/05\/NHLS_Annual_Report_2019_Revised_00000004.pdf\" target=\"_blank\">https:\/\/www.nhls.ac.za\/wp-content\/uploads\/2020\/05\/NHLS_Annual_Report_2019_Revised_00000004.pdf<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 20 February 2021<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=National+Health+Laboratory+Service+Annual+Report+2018%2F19&rft.atitle=&rft.aulast=National+Health+Laboratory+Service&rft.au=National+Health+Laboratory+Service&rft.date=May+2020&rft_id=https%3A%2F%2Fwww.nhls.ac.za%2Fwp-content%2Fuploads%2F2020%2F05%2FNHLS_Annual_Report_2019_Revised_00000004.pdf&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-5\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-5\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Namibia Institute of Pathology Limited (November 2019). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/nip.com.na\/wp-content\/uploads\/2019\/11\/NIP-Annual-Report-2018_updated-6-3.pdf\" target=\"_blank\">\"Namibia Institute of Pathology Limited Annual Report 2017\u201318\"<\/a> (PDF)<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/nip.com.na\/wp-content\/uploads\/2019\/11\/NIP-Annual-Report-2018_updated-6-3.pdf\" target=\"_blank\">https:\/\/nip.com.na\/wp-content\/uploads\/2019\/11\/NIP-Annual-Report-2018_updated-6-3.pdf<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 20 February 2021<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Namibia+Institute+of+Pathology+Limited+Annual+Report+2017%E2%80%9318&rft.atitle=&rft.aulast=Namibia+Institute+of+Pathology+Limited&rft.au=Namibia+Institute+of+Pathology+Limited&rft.date=November+2019&rft_id=https%3A%2F%2Fnip.com.na%2Fwp-content%2Fuploads%2F2019%2F11%2FNIP-Annual-Report-2018_updated-6-3.pdf&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-6\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-6\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Abera, W.S. (June 2013). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/etd.aau.edu.et\/handle\/123456789\/14825\" target=\"_blank\">\"Data Exchnage Interoprability Framework for Laboratory Information System (Lis) and Electronic Health Record (Ehr) of Two Hospitals in Addis Ababa\"<\/a>. Addis Ababa University Libraries<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/etd.aau.edu.et\/handle\/123456789\/14825\" target=\"_blank\">http:\/\/etd.aau.edu.et\/handle\/123456789\/14825<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 20 February 2021<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Data+Exchnage+Interoprability+Framework+for+Laboratory+Information+System+%28Lis%29+and+Electronic+Health+Record+%28Ehr%29+of+Two+Hospitals+in+Addis+Ababa&rft.atitle=&rft.aulast=Abera%2C+W.S.&rft.au=Abera%2C+W.S.&rft.date=June+2013&rft.pub=Addis+Ababa+University+Libraries&rft_id=http%3A%2F%2Fetd.aau.edu.et%2Fhandle%2F123456789%2F14825&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:5-7\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:5_7-0\">7.0<\/a><\/sup> <sup><a href=\"#cite_ref-:5_7-1\">7.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Pyrko, Igor; D\u00f6rfler, Viktor; Eden, Colin (1 April 2017). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/journals.sagepub.com\/doi\/10.1177\/0018726716661040\" target=\"_blank\">\"Thinking together: What makes Communities of Practice work?\"<\/a> (in en). <i>Human Relations<\/i> <b>70<\/b> (4): 389\u2013409. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1177%2F0018726716661040\" target=\"_blank\">10.1177\/0018726716661040<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0018-7267\" target=\"_blank\">0018-7267<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC5305036\/\" target=\"_blank\">PMC5305036<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/28232754\" target=\"_blank\">28232754<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/journals.sagepub.com\/doi\/10.1177\/0018726716661040\" target=\"_blank\">http:\/\/journals.sagepub.com\/doi\/10.1177\/0018726716661040<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Thinking+together%3A+What+makes+Communities+of+Practice+work%3F&rft.jtitle=Human+Relations&rft.aulast=Pyrko&rft.aufirst=Igor&rft.au=Pyrko%2C%26%2332%3BIgor&rft.au=D%C3%B6rfler%2C%26%2332%3BViktor&rft.au=Eden%2C%26%2332%3BColin&rft.date=1+April+2017&rft.volume=70&rft.issue=4&rft.pages=389%E2%80%93409&rft_id=info:doi\/10.1177%2F0018726716661040&rft.issn=0018-7267&rft_id=info:pmc\/PMC5305036&rft_id=info:pmid\/28232754&rft_id=http%3A%2F%2Fjournals.sagepub.com%2Fdoi%2F10.1177%2F0018726716661040&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-8\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-8\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Syzdykova, Assel; Malta, Andr\u00e9; Zolfo, Maria; Diro, Ermias; Oliveira, Jos\u00e9 Luis (13 November 2017). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/medinform.jmir.org\/2017\/4\/e44\/\" target=\"_blank\">\"Open-Source Electronic Health Record Systems for Low-Resource Settings: Systematic Review\"<\/a> (in en). <i>JMIR Medical Informatics<\/i> <b>5<\/b> (4): e44. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.2196%2Fmedinform.8131\" target=\"_blank\">10.2196\/medinform.8131<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2291-9694\" target=\"_blank\">2291-9694<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC5703976\/\" target=\"_blank\">PMC5703976<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/29133283\" target=\"_blank\">29133283<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/medinform.jmir.org\/2017\/4\/e44\/\" target=\"_blank\">http:\/\/medinform.jmir.org\/2017\/4\/e44\/<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Open-Source+Electronic+Health+Record+Systems+for+Low-Resource+Settings%3A+Systematic+Review&rft.jtitle=JMIR+Medical+Informatics&rft.aulast=Syzdykova&rft.aufirst=Assel&rft.au=Syzdykova%2C%26%2332%3BAssel&rft.au=Malta%2C%26%2332%3BAndr%C3%A9&rft.au=Zolfo%2C%26%2332%3BMaria&rft.au=Diro%2C%26%2332%3BErmias&rft.au=Oliveira%2C%26%2332%3BJos%C3%A9+Luis&rft.date=13+November+2017&rft.volume=5&rft.issue=4&rft.pages=e44&rft_id=info:doi\/10.2196%2Fmedinform.8131&rft.issn=2291-9694&rft_id=info:pmc\/PMC5703976&rft_id=info:pmid\/29133283&rft_id=http%3A%2F%2Fmedinform.jmir.org%2F2017%2F4%2Fe44%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-9\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-9\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Flowers, J. (6 April 2021). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/wiki.ohie.org\/display\/SUB\/Open%2bSource%2bLab%2bInformation%2bSystems%2band%2bTools\" target=\"_blank\">\"Open Source Lab Information Systems and Tools\"<\/a>. <i>OpenHIE<\/i><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/wiki.ohie.org\/display\/SUB\/Open%2bSource%2bLab%2bInformation%2bSystems%2band%2bTools\" target=\"_blank\">https:\/\/wiki.ohie.org\/display\/SUB\/Open%2bSource%2bLab%2bInformation%2bSystems%2band%2bTools<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 22 May 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Open+Source+Lab+Information+Systems+and+Tools&rft.atitle=OpenHIE&rft.aulast=Flowers%2C+J.&rft.au=Flowers%2C+J.&rft.date=6+April+2021&rft_id=https%3A%2F%2Fwiki.ohie.org%2Fdisplay%2FSUB%2FOpen%252bSource%252bLab%252bInformation%252bSystems%252band%252bTools&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-10\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-10\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">McKay, Mary M.; Sensoy Bahar, Ozge; Ssewamala, Fred M. (1 January 2020). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0165178119308224\" target=\"_blank\">\"Implementation science in global health settings: Collaborating with governmental & community partners in Uganda\"<\/a> (in en). <i>Psychiatry Research<\/i> <b>283<\/b>: 112585. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.psychres.2019.112585\" target=\"_blank\">10.1016\/j.psychres.2019.112585<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC6954316\/\" target=\"_blank\">PMC6954316<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/31590906\" target=\"_blank\">31590906<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0165178119308224\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0165178119308224<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Implementation+science+in+global+health+settings%3A+Collaborating+with+governmental+%26+community+partners+in+Uganda&rft.jtitle=Psychiatry+Research&rft.aulast=McKay&rft.aufirst=Mary+M.&rft.au=McKay%2C%26%2332%3BMary+M.&rft.au=Sensoy+Bahar%2C%26%2332%3BOzge&rft.au=Ssewamala%2C%26%2332%3BFred+M.&rft.date=1+January+2020&rft.volume=283&rft.pages=112585&rft_id=info:doi\/10.1016%2Fj.psychres.2019.112585&rft_id=info:pmc\/PMC6954316&rft_id=info:pmid\/31590906&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS0165178119308224&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-11\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-11\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Abimbola, Seye; Asthana, Sumegha; Montenegro, Cristian; Guinto, Renzo R.; Jumbam, Desmond Tanko; Louskieter, Lance; Kabubei, Kenneth Munge; Munshi, Shehnaz <i>et al.<\/i> (22 April 2021). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/dx.plos.org\/10.1371\/journal.pmed.1003604\" target=\"_blank\">\"Addressing power asymmetries in global health: Imperatives in the wake of the COVID-19 pandemic\"<\/a> (in en). <i>PLOS Medicine<\/i> <b>18<\/b> (4): e1003604. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1371%2Fjournal.pmed.1003604\" target=\"_blank\">10.1371\/journal.pmed.1003604<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1549-1676\" target=\"_blank\">1549-1676<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC8101997\/\" target=\"_blank\">PMC8101997<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/33886540\" target=\"_blank\">33886540<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/dx.plos.org\/10.1371\/journal.pmed.1003604\" target=\"_blank\">https:\/\/dx.plos.org\/10.1371\/journal.pmed.1003604<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Addressing+power+asymmetries+in+global+health%3A+Imperatives+in+the+wake+of+the+COVID-19+pandemic&rft.jtitle=PLOS+Medicine&rft.aulast=Abimbola&rft.aufirst=Seye&rft.au=Abimbola%2C%26%2332%3BSeye&rft.au=Asthana%2C%26%2332%3BSumegha&rft.au=Montenegro%2C%26%2332%3BCristian&rft.au=Guinto%2C%26%2332%3BRenzo+R.&rft.au=Jumbam%2C%26%2332%3BDesmond+Tanko&rft.au=Louskieter%2C%26%2332%3BLance&rft.au=Kabubei%2C%26%2332%3BKenneth+Munge&rft.au=Munshi%2C%26%2332%3BShehnaz&rft.au=Muraya%2C%26%2332%3BKui&rft.date=22+April+2021&rft.volume=18&rft.issue=4&rft.pages=e1003604&rft_id=info:doi\/10.1371%2Fjournal.pmed.1003604&rft.issn=1549-1676&rft_id=info:pmc\/PMC8101997&rft_id=info:pmid\/33886540&rft_id=https%3A%2F%2Fdx.plos.org%2F10.1371%2Fjournal.pmed.1003604&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:2-12\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:2_12-0\">12.0<\/a><\/sup> <sup><a href=\"#cite_ref-:2_12-1\">12.1<\/a><\/sup> <sup><a href=\"#cite_ref-:2_12-2\">12.2<\/a><\/sup> <sup><a href=\"#cite_ref-:2_12-3\">12.3<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Landgraf, Kenneth M.; Kakkar, Reshma; Meigs, Michelle; Jankauskas, Paul T.; Phan, Thi Thu Huong; Nguyen, Viet Nga; Nguyen, Duy Thai; Duong, Thanh Tung <i>et al.<\/i> (1 September 2016). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1386505616301393\" target=\"_blank\">\"Open-source LIMS in Vietnam: The path toward sustainability and host country ownership\"<\/a> (in en). <i>International Journal of Medical Informatics<\/i> <b>93<\/b>: 92\u2013102. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.ijmedinf.2016.06.010\" target=\"_blank\">10.1016\/j.ijmedinf.2016.06.010<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1386505616301393\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1386505616301393<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Open-source+LIMS+in+Vietnam%3A+The+path+toward+sustainability+and+host+country+ownership&rft.jtitle=International+Journal+of+Medical+Informatics&rft.aulast=Landgraf&rft.aufirst=Kenneth+M.&rft.au=Landgraf%2C%26%2332%3BKenneth+M.&rft.au=Kakkar%2C%26%2332%3BReshma&rft.au=Meigs%2C%26%2332%3BMichelle&rft.au=Jankauskas%2C%26%2332%3BPaul+T.&rft.au=Phan%2C%26%2332%3BThi+Thu+Huong&rft.au=Nguyen%2C%26%2332%3BViet+Nga&rft.au=Nguyen%2C%26%2332%3BDuy+Thai&rft.au=Duong%2C%26%2332%3BThanh+Tung&rft.au=Nguyen%2C%26%2332%3BThi+Hoa&rft.date=1+September+2016&rft.volume=93&rft.pages=92%E2%80%93102&rft_id=info:doi\/10.1016%2Fj.ijmedinf.2016.06.010&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS1386505616301393&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-13\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-13\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation\" id=\"rdp-ebb-CITEREFKaplanMaxwell2005\">Kaplan, Bonnie; Maxwell, Joseph A. (2005), Anderson, James G.; Aydin, Carolyn E., eds., <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/link.springer.com\/10.1007\/0-387-30329-4_2\" target=\"_blank\">\"Qualitative Research Methods for Evaluating Computer Information Systems\"<\/a> (in en), <i>Evaluating the Organizational Impact of Healthcare Information Systems<\/i> (New York: Springer-Verlag): 30\u201355, <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1007%2F0-387-30329-4_2\" target=\"_blank\">10.1007\/0-387-30329-4_2<\/a>, <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-0-387-24558-4<span class=\"printonly\">, <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/link.springer.com\/10.1007\/0-387-30329-4_2\" target=\"_blank\">http:\/\/link.springer.com\/10.1007\/0-387-30329-4_2<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 2023-06-06<\/span><\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Qualitative+Research+Methods+for+Evaluating+Computer+Information+Systems&rft.jtitle=Evaluating+the+Organizational+Impact+of+Healthcare+Information+Systems&rft.aulast=Kaplan&rft.aufirst=Bonnie&rft.au=Kaplan%2C%26%2332%3BBonnie&rft.au=Maxwell%2C%26%2332%3BJoseph+A.&rft.date=2005&rft.pages=30%E2%80%9355&rft.place=New+York&rft.pub=Springer-Verlag&rft_id=info:doi\/10.1007%2F0-387-30329-4_2&rft.isbn=978-0-387-24558-4&rft_id=http%3A%2F%2Flink.springer.com%2F10.1007%2F0-387-30329-4_2&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:3-14\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:3_14-0\">14.0<\/a><\/sup> <sup><a href=\"#cite_ref-:3_14-1\">14.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation web\">MEASURE Evaluation (2019). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.measureevaluation.org\/resources\/publications\/ms-19-158.html\" target=\"_blank\">\"Health Information System Stages of Continuous Improvement Toolkit: User Guide\"<\/a>. <i>MEASURE Evaluation<\/i><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.measureevaluation.org\/resources\/publications\/ms-19-158.html\" target=\"_blank\">https:\/\/www.measureevaluation.org\/resources\/publications\/ms-19-158.html<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 22 May 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Health+Information+System+Stages+of+Continuous+Improvement+Toolkit%3A+User+Guide&rft.atitle=MEASURE+Evaluation&rft.aulast=MEASURE+Evaluation&rft.au=MEASURE+Evaluation&rft.date=2019&rft_id=https%3A%2F%2Fwww.measureevaluation.org%2Fresources%2Fpublications%2Fms-19-158.html&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-15\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-15\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">MEASURE Evaluation (2019). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.measureevaluation.org\/resources\/publications\/ws-19-52.html\" target=\"_blank\">\"Mapping a Path to Improve Uganda\u2019s Health Information System Using the Stages of Continuous Improvement Toolkit\"<\/a>. <i>MEASURE Evaluation<\/i><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.measureevaluation.org\/resources\/publications\/ws-19-52.html\" target=\"_blank\">https:\/\/www.measureevaluation.org\/resources\/publications\/ws-19-52.html<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 22 May 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Mapping+a+Path+to+Improve+Uganda%E2%80%99s+Health+Information+System+Using+the+Stages+of+Continuous+Improvement+Toolkit&rft.atitle=MEASURE+Evaluation&rft.aulast=MEASURE+Evaluation&rft.au=MEASURE+Evaluation&rft.date=2019&rft_id=https%3A%2F%2Fwww.measureevaluation.org%2Fresources%2Fpublications%2Fws-19-52.html&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-16\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-16\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Minist\u00e8re de la Sant\u00e9 Publique (2019). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/web.archive.org\/web\/20220512211831\/https:\/\/www.minsante.cm\/site\/sites\/default\/files\/FR_DOCUMENT_PLAN%20STRATEGIQUE%20NATIONAL%20DE%20SANTE%20NUMERIQUE_R%C3%A9duit.pdf\" target=\"_blank\">\"Plan Strat\u00e9gique National de Sant\u00e9 Num\u00e9rique 2020 - 2024\"<\/a> (PDF). Archived from <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.minsante.cm\/site\/sites\/default\/files\/FR_DOCUMENT_PLAN%20STRATEGIQUE%20NATIONAL%20DE%20SANTE%20NUMERIQUE_R%C3%A9duit.pdf\" target=\"_blank\">the original<\/a> on 12 May 2022<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/web.archive.org\/web\/20220512211831\/https:\/\/www.minsante.cm\/site\/sites\/default\/files\/FR_DOCUMENT_PLAN%20STRATEGIQUE%20NATIONAL%20DE%20SANTE%20NUMERIQUE_R%C3%A9duit.pdf\" target=\"_blank\">https:\/\/web.archive.org\/web\/20220512211831\/https:\/\/www.minsante.cm\/site\/sites\/default\/files\/FR_DOCUMENT_PLAN%20STRATEGIQUE%20NATIONAL%20DE%20SANTE%20NUMERIQUE_R%C3%A9duit.pdf<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 22 May 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Plan+Strat%C3%A9gique+National+de+Sant%C3%A9+Num%C3%A9rique+2020+-+2024&rft.atitle=&rft.aulast=Minist%C3%A8re+de+la+Sant%C3%A9+Publique&rft.au=Minist%C3%A8re+de+la+Sant%C3%A9+Publique&rft.date=2019&rft_id=https%3A%2F%2Fweb.archive.org%2Fweb%2F20220512211831%2Fhttps%3A%2F%2Fwww.minsante.cm%2Fsite%2Fsites%2Fdefault%2Ffiles%2FFR_DOCUMENT_PLAN%2520STRATEGIQUE%2520NATIONAL%2520DE%2520SANTE%2520NUMERIQUE_R%25C3%25A9duit.pdf&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-17\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-17\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Flott, Kelsey; Callahan, Ryan; Darzi, Ara; Mayer, Erik (14 April 2016). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.jmir.org\/2016\/4\/e75\/\" target=\"_blank\">\"A Patient-Centered Framework for Evaluating Digital Maturity of Health Services: A Systematic Review\"<\/a> (in en). <i>Journal of Medical Internet Research<\/i> <b>18<\/b> (4): e75. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.2196%2Fjmir.5047\" target=\"_blank\">10.2196\/jmir.5047<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1438-8871\" target=\"_blank\">1438-8871<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC4850277\/\" target=\"_blank\">PMC4850277<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/27080852\" target=\"_blank\">27080852<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/www.jmir.org\/2016\/4\/e75\/\" target=\"_blank\">http:\/\/www.jmir.org\/2016\/4\/e75\/<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=A+Patient-Centered+Framework+for+Evaluating+Digital+Maturity+of+Health+Services%3A+A+Systematic+Review&rft.jtitle=Journal+of+Medical+Internet+Research&rft.aulast=Flott&rft.aufirst=Kelsey&rft.au=Flott%2C%26%2332%3BKelsey&rft.au=Callahan%2C%26%2332%3BRyan&rft.au=Darzi%2C%26%2332%3BAra&rft.au=Mayer%2C%26%2332%3BErik&rft.date=14+April+2016&rft.volume=18&rft.issue=4&rft.pages=e75&rft_id=info:doi\/10.2196%2Fjmir.5047&rft.issn=1438-8871&rft_id=info:pmc\/PMC4850277&rft_id=info:pmid\/27080852&rft_id=http%3A%2F%2Fwww.jmir.org%2F2016%2F4%2Fe75%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-18\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-18\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Gomes, Jorge; Rom\u00e3o, M\u00e1rio (1 December 2018). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/link.springer.com\/10.1007\/s10916-018-1097-0\" target=\"_blank\">\"Information System Maturity Models in Healthcare\"<\/a> (in en). <i>Journal of Medical Systems<\/i> <b>42<\/b> (12): 235. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1007%2Fs10916-018-1097-0\" target=\"_blank\">10.1007\/s10916-018-1097-0<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0148-5598\" target=\"_blank\">0148-5598<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/link.springer.com\/10.1007\/s10916-018-1097-0\" target=\"_blank\">http:\/\/link.springer.com\/10.1007\/s10916-018-1097-0<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Information+System+Maturity+Models+in+Healthcare&rft.jtitle=Journal+of+Medical+Systems&rft.aulast=Gomes&rft.aufirst=Jorge&rft.au=Gomes%2C%26%2332%3BJorge&rft.au=Rom%C3%A3o%2C%26%2332%3BM%C3%A1rio&rft.date=1+December+2018&rft.volume=42&rft.issue=12&rft.pages=235&rft_id=info:doi\/10.1007%2Fs10916-018-1097-0&rft.issn=0148-5598&rft_id=http%3A%2F%2Flink.springer.com%2F10.1007%2Fs10916-018-1097-0&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-19\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-19\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Carvalho, Jo\u00e3o Vidal; Rocha, \u00c1lvaro; Abreu, Ant\u00f3nio (1 June 2016). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/link.springer.com\/10.1007\/s10916-016-0486-5\" target=\"_blank\">\"Maturity Models of Healthcare Information Systems and Technologies: a Literature Review\"<\/a> (in en). <i>Journal of Medical Systems<\/i> <b>40<\/b> (6): 131. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1007%2Fs10916-016-0486-5\" target=\"_blank\">10.1007\/s10916-016-0486-5<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0148-5598\" target=\"_blank\">0148-5598<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/link.springer.com\/10.1007\/s10916-016-0486-5\" target=\"_blank\">http:\/\/link.springer.com\/10.1007\/s10916-016-0486-5<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Maturity+Models+of+Healthcare+Information+Systems+and+Technologies%3A+a+Literature+Review&rft.jtitle=Journal+of+Medical+Systems&rft.aulast=Carvalho&rft.aufirst=Jo%C3%A3o+Vidal&rft.au=Carvalho%2C%26%2332%3BJo%C3%A3o+Vidal&rft.au=Rocha%2C%26%2332%3B%C3%81lvaro&rft.au=Abreu%2C%26%2332%3BAnt%C3%B3nio&rft.date=1+June+2016&rft.volume=40&rft.issue=6&rft.pages=131&rft_id=info:doi\/10.1007%2Fs10916-016-0486-5&rft.issn=0148-5598&rft_id=http%3A%2F%2Flink.springer.com%2F10.1007%2Fs10916-016-0486-5&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-SHLUIOpenELIS12-20\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-SHLUIOpenELIS12_20-0\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\"><a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.shl.uiowa.edu\/publications\/lablink\/201201\/openelis.xml\" target=\"_blank\">\"OpenELIS comes home\"<\/a>. <i>Lab Link<\/i> (State Hygienic Laboratory at The University of Iowa) <b>4<\/b> (1). January 2012<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/www.shl.uiowa.edu\/publications\/lablink\/201201\/openelis.xml\" target=\"_blank\">http:\/\/www.shl.uiowa.edu\/publications\/lablink\/201201\/openelis.xml<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=OpenELIS+comes+home&rft.jtitle=Lab+Link&rft.date=January+2012&rft.volume=4&rft.issue=1&rft.pub=State+Hygienic+Laboratory+at+The+University+of+Iowa&rft_id=http%3A%2F%2Fwww.shl.uiowa.edu%2Fpublications%2Flablink%2F201201%2Fopenelis.xml&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-21\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-21\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/openmrs.org\/\" target=\"_blank\">\"OpenMRS\"<\/a>. OpenMRS Community<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/openmrs.org\/\" target=\"_blank\">https:\/\/openmrs.org\/<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 22 May 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=OpenMRS&rft.atitle=&rft.pub=OpenMRS+Community&rft_id=https%3A%2F%2Fopenmrs.org%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-22\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-22\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Dings\u00f8yr, Torgeir; Nerur, Sridhar; Balijepally, VenuGopal; Moe, Nils Brede (1 June 2012). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0164121212000532\" target=\"_blank\">\"A decade of agile methodologies: Towards explaining agile software development\"<\/a> (in en). <i>Journal of Systems and Software<\/i> <b>85<\/b> (6): 1213\u20131221. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.jss.2012.02.033\" target=\"_blank\">10.1016\/j.jss.2012.02.033<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0164121212000532\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0164121212000532<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=A+decade+of+agile+methodologies%3A+Towards+explaining+agile+software+development&rft.jtitle=Journal+of+Systems+and+Software&rft.aulast=Dings%C3%B8yr&rft.aufirst=Torgeir&rft.au=Dings%C3%B8yr%2C%26%2332%3BTorgeir&rft.au=Nerur%2C%26%2332%3BSridhar&rft.au=Balijepally%2C%26%2332%3BVenuGopal&rft.au=Moe%2C%26%2332%3BNils+Brede&rft.date=1+June+2012&rft.volume=85&rft.issue=6&rft.pages=1213%E2%80%931221&rft_id=info:doi\/10.1016%2Fj.jss.2012.02.033&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS0164121212000532&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-23\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-23\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Liams-Hauser,C. (10 December 2014). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/openelis-global.org\/tools\/roadmap\/\" target=\"_blank\">\"Software Release Roadmap\"<\/a>. <i>OpenELIS Global<\/i><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/openelis-global.org\/tools\/roadmap\/\" target=\"_blank\">https:\/\/openelis-global.org\/tools\/roadmap\/<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 22 May 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Software+Release+Roadmap&rft.atitle=OpenELIS+Global&rft.aulast=Liams-Hauser%2CC.&rft.au=Liams-Hauser%2CC.&rft.date=10+December+2014&rft_id=https%3A%2F%2Fopenelis-global.org%2Ftools%2Froadmap%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-24\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-24\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">C\u00f4te d\u2019Ivoire Minist\u00e8re de la Sant\u00e9 et de l\u2019Hygi\u00e8ne Publique (2019). \"Plan Strat\u00e9gique National Pour Le D\u00e9veloppement Des Laboratoires de Biologie M\u00e9dicale 2017-2020\".<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Plan+Strat%C3%A9gique+National+Pour+Le+D%C3%A9veloppement+Des+Laboratoires+de+Biologie+M%C3%A9dicale+2017-2020&rft.atitle=&rft.aulast=C%C3%B4te+d%E2%80%99Ivoire+Minist%C3%A8re+de+la+Sant%C3%A9+et+de+l%E2%80%99Hygi%C3%A8ne+Publique&rft.au=C%C3%B4te+d%E2%80%99Ivoire+Minist%C3%A8re+de+la+Sant%C3%A9+et+de+l%E2%80%99Hygi%C3%A8ne+Publique&rft.date=2019&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-25\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-25\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Kirk, Mary; Assoa, Paul H.; Iiams-Hauser, Casey; Kouabenan, Yves-Rolland; Antilla, Jennifer; Steele-Lane, Caleb; Rossum, Greg; Komena, Pascal <i>et al.<\/i> (17 May 2021). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ajlmonline.org\/index.php\/AJLM\/article\/view\/1284\" target=\"_blank\">\"Adaptation of an electronic dashboard to monitor HIV viral load testing in C\u00f4te d\u2019Ivoire\"<\/a> (in en). <i>African Journal of Laboratory Medicine<\/i> <b>10<\/b> (1). <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.4102%2Fajlm.v10i1.1284\" target=\"_blank\">10.4102\/ajlm.v10i1.1284<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2225-2010\" target=\"_blank\">2225-2010<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC8182557\/\" target=\"_blank\">PMC8182557<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/34192117\" target=\"_blank\">34192117<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/www.ajlmonline.org\/index.php\/AJLM\/article\/view\/1284\" target=\"_blank\">http:\/\/www.ajlmonline.org\/index.php\/AJLM\/article\/view\/1284<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Adaptation+of+an+electronic+dashboard+to+monitor+HIV+viral+load+testing+in+C%C3%B4te+d%E2%80%99Ivoire&rft.jtitle=African+Journal+of+Laboratory+Medicine&rft.aulast=Kirk&rft.aufirst=Mary&rft.au=Kirk%2C%26%2332%3BMary&rft.au=Assoa%2C%26%2332%3BPaul+H.&rft.au=Iiams-Hauser%2C%26%2332%3BCasey&rft.au=Kouabenan%2C%26%2332%3BYves-Rolland&rft.au=Antilla%2C%26%2332%3BJennifer&rft.au=Steele-Lane%2C%26%2332%3BCaleb&rft.au=Rossum%2C%26%2332%3BGreg&rft.au=Komena%2C%26%2332%3BPascal&rft.au=Ngatchou%2C%26%2332%3BPatricia+Sadate&rft.date=17+May+2021&rft.volume=10&rft.issue=1&rft_id=info:doi\/10.4102%2Fajlm.v10i1.1284&rft.issn=2225-2010&rft_id=info:pmc\/PMC8182557&rft_id=info:pmid\/34192117&rft_id=http%3A%2F%2Fwww.ajlmonline.org%2Findex.php%2FAJLM%2Farticle%2Fview%2F1284&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-26\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-26\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Blaya, Joaqu\u00edn A.; Shin, Sonya S.; Yagui, Martin; Contreras, Carmen; Cegielski, Peter; Yale, Gloria; Suarez, Carmen; Asencios, Luis <i>et al.<\/i> (10 April 2014). Pai, Madhukar. ed. <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/dx.plos.org\/10.1371\/journal.pone.0090110\" target=\"_blank\">\"Reducing Communication Delays and Improving Quality of Care with a Tuberculosis Laboratory Information System in Resource Poor Environments: A Cluster Randomized Controlled Trial\"<\/a> (in en). <i>PLoS ONE<\/i> <b>9<\/b> (4): e90110. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1371%2Fjournal.pone.0090110\" target=\"_blank\">10.1371\/journal.pone.0090110<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1932-6203\" target=\"_blank\">1932-6203<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC3982951\/\" target=\"_blank\">PMC3982951<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/24721980\" target=\"_blank\">24721980<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/dx.plos.org\/10.1371\/journal.pone.0090110\" target=\"_blank\">https:\/\/dx.plos.org\/10.1371\/journal.pone.0090110<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Reducing+Communication+Delays+and+Improving+Quality+of+Care+with+a+Tuberculosis+Laboratory+Information+System+in+Resource+Poor+Environments%3A+A+Cluster+Randomized+Controlled+Trial&rft.jtitle=PLoS+ONE&rft.aulast=Blaya&rft.aufirst=Joaqu%C3%ADn+A.&rft.au=Blaya%2C%26%2332%3BJoaqu%C3%ADn+A.&rft.au=Shin%2C%26%2332%3BSonya+S.&rft.au=Yagui%2C%26%2332%3BMartin&rft.au=Contreras%2C%26%2332%3BCarmen&rft.au=Cegielski%2C%26%2332%3BPeter&rft.au=Yale%2C%26%2332%3BGloria&rft.au=Suarez%2C%26%2332%3BCarmen&rft.au=Asencios%2C%26%2332%3BLuis&
