{"ID":108315,"post_author":"9412100","post_date":"2023-06-30 11:20:47","post_date_gmt":"0000-00-00 00:00:00","post_content":"","post_title":"LIMSjournal - Summer 2023","post_excerpt":"","post_status":"draft","comment_status":"closed","ping_status":"closed","post_password":"","post_name":"","to_ping":"","pinged":"","post_modified":"2023-06-30 11:20:47","post_modified_gmt":"2023-06-30 15:20:47","post_content_filtered":"","post_parent":0,"guid":"https:\/\/www.limsforum.com\/?post_type=ebook&p=108315","menu_order":0,"post_type":"ebook","post_mime_type":"","comment_count":"0","filter":"","holland":null,"_ebook_metadata":{"enabled":"on","private":"0","guid":"B61E43B6-B311-4E69-AC22-4E7D53D6F9E6","title":"LIMSjournal - Summer 2023","subtitle":"Volume 9, Issue 2","cover_theme":"nico_21","cover_image":"https:\/\/www.limsforum.com\/wp-content\/plugins\/rdp-ebook-builder\/pl\/cover.php?cover_style=nico_21&subtitle=Volume+9%2C+Issue+2&editor=Shawn+Douglas&title=LIMSjournal+-+Summer+2023&title_image=https%3A%2F%2Fs3.limswiki.org%2Fwww.limswiki.org%2Fimages%2F8%2F86%2FFig1_Gonzales_PLOSComBio22_18-8.png&publisher=LabLynx+Press","editor":"Shawn Douglas","publisher":"LabLynx Press","author_id":"26","image_url":"","items":{"09a05cec486b0e795821acfbb792b350_type":"article","09a05cec486b0e795821acfbb792b350_title":"Development and national scale implementation of an open-source electronic laboratory information system (OpenELIS) in C\u00f4te d\u2019Ivoire: Sustainability lessons from the first 13 years (He et al. 2023)","09a05cec486b0e795821acfbb792b350_url":"https:\/\/www.limswiki.org\/index.php\/Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years","09a05cec486b0e795821acfbb792b350_plaintext":"\n\nJournal:Development and national scale implementation of an open-source electronic laboratory information system (OpenELIS) in C\u00f4te d\u2019Ivoire: Sustainability lessons from the first 13 yearsFrom LIMSWikiJump to navigationJump to searchFull article title\n \nDevelopment and national scale implementation of an open-source electronic laboratory information system (OpenELIS) in C\u00f4te d\u2019Ivoire: Sustainability lessons from the first 13 yearsJournal\n \nInternational Journal of Medical InformaticsAuthor(s)\n \nHe, Yao; Liams-Hauser, Casey; Assoa, Paul H.; Kouabenan, Yves-Rolland; Komena, Pascal; Pongathie, Adama; Kouakou, Alain; Kirn, Mary; Antilla, Jennifer; Rogosin, Carli; Ngatchou, Patricia S.; Kohemun, Natacha; Koffi, Jean B.; Flowers, Jan; Abiola, Nadine; Adj\u00e9-Tour\u00e9, Christiane; Puttkammer, Nancy; Perrone, Luca A.Author affiliation(s)\n \nUniversity of Washington, I-TECH C\u00f4te d\u2019Ivoire, Ministry of Health and Public Hygiene, U.S. Centers for Disease Control and PreventionPrimary contact\n \nlucy dot perrone at ubc dot caYear published\n \n2023Volume and issue\n \n170Article #\n \n104977DOI\n \n10.1016\/j.ijmedinf.2022.104977ISSN\n \n1872-8243Distribution license\n \nCreative Commons Attribution-NonCommercial-NoDerivatives 4.0 InternationalWebsite\n \nhttps:\/\/www.sciencedirect.com\/science\/article\/pii\/S138650562200291XDownload\n \nhttps:\/\/www.sciencedirect.com\/science\/article\/pii\/S138650562200291X\/pdfft\n\nContents \n\n1 Abstract \n2 Introduction \n3 Materials and methods \n4 Results \n\n4.1 Design and development \n4.2 Deploy, scale-up, and support \n4.3 Strengthening local leadership and ownership \n4.4 Building local capacity \n4.5 Supporting data-driven decision-making in HIV\/AIDS \n4.6 Networking, interoperability between systems, and expansion \n\n\n5 Discussion \n\n5.1 Open-source design and CoPs-supported software adoption, implementation, sustainability, and innovation \n5.2 Collaboration, capacity building, and local ownership are the key to sustainable implementation \n5.3 Limitations \n\n\n6 Conclusions \n7 Abbreviations, acronyms, and initialisms \n8 Acknowledgements \n\n8.1 Funding \n8.2 Conflict of interest \n\n\n9 References \n10 Notes \n\n\n\nAbstract \nPurpose: C\u00f4te d'Ivoire has a tiered public health laboratory system of nine reference laboratories, 77 laboratories at regional and general hospitals, and 100 laboratories among 1,486 district health centers. Prior to 2009, nearly all of these laboratories used paper registers and reports to collect and report laboratory data to clinicians and national disease monitoring programs.\nProject: Since 2009 the Ministry of Health (MOH) in C\u00f4te d'Ivoire has sought to implement a comprehensive set of activities aimed at strengthening the laboratory system. One of these activities is the sustainable development, expansion, and technical support of an open-source electronic laboratory information system (LIS) called OpenELIS, with the long-term goal of Ivorian technical support and managerial sustainment of the system. This project has addressed the need for a comprehensive, customizable, low- to no-cost, open-source LIS to serve the public health systems, with initial attention to HIV clients and later expansion to cover the general population. This descriptive case study presents the first published summary of original work which has been ongoing since 2009 in C\u00f4te d\u2019Ivoire to transform the information management systems and processes in laboratories nationally.\nImpact: OpenELIS is now in use at 106 laboratories across C\u00f4te d\u2019Ivoire. This article describes the iterative planning, design, and implementation process of OpenELIS in C\u00f4te d'Ivoire, and the evolving leadership, ownership, and capacity of the Ivorian MOH in sustaining the system. This original work synthesizes lessons learned from this 13-year experience towards strengthening LISs in other low-resource settings.\nHighlights of this work:\r\n\n\nFactors for scaling and sustaining an electronic LIS (eLIS) in low- and middle-income countries (LMICs) have not been previously described in the literature.\nSuccessful adoption, scaling, and sustainment of OpenELIS in C\u00f4te d'Ivoire relied on early collaboration with partners, regulatory agencies, and technical experts into every step of the design, implementation, and evaluation phases.\nEntities planning to nationally scale an eLIS should plan for 1) workforce development in both end users and system administrators; 2) financial sustainability; and 3) institutionalization of government ownership and technical leadership.\nAn open-source eLIS can increase accuracy and timeliness of clinical laboratory data, supporting diagnostic testing and monitoring in a resource-limited setting such as Cote d\u2019Ivoire.\nKeywords: electronic information systems, laboratory information systems, quality, low-resource country\n\nIntroduction \nIn low- and middle-income countries (LMICs), inadequate infrastructure\u2014including limited availability and use of electronic laboratory information systems (LISs)\u2014has hindered quality laboratory service delivery for communities.[1] International development efforts such as the U.S. President's Emergency Fund for AIDS Relief (PEPFAR) have aimed to strengthen national laboratory systems by modernizing infrastructure and diagnostic testing methods, including automated analyzers that require computer connectivity for data management. The increase in the quantity and complexity of data generated from high-throughput analyzers and sophisticated diagnostics necessitates the transition from paper records to LIS.\nCompared to paper-based systems, LIS are more efficient and enable better quality control (QC) in collecting, processing, managing, synthesizing, and reporting large amounts of data (Table 1).[1][2] The COVID-19 pandemic has highlighted the acute importance of digital health, including LIS, in providing data and enabling rapid data exchange and sharing to facilitate public health surveillance and data-driven decision-making.[3]\n\n\n\n\n\n\n\nTable 1. Strengths of laboratory information systems (LISs) compared to paper-based processes.\n\n\nLab aspect\n\nLIS feature(s)\n\nActions\n\nImpact\n\n\nReception\n\nBatch entry; referral workflows\n\nAccelerate the processing and recording of incoming work\n\nReduce turnaround time (TAT)\n\n\nResults generation\n\nWork plans\n\nHelp managers monitor workload and supply management\n\nEnsure efficient operation of laboratories\n\n\nAnalyzer interfaces\n\nRelay results quickly and accurately\n\nReduce TAT\n\n\nReporting\n\nInterface with electronic medical record (EMR)\n\nCommunicate client laboratory history rapidly to clinicians in referral networks\n\nEnable faster clinical decision-making regarding diagnosis, treatment, and prognosis; reduce TAT\n\n\nInterface with client notification systems via Short Message Service (SMS) or email\n\nCommunicate test results to clients rapidly\n\nPrompt immediate behavior augmentation and achieve better health outcomes (e.g., initiate self-quarantine in the case of COVID-19).\n\n\nInterface with routine health information systems at the district, regional, and national levels\n\nEnable faster aggregate data reporting\n\nFacilitate data-driven policy making; reduce TAT\n\n\nReports of quality indicators such as turnaround time\n\nHelp managers monitor quality performance\n\nFacilitate continuous quality improvement; increase testing quality\n\n\nOverarching\n\nGraphic widgets (e.g., drop-down menus, checkboxes), active logic and value checks, flags and reminders for potential issues, and automation\n\nReduce errors\n\nFacilitate quality control; increase testing quality\n\n\nData storage and data query tools\n\nAllow secure, long-term data retainment and easy data retrieval based on specific needs\n\nImprove client privacy, long-term data availability, and data usage\n\n\n\nHowever, LIS uptake and routine usage in LMICs remains low due to several barriers. LIS ownership, development, and maintenance can be perceived as bearing high costs of financial and human resources. Numerous proprietary LIS exist but may not be ideally suited for LMICs, where financial resources are limited and, most often, ongoing software support relies on long-term service contracts with private companies. Although some LMICs have implemented proprietary systems[4][5][6], these systems are vulnerable to market changes and can leave users unsupported if a company suspends its operations or modifies its service terms. Health information systems (HIS), including LIS, that use open-source code and are supported by communities of practice (CoPs) offer an attractive alternative in LMICs. Open-source CoPs have a vested interest in capacity building of software developers and users, including those from LMICs.[7] Implementation time and effort aside, there are no licensing fees, and all software code created is in public ownership, which enables others to customize and improve functionality.[8] Several open-source LISs are currently in use in LMICs in Africa and Asia, with varied scale.[9]\nAnother barrier to sustained, wide-scale usage of LIS is that LIS initiatives are often international-donor-driven and may lack close collaborations with ministries of health (MOHs) in LMICs. Engaging the MOH in the initial design and feature prioritization stage, building local capacity to own and maintain the software, and securing resource commitment after phase-out of donor support are time- and labor-intensive.[10] Additionally, power asymmetries between donors and LMIC stakeholders may discount local priorities, requirements, and innovations.[11] However, successful experiences of implementing an LIS in LMICs at the national scale have shown that strengthening MOH leadership and cultivating mutually beneficial partnerships are essential to impactful and sustainable laboratory system strengthening.[4][12]\nSince 2009, the University of Washington\u2019s (UW) International Training and Education Center for Health (I-TECH) has worked in partnership with the C\u00f4te d'Ivoire Ministry of Health and Public Hygiene (Minist\u00e8re de la Sant\u00e9 et de l\u2019Hygi\u00e8ne Publique, or MSHP) to implement a comprehensive set of activities aimed at strengthening the laboratory system. PEPFAR and the U.S. Centers for Disease Control and Prevention (CDC) have funded the partnership. One of the key activities is the sustainable development, expansion, and technical support of an open-source enterprise-level LIS, the OpenELIS system, with the long-term goal of Ivorian technical support and managerial sustainment of the system. The software serves as both an effective laboratory information management solution and a business operations framework for the laboratory service units (Fig. 1). The collaboration has addressed the need for a comprehensive, customizable, low- to no-cost, open-source LIS to serve the public health systems, with initial attention to HIV clients and later expansion to cover the general population.\n\r\n\n\n\n\n\n\n\n\n\n\nFigure 1. OpenELIS laboratory software solution and business process framework. (Color should be used in print).\n\n\n\nC\u00f4te d'Ivoire has a tiered public health laboratory system of nine reference laboratories, 77 laboratories at regional and general hospitals, and 100 laboratories among 1,486 district health centers. Prior to 2009, most laboratories used paper registers and reports to collect and report laboratory data to clinicians and national disease monitoring programs. The only LIS was a bespoke database located at the national HIV reference laboratory (called rETRO-CI), and this system was paired with commercial software.\nThe objectives of this case study are to: 1) present the iterative implementation process of OpenELIS in C\u00f4te d'Ivoire; 2) describe the evolving leadership, ownership, and capacity of the C\u00f4te d'Ivoire MSHP in sustaining routine use of OpenELIS; and 3) synthesize lessons learned for strengthening LIS in other LMICs.\n\nMaterials and methods \nWe used qualitative methods in this case study to describe the implementation and collaboration around OpenELIS and its supporting activities.[12][13] We reviewed monthly and annual project reports from the implementers; activity and trip reports from technical experts, as well as from government and donor representatives; and software development roadmap and technical documentation from 2009 to 2020. This project was determined to be non-research by the University of Washington and has been approved by C\u00f4te d'Ivoire Comit\u00e9 National d'Ethique des Sciences de la Vie et de la Sant\u00e9 (CNESVS, Ivorian Institutional Review Board; reference number 006\u201321\/MSHP\/CNESVS-km) and the U.S. CDC.\nInformation abstracted from the project documents was initially summarized in chronological order and later coded deductively and inductively. Next, we coded the summaries deductively using the components of the Stages of Continuous Improvement (SOCI) Framework for Health Information Systems.[14] The SOCI Framework has previously been used in Uganda and Cameroon to assess the maturity of digital health tools.[14][15][16] In addition to deductive codes, we also created new codes inductively where the SOCI Framework did not apply. Inductive codes captured the different steps of OpenELIS implementation and evolving collaboration among stakeholders. When coding was complete, codes and their corresponding excerpts from the summaries were organized into themes. YH coded the summaries. The other co-authors reviewed and verified the coding and analysis to ensure accuracy. The coding and thematic analysis took place in ATLAS.ti 8 Windows.\nTo ensure that LIS implementation translates into high-quality health services and population health benefits[17], it is important to monitor how data systems mature over time. As such, the SOCI Framework outlines 13 components and 39 subcomponents within five domains, i.e., HIS leadership and governance, management and workforce, infrastructure, standards and interoperability, and data quality and use.[18][19]\n\nResults \nDesign and development \nOpenELIS was initially designed and implemented by a group of six U.S. state public health laboratories.[20] Its implementation in global health began as part of a collaborative effort between the U.S. CDC and the Government of Vietnam to strengthen HIV service delivery and laboratory systems in 2005.[12] As part of the open-source medical record system (OpenMRS) consortium of partners[21], UW I-TECH received the OpenELIS source code and joined the development of the OpenELIS codebase in 2009.\nAn agile software design and development methodology was adopted by UW I-TECH for OpenELIS to enable an inclusive, iterative approach to software creation together with the local stakeholders in C\u00f4te d'Ivoire.[22] Since its introduction and adaptation in C\u00f4te d'Ivoire in 2009, OpenELIS has evolved through multiple iterations of improving functionality and flexibility, and through new releases twice per year. The first versions of OpenELIS were limited in scope and focused primarily on HIV care. They provided pre-defined forms and reports for common HIV-related tests such as early infant diagnosis of HIV (EID), CD4 counts, and HIV genotyping.\nIn 2011, UW I-TECH merged all versions of OpenELIS for different laboratories into one core, i.e., OpenELIS Global 1.4, greatly reducing the burden of maintenance and update. Before 2011, we created a customized copy of OpenELIS for each laboratory. This approach was manageable when OpenELIS was implemented in four national laboratories in C\u00f4te d'Ivoire and Haiti. However, as OpenELIS expanded to new laboratories, the time burden of maintaining and updating the software across different versions became excessive. The shift to a common code base shortened the software testing cycle for each new version from approximately 200 hours to 40 hours and permitted a more thorough software testing process and a higher-quality final release.\nThe core software improvements also enabled greater customizability and made it possible for a lab to install and configure OpenELIS without engaging a software developer to customize elements. We added test catalog management features, allowing laboratories to modify catalogs between version releases. Laboratories could make changes to existing tests or add new tests or panels without a software developer adding them manually to the system. New analyzer interfaces were added so that laboratories could import data from analyzers beyond those related to HIV. The core software could be deployed without impacting previous local customizations and further adapted to any setting without code re-write or maintenance. This allowed for countries and laboratories to have more control over what features to include in the software.\nIn 2018, UW I-TECH began an extensive review of the OpenELIS application and identified where the older technology had become obsolete and presented data security risks. OpenELIS Global 2.0, completed in 2019, upgraded the core framework to mitigate security risks (Table 2).\n\n\n\n\n\n\n\nTable 2. Open-source components in OpenELIS. HL7 = Health Level 7; FHIR = Fast Healthcare Interoperability Resources; ASTM = American Society of Testing and Materials\n\n\nComponent\n\nOpenELIS Global 1.X series\n\nOpenELIS Global 2.X series\n\n\nTimeframe\n\nBefore 2011\n\nAfter 2011\n\n\nOperating system\n\nUbuntu 12\n\nUbuntu 20\n\n\nProgramming framework\n\nJava Struts 1\n\nJava Spring\n\n\nWeb application\n\nTomcat\n\nTomcat\n\n\nDatabase\n\nPostgreSQL\n\nPostgreSQL\n\n\nInteroperability\n\nMirth, HL7 2.5.1\n\nFHIR R4, HL7 2.5.1, ASTM\n\n\nCustomization\n\nHard-coded multiple forks by developers for each use case\n\nCore software with flexible customization by users\n\n\n\nMany expansions and improvements in later iterations of OpenELIS stemmed from close collaboration between UW I-TECH and the multi-stakeholder OpenELIS technical working group (TWG) in C\u00f4te d'Ivoire, convened in 2015. The TWG consists of representatives from the MSHP, I-TECH C\u00f4te d'Ivoire, PEPFAR's NGO implementing partners (IPs), and the CDC. UW I-TECH and the design team within the TWG would lead design workshops that start with needs gathering at regional and district hospitals and laboratories using a standardized questionnaire. After reconvening, group members would share the findings on identified needs and gaps in LIS functionality and reporting, prioritizing design features, adding the designs to the roadmap[23], and writing software specifications.\nThe software development process followed a similar collaborative trajectory as the design process. Before 2014, UW I-TECH conducted all software development, mostly by one senior software developer and joined later by a second developer. All reports, enhancements, and changes relied on the two developers and was dependent on the next release. Starting in 2015, UW I-TECH has provided software development training in C\u00f4te d'Ivoire and created a more collaborative workflow with Ivorian developers so that both design and development have become more localized.\n\n Deploy, scale-up, and support \nOpenELIS deployment and scale-up took place in several stages since 2009 (Table 3), and the respective roles of the MSHP and I-TECH in the process evolved over time. Before 2015, I-TECH led the deployment process. The deployment at a laboratory began with a team of I-TECH staff from C\u00f4te d'Ivoire and Seattle conducting an initial laboratory assessment. Then, during a second visit, the team deployed a customized version. By the end of 2015, OpenELIS had been deployed at 11 laboratories, covering the entire network of laboratories performing viral load testing at the time (Fig. 2).\n\n\n\n\n\n\n\nTable 3. Timeline of the OpenELIS scale-up in C\u00f4te d'Ivoire.\n\n\nYear\n\nNumber of laboratories implementing OpenELIS\n\n\nNew\n\nCumulative\n\n\n2009\u20132012\n\n3\n\n3\n\n\n2013\u20132015\n\n8\n\n11\n\n\n2016\n\n1\n\n12\n\n\n2017\n\n31\n\n43\n\n\n2018\n\n12\n\n55\n\n\n2019\n\n13\n\n68\n\n\n2020\n\n28\n\n93\n\n\n2021\n\n15\n\n111\n\n\n\n\r\n\n\n\n\n\n\n\n\n\n\nFigure 2. Laboratories in C\u00f4te d'Ivoire that implement OpenELIS before and after 2015. (Color should be used in print).\n\n\n\nIn 2015, after the MSHP defined and ratified LIS requirements, they determined that OpenELIS satisfied most of these requirements and would be the system deployed at laboratories throughout the country. The MSHP became the owner of OpenELIS in C\u00f4te d'Ivoire and started collaborating with I-TECH closely in deployment to roll out OpenELIS. The scale-up first prioritized regional referral laboratories that newly started providing viral load testing as part of a MSHP- and CDC-led initiative to scale-up viral load testing. OpenELIS was then deployed in hospitals at the district and local level to support their collection and management of data on routine laboratory testing for both HIV and non-HIV clients. As of 2021, 111 laboratories in C\u00f4te d'Ivoire had implemented OpenELIS (Fig. 2). OpenELIS currently supports testing of hematology, biochemistry, molecular biology, serology, and testing of microbiology, pathology, and immunohistochemistry will be available in January 2023.\nThe collaborative deployment and scale-up process started with a series of deployment workshops with relevant stakeholders from the OpenELIS TWG in 2015. Participants received hands-on training on setting up servers and workstations, conducting maintenance and updates, and troubleshooting. During the deployment wave each year, starting from 2015, a team of MSHP implementation, I-TECH C\u00f4te d'Ivoire staff, and IP representatives would organize a week-long implementation trip to deploy the software and perform the initial training of laboratory staff. The team would follow up with the laboratories by phone weekly and conduct a coaching and review visit pne to three months after the deployment and training.\nStarting in 2020, the MSHP began leading the deployment process with minimal support from I-TECH. The MSHP team conducts all follow-up visits, and the training is facilitated by MSHP trainers with co-facilitation by I-TECH C\u00f4te d\u2019Ivoire. The MSHP also independently operates the OpenELIS Technical Assistance Unit (Cellule d'Assistance Technique de OpenELIS, or CATOE), the technical support call center for OpenELIS. Established in 2016 within the MSHP, CATOE provides direct, real-time technical support to OpenELIS users. CATOE technicians hold bidirectional call services with laboratories to conduct monthly check-ins that proactively probe for issues and to respond to technical assistance requests. CATOE consists of four MSHP staff members who were recruited from the participants of the first OpenELIS implementers' workshop in 2015. The technicians received targeted training on providing real-time support, equipment, phone credits, and a six-month mentorship with the primary support and development staff at I-TECH. CATOE meets monthly with the OpenELIS TWG to review activities and findings from the support calls, feeding information into the software roadmap.\n\nStrengthening local leadership and ownership \nThe C\u00f4te d'Ivoire MSHP started collaborating with I-TECH in OpenELIS implementation more actively in 2015. The MSHP initiated a reorganization process in 2014 that spurred the creation of the Department of Informatics and Health Information (Direction de l'Informatique et de l'Information Sanitaire, or DIIS) in 2015 to consolidate and coordinate health informatics activities in the country. This designation signaled a leadership commitment to ownership of HIS development, implementation, and management activities nationally. In 2017 the MSHP incorporated the designation of OpenELIS and its scale-up in the National Strategic Plan for the Development of Medical Biology Laboratories 2017\u20132020.[24]\nThe continuous strengthening of MSHP leadership demonstrates comprehensive ownership of not only the software and hardware but also the essential knowledge, skills, and processes to sustain routine OpenELIS implementation. Before 2015, the MSHP was only involved in site selection for OpenELIS. After the formation of DIIS, the MSHP joined I-TECH throughout the implementation process from forming the TWG, gathering needs, and training developers and technicians to deploying the software and providing technical support. By 2020, the DIIS was conducting follow-up visits and operating CATOE independently, leading the deployment process, configuration of servers, and training of new and existing users.\n\nBuilding local capacity \nIn addition to providing the software and hardware and strengthening local leadership, building local capacity for implementing OpenELIS in C\u00f4te d'Ivoire is also critical. Training on various topics along the software development pipeline and in various formats has equipped Ivorian policymakers and technicians with necessary knowledge and skills for routine OpenELIS implementation and maintenance.\nBefore 2015, UW I-TECH staff initially provided on-the-job training (OJT) on OpenELIS deployment and upgrade to selected staff at the MSHP, national laboratories, and IPs. In 2014, a targeted month-long training on OpenELIS development took place in Seattle for software developers with background in Java from the MSHP, Institut Pasteur C\u00f4te d'Ivoire, Institut National Polytechnique F\u00e9lix Houphou\u00ebt-Boigny (INPHB; a public polytechnic institute of higher education), and I-TECH C\u00f4te d'Ivoire. After participants returned to C\u00f4te d'Ivoire, UW I-TECH staff provided remote mentoring and exercises. While the results of the OJT and targeted training were promising, the time and resources for replicating these formats became unsustainably high as the OpenELIS scale-up started in 2015.\nIn response, UW I-TECH started collaborating with the MSHP in 2015 to develop a full suite of materials for OpenELIS, including a package for trainers and users, and to lead a series of training of trainers (TOT) sessions within C\u00f4te d'Ivoire. The week-long TOTs used theoretical and practical activities and took a holistic technical approach covering a range of topics from design, planning, development, and programming to implementation and support. Among the participants at the first TOT, one became the deputy director of DIIS, and most joined the OpenELIS TWG. The TOT participants later conducted cascade training led by the MSHP during the OpenELIS scale-up. Cascade training participants provided largely positive ratings, appreciating the theoretical and practical exercises. The TOTs and cascade trainings have been an integral part of the deployment and scale-up process since 2015, and they have formed a cadre of trained teams in C\u00f4te d'Ivoire to ensure sustainable OpenELIS deployment and support.\nThe collaboration between I-TECH and INPHB incorporated OpenELIS into the computer science curriculum and started the OpenELIS internship at INPHB. In 2016, two INPHB faculty received training on OpenELIS software development from UW I-TECH, and they started using OpenELIS as an example LIS to teach students in computer science. In 2018, the OpenELIS internship program started with three students studying at INPHB and working with I-TECH C\u00f4te d'Ivoire simultaneously to practice OpenELIS software development, deployment, and technical support. The training program and assessment process became standardized in 2019, and two interns per year embedded with I-TECH or MSHP teams for one year. Ten interns have graduated from the program, and one was eventually hired as I-TECH C\u00f4te d'Ivoire staff.\nIn addition to periodic training and the internship program, software developer retreats and opportunities to attend and present at international and regional conferences for HIV\/AIDS or health informatics have also been part of capacity building.\n\n Supporting data-driven decision-making in HIV\/AIDS \nTo transform data stored in OpenELIS into information that is meaningful for decision-making, I-TECH built the online data dashboards that display aggregate data on viral load testing and EID imported from OpenELIS.[25] The dashboards import data from OpenELIS and create visualizations that help the MSHP, IPs, and CDC monitor performance along the HIV care cascade and make programmatic decisions to improve quality of care. For example, the viral load dashboard helped discover a large group of clients who only had initial HIV diagnostic and viral load tests but no follow-up tests across multiple regions in C\u00f4te d'Ivoire. This issue would have been hidden before the dashboarding process cleaned, consolidated, and visualized the data. The MSHP and CDC based their directions for the regions and IPs on the discovery from the dashboard.\nI-TECH also developed the pediatric HIV case management tool that combined OpenELIS data of pediatric HIV clients with those from the HIV electronic medical records (EMR) system in C\u00f4te d'Ivoire. This tool helped health facilities and districts identify and follow up with lost-to-follow-up pediatric clients and parents and those whose viral load test results indicated a decline in antiretroviral regimen effectiveness. OpenELIS's pivotal role as an essential public health tool was solidified.\n\n Networking, interoperability between systems, and expansion \nTo respond to emerging needs from the MSHP and laboratories, the OpenELIS project will always have room for adaptation and growth. Current activities include transitioning from a series of individual instances of OpenELIS to a more interconnected national laboratory information system through system networking. The pilot of a consolidated server for the national laboratory data warehouse began in 2021, bringing all laboratory data to one central location for reporting and real-time decision-making by the MSHP. The continuous demands from laboratories to add more testing modules to OpenELIS motivated the project to start developing modules for tuberculosis, COVID-19, and enhanced support for molecular biology and bidirectional analyzer interfacing. A reference testing workflow has been developed, allowing results to be sent between OpenELIS instances and providing laboratory results instantly between laboratories and reference laboratories to aid diagnosis and allow for faster treatment. Programmatically, I-TECH will continue to work with the C\u00f4te d'Ivoire MSHP to provide necessary assistance for the full transition.\n\nDiscussion \nTo our knowledge, this is the first case study of best practices and lessons learned from the implementation of a LIS in a tiered laboratory system in West Africa. This case study illustrates the development, implementation, and capacity building process for OpenELIS in C\u00f4te d'Ivoire since 2009, with support from PEPFAR, as part of an initiative to strengthen the national laboratory system. The open-source nature of OpenELIS coupled with the close partnership between the MSHP and I-TECH have facilitated the collaborative, iterative process of designing, developing, deploying, and scaling up OpenELIS in C\u00f4te d'Ivoire. Strong local leadership and ownership of OpenELIS implementation contributed to the scaling and sustainment of routine use of OpenELIS at laboratories nationwide beyond the first 13 years. The improved capacity and talent pool for OpenELIS implementation and support, resulting from continuous training efforts, also facilitated scaling and sustainment. OpenELIS and its dependent data dashboards have already demonstrated value in supporting the MSHP and other stakeholders in data-driven decision-making.\n\n Open-source design and CoPs-supported software adoption, implementation, sustainability, and innovation \nThe open-source nature and the resulting potential for in-country capacity building and ownership of OpenELIS were the main reasons why the C\u00f4te d'Ivoire MSHP decided to adopt it. Reports from open-source LIS software projects in other settings, including the OpenELIS project in Vietnam[12], a LIS pilot for tuberculosis in Peru[26], and a LIS pilot for HIV in Malawi[27], have also underscored the value of open-source software in LMICs. Open-source software provide flexibility and agility so that governments can start with a pilot project and gradually build in more functions as use cases evolve and expand. The open-source nature invites collaboration and cultivates local capacity so that costs of development and maintenance will decrease over time, contributing to sustainability. Digital Square, a global consortium for promoting health equity through digital health, designated OpenELIS in 2018 as a digital \u201cglobal good.\u201d[28] A CoP was also developed to support the advancement and implementation of OpenELIS globally. As of October 2020, over 270 laboratories in 18 LMICs in sub-Saharan Africa, Asia, and the Caribbean use OpenELIS.\nContinuous maintenance and funding support for software is crucial after the initial launch[29], and the OpenELIS CoP worldwide is a model that facilitates sustainable implementation, meaningful collaboration, and local ownership. There are three common models for implementing open-source software in LMICs, namely software as a service (SaaS)[30], donor investment in the core global good[31][32], and CoP.[33] The first two models keep the knowledge and maintenance responsibility with the developers who are usually in high-income countries, and funding can be highly donor-driven. On the contrary, the CoP model brings a variety of actors and resources to a shared table to support the core stewardship and maintenance of the global good. The large-scale adoption of OpenELIS through different funding streams, not just PEPFAR, has led to a broader set of features and more sustainable cost-sharing, including recent co-investment from LMICs and the U.S. in 2021. Each implementing country benefits from features developed for other use cases due to the single code base and flexible administrative options. The OpenELIS CoP continuously supports the development of innovations and flexible design that can be used across use cases.[7]\n\n Collaboration, capacity building, and local ownership are the key to sustainable implementation \nNumerous global health projects have struggled to continue beyond the pilot or trial phase, and one of the key barriers to scale-up and sustainability is lack of local ownership and leadership at each level of the system.[34][35] The collaboration between the MSHP and I-TECH is the nurturing ground for the decade-long OpenELIS project in C\u00f4te d'Ivoire. The open-source and global CoP of software such as OpenELIS naturally support technical collaboration and exchange.[36] However, without committed engagement and close partnership with the MSHP, the OpenELIS design and development process in C\u00f4te d'Ivoire would likely have been less participatory, less successful, and less sustainable.[37]\nThe improved local capacity of software development and maintenance for OpenELIS is an important contribution toward the vision of long-term, locally sustained implementation. Providing information technology (IT) without investing in human resources or building capacity would still be inadequate in addressing the gaps in the laboratory system.[2] Therefore, the policymakers and technicians trained in OpenELIS development and deployment, as well as the interns embedded in MSHP teams to support OpenELIS implementation, will ensure the medium- and long-term success of the project.\nThe collaboration has also strengthened local ownership of OpenELIS and leadership of relevant software development and support activities to achieve routine usage and nationwide scale. Although the OpenELIS project in C\u00f4te d'Ivoire is still receiving funding by the U.S. government as part of PEPFAR, and the C\u00f4te d'Ivoire MSHP has not committed to completely taking over the continuous implementation of OpenELIS, there has at least been progress towards this goal. Transition of all OpenELIS-related planning, design, development, and implementation to the MSHP has been underway as of March 2022.\n\nLimitations \nThis case study represents the experiences of one LIS project in C\u00f4te d'Ivoire and thus may not be generalizable to other settings, though the lessons learned are relevant to many HIS strengthening projects in LMICs. Evaluation research that uses rigorous quantitative, qualitative, or mixed methods is necessary to assess and demonstrate the reach, effectiveness, adoption, implementation, and maintenance of the project.[38] For example, one could evaluate the use of a quasi-experimental design to assess the effectiveness of improving laboratory testing data quality (e.g., data timeliness, data completeness, data validity) and service quality (e.g., TAT, testing validity) by comparing LIS to paper records, or the use of a qualitative study to interview laboratory staff about the facilitators and barriers to LIS implementation.\n\nConclusions \nThe development and nationwide scale-up of OpenELIS in C\u00f4te d\u2019Ivoire for over a decade have relied on the open-source software design, CoP support, close collaboration with the C\u00f4te d\u2019Ivoire MSHP, and cultivation of local ownership and capacity since inception. Other countries and supporting partners planning to adapt and nationally scale LIS may consider the importance of HIS workforce development, financial sustainability, and institutionalization of government ownership and technical leadership.\nBefore this study, the following was already known:\n\nLIS has the potential to increase accuracy and timeliness of laboratory data, supporting diagnostic testing and clinical monitoring.\nFactors for scaling and sustaining LIS in LMICs have not been previously described.\nThis study added the following to our knowledge:\n\nOpenELIS, an open-source electronic LIS, has been implemented in C\u00f4te d'Ivoire since 2009 and scaled nationwide to 111 clinical and reference laboratories.\nSuccessful adoption, scaling, and sustainment of OpenELIS has relied on active collaboration starting in the earliest planning phases and integrating local partners, regulatory agencies, and technical experts into every step of the design, implementation, and evaluation phases.\nOther countries and supporting partners planning to adapt and nationally scale LIS may consider the importance of carefully developing plans for 1) workforce development in both end users and system administrators; 2) financial sustainability; and 3) institutionalization of government ownership and technical leadership.\n Abbreviations, acronyms, and initialisms \nASTM: American Society of Testing and Materials\nCATOE: Cellule d'Assistance Technique de OpenELIS\nCDC: Centers for Disease Control and Prevention\nCNESVS: C\u00f4te d'Ivoire Comit\u00e9 National d'Ethique des Sciences de la Vie et de la Sant\u00e9\nCoP: community of practice\nDIIS: Direction de l'Informatique et de l'Information Sanitaire\neLIS: electronic laboratory information system\nEID: early infant diagnosis\nEMR: electronic medical record\nFHIR: Fast Healthcare Interoperability Resources\nHIS: health information system\nHL7: Health Level 7\nI-TECH: International Training and Education Center for Health\nINPHB: Institut Pasteur C\u00f4te d'Ivoire, Institut National Polytechnique F\u00e9lix Houphou\u00ebt-Boigny\nIP: implementing partner\nLIS: laboratory information system\nLMIC: low- and middle-income country\nMOH: Ministry of Health\nMSHP: Minist\u00e8re de la Sant\u00e9 et de l\u2019Hygi\u00e8ne Publique\nOJT: on-the-job training\nOpenELIS: Open-source Electronic Laboratory Information System\nPEPFAR: U.S. President's Emergency Fund for AIDS Relief\nSMS: Short Message Service\nSOCI: Stages of Continuous Improvement\nTAT: turnaround time\nTOT: training of trainers\nTWG: technical working group\nUW: University of Washington\nAcknowledgements \nWe thank the C\u00f4te d'Ivoire MSHP and all implementing laboratories for the continuous collaboration. We thank Oliver Defawe, Paul Schwartz, Justin Sogo, Emily DeRiel for their programming and project planning support early in this work. We thank the CDC and our fellow PEPFAR IPs (ACONDA, Ariel Glaser Foundation, Elizabeth Glaser Pediatric AIDS Foundation, ICAP, SEV-CI, and Health Alliance International) for their collaboration in the implementation and optimization of OpenELIS in C\u00f4te d'Ivoire.\n\nFunding \nFunding for this work was provided by the U.S. Health Services and Resources Administration (#6U91HA06801) and CDC (#NU2GGH001968-05-00) awarded to the University of Washington.\n\nConflict of interest \nThe authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.\n\nReferences \n\n\n\u2191 1.0 1.1 Wilson, Michael L; Fleming, Kenneth A; Kuti, Modupe A; Looi, Lai Meng; Lago, Nestor; Ru, Kun (1 May 2018). \"Access to pathology and laboratory medicine services: a crucial gap\" (in en). The Lancet 391 (10133): 1927\u20131938. doi:10.1016\/S0140-6736(18)30458-6. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0140673618304586 .   \n \n\n\u2191 2.0 2.1 Sayed, Shahin; Cherniak, William; Lawler, Mark; Tan, Soo Yong; El Sadr, Wafaa; Wolf, Nicholas; Silkensen, Shannon; Brand, Nathan et al. (1 May 2018). \"Improving pathology and laboratory medicine in low-income and middle-income countries: roadmap to solutions\" (in en). The Lancet 391 (10133): 1939\u20131952. doi:10.1016\/S0140-6736(18)30459-8. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0140673618304598 .   \n \n\n\u2191 Al Knawy, Bandar; McKillop, Mollie Marian; Abduljawad, Joud; Tarkoma, Sasu; Adil, Mahmood; Schaper, Louise; Chee, Adam; Bates, David W. et al. (23 February 2022). \"Successfully Implementing Digital Health to Ensure Future Global Health Security During Pandemics: A Consensus Statement\" (in en). JAMA Network Open 5 (2): e220214. doi:10.1001\/jamanetworkopen.2022.0214. ISSN 2574-3805. https:\/\/jamanetwork.com\/journals\/jamanetworkopen\/fullarticle\/2789277 .   \n \n\n\u2191 4.0 4.1 National Health Laboratory Service (May 2020). \"National Health Laboratory Service Annual Report 2018\/19\" (PDF). https:\/\/www.nhls.ac.za\/wp-content\/uploads\/2020\/05\/NHLS_Annual_Report_2019_Revised_00000004.pdf . Retrieved 20 February 2021 .   \n \n\n\u2191 Namibia Institute of Pathology Limited (November 2019). \"Namibia Institute of Pathology Limited Annual Report 2017\u201318\" (PDF). https:\/\/nip.com.na\/wp-content\/uploads\/2019\/11\/NIP-Annual-Report-2018_updated-6-3.pdf . Retrieved 20 February 2021 .   \n \n\n\u2191 Abera, W.S. (June 2013). \"Data Exchnage Interoprability Framework for Laboratory Information System (Lis) and Electronic Health Record (Ehr) of Two Hospitals in Addis Ababa\". Addis Ababa University Libraries. http:\/\/etd.aau.edu.et\/handle\/123456789\/14825 . Retrieved 20 February 2021 .   \n \n\n\u2191 7.0 7.1 Pyrko, Igor; D\u00f6rfler, Viktor; Eden, Colin (1 April 2017). \"Thinking together: What makes Communities of Practice work?\" (in en). Human Relations 70 (4): 389\u2013409. doi:10.1177\/0018726716661040. ISSN 0018-7267. PMC PMC5305036. PMID 28232754. http:\/\/journals.sagepub.com\/doi\/10.1177\/0018726716661040 .   \n \n\n\u2191 Syzdykova, Assel; Malta, Andr\u00e9; Zolfo, Maria; Diro, Ermias; Oliveira, Jos\u00e9 Luis (13 November 2017). \"Open-Source Electronic Health Record Systems for Low-Resource Settings: Systematic Review\" (in en). JMIR Medical Informatics 5 (4): e44. doi:10.2196\/medinform.8131. ISSN 2291-9694. PMC PMC5703976. PMID 29133283. http:\/\/medinform.jmir.org\/2017\/4\/e44\/ .   \n \n\n\u2191 Flowers, J. (6 April 2021). \"Open Source Lab Information Systems and Tools\". OpenHIE. https:\/\/wiki.ohie.org\/display\/SUB\/Open%2bSource%2bLab%2bInformation%2bSystems%2band%2bTools . Retrieved 22 May 2022 .   \n \n\n\u2191 McKay, Mary M.; Sensoy Bahar, Ozge; Ssewamala, Fred M. (1 January 2020). \"Implementation science in global health settings: Collaborating with governmental & community partners in Uganda\" (in en). Psychiatry Research 283: 112585. doi:10.1016\/j.psychres.2019.112585. PMC PMC6954316. PMID 31590906. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0165178119308224 .   \n \n\n\u2191 Abimbola, Seye; Asthana, Sumegha; Montenegro, Cristian; Guinto, Renzo R.; Jumbam, Desmond Tanko; Louskieter, Lance; Kabubei, Kenneth Munge; Munshi, Shehnaz et al. (22 April 2021). \"Addressing power asymmetries in global health: Imperatives in the wake of the COVID-19 pandemic\" (in en). PLOS Medicine 18 (4): e1003604. doi:10.1371\/journal.pmed.1003604. ISSN 1549-1676. PMC PMC8101997. PMID 33886540. https:\/\/dx.plos.org\/10.1371\/journal.pmed.1003604 .   \n \n\n\u2191 12.0 12.1 12.2 12.3 Landgraf, Kenneth M.; Kakkar, Reshma; Meigs, Michelle; Jankauskas, Paul T.; Phan, Thi Thu Huong; Nguyen, Viet Nga; Nguyen, Duy Thai; Duong, Thanh Tung et al. (1 September 2016). \"Open-source LIMS in Vietnam: The path toward sustainability and host country ownership\" (in en). International Journal of Medical Informatics 93: 92\u2013102. doi:10.1016\/j.ijmedinf.2016.06.010. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1386505616301393 .   \n \n\n\u2191 Kaplan, Bonnie; Maxwell, Joseph A. (2005), Anderson, James G.; Aydin, Carolyn E., eds., \"Qualitative Research Methods for Evaluating Computer Information Systems\" (in en), Evaluating the Organizational Impact of Healthcare Information Systems (New York: Springer-Verlag): 30\u201355, doi:10.1007\/0-387-30329-4_2, ISBN 978-0-387-24558-4, http:\/\/link.springer.com\/10.1007\/0-387-30329-4_2 . Retrieved 2023-06-06   \n \n\n\u2191 14.0 14.1 MEASURE Evaluation (2019). \"Health Information System Stages of Continuous Improvement Toolkit: User Guide\". MEASURE Evaluation. https:\/\/www.measureevaluation.org\/resources\/publications\/ms-19-158.html . Retrieved 22 May 2022 .   \n \n\n\u2191 MEASURE Evaluation (2019). \"Mapping a Path to Improve Uganda\u2019s Health Information System Using the Stages of Continuous Improvement Toolkit\". MEASURE Evaluation. https:\/\/www.measureevaluation.org\/resources\/publications\/ws-19-52.html . Retrieved 22 May 2022 .   \n \n\n\u2191 Minist\u00e8re de la Sant\u00e9 Publique (2019). \"Plan Strat\u00e9gique National de Sant\u00e9 Num\u00e9rique 2020 - 2024\" (PDF). Archived from the original on 12 May 2022. https:\/\/web.archive.org\/web\/20220512211831\/https:\/\/www.minsante.cm\/site\/sites\/default\/files\/FR_DOCUMENT_PLAN%20STRATEGIQUE%20NATIONAL%20DE%20SANTE%20NUMERIQUE_R%C3%A9duit.pdf . Retrieved 22 May 2022 .   \n \n\n\u2191 Flott, Kelsey; Callahan, Ryan; Darzi, Ara; Mayer, Erik (14 April 2016). \"A Patient-Centered Framework for Evaluating Digital Maturity of Health Services: A Systematic Review\" (in en). Journal of Medical Internet Research 18 (4): e75. doi:10.2196\/jmir.5047. ISSN 1438-8871. PMC PMC4850277. PMID 27080852. http:\/\/www.jmir.org\/2016\/4\/e75\/ .   \n \n\n\u2191 Gomes, Jorge; Rom\u00e3o, M\u00e1rio (1 December 2018). \"Information System Maturity Models in Healthcare\" (in en). Journal of Medical Systems 42 (12): 235. doi:10.1007\/s10916-018-1097-0. ISSN 0148-5598. http:\/\/link.springer.com\/10.1007\/s10916-018-1097-0 .   \n \n\n\u2191 Carvalho, Jo\u00e3o Vidal; Rocha, \u00c1lvaro; Abreu, Ant\u00f3nio (1 June 2016). \"Maturity Models of Healthcare Information Systems and Technologies: a Literature Review\" (in en). Journal of Medical Systems 40 (6): 131. doi:10.1007\/s10916-016-0486-5. ISSN 0148-5598. http:\/\/link.springer.com\/10.1007\/s10916-016-0486-5 .   \n \n\n\u2191 \"OpenELIS comes home\". Lab Link (State Hygienic Laboratory at The University of Iowa) 4 (1). January 2012. http:\/\/www.shl.uiowa.edu\/publications\/lablink\/201201\/openelis.xml .   \n \n\n\u2191 \"OpenMRS\". OpenMRS Community. https:\/\/openmrs.org\/ . Retrieved 22 May 2022 .   \n \n\n\u2191 Dings\u00f8yr, Torgeir; Nerur, Sridhar; Balijepally, VenuGopal; Moe, Nils Brede (1 June 2012). \"A decade of agile methodologies: Towards explaining agile software development\" (in en). Journal of Systems and Software 85 (6): 1213\u20131221. doi:10.1016\/j.jss.2012.02.033. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0164121212000532 .   \n \n\n\u2191 Liams-Hauser,C. (10 December 2014). \"Software Release Roadmap\". OpenELIS Global. https:\/\/openelis-global.org\/tools\/roadmap\/ . Retrieved 22 May 2022 .   \n \n\n\u2191 C\u00f4te d\u2019Ivoire Minist\u00e8re de la Sant\u00e9 et de l\u2019Hygi\u00e8ne Publique (2019). \"Plan Strat\u00e9gique National Pour Le D\u00e9veloppement Des Laboratoires de Biologie M\u00e9dicale 2017-2020\".   \n \n\n\u2191 Kirk, Mary; Assoa, Paul H.; Iiams-Hauser, Casey; Kouabenan, Yves-Rolland; Antilla, Jennifer; Steele-Lane, Caleb; Rossum, Greg; Komena, Pascal et al. (17 May 2021). \"Adaptation of an electronic dashboard to monitor HIV viral load testing in C\u00f4te d\u2019Ivoire\" (in en). African Journal of Laboratory Medicine 10 (1). doi:10.4102\/ajlm.v10i1.1284. ISSN 2225-2010. PMC PMC8182557. PMID 34192117. http:\/\/www.ajlmonline.org\/index.php\/AJLM\/article\/view\/1284 .   \n \n\n\u2191 Blaya, Joaqu\u00edn A.; Shin, Sonya S.; Yagui, Martin; Contreras, Carmen; Cegielski, Peter; Yale, Gloria; Suarez, Carmen; Asencios, Luis et al. (10 April 2014). Pai, Madhukar. ed. \"Reducing Communication Delays and Improving Quality of Care with a Tuberculosis Laboratory Information System in Resource Poor Environments: A Cluster Randomized Controlled Trial\" (in en). PLoS ONE 9 (4): e90110. doi:10.1371\/journal.pone.0090110. ISSN 1932-6203. PMC PMC3982951. PMID 24721980. https:\/\/dx.plos.org\/10.1371\/journal.pone.0090110 .   \n \n\n\u2191 Mtonga, Timothy M.; Choonara, Faheema E.; Espino, Jeremy U.; Kachaje, Chimwemwe; Kapundi, Kenneth; Mengezi, Takondwa E.; Mumba, Soyapi L.; Douglas, Gerald P. (28 October 2019). \"Design and implementation of a clinical laboratory information system in a low-resource setting\" (in en). African Journal of Laboratory Medicine 8 (1). doi:10.4102\/ajlm.v8i1.841. ISSN 2225-2010. PMC PMC6852617. PMID 31745456. http:\/\/www.ajlmonline.org\/index.php\/AJLM\/article\/view\/841 .   \n \n\n\u2191 \"Digital Square Investments in Global Goods:Approved Global Goods\". Digital Square Wiki. Digital Square. 2021. https:\/\/wiki.digitalsquare.io\/index.php\/Digital_Square_Investments_in_Global_Goods:Approved_Global_Goods#OpenELIS . Retrieved 22 May 2022 .   \n \n\n\u2191 Nowogrodzki, Anna (1 July 2019). \"How to support open-source software and stay sane\" (in en). Nature 571 (7763): 133\u2013134. doi:10.1038\/d41586-019-02046-0. ISSN 0028-0836. https:\/\/www.nature.com\/articles\/d41586-019-02046-0 .   \n \n\n\u2191 Ekie, Jesus; Gueye, Bassirou; Ekie, Tresor; Niang, Ibrahima (1 June 2021). \"An Evidence-Based Approach on Public Health Decisions in Low-Middle Income Countries: Use Case of Senegal at the Verge of COVID-19\". 2021 International Conference on Digital Age & Technological Advances for Sustainable Development (ICDATA) (Marrakech, Morocco: IEEE): 193\u2013200. doi:10.1109\/ICDATA52997.2021.00046. ISBN 978-1-6654-2901-6. https:\/\/ieeexplore.ieee.org\/document\/9588192\/ .   \n \n\n\u2191 \"Funder\". OpenLIMS. https:\/\/openlmis.org\/get-started\/partner\/ . Retrieved 22 May 2022 .   \n \n\n\u2191 \"Community Health Toolkit\". Community Health Toolkit. https:\/\/communityhealthtoolkit.org\/ . Retrieved 22 May 2022 .   \n \n\n\u2191 Thomas, J. (2021). \"Lab Information Systems Community\". OpenHIE Wiki. OpenHIE. https:\/\/wiki.ohie.org\/display\/SUB\/Lab%2bInformation%2bSystems%2bCommunity . Retrieved 22 May 2022 .   \n \n\n\u2191 Yamey, Gavin (2012). \"What are the barriers to scaling up health interventions in low and middle income countries? A qualitative study of academic leaders in implementation science\" (in en). Globalization and Health 8 (1): 11. doi:10.1186\/1744-8603-8-11. ISSN 1744-8603. PMC PMC3514334. PMID 22643120. http:\/\/globalizationandhealth.biomedcentral.com\/articles\/10.1186\/1744-8603-8-11 .   \n \n\n\u2191 Olusanya, Jacob O.; Ubogu, Olufunmilayo I.; Njokanma, Fidelis O.; Olusanya, Bolajoko O. (1 July 2021). \"Transforming global health through equity-driven funding\" (in en). Nature Medicine 27 (7): 1136\u20131138. doi:10.1038\/s41591-021-01422-6. ISSN 1078-8956. https:\/\/www.nature.com\/articles\/s41591-021-01422-6 .   \n \n\n\u2191 Men\u00e9ndez-Caravaca, Elo\u00edsa; Bueno, Salvador; Gallego, M. Dolores (1 December 2021). \"Exploring the link between free and open source software and the collaborative economy: A Delphi-based scenario for the year 2025\" (in en). Technological Forecasting and Social Change 173: 121087. doi:10.1016\/j.techfore.2021.121087. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0040162521005205 .   \n \n\n\u2191 Abimbola, Seye (1 October 2019). \"The foreign gaze: authorship in academic global health\" (in en). BMJ Global Health 4 (5): e002068. doi:10.1136\/bmjgh-2019-002068. ISSN 2059-7908. PMC PMC6830280. PMID 31750005. https:\/\/gh.bmj.com\/lookup\/doi\/10.1136\/bmjgh-2019-002068 .   \n \n\n\u2191 Glasgow, Russell E.; Harden, Samantha M.; Gaglio, Bridget; Rabin, Borsika; Smith, Matthew Lee; Porter, Gwenndolyn C.; Ory, Marcia G.; Estabrooks, Paul A. (2019). \"RE-AIM Planning and Evaluation Framework: Adapting to New Science and Practice With a 20-Year Review\". Frontiers in Public Health 7. doi:10.3389\/fpubh.2019.00064. ISSN 2296-2565. PMC PMC6450067. PMID 30984733. https:\/\/www.frontiersin.org\/articles\/10.3389\/fpubh.2019.00064 .   \n \n\n\nNotes \nThis presentation is faithful to the original, with only a few minor changes to presentation. Grammar was cleaned up for smoother reading. In some cases important information was missing from the references, and that information was added. The original cites this wiki as a source of information about the origins of OpenELIS, but the original article's statement of Iowa and Minnesota being involved was shortsighted; for this version, we mention that other public health labs were involved and we use the original source used on the OpenELIS wiki page, not the wiki page itself. No other changes were made in accordance with the \"NoDerivatives\" portion of the content license.\n\n\n\n\n\nSource: <a rel=\"external_link\" class=\"external\" href=\"https:\/\/www.limswiki.org\/index.php\/Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\">https:\/\/www.limswiki.org\/index.php\/Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years<\/a>\nCategories: LIMSwiki journal articles (added in 2023)LIMSwiki journal articles (all)LIMSwiki journal articles on laboratory informaticsNavigation menuPage actionsJournalDiscussionView sourceHistoryPage actionsJournalDiscussionMoreToolsIn other languagesPersonal toolsLog inNavigationMain pageEncyclopedic articlesRecent changesRandom pageHelp about MediaWikiSearch\u00a0 ToolsWhat links hereRelated changesSpecial pagesPermanent linkPage informationPopular publications\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\nPrint\/exportCreate a bookDownload as PDFDownload as PDFDownload as Plain textPrintable version This page was last edited on 6 June 2023, at 21:24.Content is available under a Creative Commons Attribution-ShareAlike 4.0 International License unless otherwise noted.This page has been accessed 88 times.Privacy policyAbout LIMSWikiDisclaimers\n\n\n\n","09a05cec486b0e795821acfbb792b350_html":"<body class=\"mediawiki ltr sitedir-ltr mw-hide-empty-elt ns-206 ns-subject page-Journal_Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_OpenELIS_in_C\u00f4te_d\u2019Ivoire_Sustainability_lessons_from_the_first_13_years rootpage-Journal_Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_OpenELIS_in_C\u00f4te_d\u2019Ivoire_Sustainability_lessons_from_the_first_13_years skin-monobook action-view skin--responsive\"><div id=\"rdp-ebb-globalWrapper\"><div id=\"rdp-ebb-column-content\"><div id=\"rdp-ebb-content\" class=\"mw-body\" role=\"main\"><a id=\"rdp-ebb-top\"><\/a>\n<h1 id=\"rdp-ebb-firstHeading\" class=\"firstHeading\" lang=\"en\">Journal:Development and national scale implementation of an open-source electronic laboratory information system (OpenELIS) in C\u00f4te d\u2019Ivoire: Sustainability lessons from the first 13 years<\/h1><div id=\"rdp-ebb-bodyContent\" class=\"mw-body-content\"><!-- start content --><div id=\"rdp-ebb-mw-content-text\" lang=\"en\" dir=\"ltr\" class=\"mw-content-ltr\"><div class=\"mw-parser-output\">\n\n\n<h2><span class=\"mw-headline\" id=\"Abstract\">Abstract<\/span><\/h2>\n<p><b>Purpose<\/b>: C\u00f4te d'Ivoire has a tiered <a href=\"https:\/\/www.limswiki.org\/index.php\/Public_health_laboratory\" title=\"Public health laboratory\" class=\"wiki-link\" data-key=\"34ffb658cb79bf322c65efaad95996f5\">public health laboratory<\/a> system of nine <a href=\"https:\/\/www.limswiki.org\/index.php\/Reference_laboratory\" title=\"Reference laboratory\" class=\"wiki-link\" data-key=\"f719f408e1660f86b53857eef2f13f32\">reference laboratories<\/a>, 77 <a href=\"https:\/\/www.limswiki.org\/index.php\/Laboratory\" title=\"Laboratory\" class=\"wiki-link\" data-key=\"c57fc5aac9e4abf31dccae81df664c33\">laboratories<\/a> at regional and general <a href=\"https:\/\/www.limswiki.org\/index.php\/Hospital\" title=\"Hospital\" class=\"wiki-link\" data-key=\"b8f070c66d8123fe91063594befebdff\">hospitals<\/a>, and 100 laboratories among 1,486 district health centers. Prior to 2009, nearly all of these laboratories used paper registers and reports to collect and report laboratory data to clinicians and national disease monitoring programs.\n<\/p><p><b>Project<\/b>: Since 2009 the Ministry of Health (MOH) in C\u00f4te d'Ivoire has sought to implement a comprehensive set of activities aimed at strengthening the laboratory system. One of these activities is the sustainable development, expansion, and technical support of an open-source electronic <a href=\"https:\/\/www.limswiki.org\/index.php\/Laboratory_information_system\" title=\"Laboratory information system\" class=\"wiki-link\" data-key=\"37add65b4d1c678b382a7d4817a9cf64\">laboratory information system<\/a> (LIS) called <a href=\"https:\/\/www.limswiki.org\/index.php\/OpenELIS\" title=\"OpenELIS\" class=\"wiki-link\" data-key=\"b11b00d1e7409d55b58e9f82204cc2a3\">OpenELIS<\/a>, with the long-term goal of Ivorian technical support and managerial sustainment of the system. This project has addressed the need for a comprehensive, customizable, low- to no-cost, open-source LIS to serve the <a href=\"https:\/\/www.limswiki.org\/index.php\/Public_health\" title=\"Public health\" class=\"wiki-link\" data-key=\"81092e25c0bd359cedd1b9f9dc350c86\">public health<\/a> systems, with initial attention to HIV clients and later expansion to cover the general population. This descriptive case study presents the first published summary of original work which has been ongoing since 2009 in C\u00f4te d\u2019Ivoire to transform the <a href=\"https:\/\/www.limswiki.org\/index.php\/Information_management\" title=\"Information management\" class=\"wiki-link\" data-key=\"f8672d270c0750a858ed940158ca0a73\">information management<\/a> systems and processes in laboratories nationally.\n<\/p><p><b>Impact<\/b>: OpenELIS is now in use at 106 laboratories across C\u00f4te d\u2019Ivoire. This article describes the iterative planning, design, and implementation process of OpenELIS in C\u00f4te d'Ivoire, and the evolving leadership, ownership, and capacity of the Ivorian MOH in sustaining the system. This original work synthesizes lessons learned from this 13-year experience towards strengthening LISs in other low-resource settings.\n<\/p><p><b>Highlights of this work<\/b>:<br \/>\n<\/p>\n<ul><li>Factors for scaling and sustaining an electronic LIS (eLIS) in low- and middle-income countries (LMICs) have not been previously described in the literature.<\/li>\n<li>Successful adoption, scaling, and sustainment of OpenELIS in C\u00f4te d'Ivoire relied on early collaboration with partners, regulatory agencies, and technical experts into every step of the design, implementation, and evaluation phases.<\/li>\n<li>Entities planning to nationally scale an eLIS should plan for 1) workforce development in both end users and system administrators; 2) financial sustainability; and 3) institutionalization of government ownership and technical leadership.<\/li>\n<li>An open-source eLIS can increase accuracy and timeliness of clinical laboratory data, supporting diagnostic testing and monitoring in a resource-limited setting such as Cote d\u2019Ivoire.<\/li><\/ul>\n<p><b>Keywords<\/b>: electronic information systems, laboratory information systems, quality, low-resource country\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Introduction\">Introduction<\/span><\/h2>\n<p>In low- and middle-income countries (LMICs), inadequate infrastructure\u2014including limited availability and use of electronic <a href=\"https:\/\/www.limswiki.org\/index.php\/Laboratory_information_system\" title=\"Laboratory information system\" class=\"wiki-link\" data-key=\"37add65b4d1c678b382a7d4817a9cf64\">laboratory information systems<\/a> (LISs)\u2014has hindered quality <a href=\"https:\/\/www.limswiki.org\/index.php\/Laboratory\" title=\"Laboratory\" class=\"wiki-link\" data-key=\"c57fc5aac9e4abf31dccae81df664c33\">laboratory<\/a> service delivery for communities.<sup id=\"rdp-ebb-cite_ref-:0_1-0\" class=\"reference\"><a href=\"#cite_note-:0-1\">[1]<\/a><\/sup> International development efforts such as the U.S. President's Emergency Fund for AIDS Relief (PEPFAR) have aimed to strengthen national laboratory systems by modernizing infrastructure and diagnostic testing methods, including automated analyzers that require computer connectivity for <a href=\"https:\/\/www.limswiki.org\/index.php\/Information_management\" title=\"Information management\" class=\"wiki-link\" data-key=\"f8672d270c0750a858ed940158ca0a73\">data management<\/a>. The increase in the quantity and complexity of data generated from high-throughput analyzers and sophisticated diagnostics necessitates the transition from paper records to LIS.\n<\/p><p>Compared to paper-based systems, LIS are more efficient and enable better <a href=\"https:\/\/www.limswiki.org\/index.php\/Quality_control\" title=\"Quality control\" class=\"wiki-link\" data-key=\"1e0e0c2eb3e45aff02f5d61799821f0f\">quality control<\/a> (QC) in collecting, processing, managing, synthesizing, and reporting large amounts of data (Table 1).<sup id=\"rdp-ebb-cite_ref-:0_1-1\" class=\"reference\"><a href=\"#cite_note-:0-1\">[1]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-:4_2-0\" class=\"reference\"><a href=\"#cite_note-:4-2\">[2]<\/a><\/sup> The <a href=\"https:\/\/www.limswiki.org\/index.php\/COVID-19\" class=\"mw-redirect wiki-link\" title=\"COVID-19\" data-key=\"da9bd20c492b2a17074ad66c2fe25652\">COVID-19<\/a> <a href=\"https:\/\/www.limswiki.org\/index.php\/Pandemic\" title=\"Pandemic\" class=\"wiki-link\" data-key=\"bd9a48e6c6e41b6d603ee703836b01f1\">pandemic<\/a> has highlighted the acute importance of digital health, including LIS, in providing data and enabling rapid data exchange and sharing to facilitate <a href=\"https:\/\/www.limswiki.org\/index.php\/Public_health\" title=\"Public health\" class=\"wiki-link\" data-key=\"81092e25c0bd359cedd1b9f9dc350c86\">public health<\/a> surveillance and data-driven decision-making.<sup id=\"rdp-ebb-cite_ref-3\" class=\"reference\"><a href=\"#cite_note-3\">[3]<\/a><\/sup>\n<\/p>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table class=\"wikitable\" border=\"1\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td colspan=\"4\" style=\"background-color:white; padding-left:10px; padding-right:10px;\"><b>Table 1.<\/b> Strengths of laboratory information systems (LISs) compared to paper-based processes.\n<\/td><\/tr>\n<tr>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Lab aspect\n<\/th>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">LIS feature(s)\n<\/th>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Actions\n<\/th>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Impact\n<\/th><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><b>Reception<\/b>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Batch entry; referral workflows\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Accelerate the processing and recording of incoming work\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Reduce turnaround time (TAT)\n<\/td><\/tr>\n<tr>\n<td rowspan=\"2\" style=\"background-color:white; padding-left:10px; padding-right:10px;\"><b>Results generation<\/b>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Work plans\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Help managers monitor workload and supply management\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Ensure efficient operation of laboratories\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Analyzer interfaces\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Relay results quickly and accurately\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Reduce TAT\n<\/td><\/tr>\n<tr>\n<td rowspan=\"4\" style=\"background-color:white; padding-left:10px; padding-right:10px;\"><b>Reporting<\/b>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Interface with <a href=\"https:\/\/www.limswiki.org\/index.php\/Electronic_medical_record\" title=\"Electronic medical record\" class=\"wiki-link\" data-key=\"99a695d2af23397807da0537d29d0be7\">electronic medical record<\/a> (EMR)\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Communicate client laboratory history rapidly to clinicians in referral networks\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Enable faster clinical decision-making regarding diagnosis, treatment, and prognosis; reduce TAT\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Interface with client notification systems via Short Message Service (SMS) or email\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Communicate test results to clients rapidly\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Prompt immediate behavior augmentation and achieve better health outcomes (e.g., initiate self-quarantine in the case of COVID-19).\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Interface with routine health information systems at the district, regional, and national levels\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Enable faster aggregate data reporting\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Facilitate data-driven policy making; reduce TAT\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Reports of quality indicators such as turnaround time\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Help managers monitor quality performance\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Facilitate continuous quality improvement; increase testing quality\n<\/td><\/tr>\n<tr>\n<td rowspan=\"2\" style=\"background-color:white; padding-left:10px; padding-right:10px;\"><b>Overarching<\/b>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Graphic widgets (e.g., drop-down menus, checkboxes), active logic and value checks, flags and reminders for potential issues, and automation\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Reduce errors\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Facilitate quality control; increase testing quality\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Data storage and data query tools\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Allow secure, long-term <a href=\"https:\/\/www.limswiki.org\/index.php\/Data_retention\" title=\"Data retention\" class=\"wiki-link\" data-key=\"d77533b92d003d39cee958a82b62391a\">data retainment<\/a> and easy data retrieval based on specific needs\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Improve client privacy, long-term data availability, and data usage\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<p>However, LIS uptake and routine usage in LMICs remains low due to several barriers. LIS ownership, development, and maintenance can be perceived as bearing high costs of financial and human resources. Numerous proprietary LIS exist but may not be ideally suited for LMICs, where financial resources are limited and, most often, ongoing software support relies on long-term service contracts with private companies. Although some LMICs have implemented proprietary systems<sup id=\"rdp-ebb-cite_ref-:1_4-0\" class=\"reference\"><a href=\"#cite_note-:1-4\">[4]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-5\" class=\"reference\"><a href=\"#cite_note-5\">[5]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-6\" class=\"reference\"><a href=\"#cite_note-6\">[6]<\/a><\/sup>, these systems are vulnerable to market changes and can leave users unsupported if a company suspends its operations or modifies its service terms. Health information systems (HIS), including LIS, that use open-source code and are supported by communities of practice (CoPs) offer an attractive alternative in LMICs. Open-source CoPs have a vested interest in capacity building of software developers and users, including those from LMICs.<sup id=\"rdp-ebb-cite_ref-:5_7-0\" class=\"reference\"><a href=\"#cite_note-:5-7\">[7]<\/a><\/sup> Implementation time and effort aside, there are no licensing fees, and all software code created is in public ownership, which enables others to customize and improve functionality.<sup id=\"rdp-ebb-cite_ref-8\" class=\"reference\"><a href=\"#cite_note-8\">[8]<\/a><\/sup> Several open-source LISs are currently in use in LMICs in Africa and Asia, with varied scale.<sup id=\"rdp-ebb-cite_ref-9\" class=\"reference\"><a href=\"#cite_note-9\">[9]<\/a><\/sup>\n<\/p><p>Another barrier to sustained, wide-scale usage of LIS is that LIS initiatives are often international-donor-driven and may lack close collaborations with ministries of health (MOHs) in LMICs. Engaging the MOH in the initial design and feature prioritization stage, building local capacity to own and maintain the software, and securing resource commitment after phase-out of donor support are time- and labor-intensive.<sup id=\"rdp-ebb-cite_ref-10\" class=\"reference\"><a href=\"#cite_note-10\">[10]<\/a><\/sup> Additionally, power asymmetries between donors and LMIC stakeholders may discount local priorities, requirements, and innovations.<sup id=\"rdp-ebb-cite_ref-11\" class=\"reference\"><a href=\"#cite_note-11\">[11]<\/a><\/sup> However, successful experiences of implementing an LIS in LMICs at the national scale have shown that strengthening MOH leadership and cultivating mutually beneficial partnerships are essential to impactful and sustainable laboratory system strengthening.<sup id=\"rdp-ebb-cite_ref-:1_4-1\" class=\"reference\"><a href=\"#cite_note-:1-4\">[4]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-:2_12-0\" class=\"reference\"><a href=\"#cite_note-:2-12\">[12]<\/a><\/sup>\n<\/p><p>Since 2009, the University of Washington\u2019s (UW) International Training and Education Center for Health (I-TECH) has worked in partnership with the C\u00f4te d'Ivoire Ministry of Health and Public Hygiene (Minist\u00e8re de la Sant\u00e9 et de l\u2019Hygi\u00e8ne Publique, or MSHP) to implement a comprehensive set of activities aimed at strengthening the laboratory system. PEPFAR and the U.S. <a href=\"https:\/\/www.limswiki.org\/index.php\/Centers_for_Disease_Control_and_Prevention\" title=\"Centers for Disease Control and Prevention\" class=\"wiki-link\" data-key=\"176aa9c9513251c328d864d1e724e814\">Centers for Disease Control and Prevention<\/a> (CDC) have funded the partnership. One of the key activities is the sustainable development, expansion, and technical support of an open-source enterprise-level LIS, the <a href=\"https:\/\/www.limswiki.org\/index.php\/OpenELIS\" title=\"OpenELIS\" class=\"wiki-link\" data-key=\"b11b00d1e7409d55b58e9f82204cc2a3\">OpenELIS<\/a> system, with the long-term goal of Ivorian technical support and managerial sustainment of the system. The software serves as both an effective laboratory information management solution and a business operations framework for the laboratory service units (Fig. 1). The collaboration has addressed the need for a comprehensive, customizable, low- to no-cost, open-source LIS to serve the public health systems, with initial attention to HIV clients and later expansion to cover the general population.\n<\/p><p><br \/>\n<a href=\"https:\/\/www.limswiki.org\/index.php\/File:Fig1_He_IntJofMedInfo2023_170.jpg\" class=\"image wiki-link\" data-key=\"dc94fab2e518bdc32435ac6dba74ca49\"><img alt=\"Fig1 He IntJofMedInfo2023 170.jpg\" src=\"https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/f\/fa\/Fig1_He_IntJofMedInfo2023_170.jpg\" decoding=\"async\" style=\"width: 100%;max-width: 400px;height: auto;\" \/><\/a>\n<\/p>\n<div style=\"clear:both;\"><\/div>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table border=\"0\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><blockquote><p><b>Figure 1.<\/b> OpenELIS laboratory software solution and business process framework. (Color should be used in print).<\/p><\/blockquote>\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<p>C\u00f4te d'Ivoire has a tiered <a href=\"https:\/\/www.limswiki.org\/index.php\/Public_health_laboratory\" title=\"Public health laboratory\" class=\"wiki-link\" data-key=\"34ffb658cb79bf322c65efaad95996f5\">public health laboratory<\/a> system of nine <a href=\"https:\/\/www.limswiki.org\/index.php\/Reference_laboratory\" title=\"Reference laboratory\" class=\"wiki-link\" data-key=\"f719f408e1660f86b53857eef2f13f32\">reference laboratories<\/a>, 77 laboratories at regional and general <a href=\"https:\/\/www.limswiki.org\/index.php\/Hospital\" title=\"Hospital\" class=\"wiki-link\" data-key=\"b8f070c66d8123fe91063594befebdff\">hospitals<\/a>, and 100 laboratories among 1,486 district health centers. Prior to 2009, most laboratories used paper registers and reports to collect and report laboratory data to clinicians and national disease monitoring programs. The only LIS was a bespoke database located at the national HIV reference laboratory (called rETRO-CI), and this system was paired with commercial software.\n<\/p><p>The objectives of this case study are to: 1) present the iterative implementation process of OpenELIS in C\u00f4te d'Ivoire; 2) describe the evolving leadership, ownership, and capacity of the C\u00f4te d'Ivoire MSHP in sustaining routine use of OpenELIS; and 3) synthesize lessons learned for strengthening LIS in other LMICs.\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Materials_and_methods\">Materials and methods<\/span><\/h2>\n<p>We used qualitative methods in this case study to describe the implementation and collaboration around OpenELIS and its supporting activities.<sup id=\"rdp-ebb-cite_ref-:2_12-1\" class=\"reference\"><a href=\"#cite_note-:2-12\">[12]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-13\" class=\"reference\"><a href=\"#cite_note-13\">[13]<\/a><\/sup> We reviewed monthly and annual project reports from the implementers; activity and trip reports from technical experts, as well as from government and donor representatives; and software development roadmap and technical documentation from 2009 to 2020. This project was determined to be non-research by the University of Washington and has been approved by C\u00f4te d'Ivoire Comit\u00e9 National d'Ethique des Sciences de la Vie et de la Sant\u00e9 (CNESVS, Ivorian Institutional Review Board; reference number 006\u201321\/MSHP\/CNESVS-km) and the U.S. CDC.\n<\/p><p>Information abstracted from the project documents was initially summarized in chronological order and later coded deductively and inductively. Next, we coded the summaries deductively using the components of the Stages of Continuous Improvement (SOCI) Framework for Health Information Systems.<sup id=\"rdp-ebb-cite_ref-:3_14-0\" class=\"reference\"><a href=\"#cite_note-:3-14\">[14]<\/a><\/sup> The SOCI Framework has previously been used in Uganda and Cameroon to assess the maturity of digital health tools.<sup id=\"rdp-ebb-cite_ref-:3_14-1\" class=\"reference\"><a href=\"#cite_note-:3-14\">[14]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-15\" class=\"reference\"><a href=\"#cite_note-15\">[15]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-16\" class=\"reference\"><a href=\"#cite_note-16\">[16]<\/a><\/sup> In addition to deductive codes, we also created new codes inductively where the SOCI Framework did not apply. Inductive codes captured the different steps of OpenELIS implementation and evolving collaboration among stakeholders. When coding was complete, codes and their corresponding excerpts from the summaries were organized into themes. YH coded the summaries. The other co-authors reviewed and verified the coding and analysis to ensure accuracy. The coding and thematic analysis took place in ATLAS.ti 8 Windows.\n<\/p><p>To ensure that LIS implementation translates into high-quality health services and population health benefits<sup id=\"rdp-ebb-cite_ref-17\" class=\"reference\"><a href=\"#cite_note-17\">[17]<\/a><\/sup>, it is important to monitor how data systems mature over time. As such, the SOCI Framework outlines 13 components and 39 subcomponents within five domains, i.e., HIS leadership and governance, management and workforce, infrastructure, standards and interoperability, and <a href=\"https:\/\/www.limswiki.org\/index.php\/Data_quality\" title=\"Data quality\" class=\"wiki-link\" data-key=\"7fe43b05eae4dfa9b5c0547cc8cfcceb\">data quality<\/a> and use.<sup id=\"rdp-ebb-cite_ref-18\" class=\"reference\"><a href=\"#cite_note-18\">[18]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-19\" class=\"reference\"><a href=\"#cite_note-19\">[19]<\/a><\/sup>\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Results\">Results<\/span><\/h2>\n<h3><span class=\"mw-headline\" id=\"Design_and_development\">Design and development<\/span><\/h3>\n<p>OpenELIS was initially designed and implemented by a group of six U.S. state public health laboratories.<sup id=\"rdp-ebb-cite_ref-SHLUIOpenELIS12_20-0\" class=\"reference\"><a href=\"#cite_note-SHLUIOpenELIS12-20\">[20]<\/a><\/sup> Its implementation in global health began as part of a collaborative effort between the U.S. CDC and the Government of Vietnam to strengthen HIV service delivery and laboratory systems in 2005.<sup id=\"rdp-ebb-cite_ref-:2_12-2\" class=\"reference\"><a href=\"#cite_note-:2-12\">[12]<\/a><\/sup> As part of the open-source medical record system (<a href=\"https:\/\/www.limswiki.org\/index.php\/OpenMRS\" title=\"OpenMRS\" class=\"wiki-link\" data-key=\"bdb797cd304c9ac66336f395c2bb6dbd\">OpenMRS<\/a>) consortium of partners<sup id=\"rdp-ebb-cite_ref-21\" class=\"reference\"><a href=\"#cite_note-21\">[21]<\/a><\/sup>, UW I-TECH received the OpenELIS source code and joined the development of the OpenELIS codebase in 2009.\n<\/p><p>An agile software design and development methodology was adopted by UW I-TECH for OpenELIS to enable an inclusive, iterative approach to software creation together with the local stakeholders in C\u00f4te d'Ivoire.<sup id=\"rdp-ebb-cite_ref-22\" class=\"reference\"><a href=\"#cite_note-22\">[22]<\/a><\/sup> Since its introduction and adaptation in C\u00f4te d'Ivoire in 2009, OpenELIS has evolved through multiple iterations of improving functionality and flexibility, and through new releases twice per year. The first versions of OpenELIS were limited in scope and focused primarily on HIV care. They provided pre-defined forms and reports for common HIV-related tests such as early infant diagnosis of HIV (EID), CD4 counts, and HIV genotyping.\n<\/p><p>In 2011, UW I-TECH merged all versions of OpenELIS for different laboratories into one core, i.e., OpenELIS Global 1.4, greatly reducing the burden of maintenance and update. Before 2011, we created a customized copy of OpenELIS for each laboratory. This approach was manageable when OpenELIS was implemented in four national laboratories in C\u00f4te d'Ivoire and Haiti. However, as OpenELIS expanded to new laboratories, the time burden of maintaining and updating the software across different versions became excessive. The shift to a common code base shortened the software testing cycle for each new version from approximately 200 hours to 40 hours and permitted a more thorough software testing process and a higher-quality final release.\n<\/p><p>The core software improvements also enabled greater customizability and made it possible for a lab to install and configure OpenELIS without engaging a software developer to customize elements. We added test catalog management features, allowing laboratories to modify catalogs between version releases. Laboratories could make changes to existing tests or add new tests or panels without a software developer adding them manually to the system. New analyzer interfaces were added so that laboratories could import data from analyzers beyond those related to HIV. The core software could be deployed without impacting previous local customizations and further adapted to any setting without code re-write or maintenance. This allowed for countries and laboratories to have more control over what features to include in the software.\n<\/p><p>In 2018, UW I-TECH began an extensive review of the OpenELIS application and identified where the older technology had become obsolete and presented data security risks. OpenELIS Global 2.0, completed in 2019, upgraded the core framework to mitigate security risks (Table 2).\n<\/p>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table class=\"wikitable\" border=\"1\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td colspan=\"3\" style=\"background-color:white; padding-left:10px; padding-right:10px;\"><b>Table 2.<\/b> Open-source components in OpenELIS. HL7 = <a href=\"https:\/\/www.limswiki.org\/index.php\/Health_Level_7\" title=\"Health Level 7\" class=\"wiki-link\" data-key=\"e0bf845fb58d2bae05a846b47629e86f\">Health Level 7<\/a>; FHIR = <a href=\"https:\/\/www.limswiki.org\/index.php\/Fast_Healthcare_Interoperability_Resources\" title=\"Fast Healthcare Interoperability Resources\" class=\"wiki-link\" data-key=\"65dd2a848285f9151006e17e036d596d\">Fast Healthcare Interoperability Resources<\/a>; ASTM = American Society of Testing and Materials\n<\/td><\/tr>\n<tr>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Component\n<\/th>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">OpenELIS Global 1.X series\n<\/th>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">OpenELIS Global 2.X series\n<\/th><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><b>Timeframe<\/b>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Before 2011\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">After 2011\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><b>Operating system<\/b>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Ubuntu 12\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Ubuntu 20\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><b>Programming framework<\/b>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Java Struts 1\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Java Spring\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><b>Web application<\/b>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Tomcat\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Tomcat\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><b>Database<\/b>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><a href=\"https:\/\/www.limswiki.org\/index.php\/PostgreSQL\" title=\"PostgreSQL\" class=\"wiki-link\" data-key=\"a5dd945cdcb63e2d8f7a5edb3a896d82\">PostgreSQL<\/a>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">PostgreSQL\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><b>Interoperability<\/b>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Mirth, HL7 2.5.1\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">FHIR R4, HL7 2.5.1, ASTM\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><b>Customization<\/b>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Hard-coded multiple forks by developers for each use case\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Core software with flexible customization by users\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<p>Many expansions and improvements in later iterations of OpenELIS stemmed from close collaboration between UW I-TECH and the multi-stakeholder OpenELIS technical working group (TWG) in C\u00f4te d'Ivoire, convened in 2015. The TWG consists of representatives from the MSHP, I-TECH C\u00f4te d'Ivoire, PEPFAR's NGO implementing partners (IPs), and the CDC. UW I-TECH and the design team within the TWG would lead design workshops that start with needs gathering at regional and district hospitals and laboratories using a standardized questionnaire. After reconvening, group members would share the findings on identified needs and gaps in LIS functionality and reporting, prioritizing design features, adding the designs to the roadmap<sup id=\"rdp-ebb-cite_ref-23\" class=\"reference\"><a href=\"#cite_note-23\">[23]<\/a><\/sup>, and writing software specifications.\n<\/p><p>The software development process followed a similar collaborative trajectory as the design process. Before 2014, UW I-TECH conducted all software development, mostly by one senior software developer and joined later by a second developer. All reports, enhancements, and changes relied on the two developers and was dependent on the next release. Starting in 2015, UW I-TECH has provided software development training in C\u00f4te d'Ivoire and created a more collaborative workflow with Ivorian developers so that both design and development have become more localized.\n<\/p>\n<h3><span id=\"rdp-ebb-Deploy,_scale-up,_and_support\"><\/span><span class=\"mw-headline\" id=\"Deploy.2C_scale-up.2C_and_support\">Deploy, scale-up, and support<\/span><\/h3>\n<p>OpenELIS deployment and scale-up took place in several stages since 2009 (Table 3), and the respective roles of the MSHP and I-TECH in the process evolved over time. Before 2015, I-TECH led the deployment process. The deployment at a laboratory began with a team of I-TECH staff from C\u00f4te d'Ivoire and Seattle conducting an initial laboratory assessment. Then, during a second visit, the team deployed a customized version. By the end of 2015, OpenELIS had been deployed at 11 laboratories, covering the entire network of laboratories performing viral load testing at the time (Fig. 2).\n<\/p>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table class=\"wikitable\" border=\"1\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td colspan=\"3\" style=\"background-color:white; padding-left:10px; padding-right:10px;\"><b>Table 3.<\/b> Timeline of the OpenELIS scale-up in C\u00f4te d'Ivoire.\n<\/td><\/tr>\n<tr>\n<th rowspan=\"2\" style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Year\n<\/th>\n<th colspan=\"2\" style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Number of laboratories implementing OpenELIS\n<\/th><\/tr>\n<tr>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">New\n<\/th>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Cumulative\n<\/th><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">2009\u20132012\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">3\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">3\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">2013\u20132015\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">8\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">11\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">2016\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">1\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">12\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">2017\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">31\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">43\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">2018\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">12\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">55\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">2019\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">13\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">68\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">2020\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">28\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">93\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">2021\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">15\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">111\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<p><br \/>\n<a href=\"https:\/\/www.limswiki.org\/index.php\/File:Fig2_He_IntJofMedInfo2023_170.jpg\" class=\"image wiki-link\" data-key=\"9ff953cb01ca9fc60c2b58ed6eb35b05\"><img alt=\"Fig2 He IntJofMedInfo2023 170.jpg\" src=\"https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/d\/db\/Fig2_He_IntJofMedInfo2023_170.jpg\" decoding=\"async\" style=\"width: 100%;max-width: 400px;height: auto;\" \/><\/a>\n<\/p>\n<div style=\"clear:both;\"><\/div>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table border=\"0\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><blockquote><p><b>Figure 2.<\/b> Laboratories in C\u00f4te d'Ivoire that implement OpenELIS before and after 2015. (Color should be used in print).<\/p><\/blockquote>\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<p>In 2015, after the MSHP defined and ratified LIS requirements, they determined that OpenELIS satisfied most of these requirements and would be the system deployed at laboratories throughout the country. The MSHP became the owner of OpenELIS in C\u00f4te d'Ivoire and started collaborating with I-TECH closely in deployment to roll out OpenELIS. The scale-up first prioritized regional referral laboratories that newly started providing viral load testing as part of a MSHP- and CDC-led initiative to scale-up viral load testing. OpenELIS was then deployed in hospitals at the district and local level to support their collection and management of data on routine laboratory testing for both HIV and non-HIV clients. As of 2021, 111 laboratories in C\u00f4te d'Ivoire had implemented OpenELIS (Fig. 2). OpenELIS currently supports testing of <a href=\"https:\/\/www.limswiki.org\/index.php\/Hematology\" title=\"Hematology\" class=\"wiki-link\" data-key=\"de8b49c7b0be3cec33af362e763b9b0c\">hematology<\/a>, <a href=\"https:\/\/www.limswiki.org\/index.php\/Biochemistry\" title=\"Biochemistry\" class=\"wiki-link\" data-key=\"17365d4e36341ee64e5637b81c21fc08\">biochemistry<\/a>, <a href=\"https:\/\/www.limswiki.org\/index.php\/Molecular_biology\" title=\"Molecular biology\" class=\"wiki-link\" data-key=\"c1b2586b4cd56652a8868e37f38c1c3d\">molecular biology<\/a>, serology, and testing of <a href=\"https:\/\/www.limswiki.org\/index.php\/Microbiology\" title=\"Microbiology\" class=\"wiki-link\" data-key=\"920bf32dc9c9cf492c58c4c5484df41f\">microbiology<\/a>, <a href=\"https:\/\/www.limswiki.org\/index.php\/Pathology\" title=\"Pathology\" class=\"wiki-link\" data-key=\"5d8e2230b55d8760dcb729fc7dcd3dc1\">pathology<\/a>, and immunohistochemistry will be available in January 2023.\n<\/p><p>The collaborative deployment and scale-up process started with a series of deployment workshops with relevant stakeholders from the OpenELIS TWG in 2015. Participants received hands-on training on setting up servers and workstations, conducting maintenance and updates, and troubleshooting. During the deployment wave each year, starting from 2015, a team of MSHP implementation, I-TECH C\u00f4te d'Ivoire staff, and IP representatives would organize a week-long implementation trip to deploy the software and perform the initial training of laboratory staff. The team would follow up with the laboratories by phone weekly and conduct a coaching and review visit pne to three months after the deployment and training.\n<\/p><p>Starting in 2020, the MSHP began leading the deployment process with minimal support from I-TECH. The MSHP team conducts all follow-up visits, and the training is facilitated by MSHP trainers with co-facilitation by I-TECH C\u00f4te d\u2019Ivoire. The MSHP also independently operates the OpenELIS Technical Assistance Unit (Cellule d'Assistance Technique de OpenELIS, or CATOE), the technical support call center for OpenELIS. Established in 2016 within the MSHP, CATOE provides direct, real-time technical support to OpenELIS users. CATOE technicians hold bidirectional call services with laboratories to conduct monthly check-ins that proactively probe for issues and to respond to technical assistance requests. CATOE consists of four MSHP staff members who were recruited from the participants of the first OpenELIS implementers' workshop in 2015. The technicians received targeted training on providing real-time support, equipment, phone credits, and a six-month mentorship with the primary support and development staff at I-TECH. CATOE meets monthly with the OpenELIS TWG to review activities and findings from the support calls, feeding information into the software roadmap.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Strengthening_local_leadership_and_ownership\">Strengthening local leadership and ownership<\/span><\/h3>\n<p>The C\u00f4te d'Ivoire MSHP started collaborating with I-TECH in OpenELIS implementation more actively in 2015. The MSHP initiated a reorganization process in 2014 that spurred the creation of the Department of Informatics and Health Information (Direction de l'Informatique et de l'Information Sanitaire, or DIIS) in 2015 to consolidate and coordinate health informatics activities in the country. This designation signaled a leadership commitment to ownership of HIS development, implementation, and management activities nationally. In 2017 the MSHP incorporated the designation of OpenELIS and its scale-up in the National Strategic Plan for the Development of Medical Biology Laboratories 2017\u20132020.<sup id=\"rdp-ebb-cite_ref-24\" class=\"reference\"><a href=\"#cite_note-24\">[24]<\/a><\/sup>\n<\/p><p>The continuous strengthening of MSHP leadership demonstrates comprehensive ownership of not only the software and hardware but also the essential knowledge, skills, and processes to sustain routine OpenELIS implementation. Before 2015, the MSHP was only involved in site selection for OpenELIS. After the formation of DIIS, the MSHP joined I-TECH throughout the implementation process from forming the TWG, gathering needs, and training developers and technicians to deploying the software and providing technical support. By 2020, the DIIS was conducting follow-up visits and operating CATOE independently, leading the deployment process, configuration of servers, and training of new and existing users.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Building_local_capacity\">Building local capacity<\/span><\/h3>\n<p>In addition to providing the software and hardware and strengthening local leadership, building local capacity for implementing OpenELIS in C\u00f4te d'Ivoire is also critical. Training on various topics along the software development pipeline and in various formats has equipped Ivorian policymakers and technicians with necessary knowledge and skills for routine OpenELIS implementation and maintenance.\n<\/p><p>Before 2015, UW I-TECH staff initially provided on-the-job training (OJT) on OpenELIS deployment and upgrade to selected staff at the MSHP, national laboratories, and IPs. In 2014, a targeted month-long training on OpenELIS development took place in Seattle for software developers with background in Java from the MSHP, Institut Pasteur C\u00f4te d'Ivoire, Institut National Polytechnique F\u00e9lix Houphou\u00ebt-Boigny (INPHB; a public polytechnic institute of higher education), and I-TECH C\u00f4te d'Ivoire. After participants returned to C\u00f4te d'Ivoire, UW I-TECH staff provided remote mentoring and exercises. While the results of the OJT and targeted training were promising, the time and resources for replicating these formats became unsustainably high as the OpenELIS scale-up started in 2015.\n<\/p><p>In response, UW I-TECH started collaborating with the MSHP in 2015 to develop a full suite of materials for OpenELIS, including a package for trainers and users, and to lead a series of training of trainers (TOT) sessions within C\u00f4te d'Ivoire. The week-long TOTs used theoretical and practical activities and took a holistic technical approach covering a range of topics from design, planning, development, and programming to implementation and support. Among the participants at the first TOT, one became the deputy director of DIIS, and most joined the OpenELIS TWG. The TOT participants later conducted cascade training led by the MSHP during the OpenELIS scale-up. Cascade training participants provided largely positive ratings, appreciating the theoretical and practical exercises. The TOTs and cascade trainings have been an integral part of the deployment and scale-up process since 2015, and they have formed a cadre of trained teams in C\u00f4te d'Ivoire to ensure sustainable OpenELIS deployment and support.\n<\/p><p>The collaboration between I-TECH and INPHB incorporated OpenELIS into the computer science curriculum and started the OpenELIS internship at INPHB. In 2016, two INPHB faculty received training on OpenELIS software development from UW I-TECH, and they started using OpenELIS as an example LIS to teach students in computer science. In 2018, the OpenELIS internship program started with three students studying at INPHB and working with I-TECH C\u00f4te d'Ivoire simultaneously to practice OpenELIS software development, deployment, and technical support. The training program and assessment process became standardized in 2019, and two interns per year embedded with I-TECH or MSHP teams for one year. Ten interns have graduated from the program, and one was eventually hired as I-TECH C\u00f4te d'Ivoire staff.\n<\/p><p>In addition to periodic training and the internship program, software developer retreats and opportunities to attend and present at international and regional conferences for HIV\/AIDS or <a href=\"https:\/\/www.limswiki.org\/index.php\/Health_informatics\" title=\"Health informatics\" class=\"wiki-link\" data-key=\"055eb51f53cfdbacc08ed150b266c9f4\">health informatics<\/a> have also been part of capacity building.\n<\/p>\n<h3><span id=\"rdp-ebb-Supporting_data-driven_decision-making_in_HIV\/AIDS\"><\/span><span class=\"mw-headline\" id=\"Supporting_data-driven_decision-making_in_HIV.2FAIDS\">Supporting data-driven decision-making in HIV\/AIDS<\/span><\/h3>\n<p>To transform data stored in OpenELIS into <a href=\"https:\/\/www.limswiki.org\/index.php\/Information\" title=\"Information\" class=\"wiki-link\" data-key=\"6300a14d9c2776dcca0999b5ed940e7d\">information<\/a> that is meaningful for decision-making, I-TECH built the online data dashboards that display aggregate data on viral load testing and EID imported from OpenELIS.<sup id=\"rdp-ebb-cite_ref-25\" class=\"reference\"><a href=\"#cite_note-25\">[25]<\/a><\/sup> The dashboards import data from OpenELIS and create visualizations that help the MSHP, IPs, and CDC monitor performance along the HIV care cascade and make programmatic decisions to improve quality of care. For example, the viral load dashboard helped discover a large group of clients who only had initial HIV diagnostic and viral load tests but no follow-up tests across multiple regions in C\u00f4te d'Ivoire. This issue would have been hidden before the dashboarding process cleaned, consolidated, and visualized the data. The MSHP and CDC based their directions for the regions and IPs on the discovery from the dashboard.\n<\/p><p>I-TECH also developed the pediatric HIV case management tool that combined OpenELIS data of pediatric HIV clients with those from the HIV <a href=\"https:\/\/www.limswiki.org\/index.php\/Electronic_medical_record\" title=\"Electronic medical record\" class=\"wiki-link\" data-key=\"99a695d2af23397807da0537d29d0be7\">electronic medical records<\/a> (EMR) system in C\u00f4te d'Ivoire. This tool helped health facilities and districts identify and follow up with lost-to-follow-up pediatric clients and parents and those whose viral load test results indicated a decline in antiretroviral regimen effectiveness. OpenELIS's pivotal role as an essential public health tool was solidified.\n<\/p>\n<h3><span id=\"rdp-ebb-Networking,_interoperability_between_systems,_and_expansion\"><\/span><span class=\"mw-headline\" id=\"Networking.2C_interoperability_between_systems.2C_and_expansion\">Networking, interoperability between systems, and expansion<\/span><\/h3>\n<p>To respond to emerging needs from the MSHP and laboratories, the OpenELIS project will always have room for adaptation and growth. Current activities include transitioning from a series of individual instances of OpenELIS to a more interconnected national laboratory information system through system networking. The pilot of a consolidated server for the national laboratory data warehouse began in 2021, bringing all laboratory data to one central location for reporting and real-time decision-making by the MSHP. The continuous demands from laboratories to add more testing modules to OpenELIS motivated the project to start developing modules for tuberculosis, COVID-19, and enhanced support for molecular biology and bidirectional analyzer interfacing. A reference testing workflow has been developed, allowing results to be sent between OpenELIS instances and providing laboratory results instantly between laboratories and reference laboratories to aid diagnosis and allow for faster treatment. Programmatically, I-TECH will continue to work with the C\u00f4te d'Ivoire MSHP to provide necessary assistance for the full transition.\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Discussion\">Discussion<\/span><\/h2>\n<p>To our knowledge, this is the first case study of best practices and lessons learned from the implementation of a LIS in a tiered laboratory system in West Africa. This case study illustrates the development, implementation, and capacity building process for OpenELIS in C\u00f4te d'Ivoire since 2009, with support from PEPFAR, as part of an initiative to strengthen the national laboratory system. The open-source nature of OpenELIS coupled with the close partnership between the MSHP and I-TECH have facilitated the collaborative, iterative process of designing, developing, deploying, and scaling up OpenELIS in C\u00f4te d'Ivoire. Strong local leadership and ownership of OpenELIS implementation contributed to the scaling and sustainment of routine use of OpenELIS at laboratories nationwide beyond the first 13 years. The improved capacity and talent pool for OpenELIS implementation and support, resulting from continuous training efforts, also facilitated scaling and sustainment. OpenELIS and its dependent data dashboards have already demonstrated value in supporting the MSHP and other stakeholders in data-driven decision-making.\n<\/p>\n<h3><span id=\"rdp-ebb-Open-source_design_and_CoPs-supported_software_adoption,_implementation,_sustainability,_and_innovation\"><\/span><span class=\"mw-headline\" id=\"Open-source_design_and_CoPs-supported_software_adoption.2C_implementation.2C_sustainability.2C_and_innovation\">Open-source design and CoPs-supported software adoption, implementation, sustainability, and innovation<\/span><\/h3>\n<p>The open-source nature and the resulting potential for in-country capacity building and ownership of OpenELIS were the main reasons why the C\u00f4te d'Ivoire MSHP decided to adopt it. Reports from open-source LIS software projects in other settings, including the OpenELIS project in Vietnam<sup id=\"rdp-ebb-cite_ref-:2_12-3\" class=\"reference\"><a href=\"#cite_note-:2-12\">[12]<\/a><\/sup>, a LIS pilot for tuberculosis in Peru<sup id=\"rdp-ebb-cite_ref-26\" class=\"reference\"><a href=\"#cite_note-26\">[26]<\/a><\/sup>, and a LIS pilot for HIV in Malawi<sup id=\"rdp-ebb-cite_ref-27\" class=\"reference\"><a href=\"#cite_note-27\">[27]<\/a><\/sup>, have also underscored the value of open-source software in LMICs. Open-source software provide flexibility and agility so that governments can start with a pilot project and gradually build in more functions as use cases evolve and expand. The open-source nature invites collaboration and cultivates local capacity so that costs of development and maintenance will decrease over time, contributing to sustainability. Digital Square, a global consortium for promoting health equity through digital health, designated OpenELIS in 2018 as a digital \u201cglobal good.\u201d<sup id=\"rdp-ebb-cite_ref-28\" class=\"reference\"><a href=\"#cite_note-28\">[28]<\/a><\/sup> A CoP was also developed to support the advancement and implementation of OpenELIS globally. As of October 2020, over 270 laboratories in 18 LMICs in sub-Saharan Africa, Asia, and the Caribbean use OpenELIS.\n<\/p><p>Continuous maintenance and funding support for software is crucial after the initial launch<sup id=\"rdp-ebb-cite_ref-29\" class=\"reference\"><a href=\"#cite_note-29\">[29]<\/a><\/sup>, and the OpenELIS CoP worldwide is a model that facilitates sustainable implementation, meaningful collaboration, and local ownership. There are three common models for implementing open-source software in LMICs, namely <a href=\"https:\/\/www.limswiki.org\/index.php\/Software_as_a_service\" title=\"Software as a service\" class=\"wiki-link\" data-key=\"ae8c8a7cd5ee1a264f4f0bbd4a4caedd\">software as a service<\/a> (SaaS)<sup id=\"rdp-ebb-cite_ref-30\" class=\"reference\"><a href=\"#cite_note-30\">[30]<\/a><\/sup>, donor investment in the core global good<sup id=\"rdp-ebb-cite_ref-31\" class=\"reference\"><a href=\"#cite_note-31\">[31]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-32\" class=\"reference\"><a href=\"#cite_note-32\">[32]<\/a><\/sup>, and CoP.<sup id=\"rdp-ebb-cite_ref-33\" class=\"reference\"><a href=\"#cite_note-33\">[33]<\/a><\/sup> The first two models keep the knowledge and maintenance responsibility with the developers who are usually in high-income countries, and funding can be highly donor-driven. On the contrary, the CoP model brings a variety of actors and resources to a shared table to support the core stewardship and maintenance of the global good. The large-scale adoption of OpenELIS through different funding streams, not just PEPFAR, has led to a broader set of features and more sustainable cost-sharing, including recent co-investment from LMICs and the U.S. in 2021. Each implementing country benefits from features developed for other use cases due to the single code base and flexible administrative options. The OpenELIS CoP continuously supports the development of innovations and flexible design that can be used across use cases.<sup id=\"rdp-ebb-cite_ref-:5_7-1\" class=\"reference\"><a href=\"#cite_note-:5-7\">[7]<\/a><\/sup>\n<\/p>\n<h3><span id=\"rdp-ebb-Collaboration,_capacity_building,_and_local_ownership_are_the_key_to_sustainable_implementation\"><\/span><span class=\"mw-headline\" id=\"Collaboration.2C_capacity_building.2C_and_local_ownership_are_the_key_to_sustainable_implementation\">Collaboration, capacity building, and local ownership are the key to sustainable implementation<\/span><\/h3>\n<p>Numerous global health projects have struggled to continue beyond the pilot or trial phase, and one of the key barriers to scale-up and sustainability is lack of local ownership and leadership at each level of the system.<sup id=\"rdp-ebb-cite_ref-34\" class=\"reference\"><a href=\"#cite_note-34\">[34]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-35\" class=\"reference\"><a href=\"#cite_note-35\">[35]<\/a><\/sup> The collaboration between the MSHP and I-TECH is the nurturing ground for the decade-long OpenELIS project in C\u00f4te d'Ivoire. The open-source and global CoP of software such as OpenELIS naturally support technical collaboration and exchange.<sup id=\"rdp-ebb-cite_ref-36\" class=\"reference\"><a href=\"#cite_note-36\">[36]<\/a><\/sup> However, without committed engagement and close partnership with the MSHP, the OpenELIS design and development process in C\u00f4te d'Ivoire would likely have been less participatory, less successful, and less sustainable.<sup id=\"rdp-ebb-cite_ref-37\" class=\"reference\"><a href=\"#cite_note-37\">[37]<\/a><\/sup>\n<\/p><p>The improved local capacity of software development and maintenance for OpenELIS is an important contribution toward the vision of long-term, locally sustained implementation. Providing information technology (IT) without investing in human resources or building capacity would still be inadequate in addressing the gaps in the laboratory system.<sup id=\"rdp-ebb-cite_ref-:4_2-1\" class=\"reference\"><a href=\"#cite_note-:4-2\">[2]<\/a><\/sup> Therefore, the policymakers and technicians trained in OpenELIS development and deployment, as well as the interns embedded in MSHP teams to support OpenELIS implementation, will ensure the medium- and long-term success of the project.\n<\/p><p>The collaboration has also strengthened local ownership of OpenELIS and leadership of relevant software development and support activities to achieve routine usage and nationwide scale. Although the OpenELIS project in C\u00f4te d'Ivoire is still receiving funding by the U.S. government as part of PEPFAR, and the C\u00f4te d'Ivoire MSHP has not committed to completely taking over the continuous implementation of OpenELIS, there has at least been progress towards this goal. Transition of all OpenELIS-related planning, design, development, and implementation to the MSHP has been underway as of March 2022.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Limitations\">Limitations<\/span><\/h3>\n<p>This case study represents the experiences of one LIS project in C\u00f4te d'Ivoire and thus may not be generalizable to other settings, though the lessons learned are relevant to many HIS strengthening projects in LMICs. Evaluation research that uses rigorous quantitative, qualitative, or mixed methods is necessary to assess and demonstrate the reach, effectiveness, adoption, implementation, and maintenance of the project.<sup id=\"rdp-ebb-cite_ref-38\" class=\"reference\"><a href=\"#cite_note-38\">[38]<\/a><\/sup> For example, one could evaluate the use of a quasi-experimental design to assess the effectiveness of improving laboratory testing data quality (e.g., data timeliness, data completeness, data validity) and service quality (e.g., TAT, testing validity) by comparing LIS to paper records, or the use of a qualitative study to interview laboratory staff about the facilitators and barriers to LIS implementation.\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Conclusions\">Conclusions<\/span><\/h2>\n<p>The development and nationwide scale-up of OpenELIS in C\u00f4te d\u2019Ivoire for over a decade have relied on the open-source software design, CoP support, close collaboration with the C\u00f4te d\u2019Ivoire MSHP, and cultivation of local ownership and capacity since inception. Other countries and supporting partners planning to adapt and nationally scale LIS may consider the importance of HIS workforce development, financial sustainability, and institutionalization of government ownership and technical leadership.\n<\/p><p>Before this study, the following was already known:\n<\/p>\n<ul><li>LIS has the potential to increase accuracy and timeliness of laboratory data, supporting diagnostic testing and clinical monitoring.<\/li>\n<li>Factors for scaling and sustaining LIS in LMICs have not been previously described.<\/li><\/ul>\n<p>This study added the following to our knowledge:\n<\/p>\n<ul><li>OpenELIS, an open-source electronic LIS, has been implemented in C\u00f4te d'Ivoire since 2009 and scaled nationwide to 111 clinical and reference laboratories.<\/li>\n<li>Successful adoption, scaling, and sustainment of OpenELIS has relied on active collaboration starting in the earliest planning phases and integrating local partners, regulatory agencies, and technical experts into every step of the design, implementation, and evaluation phases.<\/li>\n<li>Other countries and supporting partners planning to adapt and nationally scale LIS may consider the importance of carefully developing plans for 1) workforce development in both end users and system administrators; 2) financial sustainability; and 3) institutionalization of government ownership and technical leadership.<\/li><\/ul>\n<h2><span id=\"rdp-ebb-Abbreviations,_acronyms,_and_initialisms\"><\/span><span class=\"mw-headline\" id=\"Abbreviations.2C_acronyms.2C_and_initialisms\">Abbreviations, acronyms, and initialisms<\/span><\/h2>\n<ul><li><b>ASTM<\/b>: American Society of Testing and Materials<\/li>\n<li><b>CATOE<\/b>: Cellule d'Assistance Technique de OpenELIS<\/li>\n<li><b>CDC<\/b>: Centers for Disease Control and Prevention<\/li>\n<li><b>CNESVS<\/b>: C\u00f4te d'Ivoire Comit\u00e9 National d'Ethique des Sciences de la Vie et de la Sant\u00e9<\/li>\n<li><b>CoP<\/b>: community of practice<\/li>\n<li><b>DIIS<\/b>: Direction de l'Informatique et de l'Information Sanitaire<\/li>\n<li><b>eLIS<\/b>: electronic laboratory information system<\/li>\n<li><b>EID<\/b>: early infant diagnosis<\/li>\n<li><b>EMR<\/b>: electronic medical record<\/li>\n<li><b>FHIR<\/b>: Fast Healthcare Interoperability Resources<\/li>\n<li><b>HIS<\/b>: health information system<\/li>\n<li><b>HL7<\/b>: Health Level 7<\/li>\n<li><b>I-TECH<\/b>: International Training and Education Center for Health<\/li>\n<li><b>INPHB<\/b>: Institut Pasteur C\u00f4te d'Ivoire, Institut National Polytechnique F\u00e9lix Houphou\u00ebt-Boigny<\/li>\n<li><b>IP<\/b>: implementing partner<\/li>\n<li><b>LIS<\/b>: laboratory information system<\/li>\n<li><b>LMIC<\/b>: low- and middle-income country<\/li>\n<li><b>MOH<\/b>: Ministry of Health<\/li>\n<li><b>MSHP<\/b>: Minist\u00e8re de la Sant\u00e9 et de l\u2019Hygi\u00e8ne Publique<\/li>\n<li><b>OJT<\/b>: on-the-job training<\/li>\n<li><b>OpenELIS<\/b>: Open-source Electronic Laboratory Information System<\/li>\n<li><b>PEPFAR<\/b>: U.S. President's Emergency Fund for AIDS Relief<\/li>\n<li><b>SMS<\/b>: Short Message Service<\/li>\n<li><b>SOCI<\/b>: Stages of Continuous Improvement<\/li>\n<li><b>TAT<\/b>: turnaround time<\/li>\n<li><b>TOT<\/b>: training of trainers<\/li>\n<li><b>TWG<\/b>: technical working group<\/li>\n<li><b>UW<\/b>: University of Washington<\/li><\/ul>\n<h2><span class=\"mw-headline\" id=\"Acknowledgements\">Acknowledgements<\/span><\/h2>\n<p>We thank the C\u00f4te d'Ivoire MSHP and all implementing laboratories for the continuous collaboration. We thank Oliver Defawe, Paul Schwartz, Justin Sogo, Emily DeRiel for their programming and project planning support early in this work. We thank the CDC and our fellow PEPFAR IPs (ACONDA, Ariel Glaser Foundation, Elizabeth Glaser Pediatric AIDS Foundation, ICAP, SEV-CI, and Health Alliance International) for their collaboration in the implementation and optimization of OpenELIS in C\u00f4te d'Ivoire.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Funding\">Funding<\/span><\/h3>\n<p>Funding for this work was provided by the U.S. Health Services and Resources Administration (#6U91HA06801) and CDC (#NU2GGH001968-05-00) awarded to the University of Washington.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Conflict_of_interest\">Conflict of interest<\/span><\/h3>\n<p>The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.\n<\/p>\n<h2><span class=\"mw-headline\" id=\"References\">References<\/span><\/h2>\n<div class=\"reflist references-column-width\" style=\"-moz-column-width: 30em; -webkit-column-width: 30em; column-width: 30em; list-style-type: decimal;\">\n<div class=\"mw-references-wrap mw-references-columns\"><ol class=\"references\">\n<li id=\"cite_note-:0-1\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:0_1-0\">1.0<\/a><\/sup> <sup><a href=\"#cite_ref-:0_1-1\">1.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Wilson, Michael L; Fleming, Kenneth A; Kuti, Modupe A; Looi, Lai Meng; Lago, Nestor; Ru, Kun (1 May 2018). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0140673618304586\" target=\"_blank\">\"Access to pathology and laboratory medicine services: a crucial gap\"<\/a> (in en). <i>The Lancet<\/i> <b>391<\/b> (10133): 1927\u20131938. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2FS0140-6736%2818%2930458-6\" target=\"_blank\">10.1016\/S0140-6736(18)30458-6<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0140673618304586\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0140673618304586<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Access+to+pathology+and+laboratory+medicine+services%3A+a+crucial+gap&rft.jtitle=The+Lancet&rft.aulast=Wilson&rft.aufirst=Michael+L&rft.au=Wilson%2C%26%2332%3BMichael+L&rft.au=Fleming%2C%26%2332%3BKenneth+A&rft.au=Kuti%2C%26%2332%3BModupe+A&rft.au=Looi%2C%26%2332%3BLai+Meng&rft.au=Lago%2C%26%2332%3BNestor&rft.au=Ru%2C%26%2332%3BKun&rft.date=1+May+2018&rft.volume=391&rft.issue=10133&rft.pages=1927%E2%80%931938&rft_id=info:doi\/10.1016%2FS0140-6736%2818%2930458-6&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS0140673618304586&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:4-2\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:4_2-0\">2.0<\/a><\/sup> <sup><a href=\"#cite_ref-:4_2-1\">2.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Sayed, Shahin; Cherniak, William; Lawler, Mark; Tan, Soo Yong; El Sadr, Wafaa; Wolf, Nicholas; Silkensen, Shannon; Brand, Nathan <i>et al.<\/i> (1 May 2018). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0140673618304598\" target=\"_blank\">\"Improving pathology and laboratory medicine in low-income and middle-income countries: roadmap to solutions\"<\/a> (in en). <i>The Lancet<\/i> <b>391<\/b> (10133): 1939\u20131952. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2FS0140-6736%2818%2930459-8\" target=\"_blank\">10.1016\/S0140-6736(18)30459-8<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0140673618304598\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0140673618304598<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Improving+pathology+and+laboratory+medicine+in+low-income+and+middle-income+countries%3A+roadmap+to+solutions&rft.jtitle=The+Lancet&rft.aulast=Sayed&rft.aufirst=Shahin&rft.au=Sayed%2C%26%2332%3BShahin&rft.au=Cherniak%2C%26%2332%3BWilliam&rft.au=Lawler%2C%26%2332%3BMark&rft.au=Tan%2C%26%2332%3BSoo+Yong&rft.au=El+Sadr%2C%26%2332%3BWafaa&rft.au=Wolf%2C%26%2332%3BNicholas&rft.au=Silkensen%2C%26%2332%3BShannon&rft.au=Brand%2C%26%2332%3BNathan&rft.au=Looi%2C%26%2332%3BLai+Meng&rft.date=1+May+2018&rft.volume=391&rft.issue=10133&rft.pages=1939%E2%80%931952&rft_id=info:doi\/10.1016%2FS0140-6736%2818%2930459-8&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS0140673618304598&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-3\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-3\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Al Knawy, Bandar; McKillop, Mollie Marian; Abduljawad, Joud; Tarkoma, Sasu; Adil, Mahmood; Schaper, Louise; Chee, Adam; Bates, David W. <i>et al.<\/i> (23 February 2022). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/jamanetwork.com\/journals\/jamanetworkopen\/fullarticle\/2789277\" target=\"_blank\">\"Successfully Implementing Digital Health to Ensure Future Global Health Security During Pandemics: A Consensus Statement\"<\/a> (in en). <i>JAMA Network Open<\/i> <b>5<\/b> (2): e220214. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1001%2Fjamanetworkopen.2022.0214\" target=\"_blank\">10.1001\/jamanetworkopen.2022.0214<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2574-3805\" target=\"_blank\">2574-3805<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/jamanetwork.com\/journals\/jamanetworkopen\/fullarticle\/2789277\" target=\"_blank\">https:\/\/jamanetwork.com\/journals\/jamanetworkopen\/fullarticle\/2789277<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Successfully+Implementing+Digital+Health+to+Ensure+Future+Global+Health+Security+During+Pandemics%3A+A+Consensus+Statement&rft.jtitle=JAMA+Network+Open&rft.aulast=Al+Knawy&rft.aufirst=Bandar&rft.au=Al+Knawy%2C%26%2332%3BBandar&rft.au=McKillop%2C%26%2332%3BMollie+Marian&rft.au=Abduljawad%2C%26%2332%3BJoud&rft.au=Tarkoma%2C%26%2332%3BSasu&rft.au=Adil%2C%26%2332%3BMahmood&rft.au=Schaper%2C%26%2332%3BLouise&rft.au=Chee%2C%26%2332%3BAdam&rft.au=Bates%2C%26%2332%3BDavid+W.&rft.au=Klag%2C%26%2332%3BMichael&rft.date=23+February+2022&rft.volume=5&rft.issue=2&rft.pages=e220214&rft_id=info:doi\/10.1001%2Fjamanetworkopen.2022.0214&rft.issn=2574-3805&rft_id=https%3A%2F%2Fjamanetwork.com%2Fjournals%2Fjamanetworkopen%2Ffullarticle%2F2789277&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:1-4\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:1_4-0\">4.0<\/a><\/sup> <sup><a href=\"#cite_ref-:1_4-1\">4.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation web\">National Health Laboratory Service (May 2020). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.nhls.ac.za\/wp-content\/uploads\/2020\/05\/NHLS_Annual_Report_2019_Revised_00000004.pdf\" target=\"_blank\">\"National Health Laboratory Service Annual Report 2018\/19\"<\/a> (PDF)<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.nhls.ac.za\/wp-content\/uploads\/2020\/05\/NHLS_Annual_Report_2019_Revised_00000004.pdf\" target=\"_blank\">https:\/\/www.nhls.ac.za\/wp-content\/uploads\/2020\/05\/NHLS_Annual_Report_2019_Revised_00000004.pdf<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 20 February 2021<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=National+Health+Laboratory+Service+Annual+Report+2018%2F19&rft.atitle=&rft.aulast=National+Health+Laboratory+Service&rft.au=National+Health+Laboratory+Service&rft.date=May+2020&rft_id=https%3A%2F%2Fwww.nhls.ac.za%2Fwp-content%2Fuploads%2F2020%2F05%2FNHLS_Annual_Report_2019_Revised_00000004.pdf&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-5\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-5\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Namibia Institute of Pathology Limited (November 2019). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/nip.com.na\/wp-content\/uploads\/2019\/11\/NIP-Annual-Report-2018_updated-6-3.pdf\" target=\"_blank\">\"Namibia Institute of Pathology Limited Annual Report 2017\u201318\"<\/a> (PDF)<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/nip.com.na\/wp-content\/uploads\/2019\/11\/NIP-Annual-Report-2018_updated-6-3.pdf\" target=\"_blank\">https:\/\/nip.com.na\/wp-content\/uploads\/2019\/11\/NIP-Annual-Report-2018_updated-6-3.pdf<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 20 February 2021<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Namibia+Institute+of+Pathology+Limited+Annual+Report+2017%E2%80%9318&rft.atitle=&rft.aulast=Namibia+Institute+of+Pathology+Limited&rft.au=Namibia+Institute+of+Pathology+Limited&rft.date=November+2019&rft_id=https%3A%2F%2Fnip.com.na%2Fwp-content%2Fuploads%2F2019%2F11%2FNIP-Annual-Report-2018_updated-6-3.pdf&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-6\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-6\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Abera, W.S. (June 2013). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/etd.aau.edu.et\/handle\/123456789\/14825\" target=\"_blank\">\"Data Exchnage Interoprability Framework for Laboratory Information System (Lis) and Electronic Health Record (Ehr) of Two Hospitals in Addis Ababa\"<\/a>. Addis Ababa University Libraries<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/etd.aau.edu.et\/handle\/123456789\/14825\" target=\"_blank\">http:\/\/etd.aau.edu.et\/handle\/123456789\/14825<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 20 February 2021<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Data+Exchnage+Interoprability+Framework+for+Laboratory+Information+System+%28Lis%29+and+Electronic+Health+Record+%28Ehr%29+of+Two+Hospitals+in+Addis+Ababa&rft.atitle=&rft.aulast=Abera%2C+W.S.&rft.au=Abera%2C+W.S.&rft.date=June+2013&rft.pub=Addis+Ababa+University+Libraries&rft_id=http%3A%2F%2Fetd.aau.edu.et%2Fhandle%2F123456789%2F14825&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:5-7\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:5_7-0\">7.0<\/a><\/sup> <sup><a href=\"#cite_ref-:5_7-1\">7.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Pyrko, Igor; D\u00f6rfler, Viktor; Eden, Colin (1 April 2017). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/journals.sagepub.com\/doi\/10.1177\/0018726716661040\" target=\"_blank\">\"Thinking together: What makes Communities of Practice work?\"<\/a> (in en). <i>Human Relations<\/i> <b>70<\/b> (4): 389\u2013409. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1177%2F0018726716661040\" target=\"_blank\">10.1177\/0018726716661040<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0018-7267\" target=\"_blank\">0018-7267<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC5305036\/\" target=\"_blank\">PMC5305036<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/28232754\" target=\"_blank\">28232754<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/journals.sagepub.com\/doi\/10.1177\/0018726716661040\" target=\"_blank\">http:\/\/journals.sagepub.com\/doi\/10.1177\/0018726716661040<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Thinking+together%3A+What+makes+Communities+of+Practice+work%3F&rft.jtitle=Human+Relations&rft.aulast=Pyrko&rft.aufirst=Igor&rft.au=Pyrko%2C%26%2332%3BIgor&rft.au=D%C3%B6rfler%2C%26%2332%3BViktor&rft.au=Eden%2C%26%2332%3BColin&rft.date=1+April+2017&rft.volume=70&rft.issue=4&rft.pages=389%E2%80%93409&rft_id=info:doi\/10.1177%2F0018726716661040&rft.issn=0018-7267&rft_id=info:pmc\/PMC5305036&rft_id=info:pmid\/28232754&rft_id=http%3A%2F%2Fjournals.sagepub.com%2Fdoi%2F10.1177%2F0018726716661040&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-8\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-8\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Syzdykova, Assel; Malta, Andr\u00e9; Zolfo, Maria; Diro, Ermias; Oliveira, Jos\u00e9 Luis (13 November 2017). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/medinform.jmir.org\/2017\/4\/e44\/\" target=\"_blank\">\"Open-Source Electronic Health Record Systems for Low-Resource Settings: Systematic Review\"<\/a> (in en). <i>JMIR Medical Informatics<\/i> <b>5<\/b> (4): e44. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.2196%2Fmedinform.8131\" target=\"_blank\">10.2196\/medinform.8131<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2291-9694\" target=\"_blank\">2291-9694<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC5703976\/\" target=\"_blank\">PMC5703976<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/29133283\" target=\"_blank\">29133283<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/medinform.jmir.org\/2017\/4\/e44\/\" target=\"_blank\">http:\/\/medinform.jmir.org\/2017\/4\/e44\/<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Open-Source+Electronic+Health+Record+Systems+for+Low-Resource+Settings%3A+Systematic+Review&rft.jtitle=JMIR+Medical+Informatics&rft.aulast=Syzdykova&rft.aufirst=Assel&rft.au=Syzdykova%2C%26%2332%3BAssel&rft.au=Malta%2C%26%2332%3BAndr%C3%A9&rft.au=Zolfo%2C%26%2332%3BMaria&rft.au=Diro%2C%26%2332%3BErmias&rft.au=Oliveira%2C%26%2332%3BJos%C3%A9+Luis&rft.date=13+November+2017&rft.volume=5&rft.issue=4&rft.pages=e44&rft_id=info:doi\/10.2196%2Fmedinform.8131&rft.issn=2291-9694&rft_id=info:pmc\/PMC5703976&rft_id=info:pmid\/29133283&rft_id=http%3A%2F%2Fmedinform.jmir.org%2F2017%2F4%2Fe44%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-9\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-9\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Flowers, J. (6 April 2021). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/wiki.ohie.org\/display\/SUB\/Open%2bSource%2bLab%2bInformation%2bSystems%2band%2bTools\" target=\"_blank\">\"Open Source Lab Information Systems and Tools\"<\/a>. <i>OpenHIE<\/i><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/wiki.ohie.org\/display\/SUB\/Open%2bSource%2bLab%2bInformation%2bSystems%2band%2bTools\" target=\"_blank\">https:\/\/wiki.ohie.org\/display\/SUB\/Open%2bSource%2bLab%2bInformation%2bSystems%2band%2bTools<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 22 May 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Open+Source+Lab+Information+Systems+and+Tools&rft.atitle=OpenHIE&rft.aulast=Flowers%2C+J.&rft.au=Flowers%2C+J.&rft.date=6+April+2021&rft_id=https%3A%2F%2Fwiki.ohie.org%2Fdisplay%2FSUB%2FOpen%252bSource%252bLab%252bInformation%252bSystems%252band%252bTools&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-10\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-10\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">McKay, Mary M.; Sensoy Bahar, Ozge; Ssewamala, Fred M. (1 January 2020). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0165178119308224\" target=\"_blank\">\"Implementation science in global health settings: Collaborating with governmental & community partners in Uganda\"<\/a> (in en). <i>Psychiatry Research<\/i> <b>283<\/b>: 112585. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.psychres.2019.112585\" target=\"_blank\">10.1016\/j.psychres.2019.112585<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC6954316\/\" target=\"_blank\">PMC6954316<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/31590906\" target=\"_blank\">31590906<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0165178119308224\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0165178119308224<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Implementation+science+in+global+health+settings%3A+Collaborating+with+governmental+%26+community+partners+in+Uganda&rft.jtitle=Psychiatry+Research&rft.aulast=McKay&rft.aufirst=Mary+M.&rft.au=McKay%2C%26%2332%3BMary+M.&rft.au=Sensoy+Bahar%2C%26%2332%3BOzge&rft.au=Ssewamala%2C%26%2332%3BFred+M.&rft.date=1+January+2020&rft.volume=283&rft.pages=112585&rft_id=info:doi\/10.1016%2Fj.psychres.2019.112585&rft_id=info:pmc\/PMC6954316&rft_id=info:pmid\/31590906&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS0165178119308224&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-11\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-11\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Abimbola, Seye; Asthana, Sumegha; Montenegro, Cristian; Guinto, Renzo R.; Jumbam, Desmond Tanko; Louskieter, Lance; Kabubei, Kenneth Munge; Munshi, Shehnaz <i>et al.<\/i> (22 April 2021). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/dx.plos.org\/10.1371\/journal.pmed.1003604\" target=\"_blank\">\"Addressing power asymmetries in global health: Imperatives in the wake of the COVID-19 pandemic\"<\/a> (in en). <i>PLOS Medicine<\/i> <b>18<\/b> (4): e1003604. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1371%2Fjournal.pmed.1003604\" target=\"_blank\">10.1371\/journal.pmed.1003604<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1549-1676\" target=\"_blank\">1549-1676<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC8101997\/\" target=\"_blank\">PMC8101997<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/33886540\" target=\"_blank\">33886540<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/dx.plos.org\/10.1371\/journal.pmed.1003604\" target=\"_blank\">https:\/\/dx.plos.org\/10.1371\/journal.pmed.1003604<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Addressing+power+asymmetries+in+global+health%3A+Imperatives+in+the+wake+of+the+COVID-19+pandemic&rft.jtitle=PLOS+Medicine&rft.aulast=Abimbola&rft.aufirst=Seye&rft.au=Abimbola%2C%26%2332%3BSeye&rft.au=Asthana%2C%26%2332%3BSumegha&rft.au=Montenegro%2C%26%2332%3BCristian&rft.au=Guinto%2C%26%2332%3BRenzo+R.&rft.au=Jumbam%2C%26%2332%3BDesmond+Tanko&rft.au=Louskieter%2C%26%2332%3BLance&rft.au=Kabubei%2C%26%2332%3BKenneth+Munge&rft.au=Munshi%2C%26%2332%3BShehnaz&rft.au=Muraya%2C%26%2332%3BKui&rft.date=22+April+2021&rft.volume=18&rft.issue=4&rft.pages=e1003604&rft_id=info:doi\/10.1371%2Fjournal.pmed.1003604&rft.issn=1549-1676&rft_id=info:pmc\/PMC8101997&rft_id=info:pmid\/33886540&rft_id=https%3A%2F%2Fdx.plos.org%2F10.1371%2Fjournal.pmed.1003604&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:2-12\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:2_12-0\">12.0<\/a><\/sup> <sup><a href=\"#cite_ref-:2_12-1\">12.1<\/a><\/sup> <sup><a href=\"#cite_ref-:2_12-2\">12.2<\/a><\/sup> <sup><a href=\"#cite_ref-:2_12-3\">12.3<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Landgraf, Kenneth M.; Kakkar, Reshma; Meigs, Michelle; Jankauskas, Paul T.; Phan, Thi Thu Huong; Nguyen, Viet Nga; Nguyen, Duy Thai; Duong, Thanh Tung <i>et al.<\/i> (1 September 2016). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1386505616301393\" target=\"_blank\">\"Open-source LIMS in Vietnam: The path toward sustainability and host country ownership\"<\/a> (in en). <i>International Journal of Medical Informatics<\/i> <b>93<\/b>: 92\u2013102. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.ijmedinf.2016.06.010\" target=\"_blank\">10.1016\/j.ijmedinf.2016.06.010<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1386505616301393\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1386505616301393<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Open-source+LIMS+in+Vietnam%3A+The+path+toward+sustainability+and+host+country+ownership&rft.jtitle=International+Journal+of+Medical+Informatics&rft.aulast=Landgraf&rft.aufirst=Kenneth+M.&rft.au=Landgraf%2C%26%2332%3BKenneth+M.&rft.au=Kakkar%2C%26%2332%3BReshma&rft.au=Meigs%2C%26%2332%3BMichelle&rft.au=Jankauskas%2C%26%2332%3BPaul+T.&rft.au=Phan%2C%26%2332%3BThi+Thu+Huong&rft.au=Nguyen%2C%26%2332%3BViet+Nga&rft.au=Nguyen%2C%26%2332%3BDuy+Thai&rft.au=Duong%2C%26%2332%3BThanh+Tung&rft.au=Nguyen%2C%26%2332%3BThi+Hoa&rft.date=1+September+2016&rft.volume=93&rft.pages=92%E2%80%93102&rft_id=info:doi\/10.1016%2Fj.ijmedinf.2016.06.010&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS1386505616301393&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-13\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-13\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation\" id=\"rdp-ebb-CITEREFKaplanMaxwell2005\">Kaplan, Bonnie; Maxwell, Joseph A. (2005), Anderson, James G.; Aydin, Carolyn E., eds., <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/link.springer.com\/10.1007\/0-387-30329-4_2\" target=\"_blank\">\"Qualitative Research Methods for Evaluating Computer Information Systems\"<\/a> (in en), <i>Evaluating the Organizational Impact of Healthcare Information Systems<\/i> (New York: Springer-Verlag): 30\u201355, <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1007%2F0-387-30329-4_2\" target=\"_blank\">10.1007\/0-387-30329-4_2<\/a>, <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-0-387-24558-4<span class=\"printonly\">, <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/link.springer.com\/10.1007\/0-387-30329-4_2\" target=\"_blank\">http:\/\/link.springer.com\/10.1007\/0-387-30329-4_2<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 2023-06-06<\/span><\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Qualitative+Research+Methods+for+Evaluating+Computer+Information+Systems&rft.jtitle=Evaluating+the+Organizational+Impact+of+Healthcare+Information+Systems&rft.aulast=Kaplan&rft.aufirst=Bonnie&rft.au=Kaplan%2C%26%2332%3BBonnie&rft.au=Maxwell%2C%26%2332%3BJoseph+A.&rft.date=2005&rft.pages=30%E2%80%9355&rft.place=New+York&rft.pub=Springer-Verlag&rft_id=info:doi\/10.1007%2F0-387-30329-4_2&rft.isbn=978-0-387-24558-4&rft_id=http%3A%2F%2Flink.springer.com%2F10.1007%2F0-387-30329-4_2&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:3-14\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:3_14-0\">14.0<\/a><\/sup> <sup><a href=\"#cite_ref-:3_14-1\">14.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation web\">MEASURE Evaluation (2019). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.measureevaluation.org\/resources\/publications\/ms-19-158.html\" target=\"_blank\">\"Health Information System Stages of Continuous Improvement Toolkit: User Guide\"<\/a>. <i>MEASURE Evaluation<\/i><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.measureevaluation.org\/resources\/publications\/ms-19-158.html\" target=\"_blank\">https:\/\/www.measureevaluation.org\/resources\/publications\/ms-19-158.html<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 22 May 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Health+Information+System+Stages+of+Continuous+Improvement+Toolkit%3A+User+Guide&rft.atitle=MEASURE+Evaluation&rft.aulast=MEASURE+Evaluation&rft.au=MEASURE+Evaluation&rft.date=2019&rft_id=https%3A%2F%2Fwww.measureevaluation.org%2Fresources%2Fpublications%2Fms-19-158.html&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-15\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-15\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">MEASURE Evaluation (2019). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.measureevaluation.org\/resources\/publications\/ws-19-52.html\" target=\"_blank\">\"Mapping a Path to Improve Uganda\u2019s Health Information System Using the Stages of Continuous Improvement Toolkit\"<\/a>. <i>MEASURE Evaluation<\/i><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.measureevaluation.org\/resources\/publications\/ws-19-52.html\" target=\"_blank\">https:\/\/www.measureevaluation.org\/resources\/publications\/ws-19-52.html<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 22 May 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Mapping+a+Path+to+Improve+Uganda%E2%80%99s+Health+Information+System+Using+the+Stages+of+Continuous+Improvement+Toolkit&rft.atitle=MEASURE+Evaluation&rft.aulast=MEASURE+Evaluation&rft.au=MEASURE+Evaluation&rft.date=2019&rft_id=https%3A%2F%2Fwww.measureevaluation.org%2Fresources%2Fpublications%2Fws-19-52.html&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-16\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-16\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Minist\u00e8re de la Sant\u00e9 Publique (2019). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/web.archive.org\/web\/20220512211831\/https:\/\/www.minsante.cm\/site\/sites\/default\/files\/FR_DOCUMENT_PLAN%20STRATEGIQUE%20NATIONAL%20DE%20SANTE%20NUMERIQUE_R%C3%A9duit.pdf\" target=\"_blank\">\"Plan Strat\u00e9gique National de Sant\u00e9 Num\u00e9rique 2020 - 2024\"<\/a> (PDF). Archived from <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.minsante.cm\/site\/sites\/default\/files\/FR_DOCUMENT_PLAN%20STRATEGIQUE%20NATIONAL%20DE%20SANTE%20NUMERIQUE_R%C3%A9duit.pdf\" target=\"_blank\">the original<\/a> on 12 May 2022<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/web.archive.org\/web\/20220512211831\/https:\/\/www.minsante.cm\/site\/sites\/default\/files\/FR_DOCUMENT_PLAN%20STRATEGIQUE%20NATIONAL%20DE%20SANTE%20NUMERIQUE_R%C3%A9duit.pdf\" target=\"_blank\">https:\/\/web.archive.org\/web\/20220512211831\/https:\/\/www.minsante.cm\/site\/sites\/default\/files\/FR_DOCUMENT_PLAN%20STRATEGIQUE%20NATIONAL%20DE%20SANTE%20NUMERIQUE_R%C3%A9duit.pdf<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 22 May 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Plan+Strat%C3%A9gique+National+de+Sant%C3%A9+Num%C3%A9rique+2020+-+2024&rft.atitle=&rft.aulast=Minist%C3%A8re+de+la+Sant%C3%A9+Publique&rft.au=Minist%C3%A8re+de+la+Sant%C3%A9+Publique&rft.date=2019&rft_id=https%3A%2F%2Fweb.archive.org%2Fweb%2F20220512211831%2Fhttps%3A%2F%2Fwww.minsante.cm%2Fsite%2Fsites%2Fdefault%2Ffiles%2FFR_DOCUMENT_PLAN%2520STRATEGIQUE%2520NATIONAL%2520DE%2520SANTE%2520NUMERIQUE_R%25C3%25A9duit.pdf&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-17\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-17\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Flott, Kelsey; Callahan, Ryan; Darzi, Ara; Mayer, Erik (14 April 2016). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.jmir.org\/2016\/4\/e75\/\" target=\"_blank\">\"A Patient-Centered Framework for Evaluating Digital Maturity of Health Services: A Systematic Review\"<\/a> (in en). <i>Journal of Medical Internet Research<\/i> <b>18<\/b> (4): e75. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.2196%2Fjmir.5047\" target=\"_blank\">10.2196\/jmir.5047<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1438-8871\" target=\"_blank\">1438-8871<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC4850277\/\" target=\"_blank\">PMC4850277<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/27080852\" target=\"_blank\">27080852<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/www.jmir.org\/2016\/4\/e75\/\" target=\"_blank\">http:\/\/www.jmir.org\/2016\/4\/e75\/<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=A+Patient-Centered+Framework+for+Evaluating+Digital+Maturity+of+Health+Services%3A+A+Systematic+Review&rft.jtitle=Journal+of+Medical+Internet+Research&rft.aulast=Flott&rft.aufirst=Kelsey&rft.au=Flott%2C%26%2332%3BKelsey&rft.au=Callahan%2C%26%2332%3BRyan&rft.au=Darzi%2C%26%2332%3BAra&rft.au=Mayer%2C%26%2332%3BErik&rft.date=14+April+2016&rft.volume=18&rft.issue=4&rft.pages=e75&rft_id=info:doi\/10.2196%2Fjmir.5047&rft.issn=1438-8871&rft_id=info:pmc\/PMC4850277&rft_id=info:pmid\/27080852&rft_id=http%3A%2F%2Fwww.jmir.org%2F2016%2F4%2Fe75%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-18\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-18\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Gomes, Jorge; Rom\u00e3o, M\u00e1rio (1 December 2018). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/link.springer.com\/10.1007\/s10916-018-1097-0\" target=\"_blank\">\"Information System Maturity Models in Healthcare\"<\/a> (in en). <i>Journal of Medical Systems<\/i> <b>42<\/b> (12): 235. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1007%2Fs10916-018-1097-0\" target=\"_blank\">10.1007\/s10916-018-1097-0<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0148-5598\" target=\"_blank\">0148-5598<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/link.springer.com\/10.1007\/s10916-018-1097-0\" target=\"_blank\">http:\/\/link.springer.com\/10.1007\/s10916-018-1097-0<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Information+System+Maturity+Models+in+Healthcare&rft.jtitle=Journal+of+Medical+Systems&rft.aulast=Gomes&rft.aufirst=Jorge&rft.au=Gomes%2C%26%2332%3BJorge&rft.au=Rom%C3%A3o%2C%26%2332%3BM%C3%A1rio&rft.date=1+December+2018&rft.volume=42&rft.issue=12&rft.pages=235&rft_id=info:doi\/10.1007%2Fs10916-018-1097-0&rft.issn=0148-5598&rft_id=http%3A%2F%2Flink.springer.com%2F10.1007%2Fs10916-018-1097-0&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-19\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-19\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Carvalho, Jo\u00e3o Vidal; Rocha, \u00c1lvaro; Abreu, Ant\u00f3nio (1 June 2016). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/link.springer.com\/10.1007\/s10916-016-0486-5\" target=\"_blank\">\"Maturity Models of Healthcare Information Systems and Technologies: a Literature Review\"<\/a> (in en). <i>Journal of Medical Systems<\/i> <b>40<\/b> (6): 131. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1007%2Fs10916-016-0486-5\" target=\"_blank\">10.1007\/s10916-016-0486-5<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0148-5598\" target=\"_blank\">0148-5598<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/link.springer.com\/10.1007\/s10916-016-0486-5\" target=\"_blank\">http:\/\/link.springer.com\/10.1007\/s10916-016-0486-5<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Maturity+Models+of+Healthcare+Information+Systems+and+Technologies%3A+a+Literature+Review&rft.jtitle=Journal+of+Medical+Systems&rft.aulast=Carvalho&rft.aufirst=Jo%C3%A3o+Vidal&rft.au=Carvalho%2C%26%2332%3BJo%C3%A3o+Vidal&rft.au=Rocha%2C%26%2332%3B%C3%81lvaro&rft.au=Abreu%2C%26%2332%3BAnt%C3%B3nio&rft.date=1+June+2016&rft.volume=40&rft.issue=6&rft.pages=131&rft_id=info:doi\/10.1007%2Fs10916-016-0486-5&rft.issn=0148-5598&rft_id=http%3A%2F%2Flink.springer.com%2F10.1007%2Fs10916-016-0486-5&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-SHLUIOpenELIS12-20\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-SHLUIOpenELIS12_20-0\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\"><a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.shl.uiowa.edu\/publications\/lablink\/201201\/openelis.xml\" target=\"_blank\">\"OpenELIS comes home\"<\/a>. <i>Lab Link<\/i> (State Hygienic Laboratory at The University of Iowa) <b>4<\/b> (1). January 2012<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/www.shl.uiowa.edu\/publications\/lablink\/201201\/openelis.xml\" target=\"_blank\">http:\/\/www.shl.uiowa.edu\/publications\/lablink\/201201\/openelis.xml<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=OpenELIS+comes+home&rft.jtitle=Lab+Link&rft.date=January+2012&rft.volume=4&rft.issue=1&rft.pub=State+Hygienic+Laboratory+at+The+University+of+Iowa&rft_id=http%3A%2F%2Fwww.shl.uiowa.edu%2Fpublications%2Flablink%2F201201%2Fopenelis.xml&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-21\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-21\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/openmrs.org\/\" target=\"_blank\">\"OpenMRS\"<\/a>. OpenMRS Community<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/openmrs.org\/\" target=\"_blank\">https:\/\/openmrs.org\/<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 22 May 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=OpenMRS&rft.atitle=&rft.pub=OpenMRS+Community&rft_id=https%3A%2F%2Fopenmrs.org%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-22\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-22\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Dings\u00f8yr, Torgeir; Nerur, Sridhar; Balijepally, VenuGopal; Moe, Nils Brede (1 June 2012). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0164121212000532\" target=\"_blank\">\"A decade of agile methodologies: Towards explaining agile software development\"<\/a> (in en). <i>Journal of Systems and Software<\/i> <b>85<\/b> (6): 1213\u20131221. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.jss.2012.02.033\" target=\"_blank\">10.1016\/j.jss.2012.02.033<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0164121212000532\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0164121212000532<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=A+decade+of+agile+methodologies%3A+Towards+explaining+agile+software+development&rft.jtitle=Journal+of+Systems+and+Software&rft.aulast=Dings%C3%B8yr&rft.aufirst=Torgeir&rft.au=Dings%C3%B8yr%2C%26%2332%3BTorgeir&rft.au=Nerur%2C%26%2332%3BSridhar&rft.au=Balijepally%2C%26%2332%3BVenuGopal&rft.au=Moe%2C%26%2332%3BNils+Brede&rft.date=1+June+2012&rft.volume=85&rft.issue=6&rft.pages=1213%E2%80%931221&rft_id=info:doi\/10.1016%2Fj.jss.2012.02.033&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS0164121212000532&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-23\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-23\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Liams-Hauser,C. (10 December 2014). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/openelis-global.org\/tools\/roadmap\/\" target=\"_blank\">\"Software Release Roadmap\"<\/a>. <i>OpenELIS Global<\/i><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/openelis-global.org\/tools\/roadmap\/\" target=\"_blank\">https:\/\/openelis-global.org\/tools\/roadmap\/<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 22 May 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Software+Release+Roadmap&rft.atitle=OpenELIS+Global&rft.aulast=Liams-Hauser%2CC.&rft.au=Liams-Hauser%2CC.&rft.date=10+December+2014&rft_id=https%3A%2F%2Fopenelis-global.org%2Ftools%2Froadmap%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-24\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-24\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">C\u00f4te d\u2019Ivoire Minist\u00e8re de la Sant\u00e9 et de l\u2019Hygi\u00e8ne Publique (2019). \"Plan Strat\u00e9gique National Pour Le D\u00e9veloppement Des Laboratoires de Biologie M\u00e9dicale 2017-2020\".<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Plan+Strat%C3%A9gique+National+Pour+Le+D%C3%A9veloppement+Des+Laboratoires+de+Biologie+M%C3%A9dicale+2017-2020&rft.atitle=&rft.aulast=C%C3%B4te+d%E2%80%99Ivoire+Minist%C3%A8re+de+la+Sant%C3%A9+et+de+l%E2%80%99Hygi%C3%A8ne+Publique&rft.au=C%C3%B4te+d%E2%80%99Ivoire+Minist%C3%A8re+de+la+Sant%C3%A9+et+de+l%E2%80%99Hygi%C3%A8ne+Publique&rft.date=2019&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-25\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-25\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Kirk, Mary; Assoa, Paul H.; Iiams-Hauser, Casey; Kouabenan, Yves-Rolland; Antilla, Jennifer; Steele-Lane, Caleb; Rossum, Greg; Komena, Pascal <i>et al.<\/i> (17 May 2021). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ajlmonline.org\/index.php\/AJLM\/article\/view\/1284\" target=\"_blank\">\"Adaptation of an electronic dashboard to monitor HIV viral load testing in C\u00f4te d\u2019Ivoire\"<\/a> (in en). <i>African Journal of Laboratory Medicine<\/i> <b>10<\/b> (1). <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.4102%2Fajlm.v10i1.1284\" target=\"_blank\">10.4102\/ajlm.v10i1.1284<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2225-2010\" target=\"_blank\">2225-2010<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC8182557\/\" target=\"_blank\">PMC8182557<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/34192117\" target=\"_blank\">34192117<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/www.ajlmonline.org\/index.php\/AJLM\/article\/view\/1284\" target=\"_blank\">http:\/\/www.ajlmonline.org\/index.php\/AJLM\/article\/view\/1284<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Adaptation+of+an+electronic+dashboard+to+monitor+HIV+viral+load+testing+in+C%C3%B4te+d%E2%80%99Ivoire&rft.jtitle=African+Journal+of+Laboratory+Medicine&rft.aulast=Kirk&rft.aufirst=Mary&rft.au=Kirk%2C%26%2332%3BMary&rft.au=Assoa%2C%26%2332%3BPaul+H.&rft.au=Iiams-Hauser%2C%26%2332%3BCasey&rft.au=Kouabenan%2C%26%2332%3BYves-Rolland&rft.au=Antilla%2C%26%2332%3BJennifer&rft.au=Steele-Lane%2C%26%2332%3BCaleb&rft.au=Rossum%2C%26%2332%3BGreg&rft.au=Komena%2C%26%2332%3BPascal&rft.au=Ngatchou%2C%26%2332%3BPatricia+Sadate&rft.date=17+May+2021&rft.volume=10&rft.issue=1&rft_id=info:doi\/10.4102%2Fajlm.v10i1.1284&rft.issn=2225-2010&rft_id=info:pmc\/PMC8182557&rft_id=info:pmid\/34192117&rft_id=http%3A%2F%2Fwww.ajlmonline.org%2Findex.php%2FAJLM%2Farticle%2Fview%2F1284&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-26\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-26\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Blaya, Joaqu\u00edn A.; Shin, Sonya S.; Yagui, Martin; Contreras, Carmen; Cegielski, Peter; Yale, Gloria; Suarez, Carmen; Asencios, Luis <i>et al.<\/i> (10 April 2014). Pai, Madhukar. ed. <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/dx.plos.org\/10.1371\/journal.pone.0090110\" target=\"_blank\">\"Reducing Communication Delays and Improving Quality of Care with a Tuberculosis Laboratory Information System in Resource Poor Environments: A Cluster Randomized Controlled Trial\"<\/a> (in en). <i>PLoS ONE<\/i> <b>9<\/b> (4): e90110. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1371%2Fjournal.pone.0090110\" target=\"_blank\">10.1371\/journal.pone.0090110<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1932-6203\" target=\"_blank\">1932-6203<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC3982951\/\" target=\"_blank\">PMC3982951<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/24721980\" target=\"_blank\">24721980<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/dx.plos.org\/10.1371\/journal.pone.0090110\" target=\"_blank\">https:\/\/dx.plos.org\/10.1371\/journal.pone.0090110<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Reducing+Communication+Delays+and+Improving+Quality+of+Care+with+a+Tuberculosis+Laboratory+Information+System+in+Resource+Poor+Environments%3A+A+Cluster+Randomized+Controlled+Trial&rft.jtitle=PLoS+ONE&rft.aulast=Blaya&rft.aufirst=Joaqu%C3%ADn+A.&rft.au=Blaya%2C%26%2332%3BJoaqu%C3%ADn+A.&rft.au=Shin%2C%26%2332%3BSonya+S.&rft.au=Yagui%2C%26%2332%3BMartin&rft.au=Contreras%2C%26%2332%3BCarmen&rft.au=Cegielski%2C%26%2332%3BPeter&rft.au=Yale%2C%26%2332%3BGloria&rft.au=Suarez%2C%26%2332%3BCarmen&rft.au=Asencios%2C%26%2332%3BLuis&rft.au=Bayona%2C%26%2332%3BJaime&rft.date=10+April+2014&rft.volume=9&rft.issue=4&rft.pages=e90110&rft_id=info:doi\/10.1371%2Fjournal.pone.0090110&rft.issn=1932-6203&rft_id=info:pmc\/PMC3982951&rft_id=info:pmid\/24721980&rft_id=https%3A%2F%2Fdx.plos.org%2F10.1371%2Fjournal.pone.0090110&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-27\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-27\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Mtonga, Timothy M.; Choonara, Faheema E.; Espino, Jeremy U.; Kachaje, Chimwemwe; Kapundi, Kenneth; Mengezi, Takondwa E.; Mumba, Soyapi L.; Douglas, Gerald P. (28 October 2019). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ajlmonline.org\/index.php\/AJLM\/article\/view\/841\" target=\"_blank\">\"Design and implementation of a clinical laboratory information system in a low-resource setting\"<\/a> (in en). <i>African Journal of Laboratory Medicine<\/i> <b>8<\/b> (1). <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.4102%2Fajlm.v8i1.841\" target=\"_blank\">10.4102\/ajlm.v8i1.841<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2225-2010\" target=\"_blank\">2225-2010<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC6852617\/\" target=\"_blank\">PMC6852617<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/31745456\" target=\"_blank\">31745456<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/www.ajlmonline.org\/index.php\/AJLM\/article\/view\/841\" target=\"_blank\">http:\/\/www.ajlmonline.org\/index.php\/AJLM\/article\/view\/841<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Design+and+implementation+of+a+clinical+laboratory+information+system+in+a+low-resource+setting&rft.jtitle=African+Journal+of+Laboratory+Medicine&rft.aulast=Mtonga&rft.aufirst=Timothy+M.&rft.au=Mtonga%2C%26%2332%3BTimothy+M.&rft.au=Choonara%2C%26%2332%3BFaheema+E.&rft.au=Espino%2C%26%2332%3BJeremy+U.&rft.au=Kachaje%2C%26%2332%3BChimwemwe&rft.au=Kapundi%2C%26%2332%3BKenneth&rft.au=Mengezi%2C%26%2332%3BTakondwa+E.&rft.au=Mumba%2C%26%2332%3BSoyapi+L.&rft.au=Douglas%2C%26%2332%3BGerald+P.&rft.date=28+October+2019&rft.volume=8&rft.issue=1&rft_id=info:doi\/10.4102%2Fajlm.v8i1.841&rft.issn=2225-2010&rft_id=info:pmc\/PMC6852617&rft_id=info:pmid\/31745456&rft_id=http%3A%2F%2Fwww.ajlmonline.org%2Findex.php%2FAJLM%2Farticle%2Fview%2F841&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-28\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-28\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"nofollow\" class=\"external text\" href=\"#OpenELIS\">\"Digital Square Investments in Global Goods:Approved Global Goods\"<\/a>. <i>Digital Square Wiki<\/i>. Digital Square. 2021<span class=\"printonly\">. <a rel=\"nofollow\" class=\"external free\" href=\"#OpenELIS\">https:\/\/wiki.digitalsquare.io\/index.php\/Digital_Square_Investments_in_Global_Goods:Approved_Global_Goods#OpenELIS<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 22 May 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Digital+Square+Investments+in+Global+Goods%3AApproved+Global+Goods&rft.atitle=Digital+Square+Wiki&rft.date=2021&rft.pub=Digital+Square&rft_id=https%3A%2F%2Fwiki.digitalsquare.io%2Findex.php%2FDigital_Square_Investments_in_Global_Goods%3AApproved_Global_Goods%23OpenELIS&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-29\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-29\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Nowogrodzki, Anna (1 July 2019). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.nature.com\/articles\/d41586-019-02046-0\" target=\"_blank\">\"How to support open-source software and stay sane\"<\/a> (in en). <i>Nature<\/i> <b>571<\/b> (7763): 133\u2013134. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1038%2Fd41586-019-02046-0\" target=\"_blank\">10.1038\/d41586-019-02046-0<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0028-0836\" target=\"_blank\">0028-0836<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.nature.com\/articles\/d41586-019-02046-0\" target=\"_blank\">https:\/\/www.nature.com\/articles\/d41586-019-02046-0<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=How+to+support+open-source+software+and+stay+sane&rft.jtitle=Nature&rft.aulast=Nowogrodzki&rft.aufirst=Anna&rft.au=Nowogrodzki%2C%26%2332%3BAnna&rft.date=1+July+2019&rft.volume=571&rft.issue=7763&rft.pages=133%E2%80%93134&rft_id=info:doi\/10.1038%2Fd41586-019-02046-0&rft.issn=0028-0836&rft_id=https%3A%2F%2Fwww.nature.com%2Farticles%2Fd41586-019-02046-0&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-30\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-30\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Ekie, Jesus; Gueye, Bassirou; Ekie, Tresor; Niang, Ibrahima (1 June 2021). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/ieeexplore.ieee.org\/document\/9588192\/\" target=\"_blank\">\"An Evidence-Based Approach on Public Health Decisions in Low-Middle Income Countries: Use Case of Senegal at the Verge of COVID-19\"<\/a>. <i>2021 International Conference on Digital Age & Technological Advances for Sustainable Development (ICDATA)<\/i> (Marrakech, Morocco: IEEE): 193\u2013200. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1109%2FICDATA52997.2021.00046\" target=\"_blank\">10.1109\/ICDATA52997.2021.00046<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-1-6654-2901-6<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/ieeexplore.ieee.org\/document\/9588192\/\" target=\"_blank\">https:\/\/ieeexplore.ieee.org\/document\/9588192\/<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=An+Evidence-Based+Approach+on+Public+Health+Decisions+in+Low-Middle+Income+Countries%3A+Use+Case+of+Senegal+at+the+Verge+of+COVID-19&rft.jtitle=2021+International+Conference+on+Digital+Age+%26+Technological+Advances+for+Sustainable+Development+%28ICDATA%29&rft.aulast=Ekie&rft.aufirst=Jesus&rft.au=Ekie%2C%26%2332%3BJesus&rft.au=Gueye%2C%26%2332%3BBassirou&rft.au=Ekie%2C%26%2332%3BTresor&rft.au=Niang%2C%26%2332%3BIbrahima&rft.date=1+June+2021&rft.pages=193%E2%80%93200&rft.place=Marrakech%2C+Morocco&rft.pub=IEEE&rft_id=info:doi\/10.1109%2FICDATA52997.2021.00046&rft.isbn=978-1-6654-2901-6&rft_id=https%3A%2F%2Fieeexplore.ieee.org%2Fdocument%2F9588192%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-31\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-31\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/openlmis.org\/get-started\/partner\/\" target=\"_blank\">\"Funder\"<\/a>. <i>OpenLIMS<\/i><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/openlmis.org\/get-started\/partner\/\" target=\"_blank\">https:\/\/openlmis.org\/get-started\/partner\/<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 22 May 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Funder&rft.atitle=OpenLIMS&rft_id=https%3A%2F%2Fopenlmis.org%2Fget-started%2Fpartner%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-32\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-32\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/communityhealthtoolkit.org\/\" target=\"_blank\">\"Community Health Toolkit\"<\/a>. <i>Community Health Toolkit<\/i><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/communityhealthtoolkit.org\/\" target=\"_blank\">https:\/\/communityhealthtoolkit.org\/<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 22 May 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Community+Health+Toolkit&rft.atitle=Community+Health+Toolkit&rft_id=https%3A%2F%2Fcommunityhealthtoolkit.org%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-33\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-33\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Thomas, J. (2021). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/wiki.ohie.org\/display\/SUB\/Lab%2bInformation%2bSystems%2bCommunity\" target=\"_blank\">\"Lab Information Systems Community\"<\/a>. <i>OpenHIE Wiki<\/i>. OpenHIE<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/wiki.ohie.org\/display\/SUB\/Lab%2bInformation%2bSystems%2bCommunity\" target=\"_blank\">https:\/\/wiki.ohie.org\/display\/SUB\/Lab%2bInformation%2bSystems%2bCommunity<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 22 May 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Lab+Information+Systems+Community&rft.atitle=OpenHIE+Wiki&rft.aulast=Thomas%2C+J.&rft.au=Thomas%2C+J.&rft.date=2021&rft.pub=OpenHIE&rft_id=https%3A%2F%2Fwiki.ohie.org%2Fdisplay%2FSUB%2FLab%252bInformation%252bSystems%252bCommunity&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-34\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-34\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Yamey, Gavin (2012). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/globalizationandhealth.biomedcentral.com\/articles\/10.1186\/1744-8603-8-11\" target=\"_blank\">\"What are the barriers to scaling up health interventions in low and middle income countries? A qualitative study of academic leaders in implementation science\"<\/a> (in en). <i>Globalization and Health<\/i> <b>8<\/b> (1): 11. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1186%2F1744-8603-8-11\" target=\"_blank\">10.1186\/1744-8603-8-11<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1744-8603\" target=\"_blank\">1744-8603<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC3514334\/\" target=\"_blank\">PMC3514334<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/22643120\" target=\"_blank\">22643120<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/globalizationandhealth.biomedcentral.com\/articles\/10.1186\/1744-8603-8-11\" target=\"_blank\">http:\/\/globalizationandhealth.biomedcentral.com\/articles\/10.1186\/1744-8603-8-11<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=What+are+the+barriers+to+scaling+up+health+interventions+in+low+and+middle+income+countries%3F+A+qualitative+study+of+academic+leaders+in+implementation+science&rft.jtitle=Globalization+and+Health&rft.aulast=Yamey&rft.aufirst=Gavin&rft.au=Yamey%2C%26%2332%3BGavin&rft.date=2012&rft.volume=8&rft.issue=1&rft.pages=11&rft_id=info:doi\/10.1186%2F1744-8603-8-11&rft.issn=1744-8603&rft_id=info:pmc\/PMC3514334&rft_id=info:pmid\/22643120&rft_id=http%3A%2F%2Fglobalizationandhealth.biomedcentral.com%2Farticles%2F10.1186%2F1744-8603-8-11&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-35\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-35\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Olusanya, Jacob O.; Ubogu, Olufunmilayo I.; Njokanma, Fidelis O.; Olusanya, Bolajoko O. (1 July 2021). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.nature.com\/articles\/s41591-021-01422-6\" target=\"_blank\">\"Transforming global health through equity-driven funding\"<\/a> (in en). <i>Nature Medicine<\/i> <b>27<\/b> (7): 1136\u20131138. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1038%2Fs41591-021-01422-6\" target=\"_blank\">10.1038\/s41591-021-01422-6<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1078-8956\" target=\"_blank\">1078-8956<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.nature.com\/articles\/s41591-021-01422-6\" target=\"_blank\">https:\/\/www.nature.com\/articles\/s41591-021-01422-6<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Transforming+global+health+through+equity-driven+funding&rft.jtitle=Nature+Medicine&rft.aulast=Olusanya&rft.aufirst=Jacob+O.&rft.au=Olusanya%2C%26%2332%3BJacob+O.&rft.au=Ubogu%2C%26%2332%3BOlufunmilayo+I.&rft.au=Njokanma%2C%26%2332%3BFidelis+O.&rft.au=Olusanya%2C%26%2332%3BBolajoko+O.&rft.date=1+July+2021&rft.volume=27&rft.issue=7&rft.pages=1136%E2%80%931138&rft_id=info:doi\/10.1038%2Fs41591-021-01422-6&rft.issn=1078-8956&rft_id=https%3A%2F%2Fwww.nature.com%2Farticles%2Fs41591-021-01422-6&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-36\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-36\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Men\u00e9ndez-Caravaca, Elo\u00edsa; Bueno, Salvador; Gallego, M. Dolores (1 December 2021). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0040162521005205\" target=\"_blank\">\"Exploring the link between free and open source software and the collaborative economy: A Delphi-based scenario for the year 2025\"<\/a> (in en). <i>Technological Forecasting and Social Change<\/i> <b>173<\/b>: 121087. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.techfore.2021.121087\" target=\"_blank\">10.1016\/j.techfore.2021.121087<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0040162521005205\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0040162521005205<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Exploring+the+link+between+free+and+open+source+software+and+the+collaborative+economy%3A+A+Delphi-based+scenario+for+the+year+2025&rft.jtitle=Technological+Forecasting+and+Social+Change&rft.aulast=Men%C3%A9ndez-Caravaca&rft.aufirst=Elo%C3%ADsa&rft.au=Men%C3%A9ndez-Caravaca%2C%26%2332%3BElo%C3%ADsa&rft.au=Bueno%2C%26%2332%3BSalvador&rft.au=Gallego%2C%26%2332%3BM.+Dolores&rft.date=1+December+2021&rft.volume=173&rft.pages=121087&rft_id=info:doi\/10.1016%2Fj.techfore.2021.121087&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS0040162521005205&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-37\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-37\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Abimbola, Seye (1 October 2019). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/gh.bmj.com\/lookup\/doi\/10.1136\/bmjgh-2019-002068\" target=\"_blank\">\"The foreign gaze: authorship in academic global health\"<\/a> (in en). <i>BMJ Global Health<\/i> <b>4<\/b> (5): e002068. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1136%2Fbmjgh-2019-002068\" target=\"_blank\">10.1136\/bmjgh-2019-002068<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2059-7908\" target=\"_blank\">2059-7908<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC6830280\/\" target=\"_blank\">PMC6830280<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/31750005\" target=\"_blank\">31750005<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/gh.bmj.com\/lookup\/doi\/10.1136\/bmjgh-2019-002068\" target=\"_blank\">https:\/\/gh.bmj.com\/lookup\/doi\/10.1136\/bmjgh-2019-002068<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=The+foreign+gaze%3A+authorship+in+academic+global+health&rft.jtitle=BMJ+Global+Health&rft.aulast=Abimbola&rft.aufirst=Seye&rft.au=Abimbola%2C%26%2332%3BSeye&rft.date=1+October+2019&rft.volume=4&rft.issue=5&rft.pages=e002068&rft_id=info:doi\/10.1136%2Fbmjgh-2019-002068&rft.issn=2059-7908&rft_id=info:pmc\/PMC6830280&rft_id=info:pmid\/31750005&rft_id=https%3A%2F%2Fgh.bmj.com%2Flookup%2Fdoi%2F10.1136%2Fbmjgh-2019-002068&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-38\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-38\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Glasgow, Russell E.; Harden, Samantha M.; Gaglio, Bridget; Rabin, Borsika; Smith, Matthew Lee; Porter, Gwenndolyn C.; Ory, Marcia G.; Estabrooks, Paul A. (2019). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpubh.2019.00064\" target=\"_blank\">\"RE-AIM Planning and Evaluation Framework: Adapting to New Science and Practice With a 20-Year Review\"<\/a>. <i>Frontiers in Public Health<\/i> <b>7<\/b>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.3389%2Ffpubh.2019.00064\" target=\"_blank\">10.3389\/fpubh.2019.00064<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2296-2565\" target=\"_blank\">2296-2565<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC6450067\/\" target=\"_blank\">PMC6450067<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/30984733\" target=\"_blank\">30984733<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpubh.2019.00064\" target=\"_blank\">https:\/\/www.frontiersin.org\/articles\/10.3389\/fpubh.2019.00064<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=RE-AIM+Planning+and+Evaluation+Framework%3A+Adapting+to+New+Science+and+Practice+With+a+20-Year+Review&rft.jtitle=Frontiers+in+Public+Health&rft.aulast=Glasgow&rft.aufirst=Russell+E.&rft.au=Glasgow%2C%26%2332%3BRussell+E.&rft.au=Harden%2C%26%2332%3BSamantha+M.&rft.au=Gaglio%2C%26%2332%3BBridget&rft.au=Rabin%2C%26%2332%3BBorsika&rft.au=Smith%2C%26%2332%3BMatthew+Lee&rft.au=Porter%2C%26%2332%3BGwenndolyn+C.&rft.au=Ory%2C%26%2332%3BMarcia+G.&rft.au=Estabrooks%2C%26%2332%3BPaul+A.&rft.date=2019&rft.volume=7&rft_id=info:doi\/10.3389%2Ffpubh.2019.00064&rft.issn=2296-2565&rft_id=info:pmc\/PMC6450067&rft_id=info:pmid\/30984733&rft_id=https%3A%2F%2Fwww.frontiersin.org%2Farticles%2F10.3389%2Ffpubh.2019.00064&rfr_id=info:sid\/en.wikipedia.org:Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<\/ol><\/div><\/div>\n<h2><span class=\"mw-headline\" id=\"Notes\">Notes<\/span><\/h2>\n<p>This presentation is faithful to the original, with only a few minor changes to presentation. Grammar was cleaned up for smoother reading. In some cases important information was missing from the references, and that information was added. The original cites this wiki as a source of information about the origins of OpenELIS, but the original article's statement of Iowa and Minnesota being involved was shortsighted; for this version, we mention that other public health labs were involved and we use the original source used on the OpenELIS wiki page, not the wiki page itself. No other changes were made in accordance with the \"NoDerivatives\" portion of the content license.\n<\/p>\n<!-- \nNewPP limit report\nCached time: 20230630152055\nCache expiry: 86400\nDynamic content: false\nComplications: []\nCPU time usage: 0.803 seconds\nReal time usage: 0.918 seconds\nPreprocessor visited node count: 36800\/1000000\nPost\u2010expand include size: 328609\/2097152 bytes\nTemplate argument size: 101777\/2097152 bytes\nHighest expansion depth: 25\/40\nExpensive parser function count: 0\/100\nUnstrip recursion depth: 0\/20\nUnstrip post\u2010expand size: 90372\/5000000 bytes\n-->\n<!--\nTransclusion expansion time report (%,ms,calls,template)\n100.00% 651.086 1 -total\n 88.13% 573.820 1 Template:Reflist\n 66.26% 431.404 38 Template:Citation\/core\n 52.46% 341.580 23 Template:Cite_journal\n 17.10% 111.364 14 Template:Cite_web\n 13.26% 86.308 34 Template:Date\n 7.77% 50.593 62 Template:Citation\/identifier\n 7.01% 45.671 1 Template:Infobox_journal_article\n 5.98% 38.939 1 Template:Infobox\n 3.20% 20.831 80 Template:Infobox\/row\n-->\n\n<!-- Saved in parser cache with key limswiki:pcache:idhash:14242-0!canonical and timestamp 20230630152054 and revision id 52270. Serialized with JSON.\n -->\n<\/div><\/div><div class=\"printfooter\">Source: <a rel=\"external_link\" class=\"external\" href=\"https:\/\/www.limswiki.org\/index.php\/Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years\">https:\/\/www.limswiki.org\/index.php\/Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years<\/a><\/div>\n<!-- end content --><div class=\"visualClear\"><\/div><\/div><\/div><div class=\"visualClear\"><\/div><\/div><!-- end of the left (by default at least) column --><div class=\"visualClear\"><\/div><\/div>\n\n\n\n<\/body>","09a05cec486b0e795821acfbb792b350_images":["https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/f\/fa\/Fig1_He_IntJofMedInfo2023_170.jpg","https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/d\/db\/Fig2_He_IntJofMedInfo2023_170.jpg"],"09a05cec486b0e795821acfbb792b350_timestamp":1688138454,"0f31a6a54c07621b155f4fa0d61b1eee_type":"article","0f31a6a54c07621b155f4fa0d61b1eee_title":"ApE, A Plasmid Editor: A freely available DNA manipulation and visualization program (Davis and Jorgensen 2022)","0f31a6a54c07621b155f4fa0d61b1eee_url":"https:\/\/www.limswiki.org\/index.php\/Journal:ApE,_A_Plasmid_Editor:_A_freely_available_DNA_manipulation_and_visualization_program","0f31a6a54c07621b155f4fa0d61b1eee_plaintext":"\n\nJournal:ApE, A Plasmid Editor: A freely available DNA manipulation and visualization programFrom LIMSWikiJump to navigationJump to searchFull article title\n \nApE, A Plasmid Editor: A freely available DNA manipulation and visualization programJournal\n \nFrontiers in BioinformaticsAuthor(s)\n \nDavis, M. Wayne; Jorgensen, Erik M.Author affiliation(s)\n \nHoward Hughes Medical Institute and School of Biological Sciences, University of UtahPrimary contact\n \nEmail: jorgensen at biology dot utah dot eduEditors\n \nMachiraju, RaghuYear published\n \n2022Volume and issue\n \n40Article #\n \ne55DOI\n \n10.1093\/nar\/gkr1288ISSN\n \n2673-7647Distribution license\n \nCreative Commons Attribution 4.0 InternationalWebsite\n \nhttps:\/\/www.frontiersin.org\/articles\/10.3389\/fbinf.2022.818619\/fullDownload\n \nhttps:\/\/www.frontiersin.org\/articles\/10.3389\/fbinf.2022.818619\/pdf (PDF)\n\nContents \n\n1 Abstract \n2 Introduction \n3 Method (code description) \n\n3.1 Language and supported operating systems \n3.2 File formats \n3.3 Auxiliary files \n3.4 Implemented methods that could be used by others \n3.5 Interchange \n\n\n4 Results (examples of use and limitations) \n\n4.1 Construct features \n4.2 Basic editing \n4.3 Sequence visualization \n4.4 Restriction site selection \n4.5 Molecular techniques simulators \n\n4.5.1 Restriction ligation \n\n\n4.6 Golden Gate \n\n4.6.1 Gibson assembly \n4.6.2 Recombinase mediated joining \n4.6.3 PCR \n\n\n4.7 Analysis tools \n\n\n5 Discussion (scalability and limitations) \n6 Abbreviations, acronyms, and initialisms \n7 Acknowledgements \n\n7.1 Author contributions \n7.2 Funding \n7.3 Data availability \n7.4 Conflict of interest \n\n\n8 References \n9 Notes \n\n\n\nAbstract \nA Plasmid Editor (ApE) is a free, multi-platform application for visualizing, designing, and presenting biologically relevant DNA sequences. ApE provides a flexible framework for annotating a sequence manually or using a user-defined library of features. ApE can be used in designing plasmids and other constructs via in silico simulation of cloning methods such as polymerase chain reaction (PCR), Gibson assembly, restriction-ligation assembly, and Golden Gate assembly. In addition, ApE provides a platform for creating visually appealing linear and circular plasmid maps. It is available for Mac, PC, and Linux-based platforms and can be downloaded at https:\/\/jorgensen.biology.utah.edu\/wayned\/ape\/.\nKeywords: plasmid editor, DNA visualization, molecular biology tools, molecular techniques simulator, freely available software\n\nIntroduction \nDNA visualization software must 1) annotate features and depict DNA features graphically, 2) simulate molecular cloning techniques, and 3) generate visually appealing output for figures. Good DNA visualization software applies meaning to a string of DNA bases. Fundamentally, this requires flexible annotation\u2014applying names to a region, and visualization of functional regions\u2014applying pictures to show the spatial relationships between sequence regions. Every piece of the DNA should be annotated with its biologically relevant attributes. In addition, a biologist must be able to identify subsequences such as restriction enzyme recognition sequences, recombinase recognition sequences, and overlapping end sequences that are useful for particular recombinant techniques.\nGood DNA software also provides powerful in silico simulation of common DNA manipulations, such as restriction digests or Gibson cloning. By manipulating DNA in silico, a biologist can ensure that recombinant constructs include functionally complete pieces that have the DNA in-order and in-frame. In other words, good software allows a researcher to synthesize a working plan. This might be working backwards in silico from a desired product to determine the needed inputs. Conversely, it allows a researcher to start with a given set of available plasmids and work in the virtual laboratory to generate possible products. Finally, visualization software can be invaluable for determining whether an analytic result\u2014a DNA sequence, a diagnostic polymerase chain reaction (PCR) or restriction digest\u2014has generated the expected product. The scientist can use the software to align sequences or simulate gels of each step to confirm their work.\nFinally, good DNA software can generate visually pleasing output with a flexible level of detail. This representation should be easily exported in an open and widely used text or graphic format. For example, text output can be used to generate class reports, student theses, or manuscripts for publication. Similarly, graphical output can be used to generate meeting posters or slides for class reports or conference presentations.\nBecause of this critical need for visualization software, many DNA visualization programs have been written. Many of these are written by researchers themselves to solve their own needs in the lab. Among these are Serial Cloner[1], pDRAW32[2], GenBeans[3], XPlasMap[4], and DNA Strider.[5] Such solutions are often very powerful at solving a specific task, but they can be lacking in broad application. Similarly, they are often dependent on a single operating system, and they can sometimes have limited visual appeal in the graphic outputs. On the other hand, they are usually freely available, and as such are very accessible to small groups and teaching labs. \nAt the other extreme, commercial ventures have written very powerful and flexible sequence visualization packages. Popular packages include Benchling[6], SnapGene[7], and Gene Construction Kit.[8] In order to have a wide customer base, they endeavor to have a complete set of analysis procedures and in silico reaction simulations. Because the visual output is usually a major factor in the product literature, the software has been carefully designed to generate visually appealing output. All of this engineering takes programmer and designer time; as such, these packages are often cost prohibitive for individual laboratories, and almost always are out-of-range of a teaching laboratory. \nWe have taken the long view to solving this problem. ApE is a freely available program written over the last 17 years by a molecular biologist for molecular biologists. Thus, it leverages the insider knowledge of what makes a successful DNA editing program. Further, the long-timeframe approach has allowed the program to become both highly versatile and streamlined; ApE now rivals the commercially available packages in both its diversity of features and its visual outputs. Importantly, unlike commercial packages, its free availability makes it well-suited for use in small labs or teaching labs. A summary of some of the features in ApE and a selected set of other visualization programs is provided in Table 1.\n\r\n\n\n\n\n\n\n\n\n\n\nTable 1. Functions available in ApE and other free or commercial software.\n\n\n\n Method (code description) \nLanguage and supported operating systems \nApE is written in Tcl\/Tk. Current distribution of ApE is with Tcl\/Tk version 8.6.11.[9] There are ready-to-run versions of ApE for Windows, MacOS, and Linux systems.\nFor Windows, the program is packaged into a self-contained tclkit[10] using the Starkit Developer eXtension (sdx).[11] The Tclkit is a compiled binary generated by Ashok P. Nadkarni and contains the Tcl Windows API extension package (TWAPI).[12] The .exe file was edited using Resource Hacker[13] to contain a custom icon set and relevant version and copyright information. Bundled in the virtual filesystem of the .exe file are copies of the ApE accessory files (see below). The .exe is compiled as an x86-32-bit application, and the software should run on versions of Windows between Windows '98 and Windows 10.\nFor MacOS, ApE is packaged as an application bundle. The executable files in the bundle were generated from Tcl and Tk source.[9] The current release is targeted to x86 architectures with OS versions 10.11 and above. The executable application bundle includes embedded Tcl and Tk frameworks, the Tcl script, copies of the ApE accessory files, a custom application icon, and a MacOS property list file.\nApE can be run on Unix\/Linux systems using the Tcl\/Tk windowing shell interpreter, wish, which is available as source code or precompiled binaries for most *nix operating systems.[9] The wish binary is available by apt or apt-get on Debian systems. Of interest for using ApE in educational settings, ApE can also be run using the wish interpreter on low-cost Raspberry Pi systems or Chromebooks that have enabled the Linux Beta feature of Chrome OS.\nWe have also run ApE within the Android operating system using AndroWish[14] as the Tcl\/Tk interpreter, however the smaller screen size of most Android-supported devices and the single window per app user interface impaired the general usability, and so compiled binaries are not provided.\n\nFile formats \nThe usefulness of a program can be judged on three factors: flexibility of input, flexibility of data processing, and flexibility of output. To make ApE widely usable, we have endeavored to write procedures to read as many DNA sequence file types as possible. ApE reads FASTA or raw ASCII, GenBank[15], EMBL, GCG, pDraw, GFF3[16], DNAStrider[5] and Serial Cloner[1], SnapGene[7], and Gene Construction Kit (GCK) file formats.[8] ApE can also read Sanger sequencing chromatogram files in either the proprietary abi or open scf format. Sanger data is displayed as a scrollable and scalable graphic window, which can be used for aligning to a reference sequence.\nApE saves DNA data in a GenBank-like file format that is designed to be understood by most parsers that can parse Genbank files. This format is open and human-readable text, so saved data is not confined to a proprietary, binary format. In addition, many other programs and open-source libraries such as BioPerl or BioPython can read this format easily. Although it is based on GenBank, ApE files contain additional information not specified in the GenBank specification. First, sequence-wide information is stored as a special COMMENT line that begins with the text \"ApEinfo\". Second, each feature has additional feature-specific formatting data stored in feature qualifiers that begin with \"\/ApEinfo\". Some GenBank parsers require qualifiers to be part of a controlled vocabulary, so ApE has a user-specified option in the preferences window to save files without this information. Only the COMMENT fields of the GenBank header are visible and editable in the ApE interface (Figure 1G), however all of the header records (e.g., SOURCE, KEYWORDS, or REFERENCE) are retained in memory and are saved in the ApE formatted file. Future editions of the program could allow viewing and editing these header lines. Users can store base64 encoded versions of abi files as Genbank comment fields within an ApE file. Abi files linked in this way can be extracted and viewed with the standard abi viewer.\n\r\n\n\n\n\n\n\n\n\n\n\nFigure 1. The main sequence editing window of ApE. (A) The top section of the window shows basic properties of the sequence and selected region. (B) The top section also shows the translation of the selected region. (C) The next pane shows a table of sequence features. Clicking on the arrowhead expands the description of the feature. (D) The next pane shows a list of all features under the mouse pointer (here, hovering over (F)). (E) The central region of the window contains the text of the sequence, with features highlighted in color. To the right is a vertical representation of these features in the currently displayed region and the scrollbar. On the far right is a representation of all of the features in the sequence. (F) When activated, the X-ray window shows a floating window containing a graphical representation of the line of text under the mouse pointer. (G) The bottom of the window shows an editable sequence comment.\n\n\n\nAuxiliary files \nTo make ApE as flexible as possible for processing and visualizing user data, ApE stores several data files as human-readable text files. This allows users to store multiple versions of the files for different purposes, or trade useful variants with others. ApE uses this modular framework for the restriction enzyme set, the feature library, gel ladders, graphical arrowheads and user preferences. The restriction enzyme files store recognition and cut sites, methylation specificities, and user specified enzyme \u201cgroups,\u201d which can be used in limiting enzyme searches (see below). Included with the distribution is a basic default set of enzymes, as well as several other enzyme database files, such as a set of all commercially available enzymes. DNA ladders for use in virtual agarose gels are stored in a file that can be edited using a ladder editor dialog within ApE. Arrowheads files are available to the user to customize the graphic map window. The \u201cApE Defaults.txt\u201d file stores over 100 default values for many user-specified parameters between sessions.\nFinally, ApE includes a folder of feature definition library files. Feature definitions are designed to provide a rich and flexible matching paradigm. Definitions include all of the characters of the IUPAC degenerate nucleotide code, with all sequence bases required to be within the degenerate set at each position for a match to be noted. There are two variable length wild-card characters\u2014# and +\u2014which match any continuous string of nucleotides. Definitions can contain < and >; any characters before < and after > are not required to match in the search stage, but after a match is found, sequences continuous with the match that also match the pre- or post-sequence are included in the final match. Finally, the definitions can contain either uppercase or lowercase characters. Once a match has been found, uppercase characters are noted as part of the feature, while lowercase characters are gaps in the feature. This allows for feature gaps such as introns, as well as searches for specific bases within a given context, for example common or important SNPs. If a definition has only lowercase characters, all of the characters are included in the feature. Currently, ApE ships with default feature libraries for C. elegans, mouse, yeast and generic plasmid features, but there is also a built-in system for adding new libraries or editing the default libraries.\n\nImplemented methods that could be used by others \nMany of the procedures within ApE could be used as stand-alone, command-line functions or incorporated into other DNA analysis projects. ApE has several basic analysis functions such as reverse complement, complement, translate, reverse-translate, search with IUPAC degeneracy codes, search for amino acid sequences in a translated DNA sequence, and melting temperature calculation. ApE also implements the DNA Strider algorithm for fast hexamer searching for restriction enzyme patterns[5], which is faster at finding restriction enzyme sites than a regular expression search. Finally, ApE includes a procedure to search for PCR primer binding sites using a modification of the Strider hexamer lookahead algorithm.\nApE implements pairwise alignment of two DNA sequences using a Needleman-Wunsch (NW) alignment algorithm with an affine gap penalty. Because this algorithm is processor intensive, the alignment algorithm first uses a simple heuristic algorithm for doing a first-pass, block-based search for locally identical sequence matches, which are then used as boundaries for aligning non-identical blocks by the NW algorithm. If the sequences have no major matching regions, the user can further specify a maximum value for mismatched regions to be aligned by the NW alignment algorithm. If a region between matching blocks has a product of lengths of each mismatched sequence region, the region is not aligned, and will be highlighted in black text in the resulting display. Once a pairwise alignment is made between the reference and each comparison sequence, the alignments are combined into a single alignment by adding gaps to each sequence; no attempt is made at multiple sequence alignment.\n\nInterchange \nApE has many ways to output and share data. For text-based visualizations or analysis windows, ApE can save an output file as plain text, or as formatted rich text format (RTF) files, which preserves color background highlighting and other text formatting. On Mac OS, formatted text can also be copied to the clipboard in RTF format. For graphic visualizations of data, for example, graphic maps or virtual agarose gels, ApE can save the data in four formats: encapsulated postscript (.eps), scalable vector graphics (.svg), OpenXML-based Power Point (.pptx), and portable document format (.pdf). An additional format, Windows Metafile (.wmf), is available on Windows systems. All of these formats retain the information in vector format so that they can be edited when opened in a vector editing program, such as Inkscape or Adobe Illustrator. For users who use LabArchives to store their electronic laboratory notebook (ELN), ApE has a direct interface to the LabArchives internet portal, so that analysis windows can be directly uploaded to a user\u2019s account. For making presentations, .pptx files can be read into Power Point, Keynote, or Google Slides. Finally, on Mac and Windows, ApE is able to directly output windows to an attached printer with formatting preserved. For DNA Sanger sequencing files, the data are scaled to fit within the printed page, with a user-specified number of lines per page. This wide variety of output formats and modalities should make ApE useful for saving an analysis in a laboratory notebook, for presenting the analysis on slides, for archiving the analysis in a database, or sharing the analysis on the internet.\n\n Results (examples of use and limitations) \nApE has many functions for working with DNA. First, sequences can be annotated, applying names to regions of a sequence using construct features. It can also edit DNA and generate formatted text or vector graphic representations of the sequence. Other functions of ApE include the ability to locate enzyme recognition sites in a sequence and simulate agarose gels of restriction digests; molecular techniques simulators for a Restriction ligation reaction, a Golden Gate reaction, a Golden Gate reaction designer, a Gibson Assembly reaction, a Recombinase\/Integrase mediated joining reaction, and PCR reactions; and several analysis tools, including alignment of Sanger sequencing to a reference sequence, a dCAPS genotyping designer, direct input into the NCBI BLAST server, and several other minor tools. These functions are described in the subsequent subsections. Additionally, a video tutorial series describing many of the functions of ApE is available at YouTube.\n\nConstruct features \nA key role of ApA is to locate and highlight functionally important sequences, called \u201cfeatures.\u201d Features can be added to a sequence manually or via an automated library search. Features can be visualized in four ways: as text in a table at the top of a sequence, as a text appearing when pointing to a sequence, as a graphical representation when pointing to a sequence line, or as a small graphical summary at the right side of the sequence window.\nIn the main sequence window, features are indicated as highlighted text (Figure 1E, above). In addition to the highlighted text, a tabular view of the features within a sequence is displayed (Figure 1C, above). The table is sortable by feature name, direction, GenBank feature type, and location. If a feature has GenBank qualifiers, those qualifiers are displayed within the table under drop-down rows that can be opened or closed. Features can be added to a file by selecting any region and then using the \u201cFeatures\u201d menu option \"New Feature.\" We\u2019ve endeavored to make the editing of features flexible. The table context menus allow the editing of many aspects of feature display, such as the name, highlight color, and display priority (a.k.a. foreground\/background, or z position). A similar context menu is available in the other columns of the table to quickly edit the other properties of each feature. For example, the location of the feature, that is, the range of bases included in the feature, as represented by numbers, can be edited. To edit a feature more extensively, a user can double-click any table row or alternatively right-click the sequence text directly.\nAn important aspect of ApE is that features can be added to a file by using a predefined or user-defined feature library to scan the entire sequence. Feature libraries consist of lines of text referred to here as \"feature definitions.\" Each feature definition includes a name, a sequence of the feature (possibly including undefined bases \u201cN,\u201d variable length of unknown sequence \u201c#,\u201d or introns \u201c-\u201d), and a color to apply to the feature if found. Each feature definition in the library is compared against the entire sequence, one by one, and if a match is found, the feature name and formatting defined in the library are applied to that part of the sequence. Thus, raw sequences can be rapidly converted to a table of feature names and base ranges. This modular approach benefits both the data sharing as well as the data preservation roles of ApE. Feature libraries can be exchanged between lab members or between lab groups. For example, collections of PCR primers can be stored as feature libraries and used to annotate any number of sequence files.\nBecause feature visualization is so important, ApE provides three ways to see what features are assigned to a piece of text. First, placing the mouse pointer over any character displays the feature names of all features assigned to that character (Figure 1D). Second, an X-ray window mode shows a semi-transparent overlay of the features and highlighted restriction recognition sites (Figure 1F, above). This window follows the mouse and updates with scrolling the text. Third, there is a small graphical map of features along the right edge of the sequence (Figure 1E, above).\nFinally, features can be hidden from the current display without deleting the feature from the feature table. This modular approach allows the user to visualize features in many different contexts.\n\nBasic editing \nApE is a sequence editor and contains powerful general and DNA-specific text editing tools, including basic text input, sequence search, open reading frames (ORF) search, specialized copy and paste functions, and brief instantaneous analysis of selected text.\nApE\u2019s main sequence window resembles many classic text editor windows, except that it is limited to representing DNA bases: either ACGT, ACGTN, or IUPAC degenerate base codes. The sequence can be linear or circular, as specified with a button at the top of the window (Figure 1A). In circular sequences, the sequence can be \u201crotated\u201d to start at any position within the sequence. Selecting sequences within the editing window can be done with the mouse or by entering numerical position values into the \u201cStart\u201d and \u201cEnd\u201d boxes at the top of the window (Figure 1A, above). Sequence-related metadata or user notes and comments can be entered into a text box at the bottom of each sequence window (Figure 1G, above).\nApE has a search function specialized for the needs of molecular biologists. The find window, accessible from the main menu \u201cEdit > Find,\u201d or from the magnifying glass icon on the toolbar, has a basic text input. However, the search can be specified to find DNA sequences using the search input as degenerate bases, single letter amino acid codes, or literal bases. Depending on the setting, the character \u201cN\u201d would match any single DNA base, the asparagine codons AAT or AAC, or just the character N, respectively. Further, the search can be specified to match just the top DNA strand, or can search for the match in both strands, and can match the characters in a case-sensitive or case-insensitive search. Finally, for DNA searches, the user can allow a fixed number of mismatches to occur between the search string and the sequence, or can specify only a fixed number of bases at the 3\u2032 end of the search be required to match.\nIn addition to a text-matching search function, ApE has an open-reading-frame-based search function. This search can find the next or previous open reading frame relative to the current insertion cursor. A user can filter ORFs requiring a minimum length, requiring starting with a methionine or the next codon after the next stop, and requiring the ORF to be on either the top or bottom DNA strand. These settings are quickly accessed in the \u201cORFs\u201d menu.\nAlong with basic copy and paste functions, ApE also has many other functions that operate through the clipboard via the \u201cEdit > Copy Special\u201d menu. First, the function \u201cCopy all as GenBank\u201d will copy the entire sequence together with the associated header and feature records as a plain text version onto the clipboard. This can be used to make a complete record of the sequence in a lab notebook, an email, or a laboratory database, for example. These clipboard files can be re-imported and will open as a new sequence window. Second, the functions \u201cCopy Uppercase\u201d and \u201cCopy Uppercase Rev-Com\u201d allows the user to copy discontinuous regions of interest. Third, the functions \u201cCopy Translated,\u201d \u201cCopy Uppercase Translated,\u201d \u201cCopy Translated Rev-Com,\u201d and \u201cCopy Uppercase Translated Rev-Com\u201d allow the user to translate a continuous or discontinuous region for export into protein analysis software. Fourth, \u201cCopy as FASTA\u201d generates a FASTA version of the selected text, with the file name and selection indices in the FASTA header. Fifth, sequences can be copied as NCBI Bankit tables for submission to the NCBI database.\nFinally, ApE displays four important attributes of user-selected sequence: melting temperature (Tm), %GC, a representation of the open reading frame (Figure 1A, above), and a translation of the top or bottom strand (Figure 1B, above). These features are displayed in the top area of the window as the text selection is changed.\n\nSequence visualization \nAt times, the user may need other ways of visualizing aspects of a sequence that go beyond the basic feature highlighting in the sequence window. First, the \u201cText Map\u201d function, available from the menu item \u201cEnzymes > Text Map\u201d or from a toolbar icon, allows the user to generate a customized text formatted representation of the sequence that includes multiple data tracks. Data tracks include restriction enzyme recognition sequences, position index, translation, bottom strand sequence, and feature regions. The user can then copy or save the window as a plain-text or rich-text (RTF) representation for archiving, sharing, or presenting the sequence. The \u201cTranslate\u201d function generates a translation of a selected sequence region or coding sequence (CDS)-type feature of a sequence. The translation can be formatted as single or three-letter codes, with optional spacing, line numbering and corresponding DNA sequence. The analysis includes the number of translated amino acids and the predicted molecular weight of the protein.\nSecond, the \u201cORF Map\u201d function, available from the menu item \u201cORFs > ORF Map,\u201d generates a simple visualization of ATG start codons, as well as amber, ochre, and opal stop codons in all six frames of a sequence region. In order to aid in visualizing the most potentially relevant open reading frames, the user is given the option of specifying a minimum cutoff for highlighting regions between stop and start or between adjacent stop codons. The user can then click on any highlighted region to select the corresponding region of the parent sequence.\nThird, the sequence can be visualized using the \u201cGraphic Map\u201d function, available from \u201cEnzymes > Graphic Map\u201d or from the toolbar. This function converts all of the sequence features and selected enzyme cut sites into a vector map (Figure 2). The map can be either circular (Figures 2A and 2B) or linear (Figures 2C and 2D), depending on the nature of the sequence region depicted. Most visual elements of the map are customizable either with a mouse drag or using a \u201cConfigure\u201d function within each map window. All feature formatting can be stored in the metadata of the parent sequence file, so subsequent graphical map windows preserve the user\u2019s customizations. Feature and enzyme elements are linked to their parent sequence regions, so that mouse clicks on a graphical element cause the corresponding region to be selected in the parent. The menu function \u201cGraphic Map + U\u201d produces the same analysis, but adds the unique (cutting just one time) restriction enzymes in addition to the selected enzyme set.\n\r\n\n\n\n\n\n\n\n\n\n\nFigure 2. Graphical maps of a sequence. (A) A circular map of pUC19, with colored features and restriction enzyme sites. (B) A different circular map of the same sequence file showing a variety of user-configurable display properties. (C) A linear map of a region of the same pUC19 file. (D) Another linear map of the same region, showing a variety of user-configurable display properties.\n\n\n\nEach graphic window can be saved into four vector-based file formats: encapsulated postscript (.eps), scalable vector graphics (.svg), XML-based Power Point (.pptx), and portable document format (.pdf). By exporting into four different popular vector-graphic formats, ApE visualizations can be imported into many other programs that can represent vector graphics. For example, sequence maps can be read into Inkscape, Adobe Illustrator, OpenOffice Draw, or LibreOffice Draw for writing papers or lab reports, or posted directly to a website as .svg for sharing on the web. Finally, the .pptx format can be read into PowerPoint, Google Slides, or Apple Keynote for presentations.\n\nRestriction site selection \nApE has several tools, described in later sections, that use restriction enzyme sites as input. First, we describe how restriction enzyme sites are selected. The central switchboard for restriction site recognition in ApE is the enzyme selector dialog. Enzymes selected in this dialog become the currently \u201cselected set\u201d of enzymes that can be used in subsequent analysis or visualization tools. The selection dialog presents a central window with a list of enzyme names (Figure 3A). Enzymes can be selected by clicking on each name, while shift-clicking will select the individual site uniquely. Enzyme comments are displayed as the pointer hovers over the list. At the top of the dialog is a window selection area, where the user can select any of the currently open sequence windows, and can elect to analyze either the entire sequence or just the currently selected region. ApE determines the number of recognition sites within the selection, which is displayed next to the enzyme name. Some restriction enzymes do not cut sites that overlap with E. coli Dam and Dcm methylase sites. ApE maintains a database of overlapping configurations that are not cut. Thus, the user can choose to calculate the number of enzyme sites as though the DNA is or is not from a methylated source.\n\r\n\n\n\n\n\n\n\n\n\n\nFigure 3. The enzyme selector dialog and virtual agarose gels. (A) The enzyme selector dialog. (B) A simulated agarose gel of pUC19 digested with ApaLI and HindIII. The bands from each lane are shown in a table. (C) The same gel window, but showing detailed information for a single ApaLI band highlighted by hovering the mouse over the band.\n\n\n\nEnzyme sites can be filtered using the \u201ccalculator\u201d function below the enzyme selection list. The calculator works by setting a desired number of sites in the current window, as well as membership in an enzyme group. The enzymes that meet both the number and group membership filters are previewed as underlined in the selection list. The user can then choose to apply one of three selection operations. First, \u201cSelect\u201d will add all of the underlined enzymes to the current selection. Second, \u201cDe-select\u201d will remove all underlined enzymes from the current set. Finally, \u201cAND\u201d will select the intersection of the current set with the filtered set.\nBecause the enzyme selector serves as a central place to select enzymes that are used in other tools, the dialog supplies a shortcut to several of these tools as a convenience. These appear at the bottom of the enzyme selection dialog. For example, the \u201cHighlight\u201d function will highlight the recognition sequences of the selected restriction enzyme set in the selection. In the X-ray window, these highlighted enzyme sequences show not only the recognition site, but also the cut sites, as a small tick mark upwards at the position of the top strand cut, and downwards for the bottom strand cut.\nThe \u201cDigest\u201d function, available from the \u201cEnzymes\u201d menu or the toolbar, generates a simulated agarose gel that would be produced when the selected sequence is digested with the selected enzymes (Figures 3B and 3C, above). Placing the pointer over a gel band brings forward a table in the analysis window and a miniature map of the features and digestion sites in the parental sequence. The table shows each band as the cut site location, band size and approximate mass percent of the total digest that the band represents, and the map highlights the sequence of the band. Clicking on a band will select the region of the sequence represented by the band. Gel bands can be used as inputs in the Gibson reaction dialog by drag-and-drop into the dialog, and can be used as inputs into the ligation dialog by simply clicking a band when the dialog is opened. The function \u201cDigest With All\u201d will generate a multi-lane gel window, with each lane being a single digest with each selected enzyme.\nWhile simple single-lane or multiple-lane-single-digest gels can be generated from the selection dialog, more complex simulated agarose gels can be generated in a single step using the \u201cDigestion Dialog,\u201d available from the \u201cEnzymes\u201d menu or from the toolbar. In this dialog, each gel lane is represented by a row. Each row is either a DNA or ladder. Each DNA row can then be digested with single or multiple enzymes by activating a checkbox representing the specific enzyme column in the row. Partial digests can be accomplished by activating the \"%\" button in the enzyme selection region. Each enzyme can then be digested between 0 and 100%.\nFor some applications it can be useful to identify sequences that can be mutated to generate a new restriction enzyme recognition site. ApE has two functions that do this kind of analysis. First, \u201cSilent Sites\u201d examines the currently selected region and identifies potential sites that maintain the reading frame. Second, \u201cAdd Diagnostic Site\u201d identifies new recognition sties independent of reading frames. Instead, it allows the user to specify a maximum number of base changes allowed for the generation of the site. In both analysis results, the sequence is live-linked to the parent sequence, so that clicking on any base representing a base in the sequence selects that base in the parent window.\n\nMolecular techniques simulators \nApE includes simulators for the classic restriction-ligation reaction, Golden Gate assembly, Gibson assembly, Recombinase assembly, and PCR. These are available from \u201cTools\u201d on the the main menu.\n\nRestriction ligation \nThe classic method for joining DNA fragments is via restriction digestion followed by DNA ligase. The ApE tool \u201cRestriction-Ligation Assembler\u201d is able to simulate this reaction with one to three DNA fragments (Figure 4). The tool dialog initially prompts the user for a DNA sequence window or gel band. The information for that DNA populates the dialog with a picture of the overhanging end sequences, and a mini-map of the sequences in the fragment. If the fragments have compatible ends, the user can choose to complete the reaction, which will generate the product of the ligation as a new sequence window. The new sequence will have a comment section that lists all of the input plasmids and digestions used to generate the product. If the ends are not compatible, the dialog will not allow the reaction to be completed. The user can choose to reverse any of the fragments or modify the ends of the fragment with several common modification reactions.\n\r\n\n\n\n\n\n\n\n\n\n\nFigure 4. The restriction-ligation assembler tool. (A) Graphic maps of the input sequence files for the planned reaction (left) and the product (right). (B) The Digestion Dialog is used to generate a virtual agarose gel of the two required DNA fragments: pU19 digested with XbaI and SalI, and a linear DNA fragment containing your favorite gene (YFG) digested with the same enzymes. The two fragments are then dragged into the Restriction-Ligation Assembler tool dialog. The tool then generates the product, shown in (A).\n\n\n\nGolden Gate \nThe Golden Gate reaction is similar to a basic restriction-ligation reaction; however, the use of type IIS restriction enzymes adds distinct requirements, and thus ApE has distinct tools for dealing with this type of reaction. Unlike traditional ligation reactions, Golden Gate reactions can join as many fragments as unique overhanging sequences can be designed. In fact, successful 35-fragment reactions have been demonstrated with empirically validated orthogonal overhangs.[17] ApE has distinct workflows for designing Golden Gate reactions to create a defined construct, as well as assembling a Golden Gate reaction using existing constructs.\nThe ApE \u201cGolden Gate Designer\u201d tool assists the user in the design of sequences to join DNA fragments (Figure 5). The dialog gives the user a choice of available type IIS enzymes, and then the option of selecting DNA fragments to be ligated. The algorithm then uses a random walk to search for a set of the most orthogonal overhangs, and presents a set of PCR primers to generate them. Because the algorithm can get caught in local minima, the user is given the option to restart the search with a new random seed if a non-optimal solution was found. A new sequence window is created containing the desired reaction product, including new features containing the primer sequences. These primer sequences are also added to the file comment, both as a list of PCR reactions including primer pairs and templates, as well as a list of primers in a format compatible with online oligonucleotide ordering systems.\n\r\n\n\n\n\n\n\n\n\n\n\nFigure 5. The Golden Gate Designer tool. (A) Graphic maps of the input sequences (left) and output sequence (right). (B) The Golden Gate Designer is first used to specify two PCR products: YFG and pUC19. The tool then designs four PCR primers and the sequence of the Golden Gate reaction, the product sequence shown in (A).\n\n\n\nThe \u201cGolden Gate Assembler\u201d tool simulates the assembly of the fragments once they have been designed (Figure 6). The user chooses one to three IIS restriction enzyme types. Once an enzyme has been selected, the assembler searches open sequences for any fragments that are flanked by oppositely oriented sites and for compatible overhang sequences. The assembler then gives the user a drop-down list of all possible fragments that are in a closed circular assembly. If multiple fragments are possible at a given position, a new dropdown menu is presented to the user. The process is repeated until the circle is closed. The user can choose to generate the conceptual product in a new sequence window. The new window will contain a sequence comment listing all of the plasmid sequence files used in the Golden Gate reaction that generated that sequence.\n\r\n\n\n\n\n\n\n\n\n\n\nFigure 6. The Golden Gate Assembler tool. (A) A graphic map of two SapI restriction fragments as designed in Figure 5 to be used in a Golden Gate reaction (left), and the product of the reaction (right). (B) The Golden Gate Assembler shows the chosen SapI restriction enzyme, the selected input fragments and the three-base overhangs of each SapI cut.\n\n\n\nGibson assembly \nA third, very flexible and effective, DNA assembly method is based on long homologous end hybridization. This class of methods includes Gibson assembly[18], sequence- and ligation-independent cloning (SLIC) assembly[19], circular polymerase extension cloning (CPEC) assembly[20], and SLiCE assembly.[21]\nApE\u2019s \u201cGibson Designer\u201d tool has a similar input to the \u201cGolden Gate Designer\u201d tool, with fragments chosen from currently open sequences (Figure 7). Also similar to the \u201cGolden Gate Designer\u201d tool, a gel band can be added as a fragment via a drag-and-drop motion. Each fragment can be designed as a PCR with additional tails, a PCR without additional tails, or a stand-alone fragment without PCR primers. Gel bands are automatically set to be non-PCR fragments. Once all of the fragments are selected, the user is prompted to review and modify the homologous overlap at each fragment junction. Each junction is displayed at the top of the review window, showing the new forward and reverse primers, and the template sequences. The overlap is generated by adding bases to the 5\u2032 end of the reverse primer until a minimum melting temperature is reached for the overlap. The user can choose to incorporate new, non-templated bases into the gap between the fragments. If gel bands are used as fragments, the user can select how the reaction will deal with single-stranded overhangs by setting the exonuclease direction to \u201c5\u2032 Exo\u201d or \u201c3\u2032 Exo\u201d in a user defaults option. Like in the \u201cGolden Gate Designer,\u201d the new sequence window will contain all newly designed primers as sequence features and will list all PCR reactions and primers in the file comments section.\n\r\n\n\n\n\n\n\n\n\n\n\nFigure 7. The Gibson Designer tool. (A) Graphic maps of the two input sequences (left) and the output sequence (right). (B) The Gibson Designer is used to specify two PCR products containing YFG and pUC19. The tool then steps through both Gibson junctions, allowing fine-grained design of each. Finally, the tool generates the sequence, shown on the right in (A).\n\n\n\nRecombinase mediated joining \nA modular assembly method is recombinase-mediated assembly. The most popular of these methods is the Gateway cloning system from Invitrogen (a brand of ThermoFisher). The ApE \u201cRecombination Assembler\u201d tool (Figure 8) functions very similarly to the \u201cGolden Gate Reaction\u201d tool. The user is first asked to choose a reaction prototype, for example a \u201cBP reaction (1\u20132)\u201d combines a fragment ending with attB1 and attB2 sites with a fragment containing attP1 and attP2 sites. Once a prototype is chosen, the algorithm searches all open windows to find fragments that contain the correct sites in the correct orientation to be a substrate for the chosen reaction. If multiple compatible sequences are found for a fragment, the user can choose between the options via the drop-down menu. Once all required sequences are found and selected, the simulated reaction generates a product plasmid. As for other reaction simulators, a list of the input sequences and the reaction performed is added to the sequence comment box of the product.\n\r\n\n\n\n\n\n\n\n\n\n\nFigure 8. Gateway reaction. (A) Graphic map of the input sequences for a Gateway BP reaction (left) and the product of the recombination (right). (B) The Recombination Assembler tool is used to select the two input sequences (Insert and Backbone). The tool then generates the product sequence, represented by the map in (A).\n\n\n\nAlthough most users only perform the basic Gateway reactions as described in the product literature, the Gateway recombination reaction is very flexible and has been adapted to specific use cases. For example, the pHELLSGATE plasmid is designed to use a PCR fragment containing attB1 and attB2 ends to recombine simultaneously into two attP1-attP2 sites to generate a hairpin silencing construct for use in Arabidopsis. Similarly, pWormgatePro allows users to build a similar hairpin construct for C. elegans RNAi using an LR-recombination reaction. ApE allows users to design new reaction prototypes to accomplish any DNA recombination reaction in silico. The \u201cRecombination Reaction Editor\u201d dialog allows new prototypes to be created. If a user wants to design recombination reactions involving a different recombinase or integrase, new recombinase reaction sites can be added using the reaction editor.\n\nPCR \nAmplification by PCR is the most critical method in molecular biology laboratories. The ApE tool \u201cPCR Reaction\u201d uses PCR primer databases, searches sequences for primer binding sites, and simulates a PCR reaction with a given set of primers (Figure 9). A major role of the tool is to use a primer database to search a template sequence for primer binding sites. The database can be loaded from a text file formatted as an ApE feature library file. Alternatively, a user can add primers to the current database by loading \u201cprimer_bind\u201d features in a sequence file, or by pasting sequences from the system clipboard. Sequences in the system clipboard can be formatted as simple DNA sequences or as tab delimited name-sequence pairs, each on a new line.\n\r\n\n\n\n\n\n\n\n\n\n\nFigure 9. PCR Reaction tool. (A) A graphic map of the Golden Gate product from Figure 5 (left), which can be used as a PCR template. A graphic map of a PCR product generated with the PCR tool (right). (B) The PCR reaction tool shows a map of the template in the center, and a table of possible PCR products at the top. Selecting \u201cFwd_primer_1\u201d and \u201cRev_primer_1\u201d then generates a virtual PCR product. A graphic map of this product is shown in (A).\n\n\n\nBinding is determined by a user-defined minimum annealing length, starting from the 3\u2032 base of the primer. The user can allow up to 10 mismatches in the primer while still requiring the minimum number of matching bases, and define the maximum number of bases that can be mismatched specifically at the 3\u2032 end of the sequence. By default, the tool then shows a list of primers that match at a single site within the template. The list has data columns: primer name, primer sequence, binding direction, distance of the 3\u2032 end from the current selection, location of the 3\u2032 end in the template sequence, melting temperature of the template-matching region, melting temperature of the full primer sequence, number of mismatches to the template (not including any 5\u2032 extension), and number of matches to the template. Primers in the list can then be selected or deselected by the user. Selected primers are shown in their approximate location and direction on a mini-map diagram in the center of the window. Finally, the user can activate a \u201cSelect Primer Pairs\u201d selection mode, which limits the current selection to two facing primer pairs. These primers can be used to generate a new linear sequence window containing the simulated PCR product.\nIn addition to working with existing primer sequences, ApE can assist the user in designing new primers. First, the user can simply select a region of text while noting the melting temperature of the sequence. Alternatively, there is a \u201cFind Primers\u201d tool that scans the selection for regions that meet a user-defined minimum and maximum length, melting temperature, percent GC, and 3\u2032 GC clamp. Oligonucleotide primers can be filtered to exclude self-hybridizing sequences, adjacent hybridizing bases and 3\u2032-end hybridization. If the user enters a target primer sequence that the primer should be compatible with, the filter will also apply a cross-hybridization filter on the same parameters as well. While a good first pass filter for primer binding sites, the tool is not as thorough or as flexible as a dedicated primer finding algorithm like Primer3.[22][23]\n\nAnalysis tools \nIn most molecular pipelines, DNA must be analyzed to determine if the actual DNA matches the conceptual sequence. ApE can display Sanger sequencing reads and align them to a reference sequence using the \u201cAlign Sequences\u201d tool (Figure 10A). The alignment display has several functions to aid in interpreting any mismatches. First, mismatches are highlighted in red text for easy identification. Next, any CDS feature in the reference sequence displays its translation above the reference. For any sequence that is an abi window, the user can place the mouse pointer above any base in the alignment display and a semi-opaque window will appear showing the corresponding region of the abi trace, so that the user can determine whether a mismatch is potentially due to a mixed fluorescence signal that led to a miscalled base (Figure 10B). The trace window additionally shows a translation of the codon centered on the base at the pointer, allowing the user to quickly determine if a mutated base leads to a non-synonymous codon. To assist in documenting the sequencing, ApE can embed abi files into an ApE sequence file to associate a sequence read with its reference sequence. Sanger sequence windows can also be printed or saved to PDF files. Printing reformats the file by breaking it into a user-specified number of lines per page.\n\r\n\n\n\n\n\n\n\n\n\n\nFigure 10. Alignment of a reference sequence to a Sanger sequence. (A) An alignment of a reference sequence (first line) to an abi output of a Sanger sequencing reaction (second line). The mouse is placed over base 677 in the abi sequence to show a floating window containing the abi data. (B) The source abi trace file of the alignment in (A).\n\n\n\nWhen working with DNA from a genomic source, users will often want to identify single nucleotide polymorphisms (SNPs). A Derived Cleaved Amplified Polymorphic Sequences (dCAPS) PCR assay is a popular way to genotype SNPs. In simple terms, a dCAPS assay uses a PCR primer that has a small number of base differences from the template near the 3\u2032 end adjacent to the polymorphic base. The primer-induced mutations are designed so that products generated from one allele have a restriction site while the other allele is lacking the site. Typically, one allele generates a 250 bp band, while the other allele generates a pair of 200 and 50 bp fragments. ApE has a \u201cdCAPS calculator\u201d tool to quickly design dCAPS primers. The user simply selects the base in the reference sequence that differs in the polymorphism. The tool asks the user to identify the alternate allele base, and then leads the user through the design of dCAPS primers.\nThe National Center for Biotechnology Information (NCBI) is a critical resource to molecular biologists. ApE provides a direct internet link to two NCBI resources: BLAST and Entrez query. The Basic Local Alignment Search Tool (BLAST)[24], provided by NCBI, allows a user to query the NCBI public databases to identify the potential source species of a sequence, to identify relevant features within a sequence, or to find orthologous or paralogous sequences. The \u201cBLAST Sequences at NCBI\u201d tool submits a sequence directly to NCBI via the web[25] and returns the BLAST result to the default web browser. Alternatively, the \u201cDownload Sequences from NCBI\u201d tool retrieves sequences from NCBI using a keyword search.\nMany molecular reactions require DNA in specific molar ratios. For example, bimolecular ligations are often performed at a 3:1 insert to vector ratio. Since the input DNA is usually different lengths and at different concentrations, molecular biologists often need to repeatedly calculate the molarity of different DNA solutions. ApE includes a molecular ratio calculator which can store the molar ratios required in frequently used reactions and can calculate the required volumes of each DNA fragment, given the sequence length and measured concentration.\nFinally, ApE has several tools that provide functions that may be useful to a more limited user base. The \u201csgRNA Analysis\u201d tool allows a user to screen sequences against a set of rules[26] for improved Cas9-CRISPR guide RNAs. The \u201cInsert Repeat\u201d tool allows a user to quickly insert a given number of exact repeats of a short sequence. The \u201cMulti-Cre Recombination\u201d tool allows a user to simulate the MultiPrime Cre-based recombination system used by Mansouri et al.[27] The \u201cPalette Generator\u201d tool generates a set of visually coordinated colors by selecting a set of colors evenly spaced in a circular hue space with random luminance and saturation. The tool includes a filter to limit the color luminance to provide a contrast ratio greater than three with both black and white, so that text displayed over the color will be readable. This tool can be used to generate a set of feature background highlight colors that are appealing and functional. The \u201cSpeak Text\u201d tool is available on Mac and Windows systems and provides an audio reading of selected text. Finally, there is a simple \u201cCalculator\u201d tool, which evaluates a mathematical expression.\n\n Discussion (scalability and limitations) \nApE is distributed free of charge and can be downloaded at https:\/\/jorgensen.biology.utah.edu\/wayned\/ape\/, but it is not distributed as true open-source software. It is distributed with most of the rights of open-source software, including rights to inspect and modify the source code. However, no right is granted to redistribute modified source. The Tcl source code is archived at https:\/\/github.com\/mwdavis2\/ApE. In the event that a community member wishes to propose a code addition or bug fix for incorporation into the centrally distributed version, they may initiate a pull request and contact the author to agree to a contributor license agreement. \nThis key distinction from true open-source projects was made consciously to prevent project forking, which we feel is inevitable with redistribution of modified versions. For small projects, especially projects lacking a user interface, forking can be a benefit. Each new user can customize the software to meet their needs, and new users not interested in modifying the source can choose from a wide variety of flavors of the code that might meet their needs. However, with a more complex program involving a user interface, forking runs three risks: 1) diluting the user base among multiple incompatible versions; 2) introducing inconsistent and unexpected user interface elements; and 3) having inconsistent quality checks on different versions of the software. With a single distribution source, there are no competing versions. Further, there is a single decision point for any aesthetic choices in the user interface. Finally, all bugs are referenced to a single version and can be corrected without needing to distribute potentially incompatible patch files to fix bugs that may or may not exist in different distributions. However, one of the strong suits of ApE is that many of its features and user interfaces have been inspired by input from users requesting new or modified functionality.\n\n Abbreviations, acronyms, and initialisms \nApE: A Plasmid Editor\nBLAST: Basic Local Alignment Search Tool\nCDS: coding sequence\nNCBI: National Center for Biotechnology Information\nNW: Needleman-Wunsch\nORF: open reading frame\nPCR: polymerase chain reaction\nRTF: rich-text format\nAcknowledgements \nThanks to Mark Palfreyman, Matthew Rich, David Almanzar, and Matt Schwartz for comments on the manuscript.\n\nAuthor contributions \nMWD developed, designed and programmed the software. MWD wrote the manuscript. MWD and EJ revised the manuscript. Funding acquisition: EJ. All authors read and approved the manuscript.\n\nFunding \nEJ is an Investigator and MWD is a research scientist of the Howard Hughes Medical Institute (HHMI.org). This work was funded by NIH to EJ (NIH.gov), including grant NIGMS 2R01GM095817 and NINDS 5R01NS034307. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.\n\nData availability \nSource code for ApE is archived at https:\/\/github.com\/mwdavis2\/ApE. The application can be downloaded from https:\/\/jorgensen.biology.utah.edu\/wayned\/ape\/.\n\nConflict of interest \nThe authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.\n\nReferences \n\n\n\u2191 1.0 1.1 Perez, F.. \"Serial Cloner\". Serial Basics. http:\/\/serialbasics.free.fr\/Serial_Cloner.html . Retrieved 21 April 2021 .   \n \n\n\u2191 \"pDRAW32 DNA analysis software\". AcaClone Software. https:\/\/www.acaclone.com\/ . Retrieved 21 April 2021 .   \n \n\n\u2191 \"GenBeans\". Gene Infinity, LLC. http:\/\/www.genbeans.org\/ . Retrieved 21 April 2021 .   \n \n\n\u2191 York, I.. \"XPlasMap\". http:\/\/www.iayork.com\/XPlasMap\/ . Retrieved 21 April 2021 .   \n \n\n\u2191 5.0 5.1 5.2 Douglas, Susan E. (1 February 1995). \"DNA strider: An inexpensive sequence analysis package for the Macintosh\" (in en). Molecular Biotechnology 3 (1): 37\u201345. doi:10.1007\/BF02821333. ISSN 1073-6085. http:\/\/link.springer.com\/10.1007\/BF02821333 .   \n \n\n\u2191 \"Benchling for Academics\". Benchling, Inc. https:\/\/www.benchling.com\/academic . Retrieved 21 April 2021 .   \n \n\n\u2191 7.0 7.1 \"SnapGene\". Dotmatics Limited. https:\/\/www.snapgene.com\/ . Retrieved 21 April 2021 .   \n \n\n\u2191 8.0 8.1 \"Gene Construction Kit\". Textco BioSoftware, Inc. http:\/\/www.textco.com\/gene-construction-kit.php . Retrieved 21 April 2021 .   \n \n\n\u2191 9.0 9.1 9.2 Walzer, K.. \"Tcl\/Tk\". GitHub. https:\/\/github.com\/tcltk . Retrieved 21 April 2021 .   \n \n\n\u2191 Wippler, J.-C.. \"tclkit\". Google Code. https:\/\/code.google.com\/archive\/p\/tclkit\/ . Retrieved 21 April 2021 .   \n \n\n\u2191 Thoyts, P.. \"patthoyts \/ tclkit\". GitHub. https:\/\/github.com\/patthoyts\/tclkit . Retrieved 21 April 2021 .   \n \n\n\u2191 Nadkarni, A.P.. \"Tcl Windows API extension Files\". SourceForge. https:\/\/sourceforge.net\/projects\/twapi\/files\/Tcl%20binaries\/Tclkits%20with%20TWAPI\/ . Retrieved 21 April 2021 .   \n \n\n\u2191 Johnson, A. (3 January 2019). \"Resource Hacker\". http:\/\/www.angusj.com\/resourcehacker\/ . Retrieved 21 April 2021 .   \n \n\n\u2191 Werner, C.. \"AndroWish\". androwish.org. https:\/\/www.androwish.org\/index.html\/home . Retrieved 21 April 2021 .   \n \n\n\u2191 Sayers, Eric W; Cavanaugh, Mark; Clark, Karen; Ostell, James; Pruitt, Kim D; Karsch-Mizrachi, Ilene (8 January 2019). \"GenBank\" (in en). Nucleic Acids Research 47 (D1): D94\u2013D99. doi:10.1093\/nar\/gky989. ISSN 0305-1048. PMC PMC6323954. PMID 30365038. https:\/\/academic.oup.com\/nar\/article\/47\/D1\/D94\/5144964 .   \n \n\n\u2191 Stein, L. (18 August 2020). \"The-Sequence-Ontology \/ Specifications\". GitHub. https:\/\/github.com\/The-Sequence-Ontology\/Specifications . Retrieved 21 April 2021 .   \n \n\n\u2191 Pryor, John M.; Potapov, Vladimir; Kucera, Rebecca B.; Bilotti, Katharina; Cantor, Eric J.; Lohman, Gregory J. S. (2 September 2020). Kalendar, Ruslan. ed. \"Enabling one-pot Golden Gate assemblies of unprecedented complexity using data-optimized assembly design\" (in en). PLOS ONE 15 (9): e0238592. doi:10.1371\/journal.pone.0238592. ISSN 1932-6203. PMC PMC7467295. PMID 32877448. https:\/\/dx.plos.org\/10.1371\/journal.pone.0238592 .   \n \n\n\u2191 Gibson, Daniel G; Young, Lei; Chuang, Ray-Yuan; Venter, J Craig; Hutchison, Clyde A; Smith, Hamilton O (1 May 2009). \"Enzymatic assembly of DNA molecules up to several hundred kilobases\" (in en). Nature Methods 6 (5): 343\u2013345. doi:10.1038\/nmeth.1318. ISSN 1548-7091. https:\/\/www.nature.com\/articles\/nmeth.1318 .   \n \n\n\u2191 Li, Mamie Z; Elledge, Stephen J (1 March 2007). \"Harnessing homologous recombination in vitro to generate recombinant DNA via SLIC\" (in en). Nature Methods 4 (3): 251\u2013256. doi:10.1038\/nmeth1010. ISSN 1548-7091. https:\/\/www.nature.com\/articles\/nmeth1010 .   \n \n\n\u2191 Quan, Jiayuan; Tian, Jingdong (30 July 2009). Ho, Paulo Lee. ed. \"Circular Polymerase Extension Cloning of Complex Gene Libraries and Pathways\" (in en). PLoS ONE 4 (7): e6441. doi:10.1371\/journal.pone.0006441. ISSN 1932-6203. PMC PMC2713398. PMID 19649325. https:\/\/dx.plos.org\/10.1371\/journal.pone.0006441 .   \n \n\n\u2191 Zhang, Yongwei; Werling, Uwe; Edelmann, Winfried (1 April 2012). \"SLiCE: a novel bacterial cell extract-based DNA cloning method\" (in en). Nucleic Acids Research 40 (8): e55\u2013e55. doi:10.1093\/nar\/gkr1288. ISSN 1362-4962. PMC PMC3333860. PMID 22241772. https:\/\/academic.oup.com\/nar\/article\/40\/8\/e55\/2411705 .   \n \n\n\u2191 Koressaar, Triinu; Remm, Maido (15 May 2007). \"Enhancements and modifications of primer design program Primer3\" (in en). Bioinformatics 23 (10): 1289\u20131291. doi:10.1093\/bioinformatics\/btm091. ISSN 1367-4811. https:\/\/academic.oup.com\/bioinformatics\/article\/23\/10\/1289\/197299 .   \n \n\n\u2191 Untergasser, Andreas; Cutcutache, Ioana; Koressaar, Triinu; Ye, Jian; Faircloth, Brant C.; Remm, Maido; Rozen, Steven G. (1 August 2012). \"Primer3\u2014new capabilities and interfaces\" (in en). Nucleic Acids Research 40 (15): e115\u2013e115. doi:10.1093\/nar\/gks596. ISSN 1362-4962. PMC PMC3424584. PMID 22730293. https:\/\/academic.oup.com\/nar\/article-lookup\/doi\/10.1093\/nar\/gks596 .   \n \n\n\u2191 Altschul, Stephen F.; Gish, Warren; Miller, Webb; Myers, Eugene W.; Lipman, David J. (1 October 1990). \"Basic local alignment search tool\" (in en). Journal of Molecular Biology 215 (3): 403\u2013410. doi:10.1016\/S0022-2836(05)80360-2. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0022283605803602 .   \n \n\n\u2191 \"NCBI BLAST Common URL API\". BLAST on the cloud. National Center for Biotechnology Information. https:\/\/ncbi.github.io\/blast-cloud\/dev\/api.html . Retrieved 21 April 2021 .   \n \n\n\u2191 Doench, John G; Hartenian, Ella; Graham, Daniel B; Tothova, Zuzana; Hegde, Mudra; Smith, Ian; Sullender, Meagan; Ebert, Benjamin L et al. (1 December 2014). \"Rational design of highly active sgRNAs for CRISPR-Cas9\u2013mediated gene inactivation\" (in en). Nature Biotechnology 32 (12): 1262\u20131267. doi:10.1038\/nbt.3026. ISSN 1087-0156. PMC PMC4262738. PMID 25184501. https:\/\/www.nature.com\/articles\/nbt.3026 .   \n \n\n\u2191 Mansouri, Maysam; Bellon-Echeverria, Itxaso; Rizk, Aur\u00e9lien; Ehsaei, Zahra; Cianciolo Cosentino, Chiara; Silva, Catarina S.; Xie, Ye; Boyce, Frederick M. et al. (4 May 2016). \"Highly efficient baculovirus-mediated multigene delivery in primary cells\" (in en). Nature Communications 7 (1): 11529. doi:10.1038\/ncomms11529. ISSN 2041-1723. PMC PMC4857464. PMID 27143231. https:\/\/www.nature.com\/articles\/ncomms11529 .   \n \n\n\nNotes \nThis presentation is faithful to the original, with only a few minor changes to presentation. In some cases important information was missing from the references, and that information was added. The original lists references alphabetically; this version lists them in order of appearance, by design.\n\n\n\n\n\nSource: <a rel=\"external_link\" class=\"external\" href=\"https:\/\/www.limswiki.org\/index.php\/Journal:ApE,_A_Plasmid_Editor:_A_freely_available_DNA_manipulation_and_visualization_program\">https:\/\/www.limswiki.org\/index.php\/Journal:ApE,_A_Plasmid_Editor:_A_freely_available_DNA_manipulation_and_visualization_program<\/a>\nCategories: LIMSwiki journal articles (added in 2023)LIMSwiki journal articles (all)LIMSwiki journal articles on bioinformaticsLIMSwiki journal articles on softwareNavigation menuPage actionsJournalDiscussionView sourceHistoryPage actionsJournalDiscussionMoreToolsIn other languagesPersonal toolsLog inNavigationMain pageEncyclopedic articlesRecent changesRandom pageHelp about MediaWikiSearch\u00a0 ToolsWhat links hereRelated changesSpecial pagesPermanent linkPage informationPopular publications\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\nPrint\/exportCreate a bookDownload as PDFDownload as PDFDownload as Plain textPrintable version This page was last edited on 21 June 2023, at 00:04.Content is available under a Creative Commons Attribution-ShareAlike 4.0 International License unless otherwise noted.This page has been accessed 140 times.Privacy policyAbout LIMSWikiDisclaimers\n\n\n\n","0f31a6a54c07621b155f4fa0d61b1eee_html":"<body class=\"mediawiki ltr sitedir-ltr mw-hide-empty-elt ns-206 ns-subject page-Journal_ApE_A_Plasmid_Editor_A_freely_available_DNA_manipulation_and_visualization_program rootpage-Journal_ApE_A_Plasmid_Editor_A_freely_available_DNA_manipulation_and_visualization_program skin-monobook action-view skin--responsive\"><div id=\"rdp-ebb-globalWrapper\"><div id=\"rdp-ebb-column-content\"><div id=\"rdp-ebb-content\" class=\"mw-body\" role=\"main\"><a id=\"rdp-ebb-top\"><\/a>\n<h1 id=\"rdp-ebb-firstHeading\" class=\"firstHeading\" lang=\"en\">Journal:ApE, A Plasmid Editor: A freely available DNA manipulation and visualization program<\/h1><div id=\"rdp-ebb-bodyContent\" class=\"mw-body-content\"><!-- start content --><div id=\"rdp-ebb-mw-content-text\" lang=\"en\" dir=\"ltr\" class=\"mw-content-ltr\"><div class=\"mw-parser-output\">\n\n\n<h2><span class=\"mw-headline\" id=\"Abstract\">Abstract<\/span><\/h2>\n<p>A Plasmid Editor (ApE) is a free, multi-platform application for <a href=\"https:\/\/www.limswiki.org\/index.php\/Data_visualization\" title=\"Data visualization\" class=\"wiki-link\" data-key=\"4a3b86cba74bc7bb7471aa3fc2fcccc3\">visualizing<\/a>, designing, and presenting biologically relevant <a href=\"https:\/\/www.limswiki.org\/index.php\/DNA_sequencing\" title=\"DNA sequencing\" class=\"wiki-link\" data-key=\"7ff86b38049c37e30858efd13bd00925\">DNA sequences<\/a>. ApE provides a flexible framework for annotating a sequence manually or using a user-defined library of features. ApE can be used in designing <a href=\"https:\/\/www.limswiki.org\/index.php\/Plasmid\" title=\"Plasmid\" class=\"wiki-link\" data-key=\"c37e5c231243d8d4d0110d4234c10b05\">plasmids<\/a> and other constructs via <i>in silico<\/i> simulation of cloning methods such as <a href=\"https:\/\/www.limswiki.org\/index.php\/Polymerase_chain_reaction\" title=\"Polymerase chain reaction\" class=\"wiki-link\" data-key=\"f6569fb01ef396379f9f4efa4527e715\">polymerase chain reaction<\/a> (PCR), Gibson assembly, restriction-ligation assembly, and Golden Gate assembly. In addition, ApE provides a platform for creating visually appealing linear and circular plasmid maps. It is available for Mac, PC, and Linux-based platforms and can be downloaded at <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/jorgensen.biology.utah.edu\/wayned\/ape\/\" target=\"_blank\">https:\/\/jorgensen.biology.utah.edu\/wayned\/ape\/<\/a>.\n<\/p><p><b>Keywords<\/b>: plasmid editor, DNA visualization, molecular biology tools, molecular techniques simulator, freely available software\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Introduction\">Introduction<\/span><\/h2>\n<p>DNA <a href=\"https:\/\/www.limswiki.org\/index.php\/Data_visualization\" title=\"Data visualization\" class=\"wiki-link\" data-key=\"4a3b86cba74bc7bb7471aa3fc2fcccc3\">visualization<\/a> software must 1) annotate features and depict DNA features graphically, 2) simulate molecular cloning techniques, and 3) generate visually appealing output for figures. Good DNA visualization software applies meaning to a string of DNA bases. Fundamentally, this requires flexible annotation\u2014applying names to a region, and visualization of functional regions\u2014applying pictures to show the spatial relationships between <a href=\"https:\/\/www.limswiki.org\/index.php\/DNA_sequencing\" title=\"DNA sequencing\" class=\"wiki-link\" data-key=\"7ff86b38049c37e30858efd13bd00925\">sequence<\/a> regions. Every piece of the DNA should be annotated with its biologically relevant attributes. In addition, a biologist must be able to identify subsequences such as restriction enzyme recognition sequences, recombinase recognition sequences, and overlapping end sequences that are useful for particular recombinant techniques.\n<\/p><p>Good DNA software also provides powerful <i>in silico<\/i> simulation of common DNA manipulations, such as restriction digests or Gibson cloning. By manipulating DNA <i>in silico<\/i>, a biologist can ensure that recombinant constructs include functionally complete pieces that have the DNA in-order and in-frame. In other words, good software allows a researcher to synthesize a working plan. This might be working backwards <i>in silico<\/i> from a desired product to determine the needed inputs. Conversely, it allows a researcher to start with a given set of available <a href=\"https:\/\/www.limswiki.org\/index.php\/Plasmid\" title=\"Plasmid\" class=\"wiki-link\" data-key=\"c37e5c231243d8d4d0110d4234c10b05\">plasmids<\/a> and work in the virtual <a href=\"https:\/\/www.limswiki.org\/index.php\/Laboratory\" title=\"Laboratory\" class=\"wiki-link\" data-key=\"c57fc5aac9e4abf31dccae81df664c33\">laboratory<\/a> to generate possible products. Finally, visualization software can be invaluable for determining whether an <a href=\"https:\/\/www.limswiki.org\/index.php\/Data_analysis\" title=\"Data analysis\" class=\"wiki-link\" data-key=\"545c95e40ca67c9e63cd0a16042a5bd1\">analytic result<\/a>\u2014a DNA sequence, a diagnostic <a href=\"https:\/\/www.limswiki.org\/index.php\/Polymerase_chain_reaction\" title=\"Polymerase chain reaction\" class=\"wiki-link\" data-key=\"f6569fb01ef396379f9f4efa4527e715\">polymerase chain reaction<\/a> (PCR) or restriction digest\u2014has generated the expected product. The scientist can use the software to align sequences or simulate gels of each step to confirm their work.\n<\/p><p>Finally, good DNA software can generate visually pleasing output with a flexible level of detail. This representation should be easily exported in an open and widely used text or graphic format. For example, text output can be used to generate class reports, student theses, or manuscripts for publication. Similarly, graphical output can be used to generate meeting posters or slides for class reports or conference presentations.\n<\/p><p>Because of this critical need for visualization software, many DNA visualization programs have been written. Many of these are written by researchers themselves to solve their own needs in the lab. Among these are Serial Cloner<sup id=\"rdp-ebb-cite_ref-:0_1-0\" class=\"reference\"><a href=\"#cite_note-:0-1\">[1]<\/a><\/sup>, pDRAW32<sup id=\"rdp-ebb-cite_ref-2\" class=\"reference\"><a href=\"#cite_note-2\">[2]<\/a><\/sup>, GenBeans<sup id=\"rdp-ebb-cite_ref-3\" class=\"reference\"><a href=\"#cite_note-3\">[3]<\/a><\/sup>, XPlasMap<sup id=\"rdp-ebb-cite_ref-4\" class=\"reference\"><a href=\"#cite_note-4\">[4]<\/a><\/sup>, and DNA Strider.<sup id=\"rdp-ebb-cite_ref-:1_5-0\" class=\"reference\"><a href=\"#cite_note-:1-5\">[5]<\/a><\/sup> Such solutions are often very powerful at solving a specific task, but they can be lacking in broad application. Similarly, they are often dependent on a single operating system, and they can sometimes have limited visual appeal in the graphic outputs. On the other hand, they are usually freely available, and as such are very accessible to small groups and teaching labs. \n<\/p><p>At the other extreme, commercial ventures have written very powerful and flexible sequence visualization packages. Popular packages include <a href=\"https:\/\/www.limswiki.org\/index.php\/Benchling,_Inc.\" title=\"Benchling, Inc.\" class=\"wiki-link\" data-key=\"67634090ee7d17da2ed0d3748a65379d\">Benchling<\/a><sup id=\"rdp-ebb-cite_ref-6\" class=\"reference\"><a href=\"#cite_note-6\">[6]<\/a><\/sup>, SnapGene<sup id=\"rdp-ebb-cite_ref-:2_7-0\" class=\"reference\"><a href=\"#cite_note-:2-7\">[7]<\/a><\/sup>, and Gene Construction Kit.<sup id=\"rdp-ebb-cite_ref-:3_8-0\" class=\"reference\"><a href=\"#cite_note-:3-8\">[8]<\/a><\/sup> In order to have a wide customer base, they endeavor to have a complete set of analysis procedures and <i>in silico<\/i> reaction simulations. Because the visual output is usually a major factor in the product literature, the software has been carefully designed to generate visually appealing output. All of this engineering takes programmer and designer time; as such, these packages are often cost prohibitive for individual laboratories, and almost always are out-of-range of a teaching laboratory. \n<\/p><p>We have taken the long view to solving this problem. ApE is a freely available program written over the last 17 years by a <a href=\"https:\/\/www.limswiki.org\/index.php\/Molecular_biology\" title=\"Molecular biology\" class=\"wiki-link\" data-key=\"c1b2586b4cd56652a8868e37f38c1c3d\">molecular biologist<\/a> for molecular biologists. Thus, it leverages the insider knowledge of what makes a successful DNA editing program. Further, the long-timeframe approach has allowed the program to become both highly versatile and streamlined; ApE now rivals the commercially available packages in both its diversity of features and its visual outputs. Importantly, unlike commercial packages, its free availability makes it well-suited for use in small labs or teaching labs. A summary of some of the features in ApE and a selected set of other visualization programs is provided in Table 1.\n<\/p><p><br \/>\n<a href=\"https:\/\/www.limswiki.org\/index.php\/File:Fig1_Davis_FrontBioinfo2022_40.jpg\" class=\"image wiki-link\" data-key=\"3703c8872726bb8f91fa2a6e7ec43f13\"><img alt=\"Fig1 Davis FrontBioinfo2022 40.jpg\" src=\"https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/6\/6c\/Fig1_Davis_FrontBioinfo2022_40.jpg\" decoding=\"async\" style=\"width: 100%;max-width: 400px;height: auto;\" \/><\/a>\n<\/p>\n<div style=\"clear:both;\"><\/div>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table border=\"0\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><blockquote><p><b>Table 1.<\/b> Functions available in ApE and other free or commercial software.<\/p><\/blockquote>\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<h2><span id=\"rdp-ebb-Method_(code_description)\"><\/span><span class=\"mw-headline\" id=\"Method_.28code_description.29\">Method (code description)<\/span><\/h2>\n<h3><span class=\"mw-headline\" id=\"Language_and_supported_operating_systems\">Language and supported operating systems<\/span><\/h3>\n<p>ApE is written in Tcl\/Tk. Current distribution of ApE is with Tcl\/Tk version 8.6.11.<sup id=\"rdp-ebb-cite_ref-:4_9-0\" class=\"reference\"><a href=\"#cite_note-:4-9\">[9]<\/a><\/sup> There are ready-to-run versions of ApE for Windows, MacOS, and Linux systems.\n<\/p><p>For Windows, the program is packaged into a self-contained tclkit<sup id=\"rdp-ebb-cite_ref-10\" class=\"reference\"><a href=\"#cite_note-10\">[10]<\/a><\/sup> using the Starkit Developer eXtension (sdx).<sup id=\"rdp-ebb-cite_ref-11\" class=\"reference\"><a href=\"#cite_note-11\">[11]<\/a><\/sup> The Tclkit is a compiled binary generated by Ashok P. Nadkarni and contains the Tcl Windows API extension package (TWAPI).<sup id=\"rdp-ebb-cite_ref-12\" class=\"reference\"><a href=\"#cite_note-12\">[12]<\/a><\/sup> The .exe file was edited using Resource Hacker<sup id=\"rdp-ebb-cite_ref-13\" class=\"reference\"><a href=\"#cite_note-13\">[13]<\/a><\/sup> to contain a custom icon set and relevant version and copyright information. Bundled in the virtual filesystem of the .exe file are copies of the ApE accessory files (see below). The .exe is compiled as an x86-32-bit application, and the software should run on versions of Windows between Windows '98 and Windows 10.\n<\/p><p>For MacOS, ApE is packaged as an application bundle. The executable files in the bundle were generated from Tcl and Tk source.<sup id=\"rdp-ebb-cite_ref-:4_9-1\" class=\"reference\"><a href=\"#cite_note-:4-9\">[9]<\/a><\/sup> The current release is targeted to x86 architectures with OS versions 10.11 and above. The executable application bundle includes embedded Tcl and Tk frameworks, the Tcl script, copies of the ApE accessory files, a custom application icon, and a MacOS property list file.\n<\/p><p>ApE can be run on Unix\/Linux systems using the Tcl\/Tk windowing shell interpreter, wish, which is available as source code or precompiled binaries for most *nix operating systems.<sup id=\"rdp-ebb-cite_ref-:4_9-2\" class=\"reference\"><a href=\"#cite_note-:4-9\">[9]<\/a><\/sup> The wish binary is available by apt or apt-get on Debian systems. Of interest for using ApE in educational settings, ApE can also be run using the wish interpreter on low-cost Raspberry Pi systems or Chromebooks that have enabled the Linux Beta feature of Chrome OS.\n<\/p><p>We have also run ApE within the Android operating system using AndroWish<sup id=\"rdp-ebb-cite_ref-14\" class=\"reference\"><a href=\"#cite_note-14\">[14]<\/a><\/sup> as the Tcl\/Tk interpreter, however the smaller screen size of most Android-supported devices and the single window per app user interface impaired the general usability, and so compiled binaries are not provided.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"File_formats\">File formats<\/span><\/h3>\n<p>The usefulness of a program can be judged on three factors: flexibility of input, flexibility of data processing, and flexibility of output. To make ApE widely usable, we have endeavored to write procedures to read as many DNA sequence file types as possible. ApE reads FASTA or raw ASCII, GenBank<sup id=\"rdp-ebb-cite_ref-15\" class=\"reference\"><a href=\"#cite_note-15\">[15]<\/a><\/sup>, EMBL, GCG, pDraw, GFF3<sup id=\"rdp-ebb-cite_ref-16\" class=\"reference\"><a href=\"#cite_note-16\">[16]<\/a><\/sup>, DNAStrider<sup id=\"rdp-ebb-cite_ref-:1_5-1\" class=\"reference\"><a href=\"#cite_note-:1-5\">[5]<\/a><\/sup> and Serial Cloner<sup id=\"rdp-ebb-cite_ref-:0_1-1\" class=\"reference\"><a href=\"#cite_note-:0-1\">[1]<\/a><\/sup>, SnapGene<sup id=\"rdp-ebb-cite_ref-:2_7-1\" class=\"reference\"><a href=\"#cite_note-:2-7\">[7]<\/a><\/sup>, and Gene Construction Kit (GCK) file formats.<sup id=\"rdp-ebb-cite_ref-:3_8-1\" class=\"reference\"><a href=\"#cite_note-:3-8\">[8]<\/a><\/sup> ApE can also read Sanger sequencing <a href=\"https:\/\/www.limswiki.org\/index.php\/Chromatography\" title=\"Chromatography\" class=\"wiki-link\" data-key=\"2615535d1f14c6cffdfad7285999ad9d\">chromatogram<\/a> files in either the proprietary abi or open scf format. Sanger data is displayed as a scrollable and scalable graphic window, which can be used for aligning to a reference sequence.\n<\/p><p>ApE saves DNA data in a GenBank-like file format that is designed to be understood by most parsers that can parse Genbank files. This format is open and human-readable text, so saved data is not confined to a proprietary, binary format. In addition, many other programs and open-source libraries such as BioPerl or BioPython can read this format easily. Although it is based on GenBank, ApE files contain additional information not specified in the GenBank specification. First, sequence-wide information is stored as a special COMMENT line that begins with the text \"ApEinfo\". Second, each feature has additional feature-specific formatting data stored in feature qualifiers that begin with \"\/ApEinfo\". Some GenBank parsers require qualifiers to be part of a controlled vocabulary, so ApE has a user-specified option in the preferences window to save files without this information. Only the COMMENT fields of the GenBank header are visible and editable in the ApE interface (Figure 1G), however all of the header records (e.g., SOURCE, KEYWORDS, or REFERENCE) are retained in memory and are saved in the ApE formatted file. Future editions of the program could allow viewing and editing these header lines. Users can store base64 encoded versions of abi files as Genbank comment fields within an ApE file. Abi files linked in this way can be extracted and viewed with the standard abi viewer.\n<\/p><p><br \/>\n<a href=\"https:\/\/www.limswiki.org\/index.php\/File:Fig1.1_Davis_FrontBioinfo2022_40.jpg\" class=\"image wiki-link\" data-key=\"a9c20c0135cf99a07600278d3f17a744\"><img alt=\"Fig1.1 Davis FrontBioinfo2022 40.jpg\" src=\"https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/6\/6a\/Fig1.1_Davis_FrontBioinfo2022_40.jpg\" decoding=\"async\" style=\"width: 100%;max-width: 400px;height: auto;\" \/><\/a>\n<\/p>\n<div style=\"clear:both;\"><\/div>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table border=\"0\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><blockquote><p><b>Figure 1.<\/b> The main sequence editing window of ApE. <b>(A)<\/b> The top section of the window shows basic properties of the sequence and selected region. <b>(B)<\/b> The top section also shows the translation of the selected region. <b>(C)<\/b> The next pane shows a table of sequence features. Clicking on the arrowhead expands the description of the feature. <b>(D)<\/b> The next pane shows a list of all features under the mouse pointer (here, hovering over <b>(F)<\/b>). <b>(E)<\/b> The central region of the window contains the text of the sequence, with features highlighted in color. To the right is a vertical representation of these features in the currently displayed region and the scrollbar. On the far right is a representation of all of the features in the sequence. <b>(F)<\/b> When activated, the X-ray window shows a floating window containing a graphical representation of the line of text under the mouse pointer. <b>(G)<\/b> The bottom of the window shows an editable sequence comment.<\/p><\/blockquote>\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<h3><span class=\"mw-headline\" id=\"Auxiliary_files\">Auxiliary files<\/span><\/h3>\n<p>To make ApE as flexible as possible for processing and visualizing user data, ApE stores several data files as human-readable text files. This allows users to store multiple versions of the files for different purposes, or trade useful variants with others. ApE uses this modular framework for the restriction enzyme set, the feature library, gel ladders, graphical arrowheads and user preferences. The restriction enzyme files store recognition and cut sites, methylation specificities, and user specified enzyme \u201cgroups,\u201d which can be used in limiting enzyme searches (see below). Included with the distribution is a basic default set of enzymes, as well as several other enzyme database files, such as a set of all commercially available enzymes. DNA ladders for use in virtual agarose gels are stored in a file that can be edited using a ladder editor dialog within ApE. Arrowheads files are available to the user to customize the graphic map window. The \u201cApE Defaults.txt\u201d file stores over 100 default values for many user-specified parameters between sessions.\n<\/p><p>Finally, ApE includes a folder of feature definition library files. Feature definitions are designed to provide a rich and flexible matching paradigm. Definitions include all of the characters of the IUPAC degenerate nucleotide code, with all sequence bases required to be within the degenerate set at each position for a match to be noted. There are two variable length wild-card characters\u2014<tt>#<\/tt> and <tt>+<\/tt>\u2014which match any continuous string of nucleotides. Definitions can contain <tt><<\/tt> and <tt>><\/tt>; any characters before <tt><<\/tt> and after <tt>><\/tt> are not required to match in the search stage, but after a match is found, sequences continuous with the match that also match the pre- or post-sequence are included in the final match. Finally, the definitions can contain either uppercase or lowercase characters. Once a match has been found, uppercase characters are noted as part of the feature, while lowercase characters are gaps in the feature. This allows for feature gaps such as introns, as well as searches for specific bases within a given context, for example common or important SNPs. If a definition has only lowercase characters, all of the characters are included in the feature. Currently, ApE ships with default feature libraries for <i>C. elegans<\/i>, mouse, yeast and generic plasmid features, but there is also a built-in system for adding new libraries or editing the default libraries.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Implemented_methods_that_could_be_used_by_others\">Implemented methods that could be used by others<\/span><\/h3>\n<p>Many of the procedures within ApE could be used as stand-alone, command-line functions or incorporated into other DNA analysis projects. ApE has several basic analysis functions such as reverse complement, complement, translate, reverse-translate, search with IUPAC degeneracy codes, search for amino acid sequences in a translated DNA sequence, and melting temperature calculation. ApE also implements the DNA Strider algorithm for fast hexamer searching for restriction enzyme patterns<sup id=\"rdp-ebb-cite_ref-:1_5-2\" class=\"reference\"><a href=\"#cite_note-:1-5\">[5]<\/a><\/sup>, which is faster at finding restriction enzyme sites than a regular expression search. Finally, ApE includes a procedure to search for PCR primer binding sites using a modification of the Strider hexamer lookahead algorithm.\n<\/p><p>ApE implements pairwise alignment of two DNA sequences using a Needleman-Wunsch (NW) alignment algorithm with an affine gap penalty. Because this algorithm is processor intensive, the alignment algorithm first uses a simple heuristic algorithm for doing a first-pass, block-based search for locally identical sequence matches, which are then used as boundaries for aligning non-identical blocks by the NW algorithm. If the sequences have no major matching regions, the user can further specify a maximum value for mismatched regions to be aligned by the NW alignment algorithm. If a region between matching blocks has a product of lengths of each mismatched sequence region, the region is not aligned, and will be highlighted in black text in the resulting display. Once a pairwise alignment is made between the reference and each comparison sequence, the alignments are combined into a single alignment by adding gaps to each sequence; no attempt is made at multiple sequence alignment.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Interchange\">Interchange<\/span><\/h3>\n<p>ApE has many ways to output and share data. For text-based visualizations or analysis windows, ApE can save an output file as plain text, or as formatted rich text format (RTF) files, which preserves color background highlighting and other text formatting. On Mac OS, formatted text can also be copied to the clipboard in RTF format. For graphic visualizations of data, for example, graphic maps or virtual agarose gels, ApE can save the data in four formats: encapsulated postscript (.eps), scalable vector graphics (.svg), OpenXML-based Power Point (.pptx), and portable document format (.pdf). An additional format, Windows Metafile (.wmf), is available on Windows systems. All of these formats retain the information in vector format so that they can be edited when opened in a vector editing program, such as Inkscape or Adobe Illustrator. For users who use <a href=\"https:\/\/www.limswiki.org\/index.php\/LabArchives,_LLC\" title=\"LabArchives, LLC\" class=\"wiki-link\" data-key=\"a5bb3fd02213c041f2b90dd24a4ac606\">LabArchives<\/a> to store their <a href=\"https:\/\/www.limswiki.org\/index.php\/Electronic_laboratory_notebook\" title=\"Electronic laboratory notebook\" class=\"wiki-link\" data-key=\"a9fbbd5e0807980106763fab31f1e72f\">electronic laboratory notebook<\/a> (ELN), ApE has a direct interface to the LabArchives internet portal, so that analysis windows can be directly uploaded to a user\u2019s account. For making presentations, .pptx files can be read into Power Point, Keynote, or Google Slides. Finally, on Mac and Windows, ApE is able to directly output windows to an attached printer with formatting preserved. For DNA Sanger sequencing files, the data are scaled to fit within the printed page, with a user-specified number of lines per page. This wide variety of output formats and modalities should make ApE useful for saving an analysis in a laboratory notebook, for presenting the analysis on slides, for archiving the analysis in a database, or sharing the analysis on the internet.\n<\/p>\n<h2><span id=\"rdp-ebb-Results_(examples_of_use_and_limitations)\"><\/span><span class=\"mw-headline\" id=\"Results_.28examples_of_use_and_limitations.29\">Results (examples of use and limitations)<\/span><\/h2>\n<p>ApE has many functions for working with DNA. First, sequences can be annotated, applying names to regions of a sequence using construct features. It can also edit DNA and generate formatted text or vector graphic representations of the sequence. Other functions of ApE include the ability to locate enzyme recognition sites in a sequence and simulate agarose gels of restriction digests; molecular techniques simulators for a Restriction ligation reaction, a Golden Gate reaction, a Golden Gate reaction designer, a Gibson Assembly reaction, a Recombinase\/Integrase mediated joining reaction, and PCR reactions; and several analysis tools, including alignment of Sanger sequencing to a reference sequence, a dCAPS genotyping designer, direct input into the NCBI BLAST server, and several other minor tools. These functions are described in the subsequent subsections. Additionally, a video tutorial series describing many of the functions of ApE is available at <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.youtube.com\/playlist?list=PLXd4WouGm92muGl4mJx5EvUFVSWZKdyuA\" target=\"_blank\">YouTube<\/a>.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Construct_features\">Construct features<\/span><\/h3>\n<p>A key role of ApA is to locate and highlight functionally important sequences, called \u201cfeatures.\u201d Features can be added to a sequence manually or via an automated library search. Features can be visualized in four ways: as text in a table at the top of a sequence, as a text appearing when pointing to a sequence, as a graphical representation when pointing to a sequence line, or as a small graphical summary at the right side of the sequence window.\n<\/p><p>In the main sequence window, features are indicated as highlighted text (Figure 1E, above). In addition to the highlighted text, a tabular view of the features within a sequence is displayed (Figure 1C, above). The table is sortable by feature name, direction, GenBank feature type, and location. If a feature has GenBank qualifiers, those qualifiers are displayed within the table under drop-down rows that can be opened or closed. Features can be added to a file by selecting any region and then using the \u201cFeatures\u201d menu option \"New Feature.\" We\u2019ve endeavored to make the editing of features flexible. The table context menus allow the editing of many aspects of feature display, such as the name, highlight color, and display priority (a.k.a. foreground\/background, or z position). A similar context menu is available in the other columns of the table to quickly edit the other properties of each feature. For example, the location of the feature, that is, the range of bases included in the feature, as represented by numbers, can be edited. To edit a feature more extensively, a user can double-click any table row or alternatively right-click the sequence text directly.\n<\/p><p>An important aspect of ApE is that features can be added to a file by using a predefined or user-defined feature library to scan the entire sequence. Feature libraries consist of lines of text referred to here as \"feature definitions.\" Each feature definition includes a name, a sequence of the feature (possibly including undefined bases \u201cN,\u201d variable length of unknown sequence \u201c#,\u201d or introns \u201c-\u201d), and a color to apply to the feature if found. Each feature definition in the library is compared against the entire sequence, one by one, and if a match is found, the feature name and formatting defined in the library are applied to that part of the sequence. Thus, raw sequences can be rapidly converted to a table of feature names and base ranges. This modular approach benefits both the data sharing as well as the data preservation roles of ApE. Feature libraries can be exchanged between lab members or between lab groups. For example, collections of PCR primers can be stored as feature libraries and used to annotate any number of sequence files.\n<\/p><p>Because feature visualization is so important, ApE provides three ways to see what features are assigned to a piece of text. First, placing the mouse pointer over any character displays the feature names of all features assigned to that character (Figure 1D). Second, an X-ray window mode shows a semi-transparent overlay of the features and highlighted restriction recognition sites (Figure 1F, above). This window follows the mouse and updates with scrolling the text. Third, there is a small graphical map of features along the right edge of the sequence (Figure 1E, above).\n<\/p><p>Finally, features can be hidden from the current display without deleting the feature from the feature table. This modular approach allows the user to visualize features in many different contexts.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Basic_editing\">Basic editing<\/span><\/h3>\n<p>ApE is a sequence editor and contains powerful general and DNA-specific text editing tools, including basic text input, sequence search, open reading frames (ORF) search, specialized copy and paste functions, and brief instantaneous analysis of selected text.\n<\/p><p>ApE\u2019s main sequence window resembles many classic text editor windows, except that it is limited to representing DNA bases: either ACGT, ACGTN, or IUPAC degenerate base codes. The sequence can be linear or circular, as specified with a button at the top of the window (Figure 1A). In circular sequences, the sequence can be \u201crotated\u201d to start at any position within the sequence. Selecting sequences within the editing window can be done with the mouse or by entering numerical position values into the \u201cStart\u201d and \u201cEnd\u201d boxes at the top of the window (Figure 1A, above). Sequence-related <a href=\"https:\/\/www.limswiki.org\/index.php\/Metadata\" title=\"Metadata\" class=\"wiki-link\" data-key=\"f872d4d6272811392bafe802f3edf2d8\">metadata<\/a> or user notes and comments can be entered into a text box at the bottom of each sequence window (Figure 1G, above).\n<\/p><p>ApE has a search function specialized for the needs of molecular biologists. The find window, accessible from the main menu \u201cEdit > Find,\u201d or from the magnifying glass icon on the toolbar, has a basic text input. However, the search can be specified to find DNA sequences using the search input as degenerate bases, single letter amino acid codes, or literal bases. Depending on the setting, the character \u201cN\u201d would match any single DNA base, the asparagine codons AAT or AAC, or just the character N, respectively. Further, the search can be specified to match just the top DNA strand, or can search for the match in both strands, and can match the characters in a case-sensitive or case-insensitive search. Finally, for DNA searches, the user can allow a fixed number of mismatches to occur between the search string and the sequence, or can specify only a fixed number of bases at the 3\u2032 end of the search be required to match.\n<\/p><p>In addition to a text-matching search function, ApE has an open-reading-frame-based search function. This search can find the next or previous open reading frame relative to the current insertion cursor. A user can filter ORFs requiring a minimum length, requiring starting with a methionine or the next codon after the next stop, and requiring the ORF to be on either the top or bottom DNA strand. These settings are quickly accessed in the \u201cORFs\u201d menu.\n<\/p><p>Along with basic copy and paste functions, ApE also has many other functions that operate through the clipboard via the \u201cEdit > Copy Special\u201d menu. First, the function \u201cCopy all as GenBank\u201d will copy the entire sequence together with the associated header and feature records as a plain text version onto the clipboard. This can be used to make a complete record of the sequence in a lab notebook, an email, or a laboratory database, for example. These clipboard files can be re-imported and will open as a new sequence window. Second, the functions \u201cCopy Uppercase\u201d and \u201cCopy Uppercase Rev-Com\u201d allows the user to copy discontinuous regions of interest. Third, the functions \u201cCopy Translated,\u201d \u201cCopy Uppercase Translated,\u201d \u201cCopy Translated Rev-Com,\u201d and \u201cCopy Uppercase Translated Rev-Com\u201d allow the user to translate a continuous or discontinuous region for export into protein analysis software. Fourth, \u201cCopy as FASTA\u201d generates a FASTA version of the selected text, with the file name and selection indices in the FASTA header. Fifth, sequences can be copied as NCBI Bankit tables for submission to the NCBI database.\n<\/p><p>Finally, ApE displays four important attributes of user-selected sequence: melting temperature (Tm), %GC, a representation of the open reading frame (Figure 1A, above), and a translation of the top or bottom strand (Figure 1B, above). These features are displayed in the top area of the window as the text selection is changed.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Sequence_visualization\">Sequence visualization<\/span><\/h3>\n<p>At times, the user may need other ways of visualizing aspects of a sequence that go beyond the basic feature highlighting in the sequence window. First, the \u201cText Map\u201d function, available from the menu item \u201cEnzymes > Text Map\u201d or from a toolbar icon, allows the user to generate a customized text formatted representation of the sequence that includes multiple data tracks. Data tracks include restriction enzyme recognition sequences, position index, translation, bottom strand sequence, and feature regions. The user can then copy or save the window as a plain-text or rich-text (RTF) representation for archiving, sharing, or presenting the sequence. The \u201cTranslate\u201d function generates a translation of a selected sequence region or coding sequence (CDS)-type feature of a sequence. The translation can be formatted as single or three-letter codes, with optional spacing, line numbering and corresponding DNA sequence. The analysis includes the number of translated amino acids and the predicted molecular weight of the protein.\n<\/p><p>Second, the \u201cORF Map\u201d function, available from the menu item \u201cORFs > ORF Map,\u201d generates a simple visualization of ATG start codons, as well as amber, ochre, and opal stop codons in all six frames of a sequence region. In order to aid in visualizing the most potentially relevant open reading frames, the user is given the option of specifying a minimum cutoff for highlighting regions between stop and start or between adjacent stop codons. The user can then click on any highlighted region to select the corresponding region of the parent sequence.\n<\/p><p>Third, the sequence can be visualized using the \u201cGraphic Map\u201d function, available from \u201cEnzymes > Graphic Map\u201d or from the toolbar. This function converts all of the sequence features and selected enzyme cut sites into a vector map (Figure 2). The map can be either circular (Figures 2A and 2B) or linear (Figures 2C and 2D), depending on the nature of the sequence region depicted. Most visual elements of the map are customizable either with a mouse drag or using a \u201cConfigure\u201d function within each map window. All feature formatting can be stored in the metadata of the parent sequence file, so subsequent graphical map windows preserve the user\u2019s customizations. Feature and enzyme elements are linked to their parent sequence regions, so that mouse clicks on a graphical element cause the corresponding region to be selected in the parent. The menu function \u201cGraphic Map + U\u201d produces the same analysis, but adds the unique (cutting just one time) restriction enzymes in addition to the selected enzyme set.\n<\/p><p><br \/>\n<a href=\"https:\/\/www.limswiki.org\/index.php\/File:Fig2_Davis_FrontBioinfo2022_40.jpg\" class=\"image wiki-link\" data-key=\"577db77e68a7d6af2ad4441ce2042bf2\"><img alt=\"Fig2 Davis FrontBioinfo2022 40.jpg\" src=\"https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/8\/8a\/Fig2_Davis_FrontBioinfo2022_40.jpg\" decoding=\"async\" style=\"width: 100%;max-width: 400px;height: auto;\" \/><\/a>\n<\/p>\n<div style=\"clear:both;\"><\/div>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table border=\"0\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><blockquote><p><b>Figure 2.<\/b> Graphical maps of a sequence. <b>(A)<\/b> A circular map of pUC19, with colored features and restriction enzyme sites. <b>(B)<\/b> A different circular map of the same sequence file showing a variety of user-configurable display properties. <b>(C)<\/b> A linear map of a region of the same pUC19 file. <b>(D)<\/b> Another linear map of the same region, showing a variety of user-configurable display properties.<\/p><\/blockquote>\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<p>Each graphic window can be saved into four vector-based file formats: encapsulated postscript (.eps), scalable vector graphics (.svg), XML-based Power Point (.pptx), and portable document format (.pdf). By exporting into four different popular vector-graphic formats, ApE visualizations can be imported into many other programs that can represent vector graphics. For example, sequence maps can be read into Inkscape, Adobe Illustrator, OpenOffice Draw, or LibreOffice Draw for writing papers or lab reports, or posted directly to a website as .svg for sharing on the web. Finally, the .pptx format can be read into PowerPoint, Google Slides, or Apple Keynote for presentations.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Restriction_site_selection\">Restriction site selection<\/span><\/h3>\n<p>ApE has several tools, described in later sections, that use restriction enzyme sites as input. First, we describe how restriction enzyme sites are selected. The central switchboard for restriction site recognition in ApE is the enzyme selector dialog. Enzymes selected in this dialog become the currently \u201cselected set\u201d of enzymes that can be used in subsequent analysis or visualization tools. The selection dialog presents a central window with a list of enzyme names (Figure 3A). Enzymes can be selected by clicking on each name, while shift-clicking will select the individual site uniquely. Enzyme comments are displayed as the pointer hovers over the list. At the top of the dialog is a window selection area, where the user can select any of the currently open sequence windows, and can elect to analyze either the entire sequence or just the currently selected region. ApE determines the number of recognition sites within the selection, which is displayed next to the enzyme name. Some restriction enzymes do not cut sites that overlap with <i>E. coli<\/i> Dam and Dcm methylase sites. ApE maintains a database of overlapping configurations that are not cut. Thus, the user can choose to calculate the number of enzyme sites as though the DNA is or is not from a methylated source.\n<\/p><p><br \/>\n<a href=\"https:\/\/www.limswiki.org\/index.php\/File:Fig3_Davis_FrontBioinfo2022_40.jpg\" class=\"image wiki-link\" data-key=\"563843363111df657f308d250cce06e6\"><img alt=\"Fig3 Davis FrontBioinfo2022 40.jpg\" src=\"https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/b\/bf\/Fig3_Davis_FrontBioinfo2022_40.jpg\" decoding=\"async\" style=\"width: 100%;max-width: 400px;height: auto;\" \/><\/a>\n<\/p>\n<div style=\"clear:both;\"><\/div>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table border=\"0\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><blockquote><p><b>Figure 3.<\/b> The enzyme selector dialog and virtual agarose gels. (<b>A<\/b>) The enzyme selector dialog. (<b>B<\/b>) A simulated agarose gel of pUC19 digested with ApaLI and HindIII. The bands from each lane are shown in a table. (<b>C<\/b>) The same gel window, but showing detailed information for a single ApaLI band highlighted by hovering the mouse over the band.<\/p><\/blockquote>\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<p>Enzyme sites can be filtered using the \u201ccalculator\u201d function below the enzyme selection list. The calculator works by setting a desired number of sites in the current window, as well as membership in an enzyme group. The enzymes that meet both the number and group membership filters are previewed as underlined in the selection list. The user can then choose to apply one of three selection operations. First, \u201cSelect\u201d will add all of the underlined enzymes to the current selection. Second, \u201cDe-select\u201d will remove all underlined enzymes from the current set. Finally, \u201cAND\u201d will select the intersection of the current set with the filtered set.\n<\/p><p>Because the enzyme selector serves as a central place to select enzymes that are used in other tools, the dialog supplies a shortcut to several of these tools as a convenience. These appear at the bottom of the enzyme selection dialog. For example, the \u201cHighlight\u201d function will highlight the recognition sequences of the selected restriction enzyme set in the selection. In the X-ray window, these highlighted enzyme sequences show not only the recognition site, but also the cut sites, as a small tick mark upwards at the position of the top strand cut, and downwards for the bottom strand cut.\n<\/p><p>The \u201cDigest\u201d function, available from the \u201cEnzymes\u201d menu or the toolbar, generates a simulated agarose gel that would be produced when the selected sequence is digested with the selected enzymes (Figures 3B and 3C, above). Placing the pointer over a gel band brings forward a table in the analysis window and a miniature map of the features and digestion sites in the parental sequence. The table shows each band as the cut site location, band size and approximate mass percent of the total digest that the band represents, and the map highlights the sequence of the band. Clicking on a band will select the region of the sequence represented by the band. Gel bands can be used as inputs in the Gibson reaction dialog by drag-and-drop into the dialog, and can be used as inputs into the ligation dialog by simply clicking a band when the dialog is opened. The function \u201cDigest With All\u201d will generate a multi-lane gel window, with each lane being a single digest with each selected enzyme.\n<\/p><p>While simple single-lane or multiple-lane-single-digest gels can be generated from the selection dialog, more complex simulated agarose gels can be generated in a single step using the \u201cDigestion Dialog,\u201d available from the \u201cEnzymes\u201d menu or from the toolbar. In this dialog, each gel lane is represented by a row. Each row is either a DNA or ladder. Each DNA row can then be digested with single or multiple enzymes by activating a checkbox representing the specific enzyme column in the row. Partial digests can be accomplished by activating the \"%\" button in the enzyme selection region. Each enzyme can then be digested between 0 and 100%.\n<\/p><p>For some applications it can be useful to identify sequences that can be mutated to generate a new restriction enzyme recognition site. ApE has two functions that do this kind of analysis. First, \u201cSilent Sites\u201d examines the currently selected region and identifies potential sites that maintain the reading frame. Second, \u201cAdd Diagnostic Site\u201d identifies new recognition sties independent of reading frames. Instead, it allows the user to specify a maximum number of base changes allowed for the generation of the site. In both analysis results, the sequence is live-linked to the parent sequence, so that clicking on any base representing a base in the sequence selects that base in the parent window.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Molecular_techniques_simulators\">Molecular techniques simulators<\/span><\/h3>\n<p>ApE includes simulators for the classic restriction-ligation reaction, Golden Gate assembly, Gibson assembly, Recombinase assembly, and PCR. These are available from \u201cTools\u201d on the the main menu.\n<\/p>\n<h4><span class=\"mw-headline\" id=\"Restriction_ligation\">Restriction ligation<\/span><\/h4>\n<p>The classic method for joining DNA fragments is via restriction digestion followed by DNA ligase. The ApE tool \u201cRestriction-Ligation Assembler\u201d is able to simulate this reaction with one to three DNA fragments (Figure 4). The tool dialog initially prompts the user for a DNA sequence window or gel band. The information for that DNA populates the dialog with a picture of the overhanging end sequences, and a mini-map of the sequences in the fragment. If the fragments have compatible ends, the user can choose to complete the reaction, which will generate the product of the ligation as a new sequence window. The new sequence will have a comment section that lists all of the input plasmids and digestions used to generate the product. If the ends are not compatible, the dialog will not allow the reaction to be completed. The user can choose to reverse any of the fragments or modify the ends of the fragment with several common modification reactions.\n<\/p><p><br \/>\n<a href=\"https:\/\/www.limswiki.org\/index.php\/File:Fig4_Davis_FrontBioinfo2022_40.jpg\" class=\"image wiki-link\" data-key=\"17732fc3e99348c75435a65780ed9341\"><img alt=\"Fig4 Davis FrontBioinfo2022 40.jpg\" src=\"https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/f\/f6\/Fig4_Davis_FrontBioinfo2022_40.jpg\" decoding=\"async\" style=\"width: 100%;max-width: 400px;height: auto;\" \/><\/a>\n<\/p>\n<div style=\"clear:both;\"><\/div>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table border=\"0\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><blockquote><p><b>Figure 4.<\/b> The restriction-ligation assembler tool. (<b>A<\/b>) Graphic maps of the input sequence files for the planned reaction (left) and the product (right). (<b>B<\/b>) The Digestion Dialog is used to generate a virtual agarose gel of the two required DNA fragments: pU19 digested with XbaI and SalI, and a linear DNA fragment containing your favorite gene (YFG) digested with the same enzymes. The two fragments are then dragged into the Restriction-Ligation Assembler tool dialog. The tool then generates the product, shown in (<b>A<\/b>).<\/p><\/blockquote>\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<h3><span class=\"mw-headline\" id=\"Golden_Gate\">Golden Gate<\/span><\/h3>\n<p>The Golden Gate reaction is similar to a basic restriction-ligation reaction; however, the use of type IIS restriction enzymes adds distinct requirements, and thus ApE has distinct tools for dealing with this type of reaction. Unlike traditional ligation reactions, Golden Gate reactions can join as many fragments as unique overhanging sequences can be designed. In fact, successful 35-fragment reactions have been demonstrated with empirically validated orthogonal overhangs.<sup id=\"rdp-ebb-cite_ref-17\" class=\"reference\"><a href=\"#cite_note-17\">[17]<\/a><\/sup> ApE has distinct workflows for designing Golden Gate reactions to create a defined construct, as well as assembling a Golden Gate reaction using existing constructs.\n<\/p><p>The ApE \u201cGolden Gate Designer\u201d tool assists the user in the design of sequences to join DNA fragments (Figure 5). The dialog gives the user a choice of available type IIS enzymes, and then the option of selecting DNA fragments to be ligated. The algorithm then uses a random walk to search for a set of the most orthogonal overhangs, and presents a set of PCR primers to generate them. Because the algorithm can get caught in local minima, the user is given the option to restart the search with a new random seed if a non-optimal solution was found. A new sequence window is created containing the desired reaction product, including new features containing the primer sequences. These primer sequences are also added to the file comment, both as a list of PCR reactions including primer pairs and templates, as well as a list of primers in a format compatible with online oligonucleotide ordering systems.\n<\/p><p><br \/>\n<a href=\"https:\/\/www.limswiki.org\/index.php\/File:Fig5_Davis_FrontBioinfo2022_40.jpg\" class=\"image wiki-link\" data-key=\"a002be5c65da1a5c95f88332857057cf\"><img alt=\"Fig5 Davis FrontBioinfo2022 40.jpg\" src=\"https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/d\/dd\/Fig5_Davis_FrontBioinfo2022_40.jpg\" decoding=\"async\" style=\"width: 100%;max-width: 400px;height: auto;\" \/><\/a>\n<\/p>\n<div style=\"clear:both;\"><\/div>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table border=\"0\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><blockquote><p><b>Figure 5.<\/b> The Golden Gate Designer tool. (<b>A<\/b>) Graphic maps of the input sequences (left) and output sequence (right). (<b>B<\/b>) The Golden Gate Designer is first used to specify two PCR products: YFG and pUC19. The tool then designs four PCR primers and the sequence of the Golden Gate reaction, the product sequence shown in (<b>A<\/b>).<\/p><\/blockquote>\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<p>The \u201cGolden Gate Assembler\u201d tool simulates the assembly of the fragments once they have been designed (Figure 6). The user chooses one to three IIS restriction enzyme types. Once an enzyme has been selected, the assembler searches open sequences for any fragments that are flanked by oppositely oriented sites and for compatible overhang sequences. The assembler then gives the user a drop-down list of all possible fragments that are in a closed circular assembly. If multiple fragments are possible at a given position, a new dropdown menu is presented to the user. The process is repeated until the circle is closed. The user can choose to generate the conceptual product in a new sequence window. The new window will contain a sequence comment listing all of the plasmid sequence files used in the Golden Gate reaction that generated that sequence.\n<\/p><p><br \/>\n<a href=\"https:\/\/www.limswiki.org\/index.php\/File:Fig6_Davis_FrontBioinfo2022_40.jpg\" class=\"image wiki-link\" data-key=\"24de658871537eed30cb61ff97c70cac\"><img alt=\"Fig6 Davis FrontBioinfo2022 40.jpg\" src=\"https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/4\/4d\/Fig6_Davis_FrontBioinfo2022_40.jpg\" decoding=\"async\" style=\"width: 100%;max-width: 400px;height: auto;\" \/><\/a>\n<\/p>\n<div style=\"clear:both;\"><\/div>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table border=\"0\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><blockquote><p><b>Figure 6.<\/b> The Golden Gate Assembler tool. (<b>A<\/b>) A graphic map of two SapI restriction fragments as designed in Figure 5 to be used in a Golden Gate reaction (left), and the product of the reaction (right). (<b>B<\/b>) The Golden Gate Assembler shows the chosen SapI restriction enzyme, the selected input fragments and the three-base overhangs of each SapI cut.<\/p><\/blockquote>\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<h4><span class=\"mw-headline\" id=\"Gibson_assembly\">Gibson assembly<\/span><\/h4>\n<p>A third, very flexible and effective, DNA assembly method is based on long homologous end hybridization. This class of methods includes Gibson assembly<sup id=\"rdp-ebb-cite_ref-18\" class=\"reference\"><a href=\"#cite_note-18\">[18]<\/a><\/sup>, sequence- and ligation-independent cloning (SLIC) assembly<sup id=\"rdp-ebb-cite_ref-19\" class=\"reference\"><a href=\"#cite_note-19\">[19]<\/a><\/sup>, circular polymerase extension cloning (CPEC) assembly<sup id=\"rdp-ebb-cite_ref-20\" class=\"reference\"><a href=\"#cite_note-20\">[20]<\/a><\/sup>, and SLiCE assembly.<sup id=\"rdp-ebb-cite_ref-21\" class=\"reference\"><a href=\"#cite_note-21\">[21]<\/a><\/sup>\n<\/p><p>ApE\u2019s \u201cGibson Designer\u201d tool has a similar input to the \u201cGolden Gate Designer\u201d tool, with fragments chosen from currently open sequences (Figure 7). Also similar to the \u201cGolden Gate Designer\u201d tool, a gel band can be added as a fragment via a drag-and-drop motion. Each fragment can be designed as a PCR with additional tails, a PCR without additional tails, or a stand-alone fragment without PCR primers. Gel bands are automatically set to be non-PCR fragments. Once all of the fragments are selected, the user is prompted to review and modify the homologous overlap at each fragment junction. Each junction is displayed at the top of the review window, showing the new forward and reverse primers, and the template sequences. The overlap is generated by adding bases to the 5\u2032 end of the reverse primer until a minimum melting temperature is reached for the overlap. The user can choose to incorporate new, non-templated bases into the gap between the fragments. If gel bands are used as fragments, the user can select how the reaction will deal with single-stranded overhangs by setting the exonuclease direction to \u201c5\u2032 Exo\u201d or \u201c3\u2032 Exo\u201d in a user defaults option. Like in the \u201cGolden Gate Designer,\u201d the new sequence window will contain all newly designed primers as sequence features and will list all PCR reactions and primers in the file comments section.\n<\/p><p><br \/>\n<a href=\"https:\/\/www.limswiki.org\/index.php\/File:Fig7_Davis_FrontBioinfo2022_40.jpg\" class=\"image wiki-link\" data-key=\"d6f42acf81ded7fbf62a3157479ff1af\"><img alt=\"Fig7 Davis FrontBioinfo2022 40.jpg\" src=\"https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/4\/40\/Fig7_Davis_FrontBioinfo2022_40.jpg\" decoding=\"async\" style=\"width: 100%;max-width: 400px;height: auto;\" \/><\/a>\n<\/p>\n<div style=\"clear:both;\"><\/div>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table border=\"0\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><blockquote><p><b>Figure 7.<\/b> The Gibson Designer tool. (<b>A<\/b>) Graphic maps of the two input sequences (left) and the output sequence (right). (<b>B<\/b>) The Gibson Designer is used to specify two PCR products containing YFG and pUC19. The tool then steps through both Gibson junctions, allowing fine-grained design of each. Finally, the tool generates the sequence, shown on the right in (<b>A<\/b>).<\/p><\/blockquote>\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<h4><span class=\"mw-headline\" id=\"Recombinase_mediated_joining\">Recombinase mediated joining<\/span><\/h4>\n<p>A modular assembly method is recombinase-mediated assembly. The most popular of these methods is the Gateway cloning system from Invitrogen (a brand of ThermoFisher). The ApE \u201cRecombination Assembler\u201d tool (Figure 8) functions very similarly to the \u201cGolden Gate Reaction\u201d tool. The user is first asked to choose a reaction prototype, for example a \u201cBP reaction (1\u20132)\u201d combines a fragment ending with attB1 and attB2 sites with a fragment containing attP1 and attP2 sites. Once a prototype is chosen, the algorithm searches all open windows to find fragments that contain the correct sites in the correct orientation to be a substrate for the chosen reaction. If multiple compatible sequences are found for a fragment, the user can choose between the options via the drop-down menu. Once all required sequences are found and selected, the simulated reaction generates a product plasmid. As for other reaction simulators, a list of the input sequences and the reaction performed is added to the sequence comment box of the product.\n<\/p><p><br \/>\n<a href=\"https:\/\/www.limswiki.org\/index.php\/File:Fig8_Davis_FrontBioinfo2022_40.jpg\" class=\"image wiki-link\" data-key=\"a68aecbf36243cf560cb23bc63fde0cb\"><img alt=\"Fig8 Davis FrontBioinfo2022 40.jpg\" src=\"https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/b\/bd\/Fig8_Davis_FrontBioinfo2022_40.jpg\" decoding=\"async\" style=\"width: 100%;max-width: 400px;height: auto;\" \/><\/a>\n<\/p>\n<div style=\"clear:both;\"><\/div>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table border=\"0\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><blockquote><p><b>Figure 8.<\/b> Gateway reaction. (<b>A<\/b>) Graphic map of the input sequences for a Gateway BP reaction (left) and the product of the recombination (right). (<b>B<\/b>) The Recombination Assembler tool is used to select the two input sequences (Insert and Backbone). The tool then generates the product sequence, represented by the map in (<b>A<\/b>).<\/p><\/blockquote>\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<p>Although most users only perform the basic Gateway reactions as described in the product literature, the Gateway recombination reaction is very flexible and has been adapted to specific use cases. For example, the pHELLSGATE plasmid is designed to use a PCR fragment containing attB1 and attB2 ends to recombine simultaneously into two attP1-attP2 sites to generate a hairpin silencing construct for use in Arabidopsis. Similarly, pWormgatePro allows users to build a similar hairpin construct for <i>C. elegans<\/i> RNAi using an LR-recombination reaction. ApE allows users to design new reaction prototypes to accomplish any DNA recombination reaction <i>in silico<\/i>. The \u201cRecombination Reaction Editor\u201d dialog allows new prototypes to be created. If a user wants to design recombination reactions involving a different recombinase or integrase, new recombinase reaction sites can be added using the reaction editor.\n<\/p>\n<h4><span class=\"mw-headline\" id=\"PCR\">PCR<\/span><\/h4>\n<p>Amplification by PCR is the most critical method in molecular biology laboratories. The ApE tool \u201cPCR Reaction\u201d uses PCR primer databases, searches sequences for primer binding sites, and simulates a PCR reaction with a given set of primers (Figure 9). A major role of the tool is to use a primer database to search a template sequence for primer binding sites. The database can be loaded from a text file formatted as an ApE feature library file. Alternatively, a user can add primers to the current database by loading \u201cprimer_bind\u201d features in a sequence file, or by pasting sequences from the system clipboard. Sequences in the system clipboard can be formatted as simple DNA sequences or as tab delimited name-sequence pairs, each on a new line.\n<\/p><p><br \/>\n<a href=\"https:\/\/www.limswiki.org\/index.php\/File:Fig9_Davis_FrontBioinfo2022_40.jpg\" class=\"image wiki-link\" data-key=\"59035ef07b93f17364372eca7e5df44f\"><img alt=\"Fig9 Davis FrontBioinfo2022 40.jpg\" src=\"https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/1\/1e\/Fig9_Davis_FrontBioinfo2022_40.jpg\" decoding=\"async\" style=\"width: 100%;max-width: 400px;height: auto;\" \/><\/a>\n<\/p>\n<div style=\"clear:both;\"><\/div>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table border=\"0\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><blockquote><p><b>Figure 9.<\/b> PCR Reaction tool. (<b>A<\/b>) A graphic map of the Golden Gate product from Figure 5 (left), which can be used as a PCR template. A graphic map of a PCR product generated with the PCR tool (right). (<b>B<\/b>) The PCR reaction tool shows a map of the template in the center, and a table of possible PCR products at the top. Selecting \u201cFwd_primer_1\u201d and \u201cRev_primer_1\u201d then generates a virtual PCR product. A graphic map of this product is shown in (<b>A<\/b>).<\/p><\/blockquote>\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<p>Binding is determined by a user-defined minimum annealing length, starting from the 3\u2032 base of the primer. The user can allow up to 10 mismatches in the primer while still requiring the minimum number of matching bases, and define the maximum number of bases that can be mismatched specifically at the 3\u2032 end of the sequence. By default, the tool then shows a list of primers that match at a single site within the template. The list has data columns: primer name, primer sequence, binding direction, distance of the 3\u2032 end from the current selection, location of the 3\u2032 end in the template sequence, melting temperature of the template-matching region, melting temperature of the full primer sequence, number of mismatches to the template (not including any 5\u2032 extension), and number of matches to the template. Primers in the list can then be selected or deselected by the user. Selected primers are shown in their approximate location and direction on a mini-map diagram in the center of the window. Finally, the user can activate a \u201cSelect Primer Pairs\u201d selection mode, which limits the current selection to two facing primer pairs. These primers can be used to generate a new linear sequence window containing the simulated PCR product.\n<\/p><p>In addition to working with existing primer sequences, ApE can assist the user in designing new primers. First, the user can simply select a region of text while noting the melting temperature of the sequence. Alternatively, there is a \u201cFind Primers\u201d tool that scans the selection for regions that meet a user-defined minimum and maximum length, melting temperature, percent GC, and 3\u2032 GC clamp. Oligonucleotide primers can be filtered to exclude self-hybridizing sequences, adjacent hybridizing bases and 3\u2032-end hybridization. If the user enters a target primer sequence that the primer should be compatible with, the filter will also apply a cross-hybridization filter on the same parameters as well. While a good first pass filter for primer binding sites, the tool is not as thorough or as flexible as a dedicated primer finding algorithm like Primer3.<sup id=\"rdp-ebb-cite_ref-22\" class=\"reference\"><a href=\"#cite_note-22\">[22]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-23\" class=\"reference\"><a href=\"#cite_note-23\">[23]<\/a><\/sup>\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Analysis_tools\">Analysis tools<\/span><\/h3>\n<p>In most molecular pipelines, DNA must be analyzed to determine if the actual DNA matches the conceptual sequence. ApE can display Sanger sequencing reads and align them to a reference sequence using the \u201cAlign Sequences\u201d tool (Figure 10A). The alignment display has several functions to aid in interpreting any mismatches. First, mismatches are highlighted in red text for easy identification. Next, any CDS feature in the reference sequence displays its translation above the reference. For any sequence that is an abi window, the user can place the mouse pointer above any base in the alignment display and a semi-opaque window will appear showing the corresponding region of the abi trace, so that the user can determine whether a mismatch is potentially due to a mixed fluorescence signal that led to a miscalled base (Figure 10B). The trace window additionally shows a translation of the codon centered on the base at the pointer, allowing the user to quickly determine if a mutated base leads to a non-synonymous codon. To assist in documenting the sequencing, ApE can embed abi files into an ApE sequence file to associate a sequence read with its reference sequence. Sanger sequence windows can also be printed or saved to PDF files. Printing reformats the file by breaking it into a user-specified number of lines per page.\n<\/p><p><br \/>\n<a href=\"https:\/\/www.limswiki.org\/index.php\/File:Fig10_Davis_FrontBioinfo2022_40.jpg\" class=\"image wiki-link\" data-key=\"797bc78d54df12df2f42066bec98d08c\"><img alt=\"Fig10 Davis FrontBioinfo2022 40.jpg\" src=\"https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/d\/db\/Fig10_Davis_FrontBioinfo2022_40.jpg\" decoding=\"async\" style=\"width: 100%;max-width: 400px;height: auto;\" \/><\/a>\n<\/p>\n<div style=\"clear:both;\"><\/div>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table border=\"0\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><blockquote><p><b>Figure 10.<\/b> Alignment of a reference sequence to a Sanger sequence. (<b>A<\/b>) An alignment of a reference sequence (first line) to an abi output of a Sanger sequencing reaction (second line). The mouse is placed over base 677 in the abi sequence to show a floating window containing the abi data. (<b>B<\/b>) The source abi trace file of the alignment in (<b>A<\/b>).<\/p><\/blockquote>\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<p>When working with DNA from a genomic source, users will often want to identify single nucleotide polymorphisms (SNPs). A Derived Cleaved Amplified Polymorphic Sequences (dCAPS) PCR assay is a popular way to genotype SNPs. In simple terms, a dCAPS assay uses a PCR primer that has a small number of base differences from the template near the 3\u2032 end adjacent to the polymorphic base. The primer-induced mutations are designed so that products generated from one allele have a restriction site while the other allele is lacking the site. Typically, one allele generates a 250 bp band, while the other allele generates a pair of 200 and 50 bp fragments. ApE has a \u201cdCAPS calculator\u201d tool to quickly design dCAPS primers. The user simply selects the base in the reference sequence that differs in the polymorphism. The tool asks the user to identify the alternate allele base, and then leads the user through the design of dCAPS primers.\n<\/p><p>The National Center for Biotechnology Information (NCBI) is a critical resource to molecular biologists. ApE provides a direct internet link to two NCBI resources: BLAST and Entrez query. The Basic Local Alignment Search Tool (BLAST)<sup id=\"rdp-ebb-cite_ref-24\" class=\"reference\"><a href=\"#cite_note-24\">[24]<\/a><\/sup>, provided by NCBI, allows a user to query the NCBI public databases to identify the potential source species of a sequence, to identify relevant features within a sequence, or to find orthologous or paralogous sequences. The \u201cBLAST Sequences at NCBI\u201d tool submits a sequence directly to NCBI via the web<sup id=\"rdp-ebb-cite_ref-25\" class=\"reference\"><a href=\"#cite_note-25\">[25]<\/a><\/sup> and returns the BLAST result to the default web browser. Alternatively, the \u201cDownload Sequences from NCBI\u201d tool retrieves sequences from NCBI using a keyword search.\n<\/p><p>Many molecular reactions require DNA in specific molar ratios. For example, bimolecular ligations are often performed at a 3:1 insert to vector ratio. Since the input DNA is usually different lengths and at different concentrations, molecular biologists often need to repeatedly calculate the molarity of different DNA solutions. ApE includes a molecular ratio calculator which can store the molar ratios required in frequently used reactions and can calculate the required volumes of each DNA fragment, given the sequence length and measured concentration.\n<\/p><p>Finally, ApE has several tools that provide functions that may be useful to a more limited user base. The \u201csgRNA Analysis\u201d tool allows a user to screen sequences against a set of rules<sup id=\"rdp-ebb-cite_ref-26\" class=\"reference\"><a href=\"#cite_note-26\">[26]<\/a><\/sup> for improved Cas9-CRISPR guide RNAs. The \u201cInsert Repeat\u201d tool allows a user to quickly insert a given number of exact repeats of a short sequence. The \u201cMulti-Cre Recombination\u201d tool allows a user to simulate the MultiPrime Cre-based recombination system used by Mansouri <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-27\" class=\"reference\"><a href=\"#cite_note-27\">[27]<\/a><\/sup> The \u201cPalette Generator\u201d tool generates a set of visually coordinated colors by selecting a set of colors evenly spaced in a circular hue space with random luminance and saturation. The tool includes a filter to limit the color luminance to provide a contrast ratio greater than three with both black and white, so that text displayed over the color will be readable. This tool can be used to generate a set of feature background highlight colors that are appealing and functional. The \u201cSpeak Text\u201d tool is available on Mac and Windows systems and provides an audio reading of selected text. Finally, there is a simple \u201cCalculator\u201d tool, which evaluates a mathematical expression.\n<\/p>\n<h2><span id=\"rdp-ebb-Discussion_(scalability_and_limitations)\"><\/span><span class=\"mw-headline\" id=\"Discussion_.28scalability_and_limitations.29\">Discussion (scalability and limitations)<\/span><\/h2>\n<p>ApE is distributed free of charge and can be downloaded at <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/jorgensen.biology.utah.edu\/wayned\/ape\/\" target=\"_blank\">https:\/\/jorgensen.biology.utah.edu\/wayned\/ape\/<\/a>, but it is not distributed as true <a href=\"https:\/\/www.limswiki.org\/index.php\/Free_and_open-source_software\" title=\"Free and open-source software\" class=\"wiki-link\" data-key=\"688dbf2b7fb58c69c6ad476828ee2c6a\">open-source software<\/a>. It is distributed with most of the rights of open-source software, including rights to inspect and modify the source code. However, no right is granted to redistribute modified source. The Tcl source code is archived at <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/github.com\/mwdavis2\/ApE\" target=\"_blank\">https:\/\/github.com\/mwdavis2\/ApE<\/a>. In the event that a community member wishes to propose a code addition or bug fix for incorporation into the centrally distributed version, they may initiate a pull request and contact the author to agree to a contributor license agreement. \n<\/p><p>This key distinction from true open-source projects was made consciously to prevent project forking, which we feel is inevitable with redistribution of modified versions. For small projects, especially projects lacking a user interface, forking can be a benefit. Each new user can customize the software to meet their needs, and new users not interested in modifying the source can choose from a wide variety of flavors of the code that might meet their needs. However, with a more complex program involving a user interface, forking runs three risks: 1) diluting the user base among multiple incompatible versions; 2) introducing inconsistent and unexpected user interface elements; and 3) having inconsistent quality checks on different versions of the software. With a single distribution source, there are no competing versions. Further, there is a single decision point for any aesthetic choices in the user interface. Finally, all bugs are referenced to a single version and can be corrected without needing to distribute potentially incompatible patch files to fix bugs that may or may not exist in different distributions. However, one of the strong suits of ApE is that many of its features and user interfaces have been inspired by input from users requesting new or modified functionality.\n<\/p>\n<h2><span id=\"rdp-ebb-Abbreviations,_acronyms,_and_initialisms\"><\/span><span class=\"mw-headline\" id=\"Abbreviations.2C_acronyms.2C_and_initialisms\">Abbreviations, acronyms, and initialisms<\/span><\/h2>\n<ul><li><b>ApE<\/b>: A Plasmid Editor<\/li>\n<li><b>BLAST<\/b>: Basic Local Alignment Search Tool<\/li>\n<li><b>CDS<\/b>: coding sequence<\/li>\n<li><b>NCBI<\/b>: National Center for Biotechnology Information<\/li>\n<li><b>NW<\/b>: Needleman-Wunsch<\/li>\n<li><b>ORF<\/b>: open reading frame<\/li>\n<li><b>PCR<\/b>: polymerase chain reaction<\/li>\n<li><b>RTF<\/b>: rich-text format<\/li><\/ul>\n<h2><span class=\"mw-headline\" id=\"Acknowledgements\">Acknowledgements<\/span><\/h2>\n<p>Thanks to Mark Palfreyman, Matthew Rich, David Almanzar, and Matt Schwartz for comments on the manuscript.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Author_contributions\">Author contributions<\/span><\/h3>\n<p>MWD developed, designed and programmed the software. MWD wrote the manuscript. MWD and EJ revised the manuscript. Funding acquisition: EJ. All authors read and approved the manuscript.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Funding\">Funding<\/span><\/h3>\n<p>EJ is an Investigator and MWD is a research scientist of the Howard Hughes Medical Institute (HHMI.org). This work was funded by NIH to EJ (NIH.gov), including grant NIGMS 2R01GM095817 and NINDS 5R01NS034307. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Data_availability\">Data availability<\/span><\/h3>\n<p>Source code for ApE is archived at <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/github.com\/mwdavis2\/ApE\" target=\"_blank\">https:\/\/github.com\/mwdavis2\/ApE<\/a>. The application can be downloaded from <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/jorgensen.biology.utah.edu\/wayned\/ape\/\" target=\"_blank\">https:\/\/jorgensen.biology.utah.edu\/wayned\/ape\/<\/a>.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Conflict_of_interest\">Conflict of interest<\/span><\/h3>\n<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.\n<\/p>\n<h2><span class=\"mw-headline\" id=\"References\">References<\/span><\/h2>\n<div class=\"reflist references-column-width\" style=\"-moz-column-width: 30em; -webkit-column-width: 30em; column-width: 30em; list-style-type: decimal;\">\n<div class=\"mw-references-wrap mw-references-columns\"><ol class=\"references\">\n<li id=\"cite_note-:0-1\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:0_1-0\">1.0<\/a><\/sup> <sup><a href=\"#cite_ref-:0_1-1\">1.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation web\">Perez, F.. <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/serialbasics.free.fr\/Serial_Cloner.html\" target=\"_blank\">\"Serial Cloner\"<\/a>. <i>Serial Basics<\/i><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/serialbasics.free.fr\/Serial_Cloner.html\" target=\"_blank\">http:\/\/serialbasics.free.fr\/Serial_Cloner.html<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 21 April 2021<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Serial+Cloner&rft.atitle=Serial+Basics&rft.aulast=Perez%2C+F.&rft.au=Perez%2C+F.&rft_id=http%3A%2F%2Fserialbasics.free.fr%2FSerial_Cloner.html&rfr_id=info:sid\/en.wikipedia.org:Journal:ApE,_A_Plasmid_Editor:_A_freely_available_DNA_manipulation_and_visualization_program\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-2\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-2\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.acaclone.com\/\" target=\"_blank\">\"pDRAW32 DNA analysis software\"<\/a>. AcaClone Software<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.acaclone.com\/\" target=\"_blank\">https:\/\/www.acaclone.com\/<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 21 April 2021<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=pDRAW32+DNA+analysis+software&rft.atitle=&rft.pub=AcaClone+Software&rft_id=https%3A%2F%2Fwww.acaclone.com%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:ApE,_A_Plasmid_Editor:_A_freely_available_DNA_manipulation_and_visualization_program\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-3\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-3\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.genbeans.org\/\" target=\"_blank\">\"GenBeans\"<\/a>. Gene Infinity, LLC<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/www.genbeans.org\/\" target=\"_blank\">http:\/\/www.genbeans.org\/<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 21 April 2021<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=GenBeans&rft.atitle=&rft.pub=Gene+Infinity%2C+LLC&rft_id=http%3A%2F%2Fwww.genbeans.org%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:ApE,_A_Plasmid_Editor:_A_freely_available_DNA_manipulation_and_visualization_program\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-4\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-4\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">York, I.. <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.iayork.com\/XPlasMap\/\" target=\"_blank\">\"XPlasMap\"<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/www.iayork.com\/XPlasMap\/\" target=\"_blank\">http:\/\/www.iayork.com\/XPlasMap\/<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 21 April 2021<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=XPlasMap&rft.atitle=&rft.aulast=York%2C+I.&rft.au=York%2C+I.&rft_id=http%3A%2F%2Fwww.iayork.com%2FXPlasMap%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:ApE,_A_Plasmid_Editor:_A_freely_available_DNA_manipulation_and_visualization_program\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:1-5\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:1_5-0\">5.0<\/a><\/sup> <sup><a href=\"#cite_ref-:1_5-1\">5.1<\/a><\/sup> <sup><a href=\"#cite_ref-:1_5-2\">5.2<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Douglas, Susan E. (1 February 1995). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/link.springer.com\/10.1007\/BF02821333\" target=\"_blank\">\"DNA strider: An inexpensive sequence analysis package for the Macintosh\"<\/a> (in en). <i>Molecular Biotechnology<\/i> <b>3<\/b> (1): 37\u201345. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1007%2FBF02821333\" target=\"_blank\">10.1007\/BF02821333<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1073-6085\" target=\"_blank\">1073-6085<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/link.springer.com\/10.1007\/BF02821333\" target=\"_blank\">http:\/\/link.springer.com\/10.1007\/BF02821333<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=DNA+strider%3A+An+inexpensive+sequence+analysis+package+for+the+Macintosh&rft.jtitle=Molecular+Biotechnology&rft.aulast=Douglas&rft.aufirst=Susan+E.&rft.au=Douglas%2C%26%2332%3BSusan+E.&rft.date=1+February+1995&rft.volume=3&rft.issue=1&rft.pages=37%E2%80%9345&rft_id=info:doi\/10.1007%2FBF02821333&rft.issn=1073-6085&rft_id=http%3A%2F%2Flink.springer.com%2F10.1007%2FBF02821333&rfr_id=info:sid\/en.wikipedia.org:Journal:ApE,_A_Plasmid_Editor:_A_freely_available_DNA_manipulation_and_visualization_program\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-6\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-6\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.benchling.com\/academic\" target=\"_blank\">\"Benchling for Academics\"<\/a>. Benchling, Inc<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.benchling.com\/academic\" target=\"_blank\">https:\/\/www.benchling.com\/academic<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 21 April 2021<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Benchling+for+Academics&rft.atitle=&rft.pub=Benchling%2C+Inc&rft_id=https%3A%2F%2Fwww.benchling.com%2Facademic&rfr_id=info:sid\/en.wikipedia.org:Journal:ApE,_A_Plasmid_Editor:_A_freely_available_DNA_manipulation_and_visualization_program\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:2-7\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:2_7-0\">7.0<\/a><\/sup> <sup><a href=\"#cite_ref-:2_7-1\">7.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.snapgene.com\/\" target=\"_blank\">\"SnapGene\"<\/a>. Dotmatics Limited<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.snapgene.com\/\" target=\"_blank\">https:\/\/www.snapgene.com\/<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 21 April 2021<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=SnapGene&rft.atitle=&rft.pub=Dotmatics+Limited&rft_id=https%3A%2F%2Fwww.snapgene.com%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:ApE,_A_Plasmid_Editor:_A_freely_available_DNA_manipulation_and_visualization_program\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:3-8\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:3_8-0\">8.0<\/a><\/sup> <sup><a href=\"#cite_ref-:3_8-1\">8.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.textco.com\/gene-construction-kit.php\" target=\"_blank\">\"Gene Construction Kit\"<\/a>. Textco BioSoftware, Inc<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/www.textco.com\/gene-construction-kit.php\" target=\"_blank\">http:\/\/www.textco.com\/gene-construction-kit.php<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 21 April 2021<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Gene+Construction+Kit&rft.atitle=&rft.pub=Textco+BioSoftware%2C+Inc&rft_id=http%3A%2F%2Fwww.textco.com%2Fgene-construction-kit.php&rfr_id=info:sid\/en.wikipedia.org:Journal:ApE,_A_Plasmid_Editor:_A_freely_available_DNA_manipulation_and_visualization_program\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:4-9\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:4_9-0\">9.0<\/a><\/sup> <sup><a href=\"#cite_ref-:4_9-1\">9.1<\/a><\/sup> <sup><a href=\"#cite_ref-:4_9-2\">9.2<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation web\">Walzer, K.. <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/github.com\/tcltk\" target=\"_blank\">\"Tcl\/Tk\"<\/a>. <i>GitHub<\/i><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/github.com\/tcltk\" target=\"_blank\">https:\/\/github.com\/tcltk<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 21 April 2021<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Tcl%2FTk&rft.atitle=GitHub&rft.aulast=Walzer%2C+K.&rft.au=Walzer%2C+K.&rft_id=https%3A%2F%2Fgithub.com%2Ftcltk&rfr_id=info:sid\/en.wikipedia.org:Journal:ApE,_A_Plasmid_Editor:_A_freely_available_DNA_manipulation_and_visualization_program\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-10\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-10\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Wippler, J.-C.. <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/code.google.com\/archive\/p\/tclkit\/\" target=\"_blank\">\"tclkit\"<\/a>. <i>Google Code<\/i><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/code.google.com\/archive\/p\/tclkit\/\" target=\"_blank\">https:\/\/code.google.com\/archive\/p\/tclkit\/<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 21 April 2021<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=tclkit&rft.atitle=Google+Code&rft.aulast=Wippler%2C+J.-C.&rft.au=Wippler%2C+J.-C.&rft_id=https%3A%2F%2Fcode.google.com%2Farchive%2Fp%2Ftclkit%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:ApE,_A_Plasmid_Editor:_A_freely_available_DNA_manipulation_and_visualization_program\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-11\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-11\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Thoyts, P.. <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/github.com\/patthoyts\/tclkit\" target=\"_blank\">\"patthoyts \/ tclkit\"<\/a>. <i>GitHub<\/i><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/github.com\/patthoyts\/tclkit\" target=\"_blank\">https:\/\/github.com\/patthoyts\/tclkit<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 21 April 2021<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=patthoyts+%2F+tclkit&rft.atitle=GitHub&rft.aulast=Thoyts%2C+P.&rft.au=Thoyts%2C+P.&rft_id=https%3A%2F%2Fgithub.com%2Fpatthoyts%2Ftclkit&rfr_id=info:sid\/en.wikipedia.org:Journal:ApE,_A_Plasmid_Editor:_A_freely_available_DNA_manipulation_and_visualization_program\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-12\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-12\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Nadkarni, A.P.. <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/sourceforge.net\/projects\/twapi\/files\/Tcl%20binaries\/Tclkits%20with%20TWAPI\/\" target=\"_blank\">\"Tcl Windows API extension Files\"<\/a>. <i>SourceForge<\/i><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/sourceforge.net\/projects\/twapi\/files\/Tcl%20binaries\/Tclkits%20with%20TWAPI\/\" target=\"_blank\">https:\/\/sourceforge.net\/projects\/twapi\/files\/Tcl%20binaries\/Tclkits%20with%20TWAPI\/<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 21 April 2021<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Tcl+Windows+API+extension+Files&rft.atitle=SourceForge&rft.aulast=Nadkarni%2C+A.P.&rft.au=Nadkarni%2C+A.P.&rft_id=https%3A%2F%2Fsourceforge.net%2Fprojects%2Ftwapi%2Ffiles%2FTcl%2520binaries%2FTclkits%2520with%2520TWAPI%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:ApE,_A_Plasmid_Editor:_A_freely_available_DNA_manipulation_and_visualization_program\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-13\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-13\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Johnson, A. (3 January 2019). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.angusj.com\/resourcehacker\/\" target=\"_blank\">\"Resource Hacker\"<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/www.angusj.com\/resourcehacker\/\" target=\"_blank\">http:\/\/www.angusj.com\/resourcehacker\/<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 21 April 2021<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Resource+Hacker&rft.atitle=&rft.aulast=Johnson%2C+A.&rft.au=Johnson%2C+A.&rft.date=3+January+2019&rft_id=http%3A%2F%2Fwww.angusj.com%2Fresourcehacker%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:ApE,_A_Plasmid_Editor:_A_freely_available_DNA_manipulation_and_visualization_program\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-14\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-14\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Werner, C.. <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.androwish.org\/index.html\/home\" target=\"_blank\">\"AndroWish\"<\/a>. <i>androwish.org<\/i><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.androwish.org\/index.html\/home\" target=\"_blank\">https:\/\/www.androwish.org\/index.html\/home<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 21 April 2021<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=AndroWish&rft.atitle=androwish.org&rft.aulast=Werner%2C+C.&rft.au=Werner%2C+C.&rft_id=https%3A%2F%2Fwww.androwish.org%2Findex.html%2Fhome&rfr_id=info:sid\/en.wikipedia.org:Journal:ApE,_A_Plasmid_Editor:_A_freely_available_DNA_manipulation_and_visualization_program\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-15\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-15\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Sayers, Eric W; Cavanaugh, Mark; Clark, Karen; Ostell, James; Pruitt, Kim D; Karsch-Mizrachi, Ilene (8 January 2019). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/academic.oup.com\/nar\/article\/47\/D1\/D94\/5144964\" target=\"_blank\">\"GenBank\"<\/a> (in en). <i>Nucleic Acids Research<\/i> <b>47<\/b> (D1): D94\u2013D99. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1093%2Fnar%2Fgky989\" target=\"_blank\">10.1093\/nar\/gky989<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0305-1048\" target=\"_blank\">0305-1048<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC6323954\/\" target=\"_blank\">PMC6323954<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/30365038\" target=\"_blank\">30365038<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/academic.oup.com\/nar\/article\/47\/D1\/D94\/5144964\" target=\"_blank\">https:\/\/academic.oup.com\/nar\/article\/47\/D1\/D94\/5144964<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=GenBank&rft.jtitle=Nucleic+Acids+Research&rft.aulast=Sayers&rft.aufirst=Eric+W&rft.au=Sayers%2C%26%2332%3BEric+W&rft.au=Cavanaugh%2C%26%2332%3BMark&rft.au=Clark%2C%26%2332%3BKaren&rft.au=Ostell%2C%26%2332%3BJames&rft.au=Pruitt%2C%26%2332%3BKim+D&rft.au=Karsch-Mizrachi%2C%26%2332%3BIlene&rft.date=8+January+2019&rft.volume=47&rft.issue=D1&rft.pages=D94%E2%80%93D99&rft_id=info:doi\/10.1093%2Fnar%2Fgky989&rft.issn=0305-1048&rft_id=info:pmc\/PMC6323954&rft_id=info:pmid\/30365038&rft_id=https%3A%2F%2Facademic.oup.com%2Fnar%2Farticle%2F47%2FD1%2FD94%2F5144964&rfr_id=info:sid\/en.wikipedia.org:Journal:ApE,_A_Plasmid_Editor:_A_freely_available_DNA_manipulation_and_visualization_program\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-16\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-16\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Stein, L. (18 August 2020). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/github.com\/The-Sequence-Ontology\/Specifications\" target=\"_blank\">\"The-Sequence-Ontology \/ Specifications\"<\/a>. <i>GitHub<\/i><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/github.com\/The-Sequence-Ontology\/Specifications\" target=\"_blank\">https:\/\/github.com\/The-Sequence-Ontology\/Specifications<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 21 April 2021<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=The-Sequence-Ontology+%2F+Specifications&rft.atitle=GitHub&rft.aulast=Stein%2C+L.&rft.au=Stein%2C+L.&rft.date=18+August+2020&rft_id=https%3A%2F%2Fgithub.com%2FThe-Sequence-Ontology%2FSpecifications&rfr_id=info:sid\/en.wikipedia.org:Journal:ApE,_A_Plasmid_Editor:_A_freely_available_DNA_manipulation_and_visualization_program\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-17\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-17\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Pryor, John M.; Potapov, Vladimir; Kucera, Rebecca B.; Bilotti, Katharina; Cantor, Eric J.; Lohman, Gregory J. S. (2 September 2020). Kalendar, Ruslan. ed. <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/dx.plos.org\/10.1371\/journal.pone.0238592\" target=\"_blank\">\"Enabling one-pot Golden Gate assemblies of unprecedented complexity using data-optimized assembly design\"<\/a> (in en). <i>PLOS ONE<\/i> <b>15<\/b> (9): e0238592. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1371%2Fjournal.pone.0238592\" target=\"_blank\">10.1371\/journal.pone.0238592<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1932-6203\" target=\"_blank\">1932-6203<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC7467295\/\" target=\"_blank\">PMC7467295<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/32877448\" target=\"_blank\">32877448<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/dx.plos.org\/10.1371\/journal.pone.0238592\" target=\"_blank\">https:\/\/dx.plos.org\/10.1371\/journal.pone.0238592<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Enabling+one-pot+Golden+Gate+assemblies+of+unprecedented+complexity+using+data-optimized+assembly+design&rft.jtitle=PLOS+ONE&rft.aulast=Pryor&rft.aufirst=John+M.&rft.au=Pryor%2C%26%2332%3BJohn+M.&rft.au=Potapov%2C%26%2332%3BVladimir&rft.au=Kucera%2C%26%2332%3BRebecca+B.&rft.au=Bilotti%2C%26%2332%3BKatharina&rft.au=Cantor%2C%26%2332%3BEric+J.&rft.au=Lohman%2C%26%2332%3BGregory+J.+S.&rft.date=2+September+2020&rft.volume=15&rft.issue=9&rft.pages=e0238592&rft_id=info:doi\/10.1371%2Fjournal.pone.0238592&rft.issn=1932-6203&rft_id=info:pmc\/PMC7467295&rft_id=info:pmid\/32877448&rft_id=https%3A%2F%2Fdx.plos.org%2F10.1371%2Fjournal.pone.0238592&rfr_id=info:sid\/en.wikipedia.org:Journal:ApE,_A_Plasmid_Editor:_A_freely_available_DNA_manipulation_and_visualization_program\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-18\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-18\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Gibson, Daniel G; Young, Lei; Chuang, Ray-Yuan; Venter, J Craig; Hutchison, Clyde A; Smith, Hamilton O (1 May 2009). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.nature.com\/articles\/nmeth.1318\" target=\"_blank\">\"Enzymatic assembly of DNA molecules up to several hundred kilobases\"<\/a> (in en). <i>Nature Methods<\/i> <b>6<\/b> (5): 343\u2013345. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1038%2Fnmeth.1318\" target=\"_blank\">10.1038\/nmeth.1318<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1548-7091\" target=\"_blank\">1548-7091<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.nature.com\/articles\/nmeth.1318\" target=\"_blank\">https:\/\/www.nature.com\/articles\/nmeth.1318<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Enzymatic+assembly+of+DNA+molecules+up+to+several+hundred+kilobases&rft.jtitle=Nature+Methods&rft.aulast=Gibson&rft.aufirst=Daniel+G&rft.au=Gibson%2C%26%2332%3BDaniel+G&rft.au=Young%2C%26%2332%3BLei&rft.au=Chuang%2C%26%2332%3BRay-Yuan&rft.au=Venter%2C%26%2332%3BJ+Craig&rft.au=Hutchison%2C%26%2332%3BClyde+A&rft.au=Smith%2C%26%2332%3BHamilton+O&rft.date=1+May+2009&rft.volume=6&rft.issue=5&rft.pages=343%E2%80%93345&rft_id=info:doi\/10.1038%2Fnmeth.1318&rft.issn=1548-7091&rft_id=https%3A%2F%2Fwww.nature.com%2Farticles%2Fnmeth.1318&rfr_id=info:sid\/en.wikipedia.org:Journal:ApE,_A_Plasmid_Editor:_A_freely_available_DNA_manipulation_and_visualization_program\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-19\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-19\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Li, Mamie Z; Elledge, Stephen J (1 March 2007). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.nature.com\/articles\/nmeth1010\" target=\"_blank\">\"Harnessing homologous recombination in vitro to generate recombinant DNA via SLIC\"<\/a> (in en). <i>Nature Methods<\/i> <b>4<\/b> (3): 251\u2013256. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1038%2Fnmeth1010\" target=\"_blank\">10.1038\/nmeth1010<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1548-7091\" target=\"_blank\">1548-7091<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.nature.com\/articles\/nmeth1010\" target=\"_blank\">https:\/\/www.nature.com\/articles\/nmeth1010<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Harnessing+homologous+recombination+in+vitro+to+generate+recombinant+DNA+via+SLIC&rft.jtitle=Nature+Methods&rft.aulast=Li&rft.aufirst=Mamie+Z&rft.au=Li%2C%26%2332%3BMamie+Z&rft.au=Elledge%2C%26%2332%3BStephen+J&rft.date=1+March+2007&rft.volume=4&rft.issue=3&rft.pages=251%E2%80%93256&rft_id=info:doi\/10.1038%2Fnmeth1010&rft.issn=1548-7091&rft_id=https%3A%2F%2Fwww.nature.com%2Farticles%2Fnmeth1010&rfr_id=info:sid\/en.wikipedia.org:Journal:ApE,_A_Plasmid_Editor:_A_freely_available_DNA_manipulation_and_visualization_program\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-20\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-20\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Quan, Jiayuan; Tian, Jingdong (30 July 2009). Ho, Paulo Lee. ed. <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/dx.plos.org\/10.1371\/journal.pone.0006441\" target=\"_blank\">\"Circular Polymerase Extension Cloning of Complex Gene Libraries and Pathways\"<\/a> (in en). <i>PLoS ONE<\/i> <b>4<\/b> (7): e6441. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1371%2Fjournal.pone.0006441\" target=\"_blank\">10.1371\/journal.pone.0006441<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1932-6203\" target=\"_blank\">1932-6203<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC2713398\/\" target=\"_blank\">PMC2713398<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/19649325\" target=\"_blank\">19649325<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/dx.plos.org\/10.1371\/journal.pone.0006441\" target=\"_blank\">https:\/\/dx.plos.org\/10.1371\/journal.pone.0006441<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Circular+Polymerase+Extension+Cloning+of+Complex+Gene+Libraries+and+Pathways&rft.jtitle=PLoS+ONE&rft.aulast=Quan&rft.aufirst=Jiayuan&rft.au=Quan%2C%26%2332%3BJiayuan&rft.au=Tian%2C%26%2332%3BJingdong&rft.date=30+July+2009&rft.volume=4&rft.issue=7&rft.pages=e6441&rft_id=info:doi\/10.1371%2Fjournal.pone.0006441&rft.issn=1932-6203&rft_id=info:pmc\/PMC2713398&rft_id=info:pmid\/19649325&rft_id=https%3A%2F%2Fdx.plos.org%2F10.1371%2Fjournal.pone.0006441&rfr_id=info:sid\/en.wikipedia.org:Journal:ApE,_A_Plasmid_Editor:_A_freely_available_DNA_manipulation_and_visualization_program\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-21\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-21\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Zhang, Yongwei; Werling, Uwe; Edelmann, Winfried (1 April 2012). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/academic.oup.com\/nar\/article\/40\/8\/e55\/2411705\" target=\"_blank\">\"SLiCE: a novel bacterial cell extract-based DNA cloning method\"<\/a> (in en). <i>Nucleic Acids Research<\/i> <b>40<\/b> (8): e55\u2013e55. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1093%2Fnar%2Fgkr1288\" target=\"_blank\">10.1093\/nar\/gkr1288<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1362-4962\" target=\"_blank\">1362-4962<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC3333860\/\" target=\"_blank\">PMC3333860<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/22241772\" target=\"_blank\">22241772<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/academic.oup.com\/nar\/article\/40\/8\/e55\/2411705\" target=\"_blank\">https:\/\/academic.oup.com\/nar\/article\/40\/8\/e55\/2411705<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=SLiCE%3A+a+novel+bacterial+cell+extract-based+DNA+cloning+method&rft.jtitle=Nucleic+Acids+Research&rft.aulast=Zhang&rft.aufirst=Yongwei&rft.au=Zhang%2C%26%2332%3BYongwei&rft.au=Werling%2C%26%2332%3BUwe&rft.au=Edelmann%2C%26%2332%3BWinfried&rft.date=1+April+2012&rft.volume=40&rft.issue=8&rft.pages=e55%E2%80%93e55&rft_id=info:doi\/10.1093%2Fnar%2Fgkr1288&rft.issn=1362-4962&rft_id=info:pmc\/PMC3333860&rft_id=info:pmid\/22241772&rft_id=https%3A%2F%2Facademic.oup.com%2Fnar%2Farticle%2F40%2F8%2Fe55%2F2411705&rfr_id=info:sid\/en.wikipedia.org:Journal:ApE,_A_Plasmid_Editor:_A_freely_available_DNA_manipulation_and_visualization_program\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-22\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-22\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Koressaar, Triinu; Remm, Maido (15 May 2007). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/academic.oup.com\/bioinformatics\/article\/23\/10\/1289\/197299\" target=\"_blank\">\"Enhancements and modifications of primer design program Primer3\"<\/a> (in en). <i>Bioinformatics<\/i> <b>23<\/b> (10): 1289\u20131291. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1093%2Fbioinformatics%2Fbtm091\" target=\"_blank\">10.1093\/bioinformatics\/btm091<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1367-4811\" target=\"_blank\">1367-4811<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/academic.oup.com\/bioinformatics\/article\/23\/10\/1289\/197299\" target=\"_blank\">https:\/\/academic.oup.com\/bioinformatics\/article\/23\/10\/1289\/197299<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Enhancements+and+modifications+of+primer+design+program+Primer3&rft.jtitle=Bioinformatics&rft.aulast=Koressaar&rft.aufirst=Triinu&rft.au=Koressaar%2C%26%2332%3BTriinu&rft.au=Remm%2C%26%2332%3BMaido&rft.date=15+May+2007&rft.volume=23&rft.issue=10&rft.pages=1289%E2%80%931291&rft_id=info:doi\/10.1093%2Fbioinformatics%2Fbtm091&rft.issn=1367-4811&rft_id=https%3A%2F%2Facademic.oup.com%2Fbioinformatics%2Farticle%2F23%2F10%2F1289%2F197299&rfr_id=info:sid\/en.wikipedia.org:Journal:ApE,_A_Plasmid_Editor:_A_freely_available_DNA_manipulation_and_visualization_program\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-23\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-23\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Untergasser, Andreas; Cutcutache, Ioana; Koressaar, Triinu; Ye, Jian; Faircloth, Brant C.; Remm, Maido; Rozen, Steven G. (1 August 2012). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/academic.oup.com\/nar\/article-lookup\/doi\/10.1093\/nar\/gks596\" target=\"_blank\">\"Primer3\u2014new capabilities and interfaces\"<\/a> (in en). <i>Nucleic Acids Research<\/i> <b>40<\/b> (15): e115\u2013e115. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1093%2Fnar%2Fgks596\" target=\"_blank\">10.1093\/nar\/gks596<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1362-4962\" target=\"_blank\">1362-4962<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC3424584\/\" target=\"_blank\">PMC3424584<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/22730293\" target=\"_blank\">22730293<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/academic.oup.com\/nar\/article-lookup\/doi\/10.1093\/nar\/gks596\" target=\"_blank\">https:\/\/academic.oup.com\/nar\/article-lookup\/doi\/10.1093\/nar\/gks596<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Primer3%E2%80%94new+capabilities+and+interfaces&rft.jtitle=Nucleic+Acids+Research&rft.aulast=Untergasser&rft.aufirst=Andreas&rft.au=Untergasser%2C%26%2332%3BAndreas&rft.au=Cutcutache%2C%26%2332%3BIoana&rft.au=Koressaar%2C%26%2332%3BTriinu&rft.au=Ye%2C%26%2332%3BJian&rft.au=Faircloth%2C%26%2332%3BBrant+C.&rft.au=Remm%2C%26%2332%3BMaido&rft.au=Rozen%2C%26%2332%3BSteven+G.&rft.date=1+August+2012&rft.volume=40&rft.issue=15&rft.pages=e115%E2%80%93e115&rft_id=info:doi\/10.1093%2Fnar%2Fgks596&rft.issn=1362-4962&rft_id=info:pmc\/PMC3424584&rft_id=info:pmid\/22730293&rft_id=https%3A%2F%2Facademic.oup.com%2Fnar%2Farticle-lookup%2Fdoi%2F10.1093%2Fnar%2Fgks596&rfr_id=info:sid\/en.wikipedia.org:Journal:ApE,_A_Plasmid_Editor:_A_freely_available_DNA_manipulation_and_visualization_program\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-24\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-24\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Altschul, Stephen F.; Gish, Warren; Miller, Webb; Myers, Eugene W.; Lipman, David J. (1 October 1990). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0022283605803602\" target=\"_blank\">\"Basic local alignment search tool\"<\/a> (in en). <i>Journal of Molecular Biology<\/i> <b>215<\/b> (3): 403\u2013410. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2FS0022-2836%2805%2980360-2\" target=\"_blank\">10.1016\/S0022-2836(05)80360-2<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0022283605803602\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0022283605803602<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Basic+local+alignment+search+tool&rft.jtitle=Journal+of+Molecular+Biology&rft.aulast=Altschul&rft.aufirst=Stephen+F.&rft.au=Altschul%2C%26%2332%3BStephen+F.&rft.au=Gish%2C%26%2332%3BWarren&rft.au=Miller%2C%26%2332%3BWebb&rft.au=Myers%2C%26%2332%3BEugene+W.&rft.au=Lipman%2C%26%2332%3BDavid+J.&rft.date=1+October+1990&rft.volume=215&rft.issue=3&rft.pages=403%E2%80%93410&rft_id=info:doi\/10.1016%2FS0022-2836%2805%2980360-2&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS0022283605803602&rfr_id=info:sid\/en.wikipedia.org:Journal:ApE,_A_Plasmid_Editor:_A_freely_available_DNA_manipulation_and_visualization_program\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-25\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-25\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/ncbi.github.io\/blast-cloud\/dev\/api.html\" target=\"_blank\">\"NCBI BLAST Common URL API\"<\/a>. <i>BLAST on the cloud<\/i>. National Center for Biotechnology Information<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/ncbi.github.io\/blast-cloud\/dev\/api.html\" target=\"_blank\">https:\/\/ncbi.github.io\/blast-cloud\/dev\/api.html<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 21 April 2021<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=NCBI+BLAST+Common+URL+API&rft.atitle=BLAST+on+the+cloud&rft.pub=National+Center+for+Biotechnology+Information&rft_id=https%3A%2F%2Fncbi.github.io%2Fblast-cloud%2Fdev%2Fapi.html&rfr_id=info:sid\/en.wikipedia.org:Journal:ApE,_A_Plasmid_Editor:_A_freely_available_DNA_manipulation_and_visualization_program\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-26\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-26\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Doench, John G; Hartenian, Ella; Graham, Daniel B; Tothova, Zuzana; Hegde, Mudra; Smith, Ian; Sullender, Meagan; Ebert, Benjamin L <i>et al.<\/i> (1 December 2014). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.nature.com\/articles\/nbt.3026\" target=\"_blank\">\"Rational design of highly active sgRNAs for CRISPR-Cas9\u2013mediated gene inactivation\"<\/a> (in en). <i>Nature Biotechnology<\/i> <b>32<\/b> (12): 1262\u20131267. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1038%2Fnbt.3026\" target=\"_blank\">10.1038\/nbt.3026<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1087-0156\" target=\"_blank\">1087-0156<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC4262738\/\" target=\"_blank\">PMC4262738<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/25184501\" target=\"_blank\">25184501<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.nature.com\/articles\/nbt.3026\" target=\"_blank\">https:\/\/www.nature.com\/articles\/nbt.3026<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Rational+design+of+highly+active+sgRNAs+for+CRISPR-Cas9%E2%80%93mediated+gene+inactivation&rft.jtitle=Nature+Biotechnology&rft.aulast=Doench&rft.aufirst=John+G&rft.au=Doench%2C%26%2332%3BJohn+G&rft.au=Hartenian%2C%26%2332%3BElla&rft.au=Graham%2C%26%2332%3BDaniel+B&rft.au=Tothova%2C%26%2332%3BZuzana&rft.au=Hegde%2C%26%2332%3BMudra&rft.au=Smith%2C%26%2332%3BIan&rft.au=Sullender%2C%26%2332%3BMeagan&rft.au=Ebert%2C%26%2332%3BBenjamin+L&rft.au=Xavier%2C%26%2332%3BRamnik+J&rft.date=1+December+2014&rft.volume=32&rft.issue=12&rft.pages=1262%E2%80%931267&rft_id=info:doi\/10.1038%2Fnbt.3026&rft.issn=1087-0156&rft_id=info:pmc\/PMC4262738&rft_id=info:pmid\/25184501&rft_id=https%3A%2F%2Fwww.nature.com%2Farticles%2Fnbt.3026&rfr_id=info:sid\/en.wikipedia.org:Journal:ApE,_A_Plasmid_Editor:_A_freely_available_DNA_manipulation_and_visualization_program\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-27\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-27\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Mansouri, Maysam; Bellon-Echeverria, Itxaso; Rizk, Aur\u00e9lien; Ehsaei, Zahra; Cianciolo Cosentino, Chiara; Silva, Catarina S.; Xie, Ye; Boyce, Frederick M. <i>et al.<\/i> (4 May 2016). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.nature.com\/articles\/ncomms11529\" target=\"_blank\">\"Highly efficient baculovirus-mediated multigene delivery in primary cells\"<\/a> (in en). <i>Nature Communications<\/i> <b>7<\/b> (1): 11529. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1038%2Fncomms11529\" target=\"_blank\">10.1038\/ncomms11529<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2041-1723\" target=\"_blank\">2041-1723<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC4857464\/\" target=\"_blank\">PMC4857464<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/27143231\" target=\"_blank\">27143231<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.nature.com\/articles\/ncomms11529\" target=\"_blank\">https:\/\/www.nature.com\/articles\/ncomms11529<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Highly+efficient+baculovirus-mediated+multigene+delivery+in+primary+cells&rft.jtitle=Nature+Communications&rft.aulast=Mansouri&rft.aufirst=Maysam&rft.au=Mansouri%2C%26%2332%3BMaysam&rft.au=Bellon-Echeverria%2C%26%2332%3BItxaso&rft.au=Rizk%2C%26%2332%3BAur%C3%A9lien&rft.au=Ehsaei%2C%26%2332%3BZahra&rft.au=Cianciolo+Cosentino%2C%26%2332%3BChiara&rft.au=Silva%2C%26%2332%3BCatarina+S.&rft.au=Xie%2C%26%2332%3BYe&rft.au=Boyce%2C%26%2332%3BFrederick+M.&rft.au=Davis%2C%26%2332%3BM.+Wayne&rft.date=4+May+2016&rft.volume=7&rft.issue=1&rft.pages=11529&rft_id=info:doi\/10.1038%2Fncomms11529&rft.issn=2041-1723&rft_id=info:pmc\/PMC4857464&rft_id=info:pmid\/27143231&rft_id=https%3A%2F%2Fwww.nature.com%2Farticles%2Fncomms11529&rfr_id=info:sid\/en.wikipedia.org:Journal:ApE,_A_Plasmid_Editor:_A_freely_available_DNA_manipulation_and_visualization_program\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<\/ol><\/div><\/div>\n<h2><span class=\"mw-headline\" id=\"Notes\">Notes<\/span><\/h2>\n<p>This presentation is faithful to the original, with only a few minor changes to presentation. In some cases important information was missing from the references, and that information was added. The original lists references alphabetically; this version lists them in order of appearance, by design.\n<\/p>\n<!-- \nNewPP limit report\nCached time: 20230630152053\nCache expiry: 86400\nDynamic content: false\nComplications: []\nCPU time usage: 0.663 seconds\nReal time usage: 0.817 seconds\nPreprocessor visited node count: 24498\/1000000\nPost\u2010expand include size: 177363\/2097152 bytes\nTemplate argument size: 48651\/2097152 bytes\nHighest expansion depth: 25\/40\nExpensive parser function count: 0\/100\nUnstrip recursion depth: 0\/20\nUnstrip post\u2010expand size: 51491\/5000000 bytes\n-->\n<!--\nTransclusion expansion time report (%,ms,calls,template)\n100.00% 432.721 1 -total\n 79.03% 341.996 1 Template:Reflist\n 61.29% 265.231 27 Template:Citation\/core\n 39.62% 171.452 12 Template:Cite_journal\n 28.37% 122.784 15 Template:Cite_web\n 13.89% 60.101 1 Template:Infobox_journal_article\n 12.38% 53.559 1 Template:Infobox\n 8.32% 35.999 14 Template:Date\n 7.92% 34.292 37 Template:Citation\/identifier\n 5.81% 25.153 80 Template:Infobox\/row\n-->\n\n<!-- Saved in parser cache with key limswiki:pcache:idhash:14252-0!canonical and timestamp 20230630152053 and revision id 52332. Serialized with JSON.\n -->\n<\/div><\/div><div class=\"printfooter\">Source: <a rel=\"external_link\" class=\"external\" href=\"https:\/\/www.limswiki.org\/index.php\/Journal:ApE,_A_Plasmid_Editor:_A_freely_available_DNA_manipulation_and_visualization_program\">https:\/\/www.limswiki.org\/index.php\/Journal:ApE,_A_Plasmid_Editor:_A_freely_available_DNA_manipulation_and_visualization_program<\/a><\/div>\n<!-- end content --><div class=\"visualClear\"><\/div><\/div><\/div><div class=\"visualClear\"><\/div><\/div><!-- end of the left (by default at least) column --><div class=\"visualClear\"><\/div><\/div>\n\n\n\n<\/body>","0f31a6a54c07621b155f4fa0d61b1eee_images":["https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/6\/6c\/Fig1_Davis_FrontBioinfo2022_40.jpg","https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/6\/6a\/Fig1.1_Davis_FrontBioinfo2022_40.jpg","https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/8\/8a\/Fig2_Davis_FrontBioinfo2022_40.jpg","https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/b\/bf\/Fig3_Davis_FrontBioinfo2022_40.jpg","https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/f\/f6\/Fig4_Davis_FrontBioinfo2022_40.jpg","https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/d\/dd\/Fig5_Davis_FrontBioinfo2022_40.jpg","https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/4\/4d\/Fig6_Davis_FrontBioinfo2022_40.jpg","https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/4\/40\/Fig7_Davis_FrontBioinfo2022_40.jpg","https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/b\/bd\/Fig8_Davis_FrontBioinfo2022_40.jpg","https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/1\/1e\/Fig9_Davis_FrontBioinfo2022_40.jpg","https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/d\/db\/Fig10_Davis_FrontBioinfo2022_40.jpg"],"0f31a6a54c07621b155f4fa0d61b1eee_timestamp":1688138453,"92f7ee03da2bf61f360ca5692fcf1da0_type":"article","92f7ee03da2bf61f360ca5692fcf1da0_title":"AI4Green: An open-source ELN for green and sustainable chemistry (Boobier et al. 2023)","92f7ee03da2bf61f360ca5692fcf1da0_url":"https:\/\/www.limswiki.org\/index.php\/Journal:AI4Green:_An_open-source_ELN_for_green_and_sustainable_chemistry","92f7ee03da2bf61f360ca5692fcf1da0_plaintext":"\n\nJournal:AI4Green: An open-source ELN for green and sustainable chemistryFrom LIMSWikiJump to navigationJump to searchFull article title\n \nAI4Green: An open-source ELN for green and sustainable chemistryJournal\n \nJournal of Chemical Information and ModelingAuthor(s)\n \nBoobier, Samuel; Davies, Joseph C.; Derbenev, Ivan N.; Handley, Christopher M.; Hirst, Jonathan D.Author affiliation(s)\n \nUniversity of NottinghamYear published\n \n2023Volume and issue\n \n63(10)Page(s)\n \n2895\u20132901DOI\n \n10.1021\/acs.jcim.3c00306ISSN\n \n1549-960XDistribution license\n \nCreative Commons Attribution 4.0 InternationalWebsite\n \nhttps:\/\/pubs.acs.org\/doi\/10.1021\/acs.jcim.3c00306Download\n \nhttps:\/\/pubs.acs.org\/doi\/pdf\/10.1021\/acs.jcim.3c00306\n\nContents \n\n1 Abstract \n2 Introduction \n3 Implementation \n4 Results \n\n4.1 Workgroups, workbooks, and user types \n4.2 Reaction Builder \n4.3 Marvin JS \n4.4 Reaction Table \n4.5 Summary Table \n4.6 Exporting data \n4.7 Sustainability add-ons \n4.8 User feedback and application development \n\n\n5 Conclusion \n6 Supporting information \n7 Abbreviations, acronyms, and initialisms \n8 Acknowledgements \n\n8.1 Author contributions \n8.2 Funding \n8.3 Data availability \n8.4 Conflict of interest \n\n\n9 References \n10 Notes \n\n\n\nAbstract \nThis paper presents the free and open-source, web-based electronic laboratory notebook (ELN) AI4Green, which combines features such as data archiving, collaboration tools, and green and sustainability metrics for organic chemistry. AI4Green offers the core functionality of an ELN, namely, the ability to store reactions securely and share them among different members of a research team. As users plan their reactions and record them in the ELN, green and sustainable chemistry is encouraged by automatically calculating green metrics and color-coding hazards, solvents, and reaction conditions. The interface links a database constructed from data extracted from PubChem, enabling the automatic collation of information for reactions. The application\u2019s design facilitates the development of auxiliary sustainability applications, such as our Solvent Guide module. As more reaction data are captured, subsequent work will focus on providing \u201cintelligent\u201d sustainability suggestions to the user.\nKeywords: electronic laboratory notebook, ELN, green and sustainable chemistry, open-source, data sharing\n\nIntroduction \nFor researchers to communicate their findings between their team and the wider scientific community, data must be shared and stored. Paper-based laboratory notebooks are traditionally used to record experiments, and little has changed over the last few decades, despite the ubiquity of digital technology. Over the past 20 years, electronic laboratory notebooks (ELNs) have become more prevalent as the benefits of digitization are realized.[1] Despite this, there remains a significant barrier to the uptake of ELNs, especially in the academic community.[2] In 2017, a survey at a BioSistemika webinar revealed that only 7% of respondents used an ELN in their daily laboratory routine.[2] Another survey from the same study showed that the main barriers were the cost associated with implementing an ELN and the system\u2019s usability.\nRecently, in a comprehensive comparison of commercial and open-source ELNs, it was discovered that the majority of the 96 currently active ELNs are commercial.[3] It was also noted that open-source codebases have the advantage that users could more directly contribute to the development of new features and have more control over the underlying software. However, there is more onus on the institution to install, host, and maintain the infrastructure. Chemotion is an open-source ELN designed for synthetic chemistry with a growing user base and a strong focus on data sharing and integrity[4][5], but not a particular emphasis on green and sustainable chemistry. Another open-source solution is eLabFTW, an ELN suitable for storing data from various scientific disciplines.[6]\nResearch data management is fundamental to scientific research.[7] Transitioning from paper-based laboratory notebooks to ELNs is crucial for adhering to data standards when reporting and publishing studies.[8] ELNs are also vital in making data FAIR (findable, accessible, interoperable, and reusable).[9] ELNs allow data sharing among colleagues and institutions, while also facilitating public access.[10] Open science[11][12] can also be enabled using ELNs, where data is curated using a standard data format, expediting data searches and preparation for machine learning (ML), where large data sets are often required to train insightful models. Recent examples of such databases include the Open Reaction Database[13] and the Chemotion Repository.[14]\nSustainability and reducing waste are vital considerations in laboratory-based projects. \"Sustainable\" refers to both the environmental and socio-economic impacts of a process.[15] Making processes more sustainable is not just a requirement of government regulations. There are also the benefits of cost reductions, improved worker health and safety, and the reduction of impact on the environment.[16][17] Current software tools for green and sustainable chemistry have recently been reviewed.[18] ELNs also offer the opportunity for collecting data that can be used to monitor sustainability targets (such as the reduction of hazardous solvents) and share knowledge among colleagues.[19]\nIn this work, we present AI4Green, designed to fulfill the core functionality of an ELN for synthetic organic chemistry in academic and industry settings, while also encouraging green and sustainable chemistry. The software automatically presents the hazards and sustainability of an inputted reaction by calculating sustainability metrics and a color-coded assessment of solvents and reaction conditions. While the web application is open-source, the software is provided in a manner that has a low barrier to installation and hosting, has a user-friendly interface, and is easily customizable. As the number of users grows, the captured reaction data will be subsequently leveraged using ML to provide \u201cintelligent\u201d suggestions to users on improving their reactions\u2019 sustainability.\n\nImplementation \nAI4Green is a web application written in Python, JavaScript, HTML, and CSS (Figure 1). The application is hosted on the cloud and available for general use at https:\/\/ai4green.app. Alternatively, visit the GitHub page for simple instructions detailing installation and hosting via Docker either locally or on an organization\u2019s local server.\n\r\n\n\n\n\n\n\n\n\n\n\nFigure 1. Web application architecture showing programming languages, databases, and how users interact with the application.\n\n\n\nThe backend server is built with Python and Flask and is linked to a Postgres relational database. The advantage of using Python for the backend is the access to many popular standard chemistry libraries, such as RDKit[20], and a low barrier for developers to add additional features. Flask is a well-documented and easy-to-use web application framework[21], and blueprints provide a clear structure to the code and facilitate expansion. Flask separates the Python backend from the JavaScript, HTML, and CSS-controlled frontend, where users input their data via Marvin JS[22] chemical editor or in a number of formats, including Simplified Molecular-Input Line-Entry System (SMILES).[23] JavaScript AJAX requests are used to update pages dynamically, e.g., automatically calculating green and sustainable metrics when inputting user data. A summary and sustainability report are presented back to the user which can be exported as a PDF or CSV file. A single database was implemented in Postgres, constructed from compound data extracted from PubChem[24] and CHEM21 sustainability data[25], to provide chemical information automatically, and separated into tables for users, workgroups, workbooks, solvents, hazards, compounds (reagents), and reactions.\n\nResults \n Workgroups, workbooks, and user types \nAI4Green installations may have one or more admin users. These users, typically system administrators for an institution, review requests to make new workgroups and can monitor the number of users, compounds, and reactions on the server. Users must register for an account to use AI4Green, at which point those in the principal investigator (PI) or equivalent roles, are prompted to make a workgroup as a space for their research group; other users are directed to join the workgroup their PI has created. \nWithin workgroups, there are workbooks that are designed to contain reactions for a specific project (Figure 2). Workgroups have three roles with different permission levels. PIs are the workgroup owner and have full permission to create workbooks and add or remove users from the workgroup and any workbooks within it. It is permissible to have two or more PIs in a workgroup. The senior researcher role, suitable for postdoctoral researchers or equivalent, can create new workbooks and add or remove users to these workbooks. They have no such rights for workgroups. The standard member role, suitable for postgraduate researchers or equivalent, have no editing rights but can request to be added to workbooks. \nUsing this flexible approach, a user can belong to multiple workgroups in different roles, e.g., a PI in one workgroup and a senior researcher in another. Reactions are only shared within the same workbook, as are any novel compounds added to the database. A user owns the reactions they create, which are also available as read-only entries to all members of the workbook, thus enabling data sharing between team members. This is especially useful when teams are spread over multiple locations while preserving data privacy.\n\r\n\n\n\n\n\n\n\n\n\n\nFigure 2. Web application architecture showing programming languages, databases, and how users interact with the application.\n\n\n\nReaction Builder \nThe core functionality of AI4Green is the Reaction Builder module. In later sections, we give further details on the different components of the Reaction Builder. Reactions can be created by navigating to a workgroup, choosing a workbook, and selecting \u201cNew Reaction.\u201d The user is prompted to enter a name for the reaction, which must be unique within the workbook. In addition, a unique code is also assigned to every new reaction. Users draw their reaction into the Marvin JS reaction sketcher. Next, the user is prompted to fill in the Reaction Table, for example, inputting the amount of each reaction component. At this stage, further solvents and reagents can be added. Finally, the Summary Table, which contains several automatically calculated green and sustainable metrics and detailed health and safety information, is generated. The reaction is automatically saved when new changes are made and can be reloaded and edited at a later date. The Summary Table can be exported to PFG or printed for use as a risk assessment.\n\nMarvin JS \nUsers must first input their reaction with the Marvin JS reaction sketcher (Figure 3). This sketcher is easy-to-use and well-documented.[22] For users familiar with other sketchers, it is possible to import structures in several formats, e.g., SMILES[23], which are easily exported from other sketchers. Reagents or solvents above or below the arrow are not currently accepted. However, these can be added directly to the Reaction Table. When the reaction is submitted, the Reaction SMILES (RXSMILES) is exported from the sketcher to the Reaction Table. The database, containing information from PubChem, is queried for the reactants and products in the RXSMILES to obtain density, molecular weight, and hazard codes automatically. All compound data have been collected from PubChem laboratory chemical safety sheets (LCSS). The hazard data are presented as Globally Harmonized System of Classification and Labelling of Chemicals (GHS) hazard codes.[26] The hazard data are only collected from the references provided by the European Chemicals Agency (ECHA).[27]\n\r\n\n\n\n\n\n\n\n\n\n\nFigure 3. Users draw their reaction using the Marvin JS reaction sketcher. Reactions can also be imported in a variety of formats, including SMILES.\n\n\n\nReaction Table \nThe user is prompted to populate the Reaction Table (Figure 4) and provide extra information if any reactant or product is not in the database. This \u201cnovel compound\u201d is saved to the database and can be reused, but only within the same workbook. Reagents can be added from the PubChem compound database by searching name or Chemical Abstracts Service (CAS) identifier; they can also be added to the database like a novel compound. Solvents can also be added from a predefined list and by searching name or CAS. \u201cNovel solvents\u201d can be added in the same way as \u201cnovel compounds\u201d. Solvents are color-coded according to the four-tier CHEM21 classification\u2014recommended, problematic, hazardous, and highly hazardous[25]\u2014providing immediate feedback to the user on the sustainability of their solvent choice. Users will then input the details of their reaction into the Reaction Table. Physical forms of all reactants, reagents, solvents, and products must be provided to assess the reaction\u2019s risk. Additionally, limiting reagent mass and the equivalence of all other reactants and reagents are required to proceed. Any suspected incorrect data from the database can be reported to system administrators for review at any point in the procedure. There is also space to describe the experimental procedure and any observations made during the reaction.\n\r\n\n\n\n\n\n\n\n\n\n\nFigure 4. A partially complete Reaction Table. Users are directed to provide information about the reaction (highlighted in red). Reagents, solvents, and novel compounds can be added or removed. Some information such as molecular weight and hazard codes are automatically populated from the PubChem database.\n\n\n\nSummary Table \nWith the Reaction Table complete, users are directed to the Summary Table (Figure 5). Information is automatically passed from the Reaction Table to the Summary Table. Visual assessments of the greenness and sustainability of the reaction are displayed to the users. These are either flagged as unsustainable (red) or given a traffic light system (i.e., red = not recommended\/hazardous; yellow = problematic; and green = recommended). The specific colors and shades for these ratings can be altered on the accessibility page. An overall hazard rating is generated from the hazard codes, denoted as Low (L), Medium (M), Hazardous (H), or Very Hazardous (VH). The threshold of the sustainability levels of the following metrics was in accordance with the CHEM21 project.[28] Several of these metrics are calculated automatically, like the sustainability of the chemical elements used in the reaction and the atom efficiency. Other metrics must be inputted by the user, such as the temperature of the reaction, batch or flow reaction conditions, the isolation method, the use of a catalyst, and whether that catalyst was recovered. A risk assessment section follows, which allows users to identify standard protocols, disposal of waste materials, spillage procedures, and any other risks associated with the reaction. An overall risk score can then be computed by self-assessment of the reaction\u2019s hazards, risks, and consequences. Typically, a reaction would be performed at this point. After the reaction run, the user can return to the Summary Table and input unreacted and actual product mass. Using these inputs, four more metrics are computed: mass efficiency, yield, conversion, and selectivity. The reaction can be marked as complete and locked to further editing at this stage. For increased data integrity, reactions modifications are time-stamped in the database. Reactions may currently be searched alphabetically or by most recently created.\n\r\n\n\n\n\n\n\n\n\n\n\nFigure 5. Part of the Summary Table showing information about the hazards of the reactions and various green and sustainability metrics and considerations.\n\n\n\nExporting data \nA reaction can be exported as a PDF, as some institutions may require reaction information and risk assessments to be displayed or filed. It is critical that data can be safely exported from an ELN for the longevity of that data, to move the data to a new system, and for more detailed analysis. The reactions from a workbook can be exported as a single PDF file, multiple PDF files, or a CSV file. The versatility of CSV files, which are machine-readable and can be opened in programs such as Microsoft Excel, makes this file format the preferred option for data offloading.\n\nSustainability add-ons \nAI4Green is open-source, and adding new sustainable auxiliary applications is simple. The Python Flask backend, built around blueprints, gives new developers a low barrier. An example of an add-on is the Solvent Guide module (Figure 6), which is a series of solvent flashcards. This can be accessed directly from the top navigation banner or as a user intervention while building a reaction. As previously discussed, the CHEM21 sustainability rating is displayed to the user when a solvent is selected. At this point, the user can open the solvent guide with this preloaded solvent flashcard. A second solvent can be selected for a side-by-side comparison. These solvent flashcards were created using data from the CHEM21 project, where the overall sustainability of the solvent is shown using the four-tier system. This is accompanied by a breakdown of the solvent\u2019s health, safety, and environment scores, with each category given a score out of 10 and a corresponding hazard color. The full methodology for calculating these scores is described in the CHEM21 publication.[25] The CAS number, linked to the PubChem entry for the solvent, is displayed to allow the user to access more information about the solvent. The family of the solvent, boiling point, flash point, and worst hazards are also displayed to guide the user further. For some solvents, a possible substitution is suggested based on an industrial solvent replacement guide and the reason for this substitution.[29] The solvent guide aims to bring the most relevant information to the user on a single page, allowing the solvents to be easily compared side-by-side. This can empower the user to choose a more sustainable and suitable solvent for their reaction at the planning stage. Future add-on applications could include a solvent map for solvent substitution, solvent or reaction conditions prediction for a specific reaction, life cycle analysis of reactions, and retrosynthesis for a target product.\n\r\n\n\n\n\n\n\n\n\n\n\nFigure 6. The Solvent Guide module, where users can explore different solvent options for their reaction.\n\n\n\nUser feedback and application development \nAI4Green has a growing userbase and is currently used by several academic groups, primarily at the University of Nottingham. As the application has evolved, users have been able to give direct input into new features either by contacting the team directly or by attending our regular user group meetings. Early feedback identified that the ELN must be easy-to-use, convenient for the laboratory chemist, and allow data to be easily shared throughout the group. Specific examples of features added because of user feedback include an automatic unique numbering system for reactions on their creation since users identified that, in a busy lab schedule, several reactions may be worked on concurrently; an autosave feature to ensure data were not accidentally lost if the browser tab is closed without saving; and adding reagents and solvents by CAS number, since this is a common identifier for laboratory chemists.\n\nConclusion \nIn this work we present an open-source web application, AI4Green, which combines the practical benefits of an ELN alongside a framework for encouraging green and sustainable chemistry. Despite the manifold benefits, many academic groups are yet to adopt usage of an ELN. AI4Green provides an accessible platform for chemists to store and share their research and receive feedback on the sustainability of their reactions. Research teams can be easily organized into workgroups and workbooks, with different levels of permission for different user types. The Reaction Builder provides a semi-automated route to generating sustainability, hazard reports, and risk assessments. The Solvent Guide is an example of an add-on application to encourage sustainable solvent selection. \nThere are, however, still many features to implement in AI4Green. Data sharing between different workgroups or to the public is not yet possible. We also aim to use inputted reaction data to make intelligent sustainability suggestions. This may be to suggest using a less hazardous solvent or reagent, predict milder suitable reaction conditions, or simulate life cycle analysis for process scale-up. There will be challenges in preserving data privacy for users, who will be able to decide whether to share data fully, partially, or not at all. Additional features to be implemented include searching reactions by component name or a substructure, a mechanism for PIs to approve reactions, and a sustainability dashboard to allow groups to set sustainability goals and track their progress toward them. \nAI4Green provides an exciting initial framework to unite an ELN with sustainable chemistry. It has a growing user base and rapidly evolving functionality.\n\nSupporting information \nFurther detail on the database schema (PDF)\n Abbreviations, acronyms, and initialisms \nCAS: Chemical Abstracts Service\nECHA: European Chemicals Agency\nELN: electronic laboratory notebook\nGHS: Globally Harmonized System of Classification and Labelling of Chemicals\nLCSS: laboratory chemical safety sheets\nPI: principal investigator\nRXSMILE: Reaction SMILES\nSMILES: Simplified Molecular-Input Line-Entry System\nAcknowledgements \nWe thank all the users of AI4Green for their valuable feedback and Aimie Garces, James Dowden, Jamie Twycross, and Zakariyyaa Siddiq for many useful discussions.\n\nAuthor contributions \nThe manuscript was written through contributions of all authors. All authors have given approval to the final version of the manuscript. S.B., J.C.D., C.M.H., and I.N.D. contributed to the development of the software. J.D.H. conceived and supervised the project.\n\nFunding \nThis work and J.D.H. are supported by the Royal Academy of Engineering under the Chairs in Emerging Technologies scheme [CiET2021_17]. The work was also supported in part by the Engineering and Physical Sciences Research Council (EPSRC) [grant number EP\/S035990\/1].\n\nData availability \nAI4Green is open-source and released under the AGPL-3.0 license. Full source code, installation instructions, and links to our video tutorials and user guides can be found at GitHub.\n\nConflict of interest \nThe authors declare no competing financial interest.\n\nReferences \n\n\n\u2191 Bird, Colin L.; Willoughby, Cerys; Frey, Jeremy G. (2013). \"Laboratory notebooks in the digital era: the role of ELNs in record keeping for chemistry and other sciences\" (in en). Chemical Society Reviews 42 (20): 8157. doi:10.1039\/c3cs60122f. ISSN 0306-0012. http:\/\/xlink.rsc.org\/?DOI=c3cs60122f .   \n \n\n\u2191 2.0 2.1 Kanza, Samantha; Willoughby, Cerys; Gibbins, Nicholas; Whitby, Richard; Frey, Jeremy Graham; Erjavec, Jana; Zupan\u010di\u010d, Klemen; Hren, Matja\u017e et al. (1 December 2017). \"Electronic lab notebooks: can they replace paper?\" (in en). Journal of Cheminformatics 9 (1): 31. doi:10.1186\/s13321-017-0221-3. ISSN 1758-2946. PMC PMC5443717. PMID 29086051. https:\/\/jcheminf.biomedcentral.com\/articles\/10.1186\/s13321-017-0221-3 .   \n \n\n\u2191 Higgins, Stuart G.; Nogiwa-Valdez, Akemi A.; Stevens, Molly M. (1 February 2022). \"Considerations for implementing electronic laboratory notebooks in an academic research environment\" (in en). Nature Protocols 17 (2): 179\u2013189. doi:10.1038\/s41596-021-00645-8. ISSN 1754-2189. https:\/\/www.nature.com\/articles\/s41596-021-00645-8 .   \n \n\n\u2191 Tremouilhac, Pierre; Nguyen, An; Huang, Yu-Chieh; Kotov, Serhii; L\u00fctjohann, Dominic Sebastian; H\u00fcbsch, Florian; Jung, Nicole; Br\u00e4se, Stefan (1 December 2017). \"Chemotion ELN: an Open Source electronic lab notebook for chemists in academia\" (in en). Journal of Cheminformatics 9 (1): 54. doi:10.1186\/s13321-017-0240-0. ISSN 1758-2946. PMC PMC5612905. PMID 29086216. https:\/\/jcheminf.biomedcentral.com\/articles\/10.1186\/s13321-017-0240-0 .   \n \n\n\u2191 Kotov, Serhii; Tremouilhac, Pierre; Jung, Nicole; Br\u00e4se, Stefan (1 December 2018). \"Chemotion-ELN part 2: adaption of an embedded Ketcher editor to advanced research applications\" (in en). Journal of Cheminformatics 10 (1): 38. doi:10.1186\/s13321-018-0292-9. ISSN 1758-2946. PMC PMC6089857. PMID 30105533. https:\/\/jcheminf.biomedcentral.com\/articles\/10.1186\/s13321-018-0292-9 .   \n \n\n\u2191 CARPi, Nicolas; Minges, Alexander; Piel, Matthieu (14 April 2017). \"eLabFTW: An open source laboratory notebook for research labs\". The Journal of Open Source Software 2 (12): 146. doi:10.21105\/joss.00146. ISSN 2475-9066. http:\/\/joss.theoj.org\/papers\/10.21105\/joss.00146 .   \n \n\n\u2191 Kanza, Samantha; Knight, Nicola J. (1 December 2022). \"Behind every great research project is great data management\" (in en). BMC Research Notes 15 (1): 20. doi:10.1186\/s13104-022-05908-5. ISSN 1756-0500. PMC PMC8781028. PMID 35063017. https:\/\/bmcresnotes.biomedcentral.com\/articles\/10.1186\/s13104-022-05908-5 .   \n \n\n\u2191 Herres\u2010Pawlis, Sonja; Bach, Felix; Bruno, Ian J.; Chalk, Stuart J.; Jung, Nicole; Liermann, Johannes C.; McEwen, Leah R.; Neumann, Steffen et al. (19 December 2022). \"Minimum Information Standards in Chemistry: A Call for Better Research Data Management Practices\" (in en). Angewandte Chemie International Edition 61 (51). doi:10.1002\/anie.202203038. ISSN 1433-7851. https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/anie.202203038 .   \n \n\n\u2191 Wilkinson, Mark D.; Dumontier, Michel; Aalbersberg, IJsbrand Jan; Appleton, Gabrielle; Axton, Myles; Baak, Arie; Blomberg, Niklas; Boiten, Jan-Willem et al. (15 March 2016). \"The FAIR Guiding Principles for scientific data management and stewardship\" (in en). Scientific Data 3 (1): 160018. doi:10.1038\/sdata.2016.18. ISSN 2052-4463. PMC PMC4792175. PMID 26978244. https:\/\/www.nature.com\/articles\/sdata201618 .   \n \n\n\u2191 Fink, Fabian; H\u00fcppe, Henrika M.; Jung, Nicole; Hoffmann, Alexander; Herres\u2010Pawlis, Sonja (1 October 2022). \"Sharing is Caring: Guidelines for Sharing in the Electronic Laboratory Notebook (ELN) Chemotion as applied by a Synthesis\u2010oriented Working Group**\" (in en). Chemistry\u2013Methods 2 (10). doi:10.1002\/cmtd.202200026. ISSN 2628-9725. https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/cmtd.202200026 .   \n \n\n\u2191 Jablonka, Kevin Maik; Patiny, Luc; Smit, Berend (1 April 2022). \"Making the collective knowledge of chemistry open and machine actionable\" (in en). Nature Chemistry 14 (4): 365\u2013376. doi:10.1038\/s41557-022-00910-7. ISSN 1755-4330. https:\/\/www.nature.com\/articles\/s41557-022-00910-7 .   \n \n\n\u2191 Baldi, Pierre (9 May 2022). \"Call for a Public Open Database of All Chemical Reactions\" (in en). Journal of Chemical Information and Modeling 62 (9): 2011\u20132014. doi:10.1021\/acs.jcim.1c01140. ISSN 1549-9596. https:\/\/pubs.acs.org\/doi\/10.1021\/acs.jcim.1c01140 .   \n \n\n\u2191 Kearnes, Steven M.; Maser, Michael R.; Wleklinski, Michael; Kast, Anton; Doyle, Abigail G.; Dreher, Spencer D.; Hawkins, Joel M.; Jensen, Klavs F. et al. (17 November 2021). \"The Open Reaction Database\" (in en). Journal of the American Chemical Society 143 (45): 18820\u201318826. doi:10.1021\/jacs.1c09820. ISSN 0002-7863. https:\/\/pubs.acs.org\/doi\/10.1021\/jacs.1c09820 .   \n \n\n\u2191 Tremouilhac, Pierre; Huang, Pei\u2010Chi; Lin, Chia\u2010Lin; Huang, Yu\u2010Chieh; Nguyen, An; Jung, Nicole; Bach, Felix; Br\u00e4se, Stefan (1 January 2021). \"Chemotion Repository, a Curated Repository for Reaction Information and Analytical Data\" (in en). Chemistry\u2013Methods 1 (1): 8\u201311. doi:10.1002\/cmtd.202000034. ISSN 2628-9725. https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/cmtd.202000034 .   \n \n\n\u2191 Horv\u00e1th, Istv\u00e1n T. (24 January 2018). \"Introduction: Sustainable Chemistry\" (in en). Chemical Reviews 118 (2): 369\u2013371. doi:10.1021\/acs.chemrev.7b00721. ISSN 0009-2665. https:\/\/pubs.acs.org\/doi\/10.1021\/acs.chemrev.7b00721 .   \n \n\n\u2191 Schulte, Paul A; McKernan, Lauralynn T; Heidel, Donna S; Okun, Andrea H; Dotson, Gary Scott; Lentz, Thomas J; Geraci, Charles L; Heckel, Pamela E et al. (1 December 2013). \"Occupational safety and health, green chemistry, and sustainability: a review of areas of convergence\" (in en). Environmental Health 12 (1): 31. doi:10.1186\/1476-069X-12-31. ISSN 1476-069X. PMC PMC3639149. PMID 23587312. http:\/\/ehjournal.biomedcentral.com\/articles\/10.1186\/1476-069X-12-31 .   \n \n\n\u2191 Anastas, Paul T.; Zimmerman, Julie B. (1 October 2018). \"The United Nations sustainability goals: How can sustainable chemistry contribute?\" (in en). Current Opinion in Green and Sustainable Chemistry 13: 150\u2013153. doi:10.1016\/j.cogsc.2018.04.017. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S245222361830021X .   \n \n\n\u2191 Derbenev, Ivan N.; Dowden, James; Twycross, Jamie; Hirst, Jonathan D. (1 June 2022). \"Software tools for green and sustainable chemistry\" (in en). Current Opinion in Green and Sustainable Chemistry 35: 100623. doi:10.1016\/j.cogsc.2022.100623. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2452223622000359 .   \n \n\n\u2191 Fantke, Peter; Cinquemani, Claudio; Yaseneva, Polina; De Mello, Jonathas; Schwabe, Henning; Ebeling, Bjoern; Lapkin, Alexei A. (1 November 2021). \"Transition to sustainable chemistry through digitalization\" (in en). Chem 7 (11): 2866\u20132882. doi:10.1016\/j.chempr.2021.09.012. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2451929421004745 .   \n \n\n\u2191 \"RDKit: Open-Source Cheminformatics Software\". T5 Informatics GmbH. https:\/\/www.rdkit.org\/ . Retrieved 27 January 2023 .   \n \n\n\u2191 \"Flask\". Pallets. https:\/\/flask.palletsprojects.com\/en\/2.3.x\/ . Retrieved 27 January 2023 .   \n \n\n\u2191 22.0 22.1 \"Marvin JS User's Guide\". Chemaxon. https:\/\/docs.chemaxon.com\/display\/docs\/marvin-js-user-s-guide.md . Retrieved 27 January 2023 .   \n \n\n\u2191 23.0 23.1 Weininger, David (1 February 1988). \"SMILES, a chemical language and information system. 1. Introduction to methodology and encoding rules\" (in en). Journal of Chemical Information and Computer Sciences 28 (1): 31\u201336. doi:10.1021\/ci00057a005. ISSN 0095-2338. https:\/\/pubs.acs.org\/doi\/abs\/10.1021\/ci00057a005 .   \n \n\n\u2191 \"PubChem\". National Library of Medicine. https:\/\/pubchem.ncbi.nlm.nih.gov\/ . Retrieved 27 January 2023 .   \n \n\n\u2191 25.0 25.1 25.2 Prat, Denis; Wells, Andy; Hayler, John; Sneddon, Helen; McElroy, C. Robert; Abou-Shehada, Sarah; Dunn, Peter J. (2016). \"CHEM21 selection guide of classical- and less classical-solvents\" (in en). Green Chemistry 18 (1): 288\u2013296. doi:10.1039\/C5GC01008J. ISSN 1463-9262. http:\/\/xlink.rsc.org\/?DOI=C5GC01008J .   \n \n\n\u2191 \"About the GHS\". United Nations Economic Commission for Europe. 2021. https:\/\/unece.org\/about-ghs .   \n \n\n\u2191 \"Information on Chemicals\". European Chemicals Agency. https:\/\/echa.europa.eu\/information-on-chemicals . Retrieved 27 January 2023 .   \n \n\n\u2191 McElroy, C. Robert; Constantinou, Andri; Jones, Leonie C.; Summerton, Louise; Clark, James H. (2015). \"Towards a holistic approach to metrics for the 21st century pharmaceutical industry\" (in en). Green Chemistry 17 (5): 3111\u20133121. doi:10.1039\/C5GC00340G. ISSN 1463-9262. http:\/\/xlink.rsc.org\/?DOI=C5GC00340G .   \n \n\n\u2191 Alfonsi, Kim; Colberg, Juan; Dunn, Peter J.; Fevig, Thomas; Jennings, Sandra; Johnson, Timothy A.; Kleine, H. Peter; Knight, Craig et al. (2008). \"Green chemistry tools to influence a medicinal chemistry and research chemistry based organisation\" (in en). Green Chem. 10 (1): 31\u201336. doi:10.1039\/B711717E. ISSN 1463-9262. http:\/\/xlink.rsc.org\/?DOI=B711717E .   \n \n\n\nNotes \nThis presentation is faithful to the original, with only a few minor changes to presentation. Grammar was cleaned up for smoother reading. In some cases important information was missing from the references, and that information was added. This version adds a reference to the GHS.\n\n\n\n\n\nSource: <a rel=\"external_link\" class=\"external\" href=\"https:\/\/www.limswiki.org\/index.php\/Journal:AI4Green:_An_open-source_ELN_for_green_and_sustainable_chemistry\">https:\/\/www.limswiki.org\/index.php\/Journal:AI4Green:_An_open-source_ELN_for_green_and_sustainable_chemistry<\/a>\nCategories: LIMSwiki journal articles (added in 2023)LIMSwiki journal articles (all)LIMSwiki journal articles on laboratory informaticsNavigation menuPage actionsJournalDiscussionView sourceHistoryPage actionsJournalDiscussionMoreToolsIn other languagesPersonal toolsLog inNavigationMain pageEncyclopedic articlesRecent changesRandom pageHelp about MediaWikiSearch\u00a0 ToolsWhat links hereRelated changesSpecial pagesPermanent linkPage informationPopular publications\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\nPrint\/exportCreate a bookDownload as PDFDownload as PDFDownload as Plain textPrintable version This page was last edited on 5 June 2023, at 19:50.Content is available under a Creative Commons Attribution-ShareAlike 4.0 International License unless otherwise noted.This page has been accessed 103 times.Privacy policyAbout LIMSWikiDisclaimers\n\n\n\n","92f7ee03da2bf61f360ca5692fcf1da0_html":"<body class=\"mediawiki ltr sitedir-ltr mw-hide-empty-elt ns-206 ns-subject page-Journal_AI4Green_An_open-source_ELN_for_green_and_sustainable_chemistry rootpage-Journal_AI4Green_An_open-source_ELN_for_green_and_sustainable_chemistry skin-monobook action-view skin--responsive\"><div id=\"rdp-ebb-globalWrapper\"><div id=\"rdp-ebb-column-content\"><div id=\"rdp-ebb-content\" class=\"mw-body\" role=\"main\"><a id=\"rdp-ebb-top\"><\/a>\n<h1 id=\"rdp-ebb-firstHeading\" class=\"firstHeading\" lang=\"en\">Journal:AI4Green: An open-source ELN for green and sustainable chemistry<\/h1><div id=\"rdp-ebb-bodyContent\" class=\"mw-body-content\"><!-- start content --><div id=\"rdp-ebb-mw-content-text\" lang=\"en\" dir=\"ltr\" class=\"mw-content-ltr\"><div class=\"mw-parser-output\">\n\n\n<h2><span class=\"mw-headline\" id=\"Abstract\">Abstract<\/span><\/h2>\n<p>This paper presents the <a href=\"https:\/\/www.limswiki.org\/index.php\/Free_and_open-source_software\" title=\"Free and open-source software\" class=\"wiki-link\" data-key=\"688dbf2b7fb58c69c6ad476828ee2c6a\">free and open-source<\/a>, web-based <a href=\"https:\/\/www.limswiki.org\/index.php\/Electronic_laboratory_notebook\" title=\"Electronic laboratory notebook\" class=\"wiki-link\" data-key=\"a9fbbd5e0807980106763fab31f1e72f\">electronic laboratory notebook<\/a> (ELN) <a href=\"https:\/\/www.limswiki.org\/index.php\/AI4Green\" title=\"AI4Green\" class=\"wiki-link\" data-key=\"9ccbf092cd8068d15243cd15f0448100\">AI4Green<\/a>, which combines features such as data archiving, collaboration tools, and green and sustainability metrics for organic <a href=\"https:\/\/www.limswiki.org\/index.php\/Chemistry\" title=\"Chemistry\" class=\"wiki-link\" data-key=\"792a1b261a4ecc7803e3f7f1de2dbda1\">chemistry<\/a>. AI4Green offers the core functionality of an ELN, namely, the ability to store reactions securely and <a href=\"https:\/\/www.limswiki.org\/index.php\/Data_sharing\" title=\"Data sharing\" class=\"wiki-link\" data-key=\"a99d5fda27f755c693c65864d9286130\">share<\/a> them among different members of a research team. As users plan their reactions and record them in the ELN, green and sustainable chemistry is encouraged by automatically calculating green metrics and color-coding hazards, solvents, and reaction conditions. The interface links a database constructed from data extracted from PubChem, enabling the automatic collation of <a href=\"https:\/\/www.limswiki.org\/index.php\/Information\" title=\"Information\" class=\"wiki-link\" data-key=\"6300a14d9c2776dcca0999b5ed940e7d\">information<\/a> for reactions. The application\u2019s design facilitates the development of auxiliary sustainability applications, such as our Solvent Guide module. As more reaction data are captured, subsequent work will focus on providing \u201cintelligent\u201d sustainability suggestions to the user.\n<\/p><p><b>Keywords<\/b>: electronic laboratory notebook, ELN, green and sustainable chemistry, open-source, data sharing\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Introduction\">Introduction<\/span><\/h2>\n<p>For researchers to communicate their findings between their team and the wider scientific community, data must be <a href=\"https:\/\/www.limswiki.org\/index.php\/Data_sharing\" title=\"Data sharing\" class=\"wiki-link\" data-key=\"a99d5fda27f755c693c65864d9286130\">shared<\/a> and stored. Paper-based are traditionally used to record experiments, and little has changed over the last few decades, despite the ubiquity of digital technology. Over the past 20 years, <a href=\"https:\/\/www.limswiki.org\/index.php\/Electronic_laboratory_notebook\" title=\"Electronic laboratory notebook\" class=\"wiki-link\" data-key=\"a9fbbd5e0807980106763fab31f1e72f\">electronic laboratory notebooks<\/a> (ELNs) have become more prevalent as the benefits of digitization are realized.<sup id=\"rdp-ebb-cite_ref-1\" class=\"reference\"><a href=\"#cite_note-1\">[1]<\/a><\/sup> Despite this, there remains a significant barrier to the uptake of ELNs, especially in the academic community.<sup id=\"rdp-ebb-cite_ref-:0_2-0\" class=\"reference\"><a href=\"#cite_note-:0-2\">[2]<\/a><\/sup> In 2017, a survey at a <a href=\"https:\/\/www.limswiki.org\/index.php\/BioSistemika_LLC\" title=\"BioSistemika LLC\" class=\"wiki-link\" data-key=\"f8ebc7d99ca5a21be4a6ee3549cdddc0\">BioSistemika<\/a> webinar revealed that only 7% of respondents used an ELN in their daily laboratory routine.<sup id=\"rdp-ebb-cite_ref-:0_2-1\" class=\"reference\"><a href=\"#cite_note-:0-2\">[2]<\/a><\/sup> Another survey from the same study showed that the main barriers were the cost associated with implementing an ELN and the system\u2019s usability.\n<\/p><p>Recently, in a comprehensive comparison of commercial and <a href=\"https:\/\/www.limswiki.org\/index.php\/Free_and_open-source_software\" title=\"Free and open-source software\" class=\"wiki-link\" data-key=\"688dbf2b7fb58c69c6ad476828ee2c6a\">open-source<\/a> ELNs, it was discovered that the majority of the 96 currently active ELNs are commercial.<sup id=\"rdp-ebb-cite_ref-3\" class=\"reference\"><a href=\"#cite_note-3\">[3]<\/a><\/sup> It was also noted that open-source codebases have the advantage that users could more directly contribute to the development of new features and have more control over the underlying software. However, there is more onus on the institution to install, host, and maintain the infrastructure. <a href=\"https:\/\/www.limswiki.org\/index.php\/Chemotion_ELN\" title=\"Chemotion ELN\" class=\"wiki-link\" data-key=\"69d105f8f7c60427d4fe9a8f21a8019a\">Chemotion<\/a> is an open-source ELN designed for synthetic <a href=\"https:\/\/www.limswiki.org\/index.php\/Chemistry\" title=\"Chemistry\" class=\"wiki-link\" data-key=\"792a1b261a4ecc7803e3f7f1de2dbda1\">chemistry<\/a> with a growing user base and a strong focus on data sharing and integrity<sup id=\"rdp-ebb-cite_ref-4\" class=\"reference\"><a href=\"#cite_note-4\">[4]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-5\" class=\"reference\"><a href=\"#cite_note-5\">[5]<\/a><\/sup>, but not a particular emphasis on green and sustainable chemistry. Another open-source solution is <a href=\"https:\/\/www.limswiki.org\/index.php\/ELabFTW\" title=\"ELabFTW\" class=\"wiki-link\" data-key=\"155590ac366985a7ee3cf74ade1df84a\">eLabFTW<\/a>, an ELN suitable for storing data from various scientific disciplines.<sup id=\"rdp-ebb-cite_ref-6\" class=\"reference\"><a href=\"#cite_note-6\">[6]<\/a><\/sup>\n<\/p><p>Research <a href=\"https:\/\/www.limswiki.org\/index.php\/Information_management\" title=\"Information management\" class=\"wiki-link\" data-key=\"f8672d270c0750a858ed940158ca0a73\">data management<\/a> is fundamental to scientific research.<sup id=\"rdp-ebb-cite_ref-7\" class=\"reference\"><a href=\"#cite_note-7\">[7]<\/a><\/sup> Transitioning from paper-based laboratory notebooks to ELNs is crucial for adhering to data standards when reporting and publishing studies.<sup id=\"rdp-ebb-cite_ref-8\" class=\"reference\"><a href=\"#cite_note-8\">[8]<\/a><\/sup> ELNs are also vital in making data <a href=\"https:\/\/www.limswiki.org\/index.php\/Journal:The_FAIR_Guiding_Principles_for_scientific_data_management_and_stewardship\" title=\"Journal:The FAIR Guiding Principles for scientific data management and stewardship\" class=\"wiki-link\" data-key=\"e5903ddcc7734415af1d91fcd258da90\">FAIR<\/a> (findable, accessible, interoperable, and reusable).<sup id=\"rdp-ebb-cite_ref-9\" class=\"reference\"><a href=\"#cite_note-9\">[9]<\/a><\/sup> ELNs allow data sharing among colleagues and institutions, while also facilitating public access.<sup id=\"rdp-ebb-cite_ref-10\" class=\"reference\"><a href=\"#cite_note-10\">[10]<\/a><\/sup> Open science<sup id=\"rdp-ebb-cite_ref-11\" class=\"reference\"><a href=\"#cite_note-11\">[11]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-12\" class=\"reference\"><a href=\"#cite_note-12\">[12]<\/a><\/sup> can also be enabled using ELNs, where data is curated using a standard data format, expediting data searches and preparation for <a href=\"https:\/\/www.limswiki.org\/index.php\/Machine_learning\" title=\"Machine learning\" class=\"wiki-link\" data-key=\"79aab39cfa124c958cd1dbcab3dde122\">machine learning<\/a> (ML), where large data sets are often required to train insightful models. Recent examples of such databases include the Open Reaction Database<sup id=\"rdp-ebb-cite_ref-13\" class=\"reference\"><a href=\"#cite_note-13\">[13]<\/a><\/sup> and the Chemotion Repository.<sup id=\"rdp-ebb-cite_ref-14\" class=\"reference\"><a href=\"#cite_note-14\">[14]<\/a><\/sup>\n<\/p><p>Sustainability and reducing waste are vital considerations in <a href=\"https:\/\/www.limswiki.org\/index.php\/Laboratory\" title=\"Laboratory\" class=\"wiki-link\" data-key=\"c57fc5aac9e4abf31dccae81df664c33\">laboratory<\/a>-based projects. \"Sustainable\" refers to both the environmental and socio-economic impacts of a process.<sup id=\"rdp-ebb-cite_ref-15\" class=\"reference\"><a href=\"#cite_note-15\">[15]<\/a><\/sup> Making processes more sustainable is not just a requirement of government regulations. There are also the benefits of cost reductions, improved worker health and safety, and the reduction of impact on the environment.<sup id=\"rdp-ebb-cite_ref-16\" class=\"reference\"><a href=\"#cite_note-16\">[16]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-17\" class=\"reference\"><a href=\"#cite_note-17\">[17]<\/a><\/sup> Current software tools for green and sustainable chemistry have recently been reviewed.<sup id=\"rdp-ebb-cite_ref-18\" class=\"reference\"><a href=\"#cite_note-18\">[18]<\/a><\/sup> ELNs also offer the opportunity for collecting data that can be used to monitor sustainability targets (such as the reduction of hazardous solvents) and share knowledge among colleagues.<sup id=\"rdp-ebb-cite_ref-19\" class=\"reference\"><a href=\"#cite_note-19\">[19]<\/a><\/sup>\n<\/p><p>In this work, we present <a href=\"https:\/\/www.limswiki.org\/index.php\/AI4Green\" title=\"AI4Green\" class=\"wiki-link\" data-key=\"9ccbf092cd8068d15243cd15f0448100\">AI4Green<\/a>, designed to fulfill the core functionality of an ELN for synthetic organic chemistry in academic and industry settings, while also encouraging green and sustainable chemistry. The software automatically presents the hazards and sustainability of an inputted reaction by calculating sustainability metrics and a color-coded assessment of solvents and reaction conditions. While the web application is open-source, the software is provided in a manner that has a low barrier to installation and hosting, has a user-friendly interface, and is easily customizable. As the number of users grows, the captured reaction data will be subsequently leveraged using ML to provide \u201cintelligent\u201d suggestions to users on improving their reactions\u2019 sustainability.\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Implementation\">Implementation<\/span><\/h2>\n<p>AI4Green is a web application written in <a href=\"https:\/\/www.limswiki.org\/index.php\/Python_(programming_language)\" title=\"Python (programming language)\" class=\"wiki-link\" data-key=\"ef6905a29cbb75d3c71e6bdf6e2915dd\">Python<\/a>, JavaScript, HTML, and CSS (Figure 1). The application is hosted on the <a href=\"https:\/\/www.limswiki.org\/index.php\/Cloud_computing\" title=\"Cloud computing\" class=\"wiki-link\" data-key=\"fcfe5882eaa018d920cedb88398b604f\">cloud<\/a> and available for general use at <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/ai4green.app\" target=\"_blank\">https:\/\/ai4green.app<\/a>. Alternatively, visit <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/github.com\/AI4Green\/AI4Green\" target=\"_blank\">the GitHub page<\/a> for simple instructions detailing installation and hosting via Docker either locally or on an organization\u2019s local server.\n<\/p><p><br \/>\n<a href=\"https:\/\/www.limswiki.org\/index.php\/File:Fig1_Boobier_JofChemInfoModel2023_63-10.gif\" class=\"image wiki-link\" data-key=\"a103baff7073de965984caf28cef1c44\"><img alt=\"Fig1 Boobier JofChemInfoModel2023 63-10.gif\" src=\"https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/c\/c6\/Fig1_Boobier_JofChemInfoModel2023_63-10.gif\" decoding=\"async\" style=\"width: 100%;max-width: 400px;height: auto;\" \/><\/a>\n<\/p>\n<div style=\"clear:both;\"><\/div>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table border=\"0\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><blockquote><p><b>Figure 1.<\/b> Web application architecture showing programming languages, databases, and how users interact with the application.<\/p><\/blockquote>\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<p>The backend server is built with Python and Flask and is linked to a <a href=\"https:\/\/www.limswiki.org\/index.php\/PostgreSQL\" title=\"PostgreSQL\" class=\"wiki-link\" data-key=\"a5dd945cdcb63e2d8f7a5edb3a896d82\">Postgres<\/a> relational database. The advantage of using Python for the backend is the access to many popular standard chemistry libraries, such as RDKit<sup id=\"rdp-ebb-cite_ref-20\" class=\"reference\"><a href=\"#cite_note-20\">[20]<\/a><\/sup>, and a low barrier for developers to add additional features. Flask is a well-documented and easy-to-use web application framework<sup id=\"rdp-ebb-cite_ref-21\" class=\"reference\"><a href=\"#cite_note-21\">[21]<\/a><\/sup>, and blueprints provide a clear structure to the code and facilitate expansion. Flask separates the Python backend from the JavaScript, HTML, and CSS-controlled frontend, where users input their data via Marvin JS<sup id=\"rdp-ebb-cite_ref-:1_22-0\" class=\"reference\"><a href=\"#cite_note-:1-22\">[22]<\/a><\/sup> chemical editor or in a number of formats, including Simplified Molecular-Input Line-Entry System (SMILES).<sup id=\"rdp-ebb-cite_ref-:2_23-0\" class=\"reference\"><a href=\"#cite_note-:2-23\">[23]<\/a><\/sup> JavaScript AJAX requests are used to update pages dynamically, e.g., automatically calculating green and sustainable metrics when inputting user data. A summary and sustainability report are presented back to the user which can be exported as a PDF or CSV file. A single database was implemented in Postgres, constructed from compound data extracted from PubChem<sup id=\"rdp-ebb-cite_ref-24\" class=\"reference\"><a href=\"#cite_note-24\">[24]<\/a><\/sup> and CHEM21 sustainability data<sup id=\"rdp-ebb-cite_ref-:3_25-0\" class=\"reference\"><a href=\"#cite_note-:3-25\">[25]<\/a><\/sup>, to provide chemical information automatically, and separated into tables for users, workgroups, workbooks, solvents, hazards, compounds (<a href=\"https:\/\/www.limswiki.org\/index.php\/Reagent\" title=\"Reagent\" class=\"wiki-link\" data-key=\"39ef926218accd8f01f4c68c5a82f9dc\">reagents<\/a>), and reactions.\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Results\">Results<\/span><\/h2>\n<h3><span id=\"rdp-ebb-Workgroups,_workbooks,_and_user_types\"><\/span><span class=\"mw-headline\" id=\"Workgroups.2C_workbooks.2C_and_user_types\">Workgroups, workbooks, and user types<\/span><\/h3>\n<p>AI4Green installations may have one or more admin users. These users, typically system administrators for an institution, review requests to make new workgroups and can monitor the number of users, compounds, and reactions on the server. Users must register for an account to use AI4Green, at which point those in the <a href=\"https:\/\/www.limswiki.org\/index.php\/Principal_investigator\" title=\"Principal investigator\" class=\"wiki-link\" data-key=\"fc46a2d8fd6731c64dab335a424a06dc\">principal investigator<\/a> (PI) or equivalent roles, are prompted to make a workgroup as a space for their research group; other users are directed to join the workgroup their PI has created. \n<\/p><p>Within workgroups, there are workbooks that are designed to contain reactions for a specific project (Figure 2). Workgroups have three roles with different permission levels. PIs are the workgroup owner and have full permission to create workbooks and add or remove users from the workgroup and any workbooks within it. It is permissible to have two or more PIs in a workgroup. The senior researcher role, suitable for postdoctoral researchers or equivalent, can create new workbooks and add or remove users to these workbooks. They have no such rights for workgroups. The standard member role, suitable for postgraduate researchers or equivalent, have no editing rights but can request to be added to workbooks. \n<\/p><p>Using this flexible approach, a user can belong to multiple workgroups in different roles, e.g., a PI in one workgroup and a senior researcher in another. Reactions are only shared within the same workbook, as are any novel compounds added to the database. A user owns the reactions they create, which are also available as read-only entries to all members of the workbook, thus enabling data sharing between team members. This is especially useful when teams are spread over multiple locations while preserving <a href=\"https:\/\/www.limswiki.org\/index.php\/Information_privacy\" title=\"Information privacy\" class=\"wiki-link\" data-key=\"185f6d9f874e48914b5789317408f782\">data privacy<\/a>.\n<\/p><p><br \/>\n<a href=\"https:\/\/www.limswiki.org\/index.php\/File:Fig2_Boobier_JofChemInfoModel2023_63-10.png\" class=\"image wiki-link\" data-key=\"3c4a8da2f4109ca3b8c763940eaad6c7\"><img alt=\"Fig2 Boobier JofChemInfoModel2023 63-10.png\" src=\"https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/a\/ab\/Fig2_Boobier_JofChemInfoModel2023_63-10.png\" decoding=\"async\" style=\"width: 100%;max-width: 400px;height: auto;\" \/><\/a>\n<\/p>\n<div style=\"clear:both;\"><\/div>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table border=\"0\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><blockquote><p><b>Figure 2.<\/b> Web application architecture showing programming languages, databases, and how users interact with the application.<\/p><\/blockquote>\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<h3><span class=\"mw-headline\" id=\"Reaction_Builder\">Reaction Builder<\/span><\/h3>\n<p>The core functionality of AI4Green is the Reaction Builder module. In later sections, we give further details on the different components of the Reaction Builder. Reactions can be created by navigating to a workgroup, choosing a workbook, and selecting \u201cNew Reaction.\u201d The user is prompted to enter a name for the reaction, which must be unique within the workbook. In addition, a unique code is also assigned to every new reaction. Users draw their reaction into the Marvin JS reaction sketcher. Next, the user is prompted to fill in the Reaction Table, for example, inputting the amount of each reaction component. At this stage, further solvents and reagents can be added. Finally, the Summary Table, which contains several automatically calculated green and sustainable metrics and detailed health and safety information, is generated. The reaction is automatically saved when new changes are made and can be reloaded and edited at a later date. The Summary Table can be exported to PFG or printed for use as a <a href=\"https:\/\/www.limswiki.org\/index.php\/Risk_assessment\" title=\"Risk assessment\" class=\"wiki-link\" data-key=\"e06196a3e3b70b62af61a54e93579f37\">risk assessment<\/a>.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Marvin_JS\">Marvin JS<\/span><\/h3>\n<p>Users must first input their reaction with the Marvin JS reaction sketcher (Figure 3). This sketcher is easy-to-use and well-documented.<sup id=\"rdp-ebb-cite_ref-:1_22-1\" class=\"reference\"><a href=\"#cite_note-:1-22\">[22]<\/a><\/sup> For users familiar with other sketchers, it is possible to import structures in several formats, e.g., SMILES<sup id=\"rdp-ebb-cite_ref-:2_23-1\" class=\"reference\"><a href=\"#cite_note-:2-23\">[23]<\/a><\/sup>, which are easily exported from other sketchers. Reagents or solvents above or below the arrow are not currently accepted. However, these can be added directly to the Reaction Table. When the reaction is submitted, the Reaction SMILES (RXSMILES) is exported from the sketcher to the Reaction Table. The database, containing information from PubChem, is queried for the reactants and products in the RXSMILES to obtain density, molecular weight, and hazard codes automatically. All compound data have been collected from PubChem laboratory chemical safety sheets (LCSS). The hazard data are presented as Globally Harmonized System of Classification and Labelling of Chemicals (GHS) hazard codes.<sup id=\"rdp-ebb-cite_ref-UNECEAbout_26-0\" class=\"reference\"><a href=\"#cite_note-UNECEAbout-26\">[26]<\/a><\/sup> The hazard data are only collected from the references provided by the European Chemicals Agency (ECHA).<sup id=\"rdp-ebb-cite_ref-27\" class=\"reference\"><a href=\"#cite_note-27\">[27]<\/a><\/sup>\n<\/p><p><br \/>\n<a href=\"https:\/\/www.limswiki.org\/index.php\/File:Fig3_Boobier_JofChemInfoModel2023_63-10.png\" class=\"image wiki-link\" data-key=\"b24861e4ac78392c1f0403f2df426723\"><img alt=\"Fig3 Boobier JofChemInfoModel2023 63-10.png\" src=\"https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/3\/30\/Fig3_Boobier_JofChemInfoModel2023_63-10.png\" decoding=\"async\" style=\"width: 100%;max-width: 400px;height: auto;\" \/><\/a>\n<\/p>\n<div style=\"clear:both;\"><\/div>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table border=\"0\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><blockquote><p><b>Figure 3.<\/b> Users draw their reaction using the Marvin JS reaction sketcher. Reactions can also be imported in a variety of formats, including SMILES.<\/p><\/blockquote>\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<h3><span class=\"mw-headline\" id=\"Reaction_Table\">Reaction Table<\/span><\/h3>\n<p>The user is prompted to populate the Reaction Table (Figure 4) and provide extra information if any reactant or product is not in the database. This \u201cnovel compound\u201d is saved to the database and can be reused, but only within the same workbook. Reagents can be added from the PubChem compound database by searching name or Chemical Abstracts Service (CAS) identifier; they can also be added to the database like a novel compound. Solvents can also be added from a predefined list and by searching name or CAS. \u201cNovel solvents\u201d can be added in the same way as \u201cnovel compounds\u201d. Solvents are color-coded according to the four-tier CHEM21 classification\u2014recommended, problematic, hazardous, and highly hazardous<sup id=\"rdp-ebb-cite_ref-:3_25-1\" class=\"reference\"><a href=\"#cite_note-:3-25\">[25]<\/a><\/sup>\u2014providing immediate feedback to the user on the sustainability of their solvent choice. Users will then input the details of their reaction into the Reaction Table. Physical forms of all reactants, reagents, solvents, and products must be provided to assess the reaction\u2019s risk. Additionally, limiting reagent mass and the equivalence of all other reactants and reagents are required to proceed. Any suspected incorrect data from the database can be reported to system administrators for review at any point in the procedure. There is also space to describe the experimental procedure and any observations made during the reaction.\n<\/p><p><br \/>\n<a href=\"https:\/\/www.limswiki.org\/index.php\/File:Fig4_Boobier_JofChemInfoModel2023_63-10.png\" class=\"image wiki-link\" data-key=\"048da9cd99a975af6749eb0c9f6d1c03\"><img alt=\"Fig4 Boobier JofChemInfoModel2023 63-10.png\" src=\"https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/0\/07\/Fig4_Boobier_JofChemInfoModel2023_63-10.png\" decoding=\"async\" style=\"width: 100%;max-width: 400px;height: auto;\" \/><\/a>\n<\/p>\n<div style=\"clear:both;\"><\/div>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table border=\"0\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><blockquote><p><b>Figure 4.<\/b> A partially complete Reaction Table. Users are directed to provide information about the reaction (highlighted in red). Reagents, solvents, and novel compounds can be added or removed. Some information such as molecular weight and hazard codes are automatically populated from the PubChem database.<\/p><\/blockquote>\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<h3><span class=\"mw-headline\" id=\"Summary_Table\">Summary Table<\/span><\/h3>\n<p>With the Reaction Table complete, users are directed to the Summary Table (Figure 5). Information is automatically passed from the Reaction Table to the Summary Table. Visual assessments of the greenness and sustainability of the reaction are displayed to the users. These are either flagged as unsustainable (red) or given a traffic light system (i.e., red = not recommended\/hazardous; yellow = problematic; and green = recommended). The specific colors and shades for these ratings can be altered on the accessibility page. An overall hazard rating is generated from the hazard codes, denoted as Low (L), Medium (M), Hazardous (H), or Very Hazardous (VH). The threshold of the sustainability levels of the following metrics was in accordance with the CHEM21 project.<sup id=\"rdp-ebb-cite_ref-28\" class=\"reference\"><a href=\"#cite_note-28\">[28]<\/a><\/sup> Several of these metrics are calculated automatically, like the sustainability of the chemical elements used in the reaction and the atom efficiency. Other metrics must be inputted by the user, such as the temperature of the reaction, batch or flow reaction conditions, the isolation method, the use of a catalyst, and whether that catalyst was recovered. A risk assessment section follows, which allows users to identify standard protocols, disposal of waste materials, spillage procedures, and any other risks associated with the reaction. An overall risk score can then be computed by self-assessment of the reaction\u2019s hazards, risks, and consequences. Typically, a reaction would be performed at this point. After the reaction run, the user can return to the Summary Table and input unreacted and actual product mass. Using these inputs, four more metrics are computed: mass efficiency, yield, conversion, and selectivity. The reaction can be marked as complete and locked to further editing at this stage. For increased data integrity, reactions modifications are time-stamped in the database. Reactions may currently be searched alphabetically or by most recently created.\n<\/p><p><br \/>\n<a href=\"https:\/\/www.limswiki.org\/index.php\/File:Fig5_Boobier_JofChemInfoModel2023_63-10.png\" class=\"image wiki-link\" data-key=\"951060e7f55e19458637c63b35b591d3\"><img alt=\"Fig5 Boobier JofChemInfoModel2023 63-10.png\" src=\"https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/8\/8e\/Fig5_Boobier_JofChemInfoModel2023_63-10.png\" decoding=\"async\" style=\"width: 100%;max-width: 400px;height: auto;\" \/><\/a>\n<\/p>\n<div style=\"clear:both;\"><\/div>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table border=\"0\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><blockquote><p><b>Figure 5.<\/b> Part of the Summary Table showing information about the hazards of the reactions and various green and sustainability metrics and considerations.<\/p><\/blockquote>\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<h3><span class=\"mw-headline\" id=\"Exporting_data\">Exporting data<\/span><\/h3>\n<p>A reaction can be exported as a PDF, as some institutions may require reaction information and risk assessments to be displayed or filed. It is critical that data can be safely exported from an ELN for the longevity of that data, to move the data to a new system, and for more detailed analysis. The reactions from a workbook can be exported as a single PDF file, multiple PDF files, or a CSV file. The versatility of CSV files, which are machine-readable and can be opened in programs such as Microsoft Excel, makes this file format the preferred option for data offloading.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Sustainability_add-ons\">Sustainability add-ons<\/span><\/h3>\n<p>AI4Green is open-source, and adding new sustainable auxiliary applications is simple. The Python Flask backend, built around blueprints, gives new developers a low barrier. An example of an add-on is the Solvent Guide module (Figure 6), which is a series of solvent flashcards. This can be accessed directly from the top navigation banner or as a user intervention while building a reaction. As previously discussed, the CHEM21 sustainability rating is displayed to the user when a solvent is selected. At this point, the user can open the solvent guide with this preloaded solvent flashcard. A second solvent can be selected for a side-by-side comparison. These solvent flashcards were created using data from the CHEM21 project, where the overall sustainability of the solvent is shown using the four-tier system. This is accompanied by a breakdown of the solvent\u2019s health, safety, and environment scores, with each category given a score out of 10 and a corresponding hazard color. The full methodology for calculating these scores is described in the CHEM21 publication.<sup id=\"rdp-ebb-cite_ref-:3_25-2\" class=\"reference\"><a href=\"#cite_note-:3-25\">[25]<\/a><\/sup> The CAS number, linked to the PubChem entry for the solvent, is displayed to allow the user to access more information about the solvent. The family of the solvent, boiling point, flash point, and worst hazards are also displayed to guide the user further. For some solvents, a possible substitution is suggested based on an industrial solvent replacement guide and the reason for this substitution.<sup id=\"rdp-ebb-cite_ref-29\" class=\"reference\"><a href=\"#cite_note-29\">[29]<\/a><\/sup> The solvent guide aims to bring the most relevant information to the user on a single page, allowing the solvents to be easily compared side-by-side. This can empower the user to choose a more sustainable and suitable solvent for their reaction at the planning stage. Future add-on applications could include a solvent map for solvent substitution, solvent or reaction conditions prediction for a specific reaction, life cycle analysis of reactions, and retrosynthesis for a target product.\n<\/p><p><br \/>\n<a href=\"https:\/\/www.limswiki.org\/index.php\/File:Fig6_Boobier_JofChemInfoModel2023_63-10.png\" class=\"image wiki-link\" data-key=\"99d993496d419894c0bd93dd82a84600\"><img alt=\"Fig6 Boobier JofChemInfoModel2023 63-10.png\" src=\"https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/a\/ae\/Fig6_Boobier_JofChemInfoModel2023_63-10.png\" decoding=\"async\" style=\"width: 100%;max-width: 400px;height: auto;\" \/><\/a>\n<\/p>\n<div style=\"clear:both;\"><\/div>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table border=\"0\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><blockquote><p><b>Figure 6.<\/b> The Solvent Guide module, where users can explore different solvent options for their reaction.<\/p><\/blockquote>\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<h3><span class=\"mw-headline\" id=\"User_feedback_and_application_development\">User feedback and application development<\/span><\/h3>\n<p>AI4Green has a growing userbase and is currently used by several academic groups, primarily at the University of Nottingham. As the application has evolved, users have been able to give direct input into new features either by contacting the team directly or by attending our regular user group meetings. Early feedback identified that the ELN must be easy-to-use, convenient for the laboratory chemist, and allow data to be easily shared throughout the group. Specific examples of features added because of user feedback include an automatic unique numbering system for reactions on their creation since users identified that, in a busy lab schedule, several reactions may be worked on concurrently; an autosave feature to ensure data were not accidentally lost if the browser tab is closed without saving; and adding reagents and solvents by CAS number, since this is a common identifier for laboratory chemists.\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Conclusion\">Conclusion<\/span><\/h2>\n<p>In this work we present an open-source web application, AI4Green, which combines the practical benefits of an ELN alongside a framework for encouraging green and sustainable chemistry. Despite the manifold benefits, many academic groups are yet to adopt usage of an ELN. AI4Green provides an accessible platform for chemists to store and share their research and receive feedback on the sustainability of their reactions. Research teams can be easily organized into workgroups and workbooks, with different levels of permission for different user types. The Reaction Builder provides a semi-automated route to generating sustainability, hazard reports, and risk assessments. The Solvent Guide is an example of an add-on application to encourage sustainable solvent selection. \n<\/p><p>There are, however, still many features to implement in AI4Green. Data sharing between different workgroups or to the public is not yet possible. We also aim to use inputted reaction data to make intelligent sustainability suggestions. This may be to suggest using a less hazardous solvent or reagent, predict milder suitable reaction conditions, or simulate life cycle analysis for process scale-up. There will be challenges in preserving data privacy for users, who will be able to decide whether to share data fully, partially, or not at all. Additional features to be implemented include searching reactions by component name or a substructure, a mechanism for PIs to approve reactions, and a sustainability dashboard to allow groups to set sustainability goals and track their progress toward them. \n<\/p><p>AI4Green provides an exciting initial framework to unite an ELN with sustainable chemistry. It has a growing user base and rapidly evolving functionality.\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Supporting_information\">Supporting information<\/span><\/h2>\n<ul><li><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/pubs.acs.org\/doi\/suppl\/10.1021\/acs.jcim.3c00306\/suppl_file\/ci3c00306_si_001.pdf\" target=\"_blank\">Further detail on the database schema<\/a> (PDF)<\/li><\/ul>\n<h2><span id=\"rdp-ebb-Abbreviations,_acronyms,_and_initialisms\"><\/span><span class=\"mw-headline\" id=\"Abbreviations.2C_acronyms.2C_and_initialisms\">Abbreviations, acronyms, and initialisms<\/span><\/h2>\n<ul><li><b>CAS<\/b>: Chemical Abstracts Service<\/li>\n<li><b>ECHA<\/b>: European Chemicals Agency<\/li>\n<li><b>ELN<\/b>: electronic laboratory notebook<\/li>\n<li><b>GHS<\/b>: Globally Harmonized System of Classification and Labelling of Chemicals<\/li>\n<li><b>LCSS<\/b>: laboratory chemical safety sheets<\/li>\n<li><b>PI<\/b>: principal investigator<\/li>\n<li><b>RXSMILE<\/b>: Reaction SMILES<\/li>\n<li><b>SMILES<\/b>: Simplified Molecular-Input Line-Entry System<\/li><\/ul>\n<h2><span class=\"mw-headline\" id=\"Acknowledgements\">Acknowledgements<\/span><\/h2>\n<p>We thank all the users of AI4Green for their valuable feedback and Aimie Garces, James Dowden, Jamie Twycross, and Zakariyyaa Siddiq for many useful discussions.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Author_contributions\">Author contributions<\/span><\/h3>\n<p>The manuscript was written through contributions of all authors. All authors have given approval to the final version of the manuscript. S.B., J.C.D., C.M.H., and I.N.D. contributed to the development of the software. J.D.H. conceived and supervised the project.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Funding\">Funding<\/span><\/h3>\n<p>This work and J.D.H. are supported by the Royal Academy of Engineering under the Chairs in Emerging Technologies scheme [CiET2021_17]. The work was also supported in part by the Engineering and Physical Sciences Research Council (EPSRC) [grant number EP\/S035990\/1].\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Data_availability\">Data availability<\/span><\/h3>\n<p>AI4Green is open-source and released under the AGPL-3.0 license. Full source code, installation instructions, and links to our video tutorials and user guides can be found at <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/github.com\/AI4Green\/AI4Green\" target=\"_blank\">GitHub<\/a>.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Conflict_of_interest\">Conflict of interest<\/span><\/h3>\n<p>The authors declare no competing financial interest.\n<\/p>\n<h2><span class=\"mw-headline\" id=\"References\">References<\/span><\/h2>\n<div class=\"reflist references-column-width\" style=\"-moz-column-width: 30em; -webkit-column-width: 30em; column-width: 30em; list-style-type: decimal;\">\n<div class=\"mw-references-wrap mw-references-columns\"><ol class=\"references\">\n<li id=\"cite_note-1\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-1\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Bird, Colin L.; Willoughby, Cerys; Frey, Jeremy G. (2013). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/xlink.rsc.org\/?DOI=c3cs60122f\" target=\"_blank\">\"Laboratory notebooks in the digital era: the role of ELNs in record keeping for chemistry and other sciences\"<\/a> (in en). <i>Chemical Society Reviews<\/i> <b>42<\/b> (20): 8157. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1039%2Fc3cs60122f\" target=\"_blank\">10.1039\/c3cs60122f<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0306-0012\" target=\"_blank\">0306-0012<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/xlink.rsc.org\/?DOI=c3cs60122f\" target=\"_blank\">http:\/\/xlink.rsc.org\/?DOI=c3cs60122f<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Laboratory+notebooks+in+the+digital+era%3A+the+role+of+ELNs+in+record+keeping+for+chemistry+and+other+sciences&rft.jtitle=Chemical+Society+Reviews&rft.aulast=Bird&rft.aufirst=Colin+L.&rft.au=Bird%2C%26%2332%3BColin+L.&rft.au=Willoughby%2C%26%2332%3BCerys&rft.au=Frey%2C%26%2332%3BJeremy+G.&rft.date=2013&rft.volume=42&rft.issue=20&rft.pages=8157&rft_id=info:doi\/10.1039%2Fc3cs60122f&rft.issn=0306-0012&rft_id=http%3A%2F%2Fxlink.rsc.org%2F%3FDOI%3Dc3cs60122f&rfr_id=info:sid\/en.wikipedia.org:Journal:AI4Green:_An_open-source_ELN_for_green_and_sustainable_chemistry\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:0-2\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:0_2-0\">2.0<\/a><\/sup> <sup><a href=\"#cite_ref-:0_2-1\">2.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Kanza, Samantha; Willoughby, Cerys; Gibbins, Nicholas; Whitby, Richard; Frey, Jeremy Graham; Erjavec, Jana; Zupan\u010di\u010d, Klemen; Hren, Matja\u017e <i>et al.<\/i> (1 December 2017). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/jcheminf.biomedcentral.com\/articles\/10.1186\/s13321-017-0221-3\" target=\"_blank\">\"Electronic lab notebooks: can they replace paper?\"<\/a> (in en). <i>Journal of Cheminformatics<\/i> <b>9<\/b> (1): 31. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1186%2Fs13321-017-0221-3\" target=\"_blank\">10.1186\/s13321-017-0221-3<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1758-2946\" target=\"_blank\">1758-2946<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC5443717\/\" target=\"_blank\">PMC5443717<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/29086051\" target=\"_blank\">29086051<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/jcheminf.biomedcentral.com\/articles\/10.1186\/s13321-017-0221-3\" target=\"_blank\">https:\/\/jcheminf.biomedcentral.com\/articles\/10.1186\/s13321-017-0221-3<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Electronic+lab+notebooks%3A+can+they+replace+paper%3F&rft.jtitle=Journal+of+Cheminformatics&rft.aulast=Kanza&rft.aufirst=Samantha&rft.au=Kanza%2C%26%2332%3BSamantha&rft.au=Willoughby%2C%26%2332%3BCerys&rft.au=Gibbins%2C%26%2332%3BNicholas&rft.au=Whitby%2C%26%2332%3BRichard&rft.au=Frey%2C%26%2332%3BJeremy+Graham&rft.au=Erjavec%2C%26%2332%3BJana&rft.au=Zupan%C4%8Di%C4%8D%2C%26%2332%3BKlemen&rft.au=Hren%2C%26%2332%3BMatja%C5%BE&rft.au=Kova%C4%8D%2C%26%2332%3BKatarina&rft.date=1+December+2017&rft.volume=9&rft.issue=1&rft.pages=31&rft_id=info:doi\/10.1186%2Fs13321-017-0221-3&rft.issn=1758-2946&rft_id=info:pmc\/PMC5443717&rft_id=info:pmid\/29086051&rft_id=https%3A%2F%2Fjcheminf.biomedcentral.com%2Farticles%2F10.1186%2Fs13321-017-0221-3&rfr_id=info:sid\/en.wikipedia.org:Journal:AI4Green:_An_open-source_ELN_for_green_and_sustainable_chemistry\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-3\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-3\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Higgins, Stuart G.; Nogiwa-Valdez, Akemi A.; Stevens, Molly M. (1 February 2022). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.nature.com\/articles\/s41596-021-00645-8\" target=\"_blank\">\"Considerations for implementing electronic laboratory notebooks in an academic research environment\"<\/a> (in en). <i>Nature Protocols<\/i> <b>17<\/b> (2): 179\u2013189. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1038%2Fs41596-021-00645-8\" target=\"_blank\">10.1038\/s41596-021-00645-8<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1754-2189\" target=\"_blank\">1754-2189<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.nature.com\/articles\/s41596-021-00645-8\" target=\"_blank\">https:\/\/www.nature.com\/articles\/s41596-021-00645-8<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Considerations+for+implementing+electronic+laboratory+notebooks+in+an+academic+research+environment&rft.jtitle=Nature+Protocols&rft.aulast=Higgins&rft.aufirst=Stuart+G.&rft.au=Higgins%2C%26%2332%3BStuart+G.&rft.au=Nogiwa-Valdez%2C%26%2332%3BAkemi+A.&rft.au=Stevens%2C%26%2332%3BMolly+M.&rft.date=1+February+2022&rft.volume=17&rft.issue=2&rft.pages=179%E2%80%93189&rft_id=info:doi\/10.1038%2Fs41596-021-00645-8&rft.issn=1754-2189&rft_id=https%3A%2F%2Fwww.nature.com%2Farticles%2Fs41596-021-00645-8&rfr_id=info:sid\/en.wikipedia.org:Journal:AI4Green:_An_open-source_ELN_for_green_and_sustainable_chemistry\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-4\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-4\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Tremouilhac, Pierre; Nguyen, An; Huang, Yu-Chieh; Kotov, Serhii; L\u00fctjohann, Dominic Sebastian; H\u00fcbsch, Florian; Jung, Nicole; Br\u00e4se, Stefan (1 December 2017). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/jcheminf.biomedcentral.com\/articles\/10.1186\/s13321-017-0240-0\" target=\"_blank\">\"Chemotion ELN: an Open Source electronic lab notebook for chemists in academia\"<\/a> (in en). <i>Journal of Cheminformatics<\/i> <b>9<\/b> (1): 54. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1186%2Fs13321-017-0240-0\" target=\"_blank\">10.1186\/s13321-017-0240-0<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1758-2946\" target=\"_blank\">1758-2946<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC5612905\/\" target=\"_blank\">PMC5612905<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/29086216\" target=\"_blank\">29086216<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/jcheminf.biomedcentral.com\/articles\/10.1186\/s13321-017-0240-0\" target=\"_blank\">https:\/\/jcheminf.biomedcentral.com\/articles\/10.1186\/s13321-017-0240-0<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Chemotion+ELN%3A+an+Open+Source+electronic+lab+notebook+for+chemists+in+academia&rft.jtitle=Journal+of+Cheminformatics&rft.aulast=Tremouilhac&rft.aufirst=Pierre&rft.au=Tremouilhac%2C%26%2332%3BPierre&rft.au=Nguyen%2C%26%2332%3BAn&rft.au=Huang%2C%26%2332%3BYu-Chieh&rft.au=Kotov%2C%26%2332%3BSerhii&rft.au=L%C3%BCtjohann%2C%26%2332%3BDominic+Sebastian&rft.au=H%C3%BCbsch%2C%26%2332%3BFlorian&rft.au=Jung%2C%26%2332%3BNicole&rft.au=Br%C3%A4se%2C%26%2332%3BStefan&rft.date=1+December+2017&rft.volume=9&rft.issue=1&rft.pages=54&rft_id=info:doi\/10.1186%2Fs13321-017-0240-0&rft.issn=1758-2946&rft_id=info:pmc\/PMC5612905&rft_id=info:pmid\/29086216&rft_id=https%3A%2F%2Fjcheminf.biomedcentral.com%2Farticles%2F10.1186%2Fs13321-017-0240-0&rfr_id=info:sid\/en.wikipedia.org:Journal:AI4Green:_An_open-source_ELN_for_green_and_sustainable_chemistry\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-5\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-5\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Kotov, Serhii; Tremouilhac, Pierre; Jung, Nicole; Br\u00e4se, Stefan (1 December 2018). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/jcheminf.biomedcentral.com\/articles\/10.1186\/s13321-018-0292-9\" target=\"_blank\">\"Chemotion-ELN part 2: adaption of an embedded Ketcher editor to advanced research applications\"<\/a> (in en). <i>Journal of Cheminformatics<\/i> <b>10<\/b> (1): 38. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1186%2Fs13321-018-0292-9\" target=\"_blank\">10.1186\/s13321-018-0292-9<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1758-2946\" target=\"_blank\">1758-2946<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC6089857\/\" target=\"_blank\">PMC6089857<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/30105533\" target=\"_blank\">30105533<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/jcheminf.biomedcentral.com\/articles\/10.1186\/s13321-018-0292-9\" target=\"_blank\">https:\/\/jcheminf.biomedcentral.com\/articles\/10.1186\/s13321-018-0292-9<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Chemotion-ELN+part+2%3A+adaption+of+an+embedded+Ketcher+editor+to+advanced+research+applications&rft.jtitle=Journal+of+Cheminformatics&rft.aulast=Kotov&rft.aufirst=Serhii&rft.au=Kotov%2C%26%2332%3BSerhii&rft.au=Tremouilhac%2C%26%2332%3BPierre&rft.au=Jung%2C%26%2332%3BNicole&rft.au=Br%C3%A4se%2C%26%2332%3BStefan&rft.date=1+December+2018&rft.volume=10&rft.issue=1&rft.pages=38&rft_id=info:doi\/10.1186%2Fs13321-018-0292-9&rft.issn=1758-2946&rft_id=info:pmc\/PMC6089857&rft_id=info:pmid\/30105533&rft_id=https%3A%2F%2Fjcheminf.biomedcentral.com%2Farticles%2F10.1186%2Fs13321-018-0292-9&rfr_id=info:sid\/en.wikipedia.org:Journal:AI4Green:_An_open-source_ELN_for_green_and_sustainable_chemistry\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-6\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-6\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">CARPi, Nicolas; Minges, Alexander; Piel, Matthieu (14 April 2017). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/joss.theoj.org\/papers\/10.21105\/joss.00146\" target=\"_blank\">\"eLabFTW: An open source laboratory notebook for research labs\"<\/a>. <i>The Journal of Open Source Software<\/i> <b>2<\/b> (12): 146. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.21105%2Fjoss.00146\" target=\"_blank\">10.21105\/joss.00146<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2475-9066\" target=\"_blank\">2475-9066<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/joss.theoj.org\/papers\/10.21105\/joss.00146\" target=\"_blank\">http:\/\/joss.theoj.org\/papers\/10.21105\/joss.00146<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=eLabFTW%3A+An+open+source+laboratory+notebook+for+research+labs&rft.jtitle=The+Journal+of+Open+Source+Software&rft.aulast=CARPi&rft.aufirst=Nicolas&rft.au=CARPi%2C%26%2332%3BNicolas&rft.au=Minges%2C%26%2332%3BAlexander&rft.au=Piel%2C%26%2332%3BMatthieu&rft.date=14+April+2017&rft.volume=2&rft.issue=12&rft.pages=146&rft_id=info:doi\/10.21105%2Fjoss.00146&rft.issn=2475-9066&rft_id=http%3A%2F%2Fjoss.theoj.org%2Fpapers%2F10.21105%2Fjoss.00146&rfr_id=info:sid\/en.wikipedia.org:Journal:AI4Green:_An_open-source_ELN_for_green_and_sustainable_chemistry\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-7\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-7\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Kanza, Samantha; Knight, Nicola J. (1 December 2022). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/bmcresnotes.biomedcentral.com\/articles\/10.1186\/s13104-022-05908-5\" target=\"_blank\">\"Behind every great research project is great data management\"<\/a> (in en). <i>BMC Research Notes<\/i> <b>15<\/b> (1): 20. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1186%2Fs13104-022-05908-5\" target=\"_blank\">10.1186\/s13104-022-05908-5<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1756-0500\" target=\"_blank\">1756-0500<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC8781028\/\" target=\"_blank\">PMC8781028<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/35063017\" target=\"_blank\">35063017<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/bmcresnotes.biomedcentral.com\/articles\/10.1186\/s13104-022-05908-5\" target=\"_blank\">https:\/\/bmcresnotes.biomedcentral.com\/articles\/10.1186\/s13104-022-05908-5<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Behind+every+great+research+project+is+great+data+management&rft.jtitle=BMC+Research+Notes&rft.aulast=Kanza&rft.aufirst=Samantha&rft.au=Kanza%2C%26%2332%3BSamantha&rft.au=Knight%2C%26%2332%3BNicola+J.&rft.date=1+December+2022&rft.volume=15&rft.issue=1&rft.pages=20&rft_id=info:doi\/10.1186%2Fs13104-022-05908-5&rft.issn=1756-0500&rft_id=info:pmc\/PMC8781028&rft_id=info:pmid\/35063017&rft_id=https%3A%2F%2Fbmcresnotes.biomedcentral.com%2Farticles%2F10.1186%2Fs13104-022-05908-5&rfr_id=info:sid\/en.wikipedia.org:Journal:AI4Green:_An_open-source_ELN_for_green_and_sustainable_chemistry\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-8\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-8\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Herres\u2010Pawlis, Sonja; Bach, Felix; Bruno, Ian J.; Chalk, Stuart J.; Jung, Nicole; Liermann, Johannes C.; McEwen, Leah R.; Neumann, Steffen <i>et al.<\/i> (19 December 2022). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/anie.202203038\" target=\"_blank\">\"Minimum Information Standards in Chemistry: A Call for Better Research Data Management Practices\"<\/a> (in en). <i>Angewandte Chemie International Edition<\/i> <b>61<\/b> (51). <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1002%2Fanie.202203038\" target=\"_blank\">10.1002\/anie.202203038<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1433-7851\" target=\"_blank\">1433-7851<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/anie.202203038\" target=\"_blank\">https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/anie.202203038<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Minimum+Information+Standards+in+Chemistry%3A+A+Call+for+Better+Research+Data+Management+Practices&rft.jtitle=Angewandte+Chemie+International+Edition&rft.aulast=Herres%E2%80%90Pawlis&rft.aufirst=Sonja&rft.au=Herres%E2%80%90Pawlis%2C%26%2332%3BSonja&rft.au=Bach%2C%26%2332%3BFelix&rft.au=Bruno%2C%26%2332%3BIan+J.&rft.au=Chalk%2C%26%2332%3BStuart+J.&rft.au=Jung%2C%26%2332%3BNicole&rft.au=Liermann%2C%26%2332%3BJohannes+C.&rft.au=McEwen%2C%26%2332%3BLeah+R.&rft.au=Neumann%2C%26%2332%3BSteffen&rft.au=Steinbeck%2C%26%2332%3BChristoph&rft.date=19+December+2022&rft.volume=61&rft.issue=51&rft_id=info:doi\/10.1002%2Fanie.202203038&rft.issn=1433-7851&rft_id=https%3A%2F%2Fonlinelibrary.wiley.com%2Fdoi%2F10.1002%2Fanie.202203038&rfr_id=info:sid\/en.wikipedia.org:Journal:AI4Green:_An_open-source_ELN_for_green_and_sustainable_chemistry\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-9\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-9\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Wilkinson, Mark D.; Dumontier, Michel; Aalbersberg, IJsbrand Jan; Appleton, Gabrielle; Axton, Myles; Baak, Arie; Blomberg, Niklas; Boiten, Jan-Willem <i>et al.<\/i> (15 March 2016). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.nature.com\/articles\/sdata201618\" target=\"_blank\">\"The FAIR Guiding Principles for scientific data management and stewardship\"<\/a> (in en). <i>Scientific Data<\/i> <b>3<\/b> (1): 160018. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1038%2Fsdata.2016.18\" target=\"_blank\">10.1038\/sdata.2016.18<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2052-4463\" target=\"_blank\">2052-4463<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC4792175\/\" target=\"_blank\">PMC4792175<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/26978244\" target=\"_blank\">26978244<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.nature.com\/articles\/sdata201618\" target=\"_blank\">https:\/\/www.nature.com\/articles\/sdata201618<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=The+FAIR+Guiding+Principles+for+scientific+data+management+and+stewardship&rft.jtitle=Scientific+Data&rft.aulast=Wilkinson&rft.aufirst=Mark+D.&rft.au=Wilkinson%2C%26%2332%3BMark+D.&rft.au=Dumontier%2C%26%2332%3BMichel&rft.au=Aalbersberg%2C%26%2332%3BIJsbrand+Jan&rft.au=Appleton%2C%26%2332%3BGabrielle&rft.au=Axton%2C%26%2332%3BMyles&rft.au=Baak%2C%26%2332%3BArie&rft.au=Blomberg%2C%26%2332%3BNiklas&rft.au=Boiten%2C%26%2332%3BJan-Willem&rft.au=da+Silva+Santos%2C%26%2332%3BLuiz+Bonino&rft.date=15+March+2016&rft.volume=3&rft.issue=1&rft.pages=160018&rft_id=info:doi\/10.1038%2Fsdata.2016.18&rft.issn=2052-4463&rft_id=info:pmc\/PMC4792175&rft_id=info:pmid\/26978244&rft_id=https%3A%2F%2Fwww.nature.com%2Farticles%2Fsdata201618&rfr_id=info:sid\/en.wikipedia.org:Journal:AI4Green:_An_open-source_ELN_for_green_and_sustainable_chemistry\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-10\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-10\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Fink, Fabian; H\u00fcppe, Henrika M.; Jung, Nicole; Hoffmann, Alexander; Herres\u2010Pawlis, Sonja (1 October 2022). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/cmtd.202200026\" target=\"_blank\">\"Sharing is Caring: Guidelines for Sharing in the Electronic Laboratory Notebook (ELN) Chemotion as applied by a Synthesis\u2010oriented Working Group**\"<\/a> (in en). <i>Chemistry\u2013Methods<\/i> <b>2<\/b> (10). <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1002%2Fcmtd.202200026\" target=\"_blank\">10.1002\/cmtd.202200026<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2628-9725\" target=\"_blank\">2628-9725<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/cmtd.202200026\" target=\"_blank\">https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/cmtd.202200026<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Sharing+is+Caring%3A+Guidelines+for+Sharing+in+the+Electronic+Laboratory+Notebook+%28ELN%29+Chemotion+as+applied+by+a+Synthesis%E2%80%90oriented+Working+Group%2A%2A&rft.jtitle=Chemistry%E2%80%93Methods&rft.aulast=Fink&rft.aufirst=Fabian&rft.au=Fink%2C%26%2332%3BFabian&rft.au=H%C3%BCppe%2C%26%2332%3BHenrika+M.&rft.au=Jung%2C%26%2332%3BNicole&rft.au=Hoffmann%2C%26%2332%3BAlexander&rft.au=Herres%E2%80%90Pawlis%2C%26%2332%3BSonja&rft.date=1+October+2022&rft.volume=2&rft.issue=10&rft_id=info:doi\/10.1002%2Fcmtd.202200026&rft.issn=2628-9725&rft_id=https%3A%2F%2Fonlinelibrary.wiley.com%2Fdoi%2F10.1002%2Fcmtd.202200026&rfr_id=info:sid\/en.wikipedia.org:Journal:AI4Green:_An_open-source_ELN_for_green_and_sustainable_chemistry\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-11\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-11\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Jablonka, Kevin Maik; Patiny, Luc; Smit, Berend (1 April 2022). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.nature.com\/articles\/s41557-022-00910-7\" target=\"_blank\">\"Making the collective knowledge of chemistry open and machine actionable\"<\/a> (in en). <i>Nature Chemistry<\/i> <b>14<\/b> (4): 365\u2013376. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1038%2Fs41557-022-00910-7\" target=\"_blank\">10.1038\/s41557-022-00910-7<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1755-4330\" target=\"_blank\">1755-4330<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.nature.com\/articles\/s41557-022-00910-7\" target=\"_blank\">https:\/\/www.nature.com\/articles\/s41557-022-00910-7<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Making+the+collective+knowledge+of+chemistry+open+and+machine+actionable&rft.jtitle=Nature+Chemistry&rft.aulast=Jablonka&rft.aufirst=Kevin+Maik&rft.au=Jablonka%2C%26%2332%3BKevin+Maik&rft.au=Patiny%2C%26%2332%3BLuc&rft.au=Smit%2C%26%2332%3BBerend&rft.date=1+April+2022&rft.volume=14&rft.issue=4&rft.pages=365%E2%80%93376&rft_id=info:doi\/10.1038%2Fs41557-022-00910-7&rft.issn=1755-4330&rft_id=https%3A%2F%2Fwww.nature.com%2Farticles%2Fs41557-022-00910-7&rfr_id=info:sid\/en.wikipedia.org:Journal:AI4Green:_An_open-source_ELN_for_green_and_sustainable_chemistry\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-12\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-12\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Baldi, Pierre (9 May 2022). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/pubs.acs.org\/doi\/10.1021\/acs.jcim.1c01140\" target=\"_blank\">\"Call for a Public Open Database of All Chemical Reactions\"<\/a> (in en). <i>Journal of Chemical Information and Modeling<\/i> <b>62<\/b> (9): 2011\u20132014. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1021%2Facs.jcim.1c01140\" target=\"_blank\">10.1021\/acs.jcim.1c01140<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1549-9596\" target=\"_blank\">1549-9596<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/pubs.acs.org\/doi\/10.1021\/acs.jcim.1c01140\" target=\"_blank\">https:\/\/pubs.acs.org\/doi\/10.1021\/acs.jcim.1c01140<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Call+for+a+Public+Open+Database+of+All+Chemical+Reactions&rft.jtitle=Journal+of+Chemical+Information+and+Modeling&rft.aulast=Baldi&rft.aufirst=Pierre&rft.au=Baldi%2C%26%2332%3BPierre&rft.date=9+May+2022&rft.volume=62&rft.issue=9&rft.pages=2011%E2%80%932014&rft_id=info:doi\/10.1021%2Facs.jcim.1c01140&rft.issn=1549-9596&rft_id=https%3A%2F%2Fpubs.acs.org%2Fdoi%2F10.1021%2Facs.jcim.1c01140&rfr_id=info:sid\/en.wikipedia.org:Journal:AI4Green:_An_open-source_ELN_for_green_and_sustainable_chemistry\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-13\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-13\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Kearnes, Steven M.; Maser, Michael R.; Wleklinski, Michael; Kast, Anton; Doyle, Abigail G.; Dreher, Spencer D.; Hawkins, Joel M.; Jensen, Klavs F. <i>et al.<\/i> (17 November 2021). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/pubs.acs.org\/doi\/10.1021\/jacs.1c09820\" target=\"_blank\">\"The Open Reaction Database\"<\/a> (in en). <i>Journal of the American Chemical Society<\/i> <b>143<\/b> (45): 18820\u201318826. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1021%2Fjacs.1c09820\" target=\"_blank\">10.1021\/jacs.1c09820<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0002-7863\" target=\"_blank\">0002-7863<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/pubs.acs.org\/doi\/10.1021\/jacs.1c09820\" target=\"_blank\">https:\/\/pubs.acs.org\/doi\/10.1021\/jacs.1c09820<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=The+Open+Reaction+Database&rft.jtitle=Journal+of+the+American+Chemical+Society&rft.aulast=Kearnes&rft.aufirst=Steven+M.&rft.au=Kearnes%2C%26%2332%3BSteven+M.&rft.au=Maser%2C%26%2332%3BMichael+R.&rft.au=Wleklinski%2C%26%2332%3BMichael&rft.au=Kast%2C%26%2332%3BAnton&rft.au=Doyle%2C%26%2332%3BAbigail+G.&rft.au=Dreher%2C%26%2332%3BSpencer+D.&rft.au=Hawkins%2C%26%2332%3BJoel+M.&rft.au=Jensen%2C%26%2332%3BKlavs+F.&rft.au=Coley%2C%26%2332%3BConnor+W.&rft.date=17+November+2021&rft.volume=143&rft.issue=45&rft.pages=18820%E2%80%9318826&rft_id=info:doi\/10.1021%2Fjacs.1c09820&rft.issn=0002-7863&rft_id=https%3A%2F%2Fpubs.acs.org%2Fdoi%2F10.1021%2Fjacs.1c09820&rfr_id=info:sid\/en.wikipedia.org:Journal:AI4Green:_An_open-source_ELN_for_green_and_sustainable_chemistry\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-14\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-14\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Tremouilhac, Pierre; Huang, Pei\u2010Chi; Lin, Chia\u2010Lin; Huang, Yu\u2010Chieh; Nguyen, An; Jung, Nicole; Bach, Felix; Br\u00e4se, Stefan (1 January 2021). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/cmtd.202000034\" target=\"_blank\">\"Chemotion Repository, a Curated Repository for Reaction Information and Analytical Data\"<\/a> (in en). <i>Chemistry\u2013Methods<\/i> <b>1<\/b> (1): 8\u201311. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1002%2Fcmtd.202000034\" target=\"_blank\">10.1002\/cmtd.202000034<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2628-9725\" target=\"_blank\">2628-9725<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/cmtd.202000034\" target=\"_blank\">https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/cmtd.202000034<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Chemotion+Repository%2C+a+Curated+Repository+for+Reaction+Information+and+Analytical+Data&rft.jtitle=Chemistry%E2%80%93Methods&rft.aulast=Tremouilhac&rft.aufirst=Pierre&rft.au=Tremouilhac%2C%26%2332%3BPierre&rft.au=Huang%2C%26%2332%3BPei%E2%80%90Chi&rft.au=Lin%2C%26%2332%3BChia%E2%80%90Lin&rft.au=Huang%2C%26%2332%3BYu%E2%80%90Chieh&rft.au=Nguyen%2C%26%2332%3BAn&rft.au=Jung%2C%26%2332%3BNicole&rft.au=Bach%2C%26%2332%3BFelix&rft.au=Br%C3%A4se%2C%26%2332%3BStefan&rft.date=1+January+2021&rft.volume=1&rft.issue=1&rft.pages=8%E2%80%9311&rft_id=info:doi\/10.1002%2Fcmtd.202000034&rft.issn=2628-9725&rft_id=https%3A%2F%2Fonlinelibrary.wiley.com%2Fdoi%2F10.1002%2Fcmtd.202000034&rfr_id=info:sid\/en.wikipedia.org:Journal:AI4Green:_An_open-source_ELN_for_green_and_sustainable_chemistry\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-15\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-15\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Horv\u00e1th, Istv\u00e1n T. (24 January 2018). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/pubs.acs.org\/doi\/10.1021\/acs.chemrev.7b00721\" target=\"_blank\">\"Introduction: Sustainable Chemistry\"<\/a> (in en). <i>Chemical Reviews<\/i> <b>118<\/b> (2): 369\u2013371. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1021%2Facs.chemrev.7b00721\" target=\"_blank\">10.1021\/acs.chemrev.7b00721<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0009-2665\" target=\"_blank\">0009-2665<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/pubs.acs.org\/doi\/10.1021\/acs.chemrev.7b00721\" target=\"_blank\">https:\/\/pubs.acs.org\/doi\/10.1021\/acs.chemrev.7b00721<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Introduction%3A+Sustainable+Chemistry&rft.jtitle=Chemical+Reviews&rft.aulast=Horv%C3%A1th&rft.aufirst=Istv%C3%A1n+T.&rft.au=Horv%C3%A1th%2C%26%2332%3BIstv%C3%A1n+T.&rft.date=24+January+2018&rft.volume=118&rft.issue=2&rft.pages=369%E2%80%93371&rft_id=info:doi\/10.1021%2Facs.chemrev.7b00721&rft.issn=0009-2665&rft_id=https%3A%2F%2Fpubs.acs.org%2Fdoi%2F10.1021%2Facs.chemrev.7b00721&rfr_id=info:sid\/en.wikipedia.org:Journal:AI4Green:_An_open-source_ELN_for_green_and_sustainable_chemistry\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-16\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-16\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Schulte, Paul A; McKernan, Lauralynn T; Heidel, Donna S; Okun, Andrea H; Dotson, Gary Scott; Lentz, Thomas J; Geraci, Charles L; Heckel, Pamela E <i>et al.<\/i> (1 December 2013). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/ehjournal.biomedcentral.com\/articles\/10.1186\/1476-069X-12-31\" target=\"_blank\">\"Occupational safety and health, green chemistry, and sustainability: a review of areas of convergence\"<\/a> (in en). <i>Environmental Health<\/i> <b>12<\/b> (1): 31. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1186%2F1476-069X-12-31\" target=\"_blank\">10.1186\/1476-069X-12-31<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1476-069X\" target=\"_blank\">1476-069X<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC3639149\/\" target=\"_blank\">PMC3639149<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/23587312\" target=\"_blank\">23587312<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/ehjournal.biomedcentral.com\/articles\/10.1186\/1476-069X-12-31\" target=\"_blank\">http:\/\/ehjournal.biomedcentral.com\/articles\/10.1186\/1476-069X-12-31<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Occupational+safety+and+health%2C+green+chemistry%2C+and+sustainability%3A+a+review+of+areas+of+convergence&rft.jtitle=Environmental+Health&rft.aulast=Schulte&rft.aufirst=Paul+A&rft.au=Schulte%2C%26%2332%3BPaul+A&rft.au=McKernan%2C%26%2332%3BLauralynn+T&rft.au=Heidel%2C%26%2332%3BDonna+S&rft.au=Okun%2C%26%2332%3BAndrea+H&rft.au=Dotson%2C%26%2332%3BGary+Scott&rft.au=Lentz%2C%26%2332%3BThomas+J&rft.au=Geraci%2C%26%2332%3BCharles+L&rft.au=Heckel%2C%26%2332%3BPamela+E&rft.au=Branche%2C%26%2332%3BChristine+M&rft.date=1+December+2013&rft.volume=12&rft.issue=1&rft.pages=31&rft_id=info:doi\/10.1186%2F1476-069X-12-31&rft.issn=1476-069X&rft_id=info:pmc\/PMC3639149&rft_id=info:pmid\/23587312&rft_id=http%3A%2F%2Fehjournal.biomedcentral.com%2Farticles%2F10.1186%2F1476-069X-12-31&rfr_id=info:sid\/en.wikipedia.org:Journal:AI4Green:_An_open-source_ELN_for_green_and_sustainable_chemistry\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-17\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-17\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Anastas, Paul T.; Zimmerman, Julie B. (1 October 2018). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S245222361830021X\" target=\"_blank\">\"The United Nations sustainability goals: How can sustainable chemistry contribute?\"<\/a> (in en). <i>Current Opinion in Green and Sustainable Chemistry<\/i> <b>13<\/b>: 150\u2013153. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.cogsc.2018.04.017\" target=\"_blank\">10.1016\/j.cogsc.2018.04.017<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S245222361830021X\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S245222361830021X<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=The+United+Nations+sustainability+goals%3A+How+can+sustainable+chemistry+contribute%3F&rft.jtitle=Current+Opinion+in+Green+and+Sustainable+Chemistry&rft.aulast=Anastas&rft.aufirst=Paul+T.&rft.au=Anastas%2C%26%2332%3BPaul+T.&rft.au=Zimmerman%2C%26%2332%3BJulie+B.&rft.date=1+October+2018&rft.volume=13&rft.pages=150%E2%80%93153&rft_id=info:doi\/10.1016%2Fj.cogsc.2018.04.017&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS245222361830021X&rfr_id=info:sid\/en.wikipedia.org:Journal:AI4Green:_An_open-source_ELN_for_green_and_sustainable_chemistry\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-18\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-18\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Derbenev, Ivan N.; Dowden, James; Twycross, Jamie; Hirst, Jonathan D. (1 June 2022). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2452223622000359\" target=\"_blank\">\"Software tools for green and sustainable chemistry\"<\/a> (in en). <i>Current Opinion in Green and Sustainable Chemistry<\/i> <b>35<\/b>: 100623. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.cogsc.2022.100623\" target=\"_blank\">10.1016\/j.cogsc.2022.100623<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2452223622000359\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2452223622000359<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Software+tools+for+green+and+sustainable+chemistry&rft.jtitle=Current+Opinion+in+Green+and+Sustainable+Chemistry&rft.aulast=Derbenev&rft.aufirst=Ivan+N.&rft.au=Derbenev%2C%26%2332%3BIvan+N.&rft.au=Dowden%2C%26%2332%3BJames&rft.au=Twycross%2C%26%2332%3BJamie&rft.au=Hirst%2C%26%2332%3BJonathan+D.&rft.date=1+June+2022&rft.volume=35&rft.pages=100623&rft_id=info:doi\/10.1016%2Fj.cogsc.2022.100623&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS2452223622000359&rfr_id=info:sid\/en.wikipedia.org:Journal:AI4Green:_An_open-source_ELN_for_green_and_sustainable_chemistry\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-19\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-19\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Fantke, Peter; Cinquemani, Claudio; Yaseneva, Polina; De Mello, Jonathas; Schwabe, Henning; Ebeling, Bjoern; Lapkin, Alexei A. (1 November 2021). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2451929421004745\" target=\"_blank\">\"Transition to sustainable chemistry through digitalization\"<\/a> (in en). <i>Chem<\/i> <b>7<\/b> (11): 2866\u20132882. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.chempr.2021.09.012\" target=\"_blank\">10.1016\/j.chempr.2021.09.012<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2451929421004745\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2451929421004745<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Transition+to+sustainable+chemistry+through+digitalization&rft.jtitle=Chem&rft.aulast=Fantke&rft.aufirst=Peter&rft.au=Fantke%2C%26%2332%3BPeter&rft.au=Cinquemani%2C%26%2332%3BClaudio&rft.au=Yaseneva%2C%26%2332%3BPolina&rft.au=De+Mello%2C%26%2332%3BJonathas&rft.au=Schwabe%2C%26%2332%3BHenning&rft.au=Ebeling%2C%26%2332%3BBjoern&rft.au=Lapkin%2C%26%2332%3BAlexei+A.&rft.date=1+November+2021&rft.volume=7&rft.issue=11&rft.pages=2866%E2%80%932882&rft_id=info:doi\/10.1016%2Fj.chempr.2021.09.012&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS2451929421004745&rfr_id=info:sid\/en.wikipedia.org:Journal:AI4Green:_An_open-source_ELN_for_green_and_sustainable_chemistry\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-20\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-20\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.rdkit.org\/\" target=\"_blank\">\"RDKit: Open-Source Cheminformatics Software\"<\/a>. T5 Informatics GmbH<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.rdkit.org\/\" target=\"_blank\">https:\/\/www.rdkit.org\/<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 27 January 2023<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=RDKit%3A+Open-Source+Cheminformatics+Software&rft.atitle=&rft.pub=T5+Informatics+GmbH&rft_id=https%3A%2F%2Fwww.rdkit.org%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:AI4Green:_An_open-source_ELN_for_green_and_sustainable_chemistry\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-21\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-21\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/flask.palletsprojects.com\/en\/2.3.x\/\" target=\"_blank\">\"Flask\"<\/a>. Pallets<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/flask.palletsprojects.com\/en\/2.3.x\/\" target=\"_blank\">https:\/\/flask.palletsprojects.com\/en\/2.3.x\/<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 27 January 2023<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Flask&rft.atitle=&rft.pub=Pallets&rft_id=https%3A%2F%2Fflask.palletsprojects.com%2Fen%2F2.3.x%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:AI4Green:_An_open-source_ELN_for_green_and_sustainable_chemistry\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:1-22\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:1_22-0\">22.0<\/a><\/sup> <sup><a href=\"#cite_ref-:1_22-1\">22.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/docs.chemaxon.com\/display\/docs\/marvin-js-user-s-guide.md\" target=\"_blank\">\"Marvin JS User's Guide\"<\/a>. Chemaxon<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/docs.chemaxon.com\/display\/docs\/marvin-js-user-s-guide.md\" target=\"_blank\">https:\/\/docs.chemaxon.com\/display\/docs\/marvin-js-user-s-guide.md<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 27 January 2023<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Marvin+JS+User%27s+Guide&rft.atitle=&rft.pub=Chemaxon&rft_id=https%3A%2F%2Fdocs.chemaxon.com%2Fdisplay%2Fdocs%2Fmarvin-js-user-s-guide.md&rfr_id=info:sid\/en.wikipedia.org:Journal:AI4Green:_An_open-source_ELN_for_green_and_sustainable_chemistry\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:2-23\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:2_23-0\">23.0<\/a><\/sup> <sup><a href=\"#cite_ref-:2_23-1\">23.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Weininger, David (1 February 1988). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/pubs.acs.org\/doi\/abs\/10.1021\/ci00057a005\" target=\"_blank\">\"SMILES, a chemical language and information system. 1. Introduction to methodology and encoding rules\"<\/a> (in en). <i>Journal of Chemical Information and Computer Sciences<\/i> <b>28<\/b> (1): 31\u201336. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1021%2Fci00057a005\" target=\"_blank\">10.1021\/ci00057a005<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0095-2338\" target=\"_blank\">0095-2338<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/pubs.acs.org\/doi\/abs\/10.1021\/ci00057a005\" target=\"_blank\">https:\/\/pubs.acs.org\/doi\/abs\/10.1021\/ci00057a005<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=SMILES%2C+a+chemical+language+and+information+system.+1.+Introduction+to+methodology+and+encoding+rules&rft.jtitle=Journal+of+Chemical+Information+and+Computer+Sciences&rft.aulast=Weininger&rft.aufirst=David&rft.au=Weininger%2C%26%2332%3BDavid&rft.date=1+February+1988&rft.volume=28&rft.issue=1&rft.pages=31%E2%80%9336&rft_id=info:doi\/10.1021%2Fci00057a005&rft.issn=0095-2338&rft_id=https%3A%2F%2Fpubs.acs.org%2Fdoi%2Fabs%2F10.1021%2Fci00057a005&rfr_id=info:sid\/en.wikipedia.org:Journal:AI4Green:_An_open-source_ELN_for_green_and_sustainable_chemistry\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-24\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-24\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/pubchem.ncbi.nlm.nih.gov\/\" target=\"_blank\">\"PubChem\"<\/a>. National Library of Medicine<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/pubchem.ncbi.nlm.nih.gov\/\" target=\"_blank\">https:\/\/pubchem.ncbi.nlm.nih.gov\/<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 27 January 2023<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=PubChem&rft.atitle=&rft.pub=National+Library+of+Medicine&rft_id=https%3A%2F%2Fpubchem.ncbi.nlm.nih.gov%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:AI4Green:_An_open-source_ELN_for_green_and_sustainable_chemistry\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:3-25\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:3_25-0\">25.0<\/a><\/sup> <sup><a href=\"#cite_ref-:3_25-1\">25.1<\/a><\/sup> <sup><a href=\"#cite_ref-:3_25-2\">25.2<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Prat, Denis; Wells, Andy; Hayler, John; Sneddon, Helen; McElroy, C. Robert; Abou-Shehada, Sarah; Dunn, Peter J. (2016). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/xlink.rsc.org\/?DOI=C5GC01008J\" target=\"_blank\">\"CHEM21 selection guide of classical- and less classical-solvents\"<\/a> (in en). <i>Green Chemistry<\/i> <b>18<\/b> (1): 288\u2013296. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1039%2FC5GC01008J\" target=\"_blank\">10.1039\/C5GC01008J<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1463-9262\" target=\"_blank\">1463-9262<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/xlink.rsc.org\/?DOI=C5GC01008J\" target=\"_blank\">http:\/\/xlink.rsc.org\/?DOI=C5GC01008J<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=CHEM21+selection+guide+of+classical-+and+less+classical-solvents&rft.jtitle=Green+Chemistry&rft.aulast=Prat&rft.aufirst=Denis&rft.au=Prat%2C%26%2332%3BDenis&rft.au=Wells%2C%26%2332%3BAndy&rft.au=Hayler%2C%26%2332%3BJohn&rft.au=Sneddon%2C%26%2332%3BHelen&rft.au=McElroy%2C%26%2332%3BC.+Robert&rft.au=Abou-Shehada%2C%26%2332%3BSarah&rft.au=Dunn%2C%26%2332%3BPeter+J.&rft.date=2016&rft.volume=18&rft.issue=1&rft.pages=288%E2%80%93296&rft_id=info:doi\/10.1039%2FC5GC01008J&rft.issn=1463-9262&rft_id=http%3A%2F%2Fxlink.rsc.org%2F%3FDOI%3DC5GC01008J&rfr_id=info:sid\/en.wikipedia.org:Journal:AI4Green:_An_open-source_ELN_for_green_and_sustainable_chemistry\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-UNECEAbout-26\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-UNECEAbout_26-0\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/unece.org\/about-ghs\" target=\"_blank\">\"About the GHS\"<\/a>. United Nations Economic Commission for Europe. 2021<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/unece.org\/about-ghs\" target=\"_blank\">https:\/\/unece.org\/about-ghs<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=About+the+GHS&rft.atitle=&rft.date=2021&rft.pub=United+Nations+Economic+Commission+for+Europe&rft_id=https%3A%2F%2Funece.org%2Fabout-ghs&rfr_id=info:sid\/en.wikipedia.org:Journal:AI4Green:_An_open-source_ELN_for_green_and_sustainable_chemistry\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-27\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-27\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/echa.europa.eu\/information-on-chemicals\" target=\"_blank\">\"Information on Chemicals\"<\/a>. European Chemicals Agency<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/echa.europa.eu\/information-on-chemicals\" target=\"_blank\">https:\/\/echa.europa.eu\/information-on-chemicals<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 27 January 2023<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Information+on+Chemicals&rft.atitle=&rft.pub=European+Chemicals+Agency&rft_id=https%3A%2F%2Fecha.europa.eu%2Finformation-on-chemicals&rfr_id=info:sid\/en.wikipedia.org:Journal:AI4Green:_An_open-source_ELN_for_green_and_sustainable_chemistry\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-28\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-28\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">McElroy, C. Robert; Constantinou, Andri; Jones, Leonie C.; Summerton, Louise; Clark, James H. (2015). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/xlink.rsc.org\/?DOI=C5GC00340G\" target=\"_blank\">\"Towards a holistic approach to metrics for the 21st century pharmaceutical industry\"<\/a> (in en). <i>Green Chemistry<\/i> <b>17<\/b> (5): 3111\u20133121. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1039%2FC5GC00340G\" target=\"_blank\">10.1039\/C5GC00340G<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1463-9262\" target=\"_blank\">1463-9262<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/xlink.rsc.org\/?DOI=C5GC00340G\" target=\"_blank\">http:\/\/xlink.rsc.org\/?DOI=C5GC00340G<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Towards+a+holistic+approach+to+metrics+for+the+21st+century+pharmaceutical+industry&rft.jtitle=Green+Chemistry&rft.aulast=McElroy&rft.aufirst=C.+Robert&rft.au=McElroy%2C%26%2332%3BC.+Robert&rft.au=Constantinou%2C%26%2332%3BAndri&rft.au=Jones%2C%26%2332%3BLeonie+C.&rft.au=Summerton%2C%26%2332%3BLouise&rft.au=Clark%2C%26%2332%3BJames+H.&rft.date=2015&rft.volume=17&rft.issue=5&rft.pages=3111%E2%80%933121&rft_id=info:doi\/10.1039%2FC5GC00340G&rft.issn=1463-9262&rft_id=http%3A%2F%2Fxlink.rsc.org%2F%3FDOI%3DC5GC00340G&rfr_id=info:sid\/en.wikipedia.org:Journal:AI4Green:_An_open-source_ELN_for_green_and_sustainable_chemistry\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-29\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-29\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Alfonsi, Kim; Colberg, Juan; Dunn, Peter J.; Fevig, Thomas; Jennings, Sandra; Johnson, Timothy A.; Kleine, H. Peter; Knight, Craig <i>et al.<\/i> (2008). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/xlink.rsc.org\/?DOI=B711717E\" target=\"_blank\">\"Green chemistry tools to influence a medicinal chemistry and research chemistry based organisation\"<\/a> (in en). <i>Green Chem.<\/i> <b>10<\/b> (1): 31\u201336. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1039%2FB711717E\" target=\"_blank\">10.1039\/B711717E<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1463-9262\" target=\"_blank\">1463-9262<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/xlink.rsc.org\/?DOI=B711717E\" target=\"_blank\">http:\/\/xlink.rsc.org\/?DOI=B711717E<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Green+chemistry+tools+to+influence+a+medicinal+chemistry+and+research+chemistry+based+organisation&rft.jtitle=Green+Chem.&rft.aulast=Alfonsi&rft.aufirst=Kim&rft.au=Alfonsi%2C%26%2332%3BKim&rft.au=Colberg%2C%26%2332%3BJuan&rft.au=Dunn%2C%26%2332%3BPeter+J.&rft.au=Fevig%2C%26%2332%3BThomas&rft.au=Jennings%2C%26%2332%3BSandra&rft.au=Johnson%2C%26%2332%3BTimothy+A.&rft.au=Kleine%2C%26%2332%3BH.+Peter&rft.au=Knight%2C%26%2332%3BCraig&rft.au=Nagy%2C%26%2332%3BMark+A.&rft.date=2008&rft.volume=10&rft.issue=1&rft.pages=31%E2%80%9336&rft_id=info:doi\/10.1039%2FB711717E&rft.issn=1463-9262&rft_id=http%3A%2F%2Fxlink.rsc.org%2F%3FDOI%3DB711717E&rfr_id=info:sid\/en.wikipedia.org:Journal:AI4Green:_An_open-source_ELN_for_green_and_sustainable_chemistry\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<\/ol><\/div><\/div>\n<h2><span class=\"mw-headline\" id=\"Notes\">Notes<\/span><\/h2>\n<p>This presentation is faithful to the original, with only a few minor changes to presentation. Grammar was cleaned up for smoother reading. In some cases important information was missing from the references, and that information was added. This version adds a reference to the GHS.\n<\/p>\n<!-- \nNewPP limit report\nCached time: 20230630152052\nCache expiry: 86400\nDynamic content: false\nComplications: []\nCPU time usage: 0.930 seconds\nReal time usage: 1.156 seconds\nPreprocessor visited node count: 29866\/1000000\nPost\u2010expand include size: 249101\/2097152 bytes\nTemplate argument size: 70370\/2097152 bytes\nHighest expansion depth: 25\/40\nExpensive parser function count: 0\/100\nUnstrip recursion depth: 0\/20\nUnstrip post\u2010expand size: 67493\/5000000 bytes\n-->\n<!--\nTransclusion expansion time report (%,ms,calls,template)\n100.00% 704.966 1 -total\n 83.61% 589.431 1 Template:Reflist\n 67.26% 474.182 29 Template:Citation\/core\n 64.85% 457.174 23 Template:Cite_journal\n 11.10% 78.223 24 Template:Date\n 9.59% 67.611 1 Template:Infobox_journal_article\n 8.90% 62.737 55 Template:Citation\/identifier\n 8.17% 57.621 1 Template:Infobox\n 7.81% 55.072 6 Template:Cite_web\n 4.18% 29.487 80 Template:Infobox\/row\n-->\n\n<!-- Saved in parser cache with key limswiki:pcache:idhash:14215-0!canonical and timestamp 20230630152051 and revision id 52217. Serialized with JSON.\n -->\n<\/div><\/div><div class=\"printfooter\">Source: <a rel=\"external_link\" class=\"external\" href=\"https:\/\/www.limswiki.org\/index.php\/Journal:AI4Green:_An_open-source_ELN_for_green_and_sustainable_chemistry\">https:\/\/www.limswiki.org\/index.php\/Journal:AI4Green:_An_open-source_ELN_for_green_and_sustainable_chemistry<\/a><\/div>\n<!-- end content --><div class=\"visualClear\"><\/div><\/div><\/div><div class=\"visualClear\"><\/div><\/div><!-- end of the left (by default at least) column --><div class=\"visualClear\"><\/div><\/div>\n\n\n\n<\/body>","92f7ee03da2bf61f360ca5692fcf1da0_images":["https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/c\/c6\/Fig1_Boobier_JofChemInfoModel2023_63-10.gif","https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/a\/ab\/Fig2_Boobier_JofChemInfoModel2023_63-10.png","https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/3\/30\/Fig3_Boobier_JofChemInfoModel2023_63-10.png","https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/0\/07\/Fig4_Boobier_JofChemInfoModel2023_63-10.png","https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/8\/8e\/Fig5_Boobier_JofChemInfoModel2023_63-10.png","https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/a\/ae\/Fig6_Boobier_JofChemInfoModel2023_63-10.png"],"92f7ee03da2bf61f360ca5692fcf1da0_timestamp":1688138451,"e100dcbf45911d7ebdcd67493dc727aa_type":"article","e100dcbf45911d7ebdcd67493dc727aa_title":"Identifying risk management challenges in laboratories (Tziakou et al. 2023)","e100dcbf45911d7ebdcd67493dc727aa_url":"https:\/\/www.limswiki.org\/index.php\/Journal:Identifying_risk_management_challenges_in_laboratories","e100dcbf45911d7ebdcd67493dc727aa_plaintext":"\n\nJournal:Identifying risk management challenges in laboratoriesFrom LIMSWikiJump to navigationJump to searchFull article title\n \nIdentifying risk management challenges in laboratoriesJournal\n \nAccreditation and Quality AssuranceAuthor(s)\n \nTziakou, Evdoxia; Fragkaki, Argyro G.; Platis, Agapios N.Author affiliation(s)\n \nHellenic Open University, National Centre for Scientific Research \u201cDemokritos\u201d, University of the AegeanPrimary contact\n \nfragkaki at bio dot demokritos dot grYear published\n \n2023Volume and issue\n \n28(3)DOI\n \n10.1007\/s00769-023-01540-3ISSN\n \n1432-0517Distribution license\n \nCreative Commons Attribution 4.0 InternationalWebsite\n \nhttps:\/\/link.springer.com\/article\/10.1007\/s00769-023-01540-3Download\n \nhttps:\/\/link.springer.com\/content\/pdf\/10.1007\/s00769-023-01540-3.pdf (PDF)\n\nContents \n\n1 Abstract \n2 Introduction \n3 The risk management process \n4 Risk assessment techniques \n5 Risk identification and treatment in laboratories \n\n5.1 Sample \n5.2 Personnel \n5.3 Reagents and waste \n5.4 Environmental conditions \n5.5 Test methods \n5.6 Measurement \n5.7 Quality control \n5.8 Results reporting \n5.9 Impartiality and confidentiality \n5.10 Digitalization \n5.11 Financial risk \n\n\n6 Conclusion \n7 Abbreviations, acronyms, and initialisms \n8 Acknowledgements \n\n8.1 Author contributions \n8.2 Funding \n8.3 Conflict of interest \n\n\n9 References \n10 Notes \n\n\n\nAbstract \nOver the years, risk management has gained significant importance in laboratories of every kind. The safety of workers, the accuracy and reliability of laboratory results, issues of financial sustainability, and protection of the environment play an important role in decision-making in both industry and service-based labs. In order for a laboratory to be considered reliable and safe, and therefore competitive, it is recommended to comply with the requirements of international standards and other regulatory documents, as well as use tools and risk management procedures. \nIn this paper, information is summarized concerning the terms \u201crisk\u201d and \u201crisk management,\u201d which are then approached through the latest International Organization for Standardization (ISO) standard ISO 9001, ISO\/IEC 17025, and ISO 14001 standards. The process of risk management based on the ISO 31000 standard is described, and the options for treatment and the techniques that can be applied in the risk management process based on the latest ISO 31010 standard are grouped and indicated. Additionally, a literature review examines the reasons that have led laboratories to integrate risk management techniques into their quality management systems, the most common mistakes that occur in the various phases of laboratory tests, their causes, and their consequences, as well as the proposed treatments. The aim of this work is to highlight significant challenges concerning the need to implement management procedures in the daily routine, while warning, raising awareness of, and informing about existing risk management methods that can be implemented, methodologically and technically, to laboratories, under internationally recognized and updated standards.\nKeywords: risk-based thinking, risk management, risk assessment techniques, laboratories, control measures\n\nIntroduction \nThe issue of risk management has existed for thousands of years.[1] The first noted practice of risk management is in the Tigris-Euphrates valley in 3200 BC by the A\u0161ipu, who are considered to be, among others, an early example of risk management consultants.[2][3] The A\u0161ipu carried out risk analysis for each alternative action related to the risky event to be studied, and after the completion of the analysis they proposed the most favorable alternative. The last step was to issue a final report engraved on a clay tablet that was given to the customer.[4]\nThe difference between modern risk analysts and the A\u0161ipu of ancient Babylon is that the former express their results as mathematical probabilities and intervals of confidence, while the latter with certainty, confidence, and power. However, to determine the causal relationship between cause and effect, both the ancient ancestors and current researchers rely on observational methods.[2] After World War II, large companies with diversified portfolios of physical assets began to develop self-insurance, which covered the financial consequences of an adverse event or accidental losses.[5][6] Modern risk management was implemented after 1955 and was first applied in the insurance industry.[7]\nThe English term \u201crisk\u201d comes from the Greek word \u201crhiza,\u201d which refers to the dangers of sailing around a cliff.[2] According to Kumamoto and Henley[8], the term \u201crisk\u201d is defined as a combination of five factors: probability, outcome, significance, causal scenario, and affected population. As far as a laboratory is concerned, \u201crisk\u201d is the probability of a laboratory error which may have adverse consequences[9], as it includes factors that threaten health and safety of staff, environment, organization's facilities, organization's financial sustainability, operational productivity, and service quality.[10] Therefore, for testing laboratories, as risk can be considered the inability to meet customer needs, the provision of incorrect analytical results and failure to meet accreditation requirements damage laboratory's reputation.[11]\nPlebani[12] defines risk management as the process by which risk is assessed and strategies are developed to manage it. The goal of any risk management process is to identify, evaluate, address, and reduce the risk to an acceptable level.[13] According to Dikmen et al.[14], risk management involves identifying sources of uncertainty (risk identification) and assessing the consequences of uncertain events\/conditions (risk analysis), thus creating response strategies based on expected results and, finally, based on the feedback received from the actual results and the emerging risk, the steps of identification, analysis and repetitive response events are performed throughout the life cycle of a project to ensure that the project objectives are achieved. Kang et al.[15] define risk management as an act of classification, analysis, and response to unforeseen risks, which are involved during the implementation of a project. Risk management involves maximizing the opportunity and impact of positive events and reducing the likelihood and impact of negative events to achieve the project objectives.\nThe concept of risk is already known to laboratories as it was indirectly included and in previous versions of International Organization for Standardization (ISO) standard ISO 9001 and, mainly via preventive measures to eliminate possible non-compliances and prevent their recurrence (i.e., ISO 9001:2008[16], ISO\/IEC 17025:2005[17]). In the new versions of ISO 9001:2015[18] and ISO\/IEC 17025:2017[19], however, the presence of risk-based thinking is more pronounced and imperative.\nAs the revised version of ISO\/IEC 17025 is in line with ISO 9001 in terms of management requirements, a laboratory should examine the impact of threats as well as seize opportunities to increase management system efficiency to achieve improved results and to avoid negative effects.[20] There is no longer a separate clause on preventive measures, and the concept of preventive action is expressed through the application of the risk and opportunities approach. The concept of risk is implied in each paragraph of the standard related to the factors that affect the validity of the results. Such factors are staff, facilities, environmental conditions, equipment, metrological traceability, technical records, etc. In addition, the creation of a formal risk management system is not a requirement of the standard, but each laboratory can choose the approach which is satisfactory and can be implemented for its needs.[19][20]\nThe revised ISO 14001[20] is also in line with ISO 9001. Risk-based thinking provides a structured approach to managing environmental issues that are likely to affect the organization. Identifying environmental risks and potential opportunities is vital to an organization's success.\nFinally, in ISO 31000:2018[21], risk management is considered to be the coordinated activities carried out for the management and control of an organization in relation to risk. Therefore, in order for a laboratory to comply with the new versions of the standards, it is important to understand the risk-based thinking and to examine the functions, procedures, and activities related to risks and opportunities. To address the concern, this paper aims to explore the implementation of a risk-based thinking framework in testing or calibration laboratories and highlight the challenges that arise as part of that implementation.\n\nThe risk management process \nThe risk management process can be applied at all levels of an organization, from strategy to project implementation. In addition, it must be an integral part of management and decision making and integrated into the structure, functions, and processes of the organization.[9] The integrated risk management process relies on a well-structured risk-based thinking which encompasses the whole quality management system (QMS).\nIn this context, the risk assessment stage consists of three sub-stages: risk identification, risk analysis, and risk evaluation. The purpose of risk identification is to find, recognize, and describe the risks that positively or negatively affect the achievement of the objectives of the organization, even those whose sources are not under its control.[9] According to Elkington and Smallman[22], risk identification is the most important phase of risk analysis, and emphasis is given in the fact that potential risks should be identified at each stage. Hallikas et al.[23] also state that the identification phase is fundamental to implement risk management, as by recognizing sources of risk, future uncertainties can be identified, and preventive measures can be taken. During risk analysis, the impact of a risk is assessed while during risk evaluation any additional action is determined.\nAfter completing the risk assessment stage, the risk is addressed by avoiding risk, taking or increasing risk to pursue an opportunity, removing the risk source, changing the likelihood, changing the consequences, sharing the risk (e.g., through contracts, insurance), or maintaining the risk with a documented decision. All the above steps should be monitored and reviewed to ensure and improve the quality and effectiveness of risk management. The results of the process should be recorded and reported throughout the organization to provide information for decision making, for the improvement of risk management activities and for the interaction with stakeholders.[9]\n\nRisk assessment techniques \nRisk assessment\u2014which is often expressed in relation to sources, possible events, consequences, and likelihood\u2014can be a very difficult process, especially when these relationships are complex. A variety of risk assessment techniques is depicted in Table 1. Though the choice of techniques is not random, some factors must be first taken into account, such as the purpose of the assessment, the needs of stakeholders, any legal, regulatory and contractual requirements, the operating environment and the scenario, how much important is the decision to be made, any defined decision criteria and their form, the time available before a decision is made, the given information and expertise, and the complexity of the situation.[24]\n\n\n\n\n\n\n\nTable 1. Risk assessment techniques\n\n\nTechnique for ...\n\nExamples\n\n\nEliciting views\n\nBrainstorming, Delfi technique, nominal group technique, structural or semi-structural interviews, surveys\n\n\nIdentifying risk\n\nChecklists, classifications, and taxonomies; failure modes and effects analysis (FMEA); failure modes, effects, and criticality analysis (FMECA); hazard and operability analysis (HAZOP); scenario analysis; structured what-if technique (SWIFT)\n\n\nDetermining sources, causes, and drivers of risk\n\nCindynic approach, Ishikawa analysis\n\n\nAnalyzing controls\n\nBow tie analysis, hazard analysis and critical control points (HACCP), layers of protection analysis (LOPA)\n\n\nUnderstanding consequences and likelihood\n\nBayesian analysis, Bayesian network and influence diagrams, business impact analysis, cause-consequence analysis, event tree analysis, fault tree analysis, human reliability analysis, Markov analysis, Monte Carlo simulation, Privacy impact analysis\/data protection impact analysis\n\n\nAnalyzing dependencies and interactions\n\nCausal mapping, cross impact analysis\n\n\nProvide a measure of risk\n\nToxicological risk assessment, value at risk, conditional value at risk or expected shortfall\n\n\nEvaluating the significance of risk\n\nAs low as reasonably practicable (ALARP)\/so far as is reasonably practicable (SFAIRP), frequency-number diagrams, Pareto chart, reliability centered maintenance, risk indices\n\n\nSelecting between options\n\nCost\/benefit analysis, decision tree analysis, game theory, multi-criteria analysis\n\n\nReporting and recording\n\nRisk registers, consequence\/likelihood matrix, S-curves\n\n\n\nThe most used techniques for identifying risk are the failure modes and effects analysis (FMEA), as well as the failure modes, effects, and criticality analysis (FMECA). FMEA\/FMECA can be applied at all levels of an organization and performed at any level of analysis of a system, from block diagrams to detailed elements of a system or steps of a process.[25] This fact leads to several sub-types of FMEA such as system FMEA, design FMEA, process FMEA, and service delivery FMEA. As defined by its name, FMEA is a systematic method designed to identify potential failure modes for a product or process before it occurs and to assess the risk. In FMEA, the system or process under consideration is broken down into individual components. For each element, the ways in which it may fail, the causes and effects of failure are examined. FMECA is a FMEA followed by criticality analysis, which means that for each failure its importance is also assessed. The calculation of the risk in FMEA method includes the multiplication of the three risk parameters severity (S), occurrence (O), and detection (D) in order to produce a risk priority number (RPN, RPN\u2009=\u2009S\u2009\u00d7\u2009O\u2009\u00d7\u2009D). However, in FMECA, failure modes are classified by their criticality.[26] A quantitative measure of criticality can be derived from actual failure rates and a quantitative measure of consequences, if known. FMEA can be used to provide information for analysis to other techniques such as fault tree analysis (FTA). FTA is a commonly used technique for understanding consequences and likelihood of risk. It is a logic diagram that represents the relationships between an adverse event, which is typically a system failure, and the causes of the event which are the component of failure. It uses logic gates and events to model the above-mentioned relationships. FTA can be used both qualitatively to identify the potential causes and pathways to the peak event and quantitatively to calculate the probability that the peak event will occur.[27][28]\nAnother technique which is commonly used in organizations is failure reporting, analysis and corrective action system (FRACAS). It is a technique for identifying and correcting identfied deficiencies in a system or a product and, thus, prevent further occurrence of them.[29] It is based upon the systematic reporting and analysis of failures, making maintenance of historical data a crucial issue. It is also necessary for the organization to have a database management system. The database is established to store all the required data, which include records on all reported failures, failure analyses, and corrective actions.[30]\n\nRisk identification and treatment in laboratories \nRisk identification is the first and most important phase of risk management.[22] In the identification phase, the possible sources of risk which concern the entire activity of the laboratory are recorded.[31]\nTo identify potential sources of risk associated with the testing process, laboratories should create a process map outlining the steps in the testing process from generating the request for test to reporting the testing result. This map should include all stages of the pre-analytical, analytical, and post-analytical process.[10] An example of such a map is given in Fig. 1.\n\r\n\n\n\n\n\n\n\n\n\n\nFigure 1. Process map of the main functions of a testing laboratory.[10]\n\n\n\nAccording to the research of both Plebani and Carraro[32] and Plebani[12], most errors occur during the pre-analytical stages, ranging between 46 to 68%, followed by post-analytical errors, ranging from 19 to 47%, while during the analytical stage the fewest errors occur, ranging from 7 to 13%. Table 2 outlines the main sources of risk in each of these three stages.\n\n\n\n\n\n\n\nTable 2. The main sources of risk during the pre-analytical, analytical, and post-analytical stage in a laboratory\n\n\nMain sources of risk during the ...\n\nReferences\n\n\nPre-analytical stage\n\nAnalytical stage\n\nPost-analytical stage\n\n\n\u2022 Incorrect sample identification\r\n\u2022 Absence of sample identification\r\n\u2022 Incorrect sample labeling\r\n\u2022 Insufficient homogenization of the sample\r\n\u2022 Incorrect sampling\r\n\u2022 Improper sampling container or sample storage\r\n\u2022 Inadequate transport conditions\r\n\u2022 Non-compliant sample\r\n\u2022 Sample contamination\r\n\u2022 Absence of sample or inappropriate test request\r\n\u2022 Insufficient sample\r\n\u2022 Inadequate storage of chemicals\r\n\u2022 Improper transport of chemicals\r\n\u2022 Missing or destroyed sample\n\n\u2022 Procedural non-conformity\r\n\u2022 Wrong test\r\n\u2022 Use of expired reagents\r\n\u2022 Improper use of reagents\r\n\u2022 Equipment malfunction\r\n\u2022 Equipment failure\r\n\u2022 Incorrect equipment calibration\r\n\u2022 Incorrect sample dilutions\r\n\u2022 Mixing samples\r\n\u2022 Deviation in the results of the internal control sample\r\n\u2022 Incorrect calculation of dilution factor\r\n\u2022 Delay in sample analysis\r\n\u2022 Unspecified quality control (QC) failure\r\n\u2022 Improper management of chemicals\r\n\u2022 Inadequate disposal of chemicals\r\n\u2022 Inadequate disposal and management of liquid waste\n\n\u2022 Incorrect results\r\n\u2022 Incorrect entry of results or related entry in the laboratory information management system (LIMS)\r\n\u2022 Send results to another customer\r\n\u2022 Ambiguous way of communicating the results\r\n\u2022 Lack of information about the limits regarding the interpretation of the results\r\n\u2022 Delayed reporting of results\n\n[10][13][32][33][34][35][36]\n\n\n\nAfter completing the risk assessment stage, the laboratory is asked to select an appropriate treatment to maintain the risk at an acceptable level.[37] The measures taken should be monitored for their effectiveness to evaluate the success of any failure reduction effort. This evaluation is achieved by monitoring the values of the quality indicators set by the laboratory.[35] Examples of quality indicators are given in Table 3. According to Lippi et al.[38], the most effective strategy to reduce uncertainties in diagnostic laboratories is to develop and implement an integrated QMS. The success of efforts to reduce errors must be monitored to assess the effectiveness of the measures taken.[39]\n\n\n\n\n\n\n\nTable 3. Examples of pre-analytical indicators and their mathematical formulas\n\n\nQuality indicator\n\nMathematical formula\n\nReferences\n\n\nError in sample identification\n\nNumber of samples with incorrect sample recording\u2009\u00d7\u2009100\/Total number of samples\n\n[37][40][41][42]\n\n\nError in sample transcription\n\nNumber of requests with incorrect data logging (incorrect test)\u2009\u00d7\u2009100\/Total number of requests\n\n\nWrong container\n\nNumber of wrong containers for each sample type\u2009\u00d7\u2009100\/Total number of requests\n\n\nInsufficient sample\n\nNumber of samples with insufficient quantity\u2009\u00d7\u2009100\/Total number of samples\n\n\nInappropriate transport and storage conditions\n\nNumber of samples with inappropriate storage conditions before analysis\u2009\u00d7\u2009100\/Total number of samples\n\n\nNumber of samples missing during transport\u2009\u00d7\u2009100\/Total number of samples\n\n\nNumber of samples destroyed during transport\u2009\u00d7\u2009100\/Total number of samples\n\n\nNumber of samples with improper temperature during transport\u2009\u00d7\u2009100\/Total number of samples\n\n\nNumber of samples with extended transfer time\u2009\u00d7\u2009100\/Total number of samples\n\n\n\nPossible risks in laboratories are identified below in more detail along with their appropriate treatment.\n\nSample \nSamples are the items sent by customers to the laboratory for testing or calibration in order for detailed and reliable results to be provided in a predefined time scale. Therefore, the consequences can be serious if there is loss or any other inconsistency with the samples, their analysis, and related procedures. Normally, samples taken from the laboratory go through a sampling process prior to analytical procedures. Heterogeneous samples must be homogenized before sampling, otherwise the results obtained are not reliable, especially when the analytes are contained in traces in the sample under study.[12]\nSample-related inconsistencies of the pre-analytical phase have already been summarized in Table 2. The strategy to prevent pre-analytical errors consists of five interrelated steps[43][44][45]:\n\nDevelop clear written procedures.\nEnhance professionals' training.\nAutomate both support functions and executive functions.\nMonitor quality indicators.\nImprove communication between professionals and encourage interservice collaboration.\nThe written procedures should clearly describe how the sample is analyzed, collected, labeled, transported, and prepared. To ensure that written procedures are followed consistently, those performing the pre-analytical activities must be well-trained to understand, in addition to the appropriate procedures, their important steps and the consequences of not following the instructions faithfully.[46]\nModern technologies, such as robotics and information management systems, should also help reduce errors. A LIMS is a computerized system that collects, processes, and stores information produced by the laboratory. Although originally created solely to automate experimental data, it is nowadays used in many laboratory activities.[47][48][49][50] The typical LIMS will have sample management functions such as sample registration, barcode labeling, and sample tracking. Using an integrated LIMS, the chain of custody (CoC) and audit trail records of the samples can be systematically kept, and operations can be improved by adding features such as model management and sample testing, while statistics concerning the number and type of samples, analytical findings, reporting time, number and origin of customers, and many other attributes can be very easily estimated or tracked.[12][51] Thus, by automating certain steps at pre-analytic workstations, the number of people participating in this phase and the number of manual steps required are reduced. In addition, barcodes simplify the routing and tracking of samples. For example, a computerized order entry system (COES) simplifies the examination order by eliminating the need for the order to be transcribed by a second person.[35]\nTo avoid problems caused by a lack of adequate storage space, the laboratory should regularly assess its capacity to handle samples, including available storage space. Therefore, the laboratory should know or proactively estimate the number of samples it can handle and store at a given time, in a manner that whenever the number of incoming samples exceeds its handling capacity, measures such as temporary reassignment of personnel or arrangement of makeshift storage areas can be taken in a timely manner.[12]\n\nPersonnel \nThe human factor is present at every stage of the pre-analytical, analytical, and post-analytical process. According to Ho and Chen[52], human error is the leading cause of laboratory accidents. Wurtz et al.[53] reported that reduced mental and physical condition, due to exhaustion, is often the cause of laboratory accidents. However, apart from causing accidents, the human factor is also responsible for any mistake that can occur at any stage of the analytical process, from the collection and recording of samples to the processing of results. The occurrence of human error and its subsequent outcome usually cannot be predicted.[12]\nThe techniques used to assess the human factor's contribution to the reliability and security of a system are called the human factor reliability analysis (HRA).[24] The first industry to develop and implement HRA was the nuclear industry[54], concluding that most accidents were due to human error rather than equipment malfunction. Since then, HRA has been applied to many \u201chigh risk\u201d industries, such as the aerospace, railways, shipping, automotive, oil, gas, chemical, military components, and air traffic control industries. HRA has been also applied in the healthcare sector, in the installation of telecommunications equipment, in the design of computer software and hardware, as well as in many manual operations such as lathe operation.\nTo avoid unpleasant consequences occurred by human factor, personnel throughout the organization should be trained appropriately and effectively to be able to perform procedures in accordance with the requirements of ISO standards or other regulations.[35] Furthermore, to avoid staff burnout, some laboratory automation systems should be installed and implemented in laboratories, including electric wheeled vehicle systems to transport the samples and systems with automatic result verification procedures.[55] McDonald et al.[56] argue that using a LIMS with highly automated laboratory equipment, researchers can perform repeatable experiments without human intervention. Finally, another measure that can reduce the occurrence of human errors is the continuous supervision of staff, followed by raising staff awareness of error causes through regular training.[12]\n\nReagents and waste \nThe ever-increasing number of laboratories in recent years has led to an increase in industrial waste, such as solid waste, liquid waste, and sewage. Most liquid waste is hazardous industrial waste, which affects human health and causes environmental pollution. The management of this waste therefore involves many risks. There have been, for example, many accidents and injuries due to mismanagement of chemical waste.[34][52] Yu and Chou[57] reported that the most common risk in laboratories is chemical reagents because they can cause immediate damage or cumulative pathological changes to the inside and outside of the human body, as they can cause fire, explosion, poisoning, and corrosion. Additionally, Lin et al.[34], following their research on university laboratories-related fires and explosions related to chemical reagents, state that many causes of accidents were based on improper chemical management, including improper storage, use, transportation, and disposal of chemicals.\nTo mitigate or even avoid the adverse risks of chemicals, their proper management is required. For example, the storage of chemical reagents should be done by category, in a controlled environment and in well-ventilated areas. Flammable materials should be separated from non-flammable materials and stored in areas that provide protection from projectiles, while stock checks should be frequent. Special care should be also taken when transporting them. For example, wooden trays could be used for transport, and always with the use of personal protective equipment.[58]\nWaste should be recycled and disposed of properly. For example, chemicals should be neutralized before disposal. It is necessary to install smoke alarms, fire extinguishers, surveillance cameras, showers, and eyewash stations, as well as signs clearly marking escape corridors, collective protection, and personal protection. Detailed procedures, clear instructions, and appropriate training are also of crucial importance.[52][58]\n\nEnvironmental conditions \nLaboratories are exposed to various types of hazards (e.g., biological, chemical, radioactive, and others), making them highly hazardous environments.[59] Moreover, the work environment of the laboratories may be exposed to more than one hazard at the same time, which further increases risk. Marque et al.[58] emphasize that chemistry laboratories, for example, are unhealthy and dangerous environments, and those involved in research work are exposed to many potential sources of risk as they not only treat chemical reagents but also encounter equipment that is a source of heat and electricity. In chemical laboratories, there are many potential risks as they contain flammable, explosive, and poisonous chemicals. There are also risks in biological laboratories, especially for laboratory staff who treat pathogens, as they are much more likely to be infected with an infectious disease than anyone else.[60]\nExposure to chemicals in the workplace can have adverse, acute, or long-term health effects. The dangers from potential exposure to chemicals are many and various, as some substances are toxic, carcinogenic, or irritating, and others are flammable or pose a risk of biological contamination.[61][62] In 2006, Chiozza and Plebani[63] reported that two decades ago, laboratory workers performed their work without following any safety procedures and, thus, put themselves in danger. Ho and Chen[52] noted that poor management of chemical waste in universities and non-profit laboratories has caused many accidents over the years. Poor management of chemical waste can harm laboratory workers and lead to environmental pollution.[36]\nThe U.S. Commission on Chemical Safety and Hazard Investigation has studied 120 laboratory accidents that occurred at various universities across the country from 2001 to 2011.[64] From 2000 to 2015, there were 34 laboratory accidents, which caused 49 deaths. These accidents were caused by explosion, exposure to biological agents, exposure to toxic substances, suffocation, electric shock, fire, exposure to ionizing radiation, and various other causes.\nIn addition to the risk to human health, of environmental pollution, and of destruction of laboratory property, there are other risk factors such as the production of unreliable results and customer dissatisfaction, which also lead to the laboratory's bad reputation, making the application of risk management process imperative to the sustainability of the laboratory.[12]\nIn order to tackle risk effectively, estimates based on effective risk management must be integrated into the analytical framework.[14] A prerequisite for the operation under appropriate environmental conditions, in a safe and competent laboratory, is the management by executives who can apply the theory of risk to reduce it to an acceptable level. Each laboratory should be able to assess the possible occurrence of errors and describe the steps needed to detect and prevent them to avoid any future adverse events.[65]\n\nTest methods \nIt is common practice that appropriate standards or formal methods, whenever available and after verification, be preferred over methods developed internally in laboratories. Otherwise, in-house methods shall be fully validated. In this case, the risk is hidden in non-properly or partially validated methods instead of fully validated methods. In addition, an analytical method may have critical test steps or parameters, such as the quantity of reagents to be added in a particular step, the reaction time, or a specific step to proceed without delay. The absence of critical steps leads to erroneous results.\nTo avoid the risk arisen from the use of internal analytical methods that are not properly validated, the laboratory should ensure that the method developed is fully validated for its intended use. To achieve this, a general method validation procedure shall exist, based on relevant international protocols, compiled from certified analysts involved in the design of method validation having extensive experience in related issues. In addition, according to the latest version of the ISO\/IEC 17025 standard, the specification of the method requirements must be recorded in detail during the method validation phase. Moreover, checks should be carried out to ensure that all requirements are met and, afterward, the declaration of method validity should be signed. Critical steps and parameters of the test methods should be appropriately marked in the respective written procedures to avoid any misunderstanding or omission by the analysts. Additionally, during staff methodological training, the importance of these points should be clearly explained.[12]\n\nMeasurement \nIn the measurement process, issues that have been already mentioned above, such as sample treatment, environmental conditions, personnel ,and test methods affect the measurement results.\nAnother critical aspect is the need for appropriate and valid (certified, if applicable) reference materials that must be used to determine the metrological traceability of the analytical results in accordance with the requirements of ISO\/IEC 17025. There are two types of reference materials involved in chemical testing which are the matrix reference materials for the validation of the methods and the pure reference standards used for the calibration of the equipment. The laboratory should retain procedures for safe handling, transport, storage, and use of reference materials to avoid possible contamination or deterioration. In addition, the laboratory should have studies on the stability of the solutions of the working standards prepared from reference standards. Matrix reference materials must be stored strictly in accordance with the storage conditions recommended by the manufacturers, and relevant records should be kept appropriately. Before use, at least a visual inspection should be performed to confirm that the materials are intact.[12]\nAlthough the occurrence and subsequent outcome of human error during test execution is usually unpredictable, it can nevertheless be minimized by strengthening personnel supervision and increasing awareness. Actions toward this effort include on-site monitoring, verbal review, and control of experimental records, including sampling, sample analysis, data handling, and reporting. The results of the monitoring actions should be maintained, and whenever a deviation is found, corrective actions should be immediately taken. To avoid the risk that may arise from any inappropriate environmental conditions during measurement, the critical requirements for environmental conditions should be clearly indicated in the written procedures of the method to raise the awareness of the involved analysts. In addition, the continuous monitoring and periodic review of environmental conditions and the maintenance of relevant records are significant prerequisites. These actions not only allow subsequent inspection or evaluation, but they also encourage analysts to stay aware of the appropriate environmental conditions when performing tests.[20][66]\n\nQuality control \nThe laboratory must have quality control procedures to monitor the validity of the tests performed and the quality of the results. Procedures are divided into internal and external quality control procedures. The main objective of internal quality control is to ensure the reliability of the results of the analytical process.[67] Internal quality control should be applied daily in the laboratory and for each laboratory test, to identify random and systematic errors as well as trends. For example, in each laboratory test, working standards of known concentration should be used to check the validity and accuracy of the test results through control charts, testing of internal blind samples, replicate tests using the same or different methods, or intermediate checks on measurement equipment. It is also useful for the laboratory to retain appropriate control of its QMS documents (e.g., procedures, instructions, calibration tables, specifications, alerts, etc.) for the purpose of updating and checking their validity, the control of the files, the control of the actions to treat threats and seizing opportunities, the control of corrective actions, etc.\nExternal quality control, on the other hand, is performed by analyzing blind control samples sent to the laboratory by external, inter-laboratory comparison providers, to check the accuracy of results independently and objectively. The laboratory participating in an external quality control program must state the tests it performs, as well as the methods and instruments it uses, if required.[68][69] The successful participation of a laboratory in external quality control programs provides objective proof of the adequacy of the laboratory to its customers, as well as to the accreditation and regulatory bodies the lab answers to.[70] Non-valid results, however, indicate the existence of inconsistencies in the analysis chain of the samples, e.g., in the used test method, equipment, or personnel[71], and they must be carefully reviewed and appropriately corrected. Although tests must be performed in the same way as routine samples, the pre-analytical procedure, however, often differs as the samples sent may be in a different form (e.g., in a lyophilized form) or in different containers (e.g., in different types of tubes) and require different pre-analytical treatment. Therefore, the program organizer must provide clear instructions on the maintenance and preparation of external quality control samples.[72]\n\nResults reporting \nThe final step in the testing process is results reporting. The risk of this stage may be the incorrect sending of results to the customer due to some falsification or even loss of data that may occur during the receipt, transfer, processing, and storage of data. Even if data handling software is used, data can be violated or modified by error or deceit.[73]\nTo avoid the risk of reporting incorrect results to clients, the laboratory shall have two- or even three-level data control procedures in place. When software is used to manipulate the data, these programs should be verified before use with appropriate protection to prevent tampering or accidental modification. However, for further improvement, these recording processes could be integrated into a LIMS which minimizes the need to manually transcribe data, and through appropriate electronic controls, data integrity can be ensured. The system could also record any failure as well as the corrective actions taken for reference. In cases where a declaration of conformity of the test to a specification or to a standard is requested, the laboratory is recommended to document the decision rules considering the relevant risk. This enhances the consistency of the results provided and avoids the risk of false acceptance or rejection.[12]\nTo prevent late reporting of results to the client, the combination of a LIMS with a web-based reporting system can be used. This combination is an important tool with which clinical and analytical laboratories can significantly speed up the process of presenting their test results to their customers, increasing their satisfaction and trust with the laboratory.[49]\n\nImpartiality and confidentiality \nImpartiality and confidentiality are two aspects that are included in the general requirements of the latest edition of ISO\/IEC 17025, giving special attention to the importance of effective risk management resulting from the lack of these aspects. In particular, the laboratory is obliged to identify the risk associated with its impartiality on an ongoing basis and to demonstrate how to eliminate or minimize this risk. For example, it should identify the risk arising from its activities, relationships with stakeholders (e.g., top management representatives, clients, service providers, etc.) or staff relationships. Impartiality is defined in ISO\/IEC 17025:2017 as the existence of subjectivity in relationships that may affect the laboratory's impartiality and are based on ownership, governance, administration, staff, shared resources, finances, contracts, and more.\nHowever, impartiality is not always intentional; most of the time it is done unintentionally by hard-working, dedicated, honest, and competent employees who try to do their job impartially but still fail. It is then considered as cognitive bias, which is widespread and implicit.[74][75] The impact of such implicit bias is significant, as it affects not only the examiner's judgment, but also it creates phenomena known as \u201cbias cascade\u201d and \u201cbias snowball.\u201d The \u201cbias cascade\u201d effect occurs when irrelevant information spills from one stage to another, thereby creating bias. In the \u201csnowball bias\u201d effect, bias is not only simply carried over from one stage to the next but sequentially grows as unrelated information from a variety of sources integrate and influence one another.[76][77][78][79] Therefore, it is extremely important to take the necessary steps to prevent and address bias.\nThe laboratory is also obliged to ensure the protection of confidential information concerning its customers and is responsible for managing all information received or generated during the execution of its activities. As impartiality and confidentiality adversely affect the laboratory's goals and compliance with the requirements of the ISO\/IEC 17025 standard, they should be treated like any other risk. Therefore, an effective risk management system is required to deal with these risks.[11][80]\nThe above is achieved by upper management's commitment to impartiality and adopting appropriate policies, procedures, and best practices to monitor the risk of bias and, where necessary, taking action to prevent or mitigate it. Undoubtedly, appropriate training is a critical parameter to assure impartiality and confidentiality. Staff must be trained in relation to cognitive bias so that they understand the existence and importance of appropriate policies, procedures, and practices.[11] Ensuring confidentiality in laboratories also requires an effective and clearly defined laboratory management system that provides all relevant information, in an accessible format, including documentation of the laboratory's confidentiality policies, procedures, and guidelines. By extension, a written confidentiality policy is essential, providing clear instructions to all laboratory workers and being signed by them. A confidentiality agreement is a standard practice for many businesses and can remain in place indefinitely, protecting the laboratory even after staff leave, as well as from outside partners. There should be also a plan that outlines exactly how laboratory personnel should react in case that workplace confidentiality policies or procedures are being violated.\nPaper documents and records should be kept in a secure location inaccessible to non-laboratory personnel, and when no longer needed, are destroyed before disposal. Special care should be also taken with mobile phones to avoid pictures of classified documents to be taken for unintended use. In addition, the electronic documentation is stored on a secure network and viewed only on secure devices.\n\nDigitalization \nModern laboratories are increasingly dependent on computers and other electronic devices for both their administrative and analytical functions. For example, the results obtained from the laboratory equipment are automatically stored in raw data files. While these technological developments create new opportunities, they also create risks.[73] Potential risks are data loss, the possibility of breaching and modifying raw data files generated by laboratory equipment, and incorrect input of information into the LIMS. According to Tully et al.[81], the main risks faced by digital forensic laboratories that use quality standards include:\n\nThe existence of inaccurate or insufficient information in the technical files and the absence of a mechanism to detect subsequent changes in the files.\nProblems with computer systems security, energy supply, use of passwords for files opening or computers use, and data backup processes.\nAbsence or insufficiency of detailed procedures for the processing of digital data, or the documented procedures are not followed consistently by the staff.\nLack of strong quality control mechanisms and problems with validation of methods.\nComputer systems used to store the data generated (raw and processed) by the laboratory can deal with problems that lead to information loss. Under some circumstances, the original data files can be recovered from hard drives using appropriate digital methods, but these can be costly and time consuming. However, even if digital data can be preserved, it is malleable and subject to undetectable changes in its content or metadata. The lack of proper data retention procedures makes it more difficult or even impossible to retrieve the original files and verify their integrity. In addition, standard backup procedures do not have the fidelity of digital forensic mechanisms.\nOne way to preserve digital data is to create backups. However, routine backup procedures do not have the fidelity of digital preservation mechanisms for some critical data, such as those of forensic laboratories. Data files created by laboratory equipment and stored on computers can be modified by mistake or intentionally. Depending on the data type and the modification method, it may be possible to detect changes or amendments. Normal backup procedures, even those updated to preserve digital forensics data, are not foolproof. Data can be falsified, and the computer system can be refreshed to make it appear that the change was made at some point in the past.[73]\nTo manage the risks of inadvertent alteration, as well as intentional breach, the solution is to update the traditional practices of tracking data provenance and use digitized ledgers of global custody.[82][83] These ledgers can be implemented in such a way that they are inviolable and independently verifiable.\nThe use of automated systems by specialized laboratory staff who interpret the results of the analyses can help maintain consistency and increase the effectiveness of the analysis. However, these systems\u2014including those with artificial intelligence (AI) and machine learning (ML)\u2014can have errors, resulting in invalid results.[84] In addition, they are sensitive to bias due to poorly selected data sets, as well as lead to misinterpretations when the results are not fully understood.[85] For example, when automated AI\/ML systems are used to support forensic research and forensic analysis, such as comparing faces in digital video or photographs, false-positive algorithms can lead to erroneous results.[73]\n\nFinancial risk \nOver the last years and due to the outbreak of the economic and health crises worldwide, the tight financial policy in many laboratories either of the public or the private sector, along with various bureaucratic obstacles, may have negative impacts on their overall technological or economic growth. Laboratories should made efforts for cost cutting assuming that accurate knowledge of their test costs exists. It is common sense that many laboratories do not exactly know the cost of services they provide or, additionally, do not take early measures to timely upgrade their equipment and analytical instruments as well as to restore staff losses from resignations or retirements maybe due to reduced financial budget or state subsidies.\nAdequate test cost accounting requires a joint effort between financial experts and those with a broad knowledge of laboratory testing. The absence of a solid cost accounting may lead to a risky incremental costing. As such, up-to-date cost information to price laboratory services, along with adequate programming of laboratory's financial and human needs (e.g., compiling a business plan), can prove to be efficient control measures for their financial sustainability and future development. Furthermore, top management representatives play a crucial role in finding or securing financial resources to cover the laboratory's human and infrastructure needs.\n\nConclusion \nThe complex activities and the operational framework of a modern laboratory involve many risks with adverse consequences for the testing outcomes, the health of workers, and the environment. For this reason, risk management procedures should be integrated into the laboratory's QMS procedures and become an integral part of their daily routine. Many methods have been developed to identify and assess risk. Most of them are described in ISO 31010:2019, while the general method instructions are referred to in ISO 31000:2018.\nThe major sources of risk in a laboratory are the personnel themselves, samples to be analyzed, chemical reagents and waste, equipment, test methods, measurements, non-updated quality control procedures, results reporting, impartiality and confidentiality, digitalization of data and information, and financial aspects. Implementing an efficient QMS, the laboratory can reduce the risks to a tolerable level when clear procedures, continuous supervision, inspections, timely training and continuous education of its staff, and upgrades of its equipment with systems automation are maintained. A continuous management of risks is necessary for the emergence of new priorities and the continuous implementation of necessary actions for the purpose of safety and prevention.\nRisk management is fundamental to ensure a safe internal and external laboratory environment, as well as to assure the delivery of reliable and competent services. Moreover, the implementation of risk-based thinking can positively affect the outcome of regular assessments in order to explore opportunities for increasing the effectiveness of the QMS and preventing further negative effects.\n\n Abbreviations, acronyms, and initialisms \nAI: artificial intelligence\nALARP: as low as reasonably practicable\nCoC: chain of custody\nCOES: computerized order entry system\nFMEA: failure modes and effects analysis\nFMECA: failure modes, effects, and criticality analysis\nFRACAS: failure reporting, analysis and corrective action system\nFTA: fault tree analysis\nHACCP: hazard analysis and critical control points\nHAZOP: hazard and operability analysis\nHRA: human factor reliability analysis\nISO: International Organization for Standardization\nLIMS: laboratory information management system\nLOPA: layers of protection analysis\nML: machine learning\nQMS: quality management system\nSFAIRP: so far as is reasonably practicable\nSWIFT: structured what-if technique\nAcknowledgements \nAuthor contributions \nET wrote the main manuscript text. AGF contributed to the writing process while both AGF and ANP made critical corrections. All authors reviewed the manuscript.\n\nFunding \nOpen access funding provided by HEAL-Link Greece.\n\nConflict of interest \nThe authors declare no competing interests.\n\nReferences \n\n\n\u2191 Dallas, Michael (2006). Value and risk management: a guide to best practice. Oxford ; Malden, MA: Blackwell Pub. ISBN 978-1-4051-2069-2. OCLC ocm59879826. https:\/\/www.worldcat.org\/title\/mediawiki\/oclc\/ocm59879826 .   \n \n\n\u2191 2.0 2.1 2.2 Covello, Vincent T.; Mumpower, Jeryl (1 June 1985). \"Risk Analysis and Risk Management: An Historical Perspective\" (in en). Risk Analysis 5 (2): 103\u2013120. doi:10.1111\/j.1539-6924.1985.tb00159.x. ISSN 0272-4332. https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/j.1539-6924.1985.tb00159.x .   \n \n\n\u2191 Grier, B. (1981). \"The Early History of the Theory and Management of Risk\". Paper presented at the Judgment and Decision Making Group Meeting, Philadelphia, Pennsylvania, 1981.   \n \n\n\u2191 Oppenheim, A. Leo (1977) (in en). Ancient Mesopotamia. University of Chicago Press. doi:10.7208\/chicago\/9780226177670.001.0001. ISBN 978-0-226-63187-5. https:\/\/doi.org\/10.7208\/chicago\/9780226177670.001.0001 .   \n \n\n\u2191 Ehrlich, Isaac; Becker, Gary S. (1 July 1972). \"Market Insurance, Self-Insurance, and Self-Protection\" (in en). Journal of Political Economy 80 (4): 623\u2013648. doi:10.1086\/259916. ISSN 0022-3808. https:\/\/www.journals.uchicago.edu\/doi\/10.1086\/259916 .   \n \n\n\u2191 Dionne, Georges; Eeckhoudt, Louis (1 January 1985). \"Self-insurance, self-protection and increased risk aversion\" (in en). Economics Letters 17 (1-2): 39\u201342. doi:10.1016\/0165-1765(85)90123-5. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/0165176585901235 .   \n \n\n\u2191 Dionne, Georges (1 September 2013). \"Risk Management: History, Definition, and Critique: Risk Management\" (in en). Risk Management and Insurance Review 16 (2): 147\u2013166. doi:10.1111\/rmir.12016. https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/rmir.12016 .   \n \n\n\u2191 Kumamoto, Hiromitsu; Henley, Ernest J.; Henley, Ernest J. (1996). Probabilistic risk assessment and management for engineers and scientists (2nd ed ed.). New York: IEEE Press. ISBN 978-0-7803-1004-9.   \n \n\n\u2191 9.0 9.1 9.2 9.3 Nichols, James H. (1 May 2011). \"Laboratory Quality Control Based on Risk Management\" (in en). Annals of Saudi Medicine 31 (3): 223\u2013228. doi:10.4103\/0256-4947.81526. ISSN 0256-4947. PMC PMC3119960. PMID 21623049. http:\/\/www.annsaudimed.net\/doi\/10.4103\/0256-4947.81526 .   \n \n\n\u2191 10.0 10.1 10.2 10.3 Dror, Itiel E.; Pierce, Michal L. (1 May 2020). \"ISO Standards Addressing Issues of Bias and Impartiality in Forensic Work\" (in en). Journal of Forensic Sciences 65 (3): 800\u2013808. doi:10.1111\/1556-4029.14265. ISSN 0022-1198. https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/1556-4029.14265 .   \n \n\n\u2191 11.0 11.1 11.2 Wong, Siu-kay (1 April 2017). \"Risk-based thinking for chemical testing\" (in en). Accreditation and Quality Assurance 22 (2): 103\u2013108. doi:10.1007\/s00769-017-1256-x. ISSN 0949-1775. http:\/\/link.springer.com\/10.1007\/s00769-017-1256-x .   \n \n\n\u2191 12.00 12.01 12.02 12.03 12.04 12.05 12.06 12.07 12.08 12.09 12.10 Plebani, Mario (1 January 2006). \"Errors in clinical laboratories or errors in laboratory medicine?\". Clinical Chemistry and Laboratory Medicine (CCLM) 44 (6). doi:10.1515\/CCLM.2006.123. ISSN 1434-6621. https:\/\/www.degruyter.com\/document\/doi\/10.1515\/CCLM.2006.123\/html .   \n \n\n\u2191 13.0 13.1 Lemos, T.; Almeida, L. T. (2001), Linkov, Igor; Palma-Oliveira, Jose, eds., \"Whole Life Cycle Risk Management\", Assessment and Management of Environmental Risks (Dordrecht: Springer Netherlands): 401\u2013407, doi:10.1007\/978-94-010-0987-4_44, ISBN 978-1-4020-0024-9, http:\/\/link.springer.com\/10.1007\/978-94-010-0987-4_44 . Retrieved 2023-05-16   \n \n\n\u2191 14.0 14.1 Dikmen, I.; Birgonul, M.T.; Anac, C.; Tah, J.H.M.; Aouad, G. (1 December 2008). \"Learning from risks: A tool for post-project risk assessment\" (in en). Automation in Construction 18 (1): 42\u201350. doi:10.1016\/j.autcon.2008.04.008. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0926580508000691 .   \n \n\n\u2191 Kang, Leen Seok; Kim, Sung-Keun; Moon, Hyoun Seok; Kim, Hyeon Seung (1 May 2013). \"Development of a 4D object-based system for visualizing the risk information of construction projects\" (in en). Automation in Construction 31: 186\u2013203. doi:10.1016\/j.autcon.2012.11.038. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0926580512002336 .   \n \n\n\u2191 International Organization for Standardization (November 2008). \"ISO 9001:2008 Quality management systems \u2014 Requirements\". International Organization for Standardization. https:\/\/www.iso.org\/standard\/46486.html .   \n \n\n\u2191 International Organization for Standardization (May 2005). \"ISO\/IEC 17025:2005 General requirements for the competence of testing and calibration laboratories\". International Organization for Standardization. https:\/\/www.iso.org\/standard\/39883.html .   \n \n\n\u2191 International Organization for Standardization (September 2015). \"ISO 9001:2015 Quality management systems \u2014 Requirements\". International Organization for Standardization. https:\/\/www.iso.org\/standard\/62085.html .   \n \n\n\u2191 19.0 19.1 International Organization for Standardization (November 2017). \"ISO\/IEC 17025:2017 General requirements for the competence of testing and calibration laboratories\". International Organization for Standardization. https:\/\/www.iso.org\/standard\/66912.html .   \n \n\n\u2191 20.0 20.1 20.2 20.3 International Organization for Standardization (September 2015). \"ISO 14001:2015 Environmental management systems \u2014 Requirements with guidance for use\". International Organization for Standardization. https:\/\/www.iso.org\/standard\/60857.html .   \n \n\n\u2191 International Organization for Standardization (February 2018). \"ISO 31000:2018 Risk management \u2014 Guidelines\". International Organization for Standardization. https:\/\/www.iso.org\/standard\/65694.html .   \n \n\n\u2191 22.0 22.1 Elkington, Paul; Smallman, Clive (1 January 2002). \"Managing project risks: a case study from the utilities sector\" (in en). International Journal of Project Management 20 (1): 49\u201357. doi:10.1016\/S0263-7863(00)00034-X. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S026378630000034X .   \n \n\n\u2191 Hallikas, Jukka; Karvonen, Iris; Pulkkinen, Urho; Virolainen, Veli-Matti; Tuominen, Markku (1 July 2004). \"Risk management processes in supplier networks\" (in en). International Journal of Production Economics 90 (1): 47\u201358. doi:10.1016\/j.ijpe.2004.02.007. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0925527304000477 .   \n \n\n\u2191 24.0 24.1 International Organization for Standardization (June 2019). \"IEC 31010:2019 Risk management \u2014 Risk assessment techniques\". International Organization for Standardization. https:\/\/www.iso.org\/standard\/72140.html .   \n \n\n\u2191 Huang, Jia; You, Jian-Xin; Liu, Hu-Chen; Song, Ming-Shun (1 July 2020). \"Failure mode and effect analysis improvement: A systematic literature review and future research agenda\" (in en). Reliability Engineering & System Safety 199: 106885. doi:10.1016\/j.ress.2020.106885. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S095183201930105X .   \n \n\n\u2191 Pillay, Anand; Wang, Jin (1 January 2003). \"Modified failure mode and effects analysis using approximate reasoning\" (in en). Reliability Engineering & System Safety 79 (1): 69\u201385. doi:10.1016\/S0951-8320(02)00179-5. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0951832002001795 .   \n \n\n\u2191 Bhattacharyya, S.K.; Cheliyan, A.S. (1 May 2019). \"Optimization of a subsea production system for cost and reliability using its fault tree model\" (in en). Reliability Engineering & System Safety 185: 213\u2013219. doi:10.1016\/j.ress.2018.12.030. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0951832017314515 .   \n \n\n\u2191 Zio, E. (1 February 2009). \"Reliability engineering: Old problems and new challenges\" (in en). Reliability Engineering & System Safety 94 (2): 125\u2013141. doi:10.1016\/j.ress.2008.06.002. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0951832008001749 .   \n \n\n\u2191 Chang, Jeonghyun; Yoo, Soo Jin; Kim, Sollip (11 May 2021). \"Development and Application of Computerized Risk Registry and Management Tool Based on FMEA and FRACAS for Total Testing Process\" (in en). Medicina 57 (5): 477. doi:10.3390\/medicina57050477. ISSN 1648-9144. PMC PMC8151538. PMID 34065022. https:\/\/www.mdpi.com\/1648-9144\/57\/5\/477 .   \n \n\n\u2191 Lee, Jae Hoon; Chan, SungIl; Jang, Joong Soon (5 July 2010). \"Process-Oriented Development of Failure Reporting, Analysis, and Corrective Action System\" (in en). International Journal of Quality, Statistics, and Reliability 2010: 1\u20138. doi:10.1155\/2010\/213690. ISSN 1687-7144. https:\/\/www.hindawi.com\/journals\/jqre\/2010\/213690\/ .   \n \n\n\u2191 Vasilnakova, Andrea (2018), Katalinic, Branko, ed., \"Risk Management in Accredited Testing Laboratories\", DAAAM Proceedings (DAAAM International Vienna) 1: 1071\u20131075, doi:10.2507\/29th.daaam.proceedings.153, ISBN 978-3-902734-20-4, http:\/\/www.daaam.info\/Downloads\/Pdfs\/proceedings\/proceedings_2018\/153.pdf . Retrieved 2023-05-16   \n \n\n\u2191 32.0 32.1 Plebani, Mario; Carraro, Paolo (1 August 1997). \"Mistakes in a stat laboratory: types and frequency\" (in en). Clinical Chemistry 43 (8): 1348\u20131351. doi:10.1093\/clinchem\/43.8.1348. ISSN 0009-9147. https:\/\/academic.oup.com\/clinchem\/article\/43\/8\/1348\/5641004 .   \n \n\n\u2191 Piton, Alain (2008). \"Risk-based assessment applied to QA GLP audits. How to fulfill regulatory requirements while making the best use of our common sense, knowledge, talents, and resources?\". Annali dell'Istituto Superiore Di Sanita 44 (4): 379\u2013384. ISSN 2384-8553. PMID 19352000. https:\/\/pubmed.ncbi.nlm.nih.gov\/19352000 .   \n \n\n\u2191 34.0 34.1 34.2 Kuo, Y.C.; Lin, C.W.; Wu, H.C. (2004). \"Investigation on the Fires and Explosions in Chemicals-related University Laboratories\". Chemical Technology 137 (8): 195\u2013208.   \n \n\n\u2191 35.0 35.1 35.2 35.3 Da Rin, Giorgio (1 June 2009). \"Pre-analytical workstations: A tool for reducing laboratory errors\" (in en). Clinica Chimica Acta 404 (1): 68\u201374. doi:10.1016\/j.cca.2009.03.024. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0009898109001454 .   \n \n\n\u2191 36.0 36.1 Kuo, T.-Y. (7 September 2006). \"Discussion of waste liquid flowing arrangement and control system in lab of college\". National Central University Library. http:\/\/ir.lib.ncu.edu.tw\/handle\/987654321\/3318 .   \n \n\n\u2191 37.0 37.1 Eliza, David Remona; Minodora, Dobreanu (1 December 2015). \"Risk Management in Clinical Laboratory: from Theory to Practice\" (in en). Acta Medica Marisiensis 61 (4): 372\u2013377. doi:10.1515\/amma-2015-0086. ISSN 2247-6113. https:\/\/www.sciendo.com\/article\/10.1515\/amma-2015-0086 .   \n \n\n\u2191 Lippi, Giuseppe; Simundic, Ana-Maria; Mattiuzzi, Camilla (2010). \"Overview on patient safety in healthcare and laboratory diagnostics\". Biochemia Medica: 131\u2013143. doi:10.11613\/BM.2010.015. http:\/\/www.biochemia-medica.com\/en\/journal\/20\/2\/10.11613\/BM.2010.015 .   \n \n\n\u2191 Fragkaki, A.G.; Leontiou, I.-P.; Kioukia-Fougia, N.; Tsivou, M.; Spyridaki, M.-\u0397.\u0395.; Georgakopoulos, C.G. (1 October 2006). \"Organization of the doping control laboratory in the Athens 2004 Olympic Games: A case study\" (in en). Technovation 26 (10): 1162\u20131169. doi:10.1016\/j.technovation.2005.09.003. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0166497205001197 .   \n \n\n\u2191 Gimenez-Marin, Angeles; Rivas-Ruiz, Francisco; Perez-Hidalgo, Maria del Mar; Molina-Mendoza, Pedro (2014). \"Pre-analytical errors management in the clinical laboratory: a five-year study\". Biochemia Medica 24 (2): 248\u2013257. doi:10.11613\/BM.2014.027. PMC PMC4083576. PMID 24969918. http:\/\/www.biochemia-medica.com\/en\/journal\/24\/2\/10.11613\/BM.2014.027 .   \n \n\n\u2191 Plebani, Mario; Sciacovelli, Laura; Aita, Ada; Chiozza, Maria Laura (2014). \"Harmonization of pre-analytical quality indicators\". Biochemia Medica: 105\u2013113. doi:10.11613\/BM.2014.012. PMC PMC3936970. PMID 24627719. http:\/\/www.biochemia-medica.com\/en\/journal\/24\/1\/10.11613\/BM.2014.012 .   \n \n\n\u2191 Sciacovelli, Laura; Plebani, Mario (1 June 2009). \"The IFCC Working Group on laboratory errors and patient safety\" (in en). Clinica Chimica Acta 404 (1): 79\u201385. doi:10.1016\/j.cca.2009.03.025. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0009898109001478 .   \n \n\n\u2191 Bates, David W.; Gawande, Atul A. (19 June 2003). \"Improving Safety with Information Technology\" (in en). New England Journal of Medicine 348 (25): 2526\u20132534. doi:10.1056\/NEJMsa020847. ISSN 0028-4793. http:\/\/www.nejm.org\/doi\/abs\/10.1056\/NEJMsa020847 .   \n \n\n\u2191 Plebani, Mario; Bonini, Pierangelo (16 February 2002). \"Wrong biochemistry results. Interdepartmental cooperation may help avoid errors in medical laboratories\". BMJ (Clinical research ed.) 324 (7334): 423\u2013424. ISSN 1756-1833. PMID 11855391. https:\/\/pubmed.ncbi.nlm.nih.gov\/11855391 .   \n \n\n\u2191 Lippi, Giuseppe; Guidi, Gian Cesare (1 January 2007). \"Risk management in the preanalytical phase of laboratory testing\". Clinical Chemical Laboratory Medicine 45 (6). doi:10.1515\/CCLM.2007.167. https:\/\/www.degruyter.com\/document\/doi\/10.1515\/CCLM.2007.167\/html .   \n \n\n\u2191 Da Rin, Giorgio (1 June 2009). \"Pre-analytical workstations: A tool for reducing laboratory errors\" (in en). Clinica Chimica Acta 404 (1): 68\u201374. doi:10.1016\/j.cca.2009.03.024. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0009898109001454 .   \n \n\n\u2191 Gibbon, Gerst A. (1 May 1996). \"A brief history of LIMS\" (in en). Laboratory Automation & Information Management 32 (1): 1\u20135. doi:10.1016\/1381-141X(95)00024-K. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/1381141X9500024K .   \n \n\n\u2191 Goodman, N.; Rozen, S.; Stein, L. D. (1998). \"The LabFlow system for workflow management in large scale biology research laboratories\". Proceedings. International Conference on Intelligent Systems for Molecular Biology 6: 69\u201377. ISSN 1553-0833. PMID 9783211. https:\/\/pubmed.ncbi.nlm.nih.gov\/9783211 .   \n \n\n\u2191 49.0 49.1 Skobelev, D. O.; Zaytseva, T. M.; Kozlov, A. D.; Perepelitsa, V. L.; Makarova, A. S. (1 January 2011). \"Laboratory information management systems in the work of the analytic laboratory\" (in en). Measurement Techniques 53 (10): 1182\u20131189. doi:10.1007\/s11018-011-9638-7. ISSN 0543-1972. http:\/\/link.springer.com\/10.1007\/s11018-011-9638-7 .   \n \n\n\u2191 Casey, Eoghan (1 March 2020). \"Standardization of forming and expressing preliminary evaluative opinions on digital evidence\" (in en). Forensic Science International: Digital Investigation 32: 200888. doi:10.1016\/j.fsidi.2019.200888. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1742287619303147 .   \n \n\n\u2191 Sun, Dingzhong; Wu, Linhuan; Fan, Guomei (1 June 2021). \"Laboratory information management system for biosafety laboratory: Safety and efficiency\" (in en). Journal of Biosafety and Biosecurity 3 (1): 28\u201334. doi:10.1016\/j.jobb.2021.03.001. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2588933821000042 .   \n \n\n\u2191 52.0 52.1 52.2 52.3 Ho, Chao-Chung; Chen, Ming-Shu (1 January 2018). \"Risk assessment and quality improvement of liquid waste management in Taiwan University chemical laboratories\" (in en). Waste Management 71: 578\u2013588. doi:10.1016\/j.wasman.2017.09.029. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0956053X17306979 .   \n \n\n\u2191 Wurtz, N.; Papa, A.; Hukic, M.; Di Caro, A.; Leparc-Goffart, I.; Leroy, E.; Landini, M. P.; Sekeyova, Z. et al. (1 August 2016). \"Survey of laboratory-acquired infections around the world in biosafety level 3 and 4 laboratories\" (in en). European Journal of Clinical Microbiology & Infectious Diseases 35 (8): 1247\u20131258. doi:10.1007\/s10096-016-2657-1. ISSN 0934-9723. PMC PMC7088173. PMID 27234593. http:\/\/link.springer.com\/10.1007\/s10096-016-2657-1 .   \n \n\n\u2191 Kirwan, B. (1994). A guide to practical human reliability assessment. Bristol, PA: Taylor & Francis. ISBN 978-0-7484-0052-2.   \n \n\n\u2191 Lou, Amy H.; Elnenaei, Manal O.; Sadek, Irene; Thompson, Shauna; Crocker, Bryan D.; Nassar, Bassam A. (1 October 2017). \"Multiple pre- and post-analytical lean approaches to the improvement of the laboratory turnaround time in a large core laboratory\" (in en). Clinical Biochemistry 50 (15): 864\u2013869. doi:10.1016\/j.clinbiochem.2017.04.019. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0009912017303284 .   \n \n\n\u2191 McDonald, Michael J.; Rice, Daniel P.; Desai, Michael M. (1 March 2016). \"Sex speeds adaptation by altering the dynamics of molecular evolution\" (in en). Nature 531 (7593): 233\u2013236. doi:10.1038\/nature17143. ISSN 0028-0836. PMC PMC4855304. PMID 26909573. http:\/\/www.nature.com\/articles\/nature17143 .   \n \n\n\u2191 Yu, S.W.; Chou, K.S. (2001). Introduction to Chemical Process Safety. GauLih Book Co., Ltd.   \n \n\n\u2191 58.0 58.1 58.2 Oliveira Marques, Karuliny Cristie; Yoshida, Lucas Silva; Teixeira de Siqueira Neto, Abilio; Dias, Acires (2017). \"Risk analysis in chemistry laboratory\". Procceedings of the 24th ABCM International Congress of Mechanicl Engineering (ABCM). doi:10.26678\/ABCM.COBEM2017.COB17-1364. http:\/\/abcm.org.br\/anais-de-eventos\/COB17\/1364 .   \n \n\n\u2191 Raab, Stephen S. (1 May 2006). \"Improving Patient Safety Through Quality Assurance\" (in en). Archives of Pathology & Laboratory Medicine 130 (5): 633\u2013637. doi:10.5858\/2006-130-633-IPSTQA. ISSN 1543-2165. https:\/\/meridian.allenpress.com\/aplm\/article\/130\/5\/633\/459841\/Improving-Patient-Safety-Through-Quality-Assurance .   \n \n\n\u2191 Skinhoj, P; Soeby, M (1 April 1981). \"Viral hepatitis in Danish health care personnel, 1974-78.\" (in en). Journal of Clinical Pathology 34 (4): 408\u2013411. doi:10.1136\/jcp.34.4.408. ISSN 0021-9746. PMC PMC493301. PMID 7240429. http:\/\/jcp.bmj.com\/cgi\/doi\/10.1136\/jcp.34.4.408 .   \n \n\n\u2191 Hollensead, Sandra C.; Lockwood, William B.; Elin, Ronald J. (1 December 2004). \"Errors in pathology and laboratory medicine: Consequences and prevention\" (in en). Journal of Surgical Oncology 88 (3): 161\u2013181. doi:10.1002\/jso.20125. ISSN 0022-4790. https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/jso.20125 .   \n \n\n\u2191 U.S. Food and Drug Administration (2020). \"Investigations Operations Manual\". U.S. Food and Drug Administration. https:\/\/www.fda.gov\/inspections-compliance-enforcement-and-criminal-investigations\/inspection-references\/investigations-operations-manual .   \n \n\n\u2191 Chiozza, Maria Laura; Plebani, Mario (1 January 2006). \"Clinical Governance: from clinical risk management to continuous quality improvement\". Clinical Chemistry and Laboratory Medicine (CCLM) 44 (6). doi:10.1515\/CCLM.2006.127. ISSN 1434-6621. https:\/\/www.degruyter.com\/document\/doi\/10.1515\/CCLM.2006.127\/html .   \n \n\n\u2191 U.S. Chemical Safety Board (19 October 2011). \"Texas Tech University Chemistry Lab Explosion, No. 2010-05-I-TX\". U.S. Chemical Safety Board. https:\/\/www.csb.gov\/texas-tech-university-chemistry-lab-explosion\/ .   \n \n\n\u2191 Mortimer, Sharon T.; Mortimer, David (28 February 2015). Quality and Risk Management in the IVF Laboratory (2 ed.). Cambridge University Press. doi:10.1017\/cbo9781139680936. ISBN 978-1-139-68093-6. https:\/\/www.cambridge.org\/core\/product\/identifier\/9781139680936\/type\/book .   \n \n\n\u2191 Lemos, Jana\u00edna; Gaspar, Pedro D.; Lima, T\u00e2nia M. (17 August 2022). \"Environmental Risk Assessment and Management in Industry 4.0: A Review of Technologies and Trends\" (in en). Machines 10 (8): 702. doi:10.3390\/machines10080702. ISSN 2075-1702. https:\/\/www.mdpi.com\/2075-1702\/10\/8\/702 .   \n \n\n\u2191 van Rossum, Huub H. (17 November 2022). \"Technical quality assurance and quality control for medical laboratories: a review and proposal of a new concept to obtain integrated and validated QA\/QC plans\" (in en). Critical Reviews in Clinical Laboratory Sciences 59 (8): 586\u2013600. doi:10.1080\/10408363.2022.2088685. ISSN 1040-8363. https:\/\/www.tandfonline.com\/doi\/full\/10.1080\/10408363.2022.2088685 .   \n \n\n\u2191 Buratta, A. (1995). \"External quality assessment programs in Lombardy, Italy\". Annali dell'Istituto Superiore di Sanita 31 (1): 157\u201361. https:\/\/chemport-n.cas.org\/\/chemport-n\/?APP=ftslink&action=reflink&origin=npg&version=1.0&coi=1%3ACAS%3A528%3ADyaK2MXps1CrsL4%3D&md5=56d3b0432762c6ffc0cc078edf26b8a5 .   \n \n\n\u2191 Badrick, Tony (1 September 2021). \"Integrating quality control and external quality assurance\" (in en). Clinical Biochemistry 95: 15\u201327. doi:10.1016\/j.clinbiochem.2021.05.003. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0009912021001442 .   \n \n\n\u2191 World Health Organization (2016) (in en). WHO manual for organizing a national external quality assessment programme for health laboratories and other testing sites. Geneva: World Health Organization. ISBN 9789241549677. https:\/\/apps.who.int\/iris\/handle\/10665\/250117 .   \n \n\n\u2191 Libeer, Jean-Claude (2 April 2001). \"External quality assurance programmes in medical laboratories\" (in en). Accreditation and Quality Assurance 6 (4-5): 151\u2013153. doi:10.1007\/PL00013513. ISSN 0949-1775. http:\/\/link.springer.com\/10.1007\/PL00013513 .   \n \n\n\u2191 Sturgeon, Catharine (2013), Wheeler, Michael J., ed., \"External Quality Assessment Schemes for Immunoassays\" (in en), Hormone Assays in Biological Fluids (Totowa, NJ: Humana Press) 1065: 291\u2013305, doi:10.1007\/978-1-62703-616-0_19, ISBN 978-1-62703-615-3, https:\/\/link.springer.com\/10.1007\/978-1-62703-616-0_19 . Retrieved 2023-05-16   \n \n\n\u2191 73.0 73.1 73.2 73.3 Casey, Eoghan; Souvignet, Thomas R. (1 November 2020). \"Digital transformation risk management in forensic science laboratories\" (in en). Forensic Science International 316: 110486. doi:10.1016\/j.forsciint.2020.110486. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0379073820303480 .   \n \n\n\u2191 Dror, Itiel E. (20 April 2018). \"Biases in forensic experts\" (in en). Science 360 (6386): 243\u2013243. doi:10.1126\/science.aat8443. ISSN 0036-8075. https:\/\/www.science.org\/doi\/10.1126\/science.aat8443 .   \n \n\n\u2191 Dror, Itiel E. (1 June 2016). \"A hierarchy of expert performance.\" (in en). Journal of Applied Research in Memory and Cognition 5 (2): 121\u2013127. doi:10.1016\/j.jarmac.2016.03.001. ISSN 2211-369X. http:\/\/doi.apa.org\/getdoi.cfm?doi=10.1016\/j.jarmac.2016.03.001 .   \n \n\n\u2191 Dror, I. (2012) (in en). Cognitive bias in forensic science. pp. 43\u20135. doi:10.1036\/1097-8542.yb120321. https:\/\/www.accessscience.com\/content\/article\/aYB120321 .   \n \n\n\u2191 Kassin, Saul M.; Dror, Itiel E.; Kukucka, Jeff (1 March 2013). \"The forensic confirmation bias: Problems, perspectives, and proposed solutions.\" (in en). Journal of Applied Research in Memory and Cognition 2 (1): 42\u201352. doi:10.1016\/j.jarmac.2013.01.001. ISSN 2211-369X. http:\/\/doi.apa.org\/getdoi.cfm?doi=10.1016\/j.jarmac.2013.01.001 .   \n \n\n\u2191 Dror, Itiel E.; Stoel, Reinoud D. (2014), Bruinsma, Gerben; Weisburd, David, eds., \"Cognitive Forensics: Human Cognition, Contextual Information, and Bias\" (in en), Encyclopedia of Criminology and Criminal Justice (New York, NY: Springer New York): 353\u2013363, doi:10.1007\/978-1-4614-5690-2_147, ISBN 978-1-4614-5689-6, https:\/\/link.springer.com\/10.1007\/978-1-4614-5690-2_147 . Retrieved 2023-05-16   \n \n\n\u2191 Edmond, G.; Tangen, J. M.; Searston, R. A.; Dror, I. E. (1 March 2015). \"Contextual bias and cross-contamination in the forensic sciences: the corrosive implications for investigations, plea bargains, trials and appeals\" (in en). Law, Probability and Risk 14 (1): 1\u201325. doi:10.1093\/lpr\/mgu018. ISSN 1470-8396. https:\/\/academic.oup.com\/lpr\/article-lookup\/doi\/10.1093\/lpr\/mgu018 .   \n \n\n\u2191 Mianes, Rodrigo Le\u00e3o; ten Caten, Carla Schwengber (1 June 2017). \"Organisation of proficiency schemes by testing and calibration laboratories\" (in en). Accreditation and Quality Assurance 22 (3): 119\u2013123. doi:10.1007\/s00769-017-1260-1. ISSN 0949-1775. http:\/\/link.springer.com\/10.1007\/s00769-017-1260-1 .   \n \n\n\u2191 Tully, Gillian; Cohen, Neil; Compton, David; Davies, Gareth; Isbell, Roy; Watson, Tim (1 March 2020). \"Quality standards for digital forensics: Learning from experience in England & Wales\" (in en). Forensic Science International: Digital Investigation 32: 200905. doi:10.1016\/j.fsidi.2020.200905. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2666282519300374 .   \n \n\n\u2191 Burri, Xavier; Casey, Eoghan; Boll\u00e9, Timothy; Jaquet-Chiffelle, David-Olivier (1 June 2020). \"Chronological independently verifiable electronic chain of custody ledger using blockchain technology\" (in en). Forensic Science International: Digital Investigation 33: 300976. doi:10.1016\/j.fsidi.2020.300976. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2666281720300780 .   \n \n\n\u2191 Jaquet-Chiffelle, David-Olivier; Casey, Eoghan; Bourquenoud, Jonathan (1 June 2020). \"Tamperproof timestamped provenance ledger using blockchain technology\" (in en). Forensic Science International: Digital Investigation 33: 300977. doi:10.1016\/j.fsidi.2020.300977. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2666281720300834 .   \n \n\n\u2191 Murray, D. (20 March 2015). \"Queensland authorities confirm \u2018miscode\u2019 affects DNA evidence in criminal cases\". The Courier Mail. https:\/\/www.couriermail.com.au\/news\/queensland\/queensland-authorities-confirm-miscode-affects-dna-evidence-in-criminal-cases\/news-story\/833c580d3f1c59039efd1a2ef55af92b . Retrieved 10 November 2022 .   \n \n\n\u2191 Margagliotti, Giulia; Boll\u00e9, Timothy (1 May 2019). \"Machine learning & forensic science\" (in en). Forensic Science International 298: 138\u2013139. doi:10.1016\/j.forsciint.2019.02.045. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0379073819300726 .   \n \n\n\nNotes \nThis presentation is faithful to the original, with changes to presentation, spelling, and grammar as needed. The PMCID and DOI were added when they were missing from the original reference.\n\n\n\n\n\nSource: <a rel=\"external_link\" class=\"external\" href=\"https:\/\/www.limswiki.org\/index.php\/Journal:Identifying_risk_management_challenges_in_laboratories\">https:\/\/www.limswiki.org\/index.php\/Journal:Identifying_risk_management_challenges_in_laboratories<\/a>\nCategories: LIMSwiki journal articles (added in 2023)LIMSwiki journal articles (all)LIMSwiki journal articles on laboratory managementLIMSwiki journal articles on quality managementNavigation menuPage actionsJournalDiscussionView sourceHistoryPage actionsJournalDiscussionMoreToolsIn other languagesPersonal toolsLog inNavigationMain pageEncyclopedic articlesRecent changesRandom pageHelp about MediaWikiSearch\u00a0 ToolsWhat links hereRelated changesSpecial pagesPermanent linkPage informationPopular publications\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\nPrint\/exportCreate a bookDownload as PDFDownload as PDFDownload as Plain textPrintable version This page was last edited on 16 May 2023, at 15:43.Content is available under a Creative Commons Attribution-ShareAlike 4.0 International License unless otherwise noted.This page has been accessed 160 times.Privacy policyAbout LIMSWikiDisclaimers\n\n\n\n","e100dcbf45911d7ebdcd67493dc727aa_html":"<body class=\"mediawiki ltr sitedir-ltr mw-hide-empty-elt ns-206 ns-subject page-Journal_Identifying_risk_management_challenges_in_laboratories rootpage-Journal_Identifying_risk_management_challenges_in_laboratories skin-monobook action-view skin--responsive\"><div id=\"rdp-ebb-globalWrapper\"><div id=\"rdp-ebb-column-content\"><div id=\"rdp-ebb-content\" class=\"mw-body\" role=\"main\"><a id=\"rdp-ebb-top\"><\/a>\n<h1 id=\"rdp-ebb-firstHeading\" class=\"firstHeading\" lang=\"en\">Journal:Identifying risk management challenges in laboratories<\/h1><div id=\"rdp-ebb-bodyContent\" class=\"mw-body-content\"><!-- start content --><div id=\"rdp-ebb-mw-content-text\" lang=\"en\" dir=\"ltr\" class=\"mw-content-ltr\"><div class=\"mw-parser-output\">\n\n\n<h2><span class=\"mw-headline\" id=\"Abstract\">Abstract<\/span><\/h2>\n<p>Over the years, <a href=\"https:\/\/www.limswiki.org\/index.php\/Risk_management\" title=\"Risk management\" class=\"wiki-link\" data-key=\"ecfbfb2550c23f053bd1aa0d9ea63e4e\">risk management<\/a> has gained significant importance in <a href=\"https:\/\/www.limswiki.org\/index.php\/Laboratory\" title=\"Laboratory\" class=\"wiki-link\" data-key=\"c57fc5aac9e4abf31dccae81df664c33\">laboratories<\/a> of every kind. The safety of workers, the <a href=\"https:\/\/www.limswiki.org\/index.php\/Accuracy_and_precision\" title=\"Accuracy and precision\" class=\"wiki-link\" data-key=\"01054809355a4274218669b103876930\">accuracy<\/a> and reliability of laboratory results, issues of financial sustainability, and protection of the environment play an important role in decision-making in both industry and service-based labs. In order for a laboratory to be considered reliable and safe, and therefore competitive, it is recommended to comply with the requirements of international standards and other <a href=\"https:\/\/www.limswiki.org\/index.php\/Regulatory_compliance\" title=\"Regulatory compliance\" class=\"wiki-link\" data-key=\"7dbc9be278a8efda25a4b592ee6ef0ca\">regulatory documents<\/a>, as well as use tools and risk management procedures. \n<\/p><p>In this paper, <a href=\"https:\/\/www.limswiki.org\/index.php\/Information\" title=\"Information\" class=\"wiki-link\" data-key=\"6300a14d9c2776dcca0999b5ed940e7d\">information<\/a> is summarized concerning the terms \u201crisk\u201d and \u201crisk management,\u201d which are then approached through the latest <a href=\"https:\/\/www.limswiki.org\/index.php\/International_Organization_for_Standardization\" title=\"International Organization for Standardization\" class=\"wiki-link\" data-key=\"116defc5d89c8a55f5b7c1be0790b442\">International Organization for Standardization<\/a> (ISO) standard <a href=\"https:\/\/www.limswiki.org\/index.php\/ISO_9000\" title=\"ISO 9000\" class=\"wiki-link\" data-key=\"53ace2d12e80a7d890ce881bc6fe244a\">ISO 9001<\/a>, <a href=\"https:\/\/www.limswiki.org\/index.php\/ISO\/IEC_17025\" title=\"ISO\/IEC 17025\" class=\"wiki-link\" data-key=\"0a89cebb34370dd860cce86881cbf29c\">ISO\/IEC 17025<\/a>, and <a href=\"https:\/\/www.limswiki.org\/index.php\/ISO_14000\" title=\"ISO 14000\" class=\"wiki-link\" data-key=\"3ab61ccf84b43bb050f057e5426c1e2b\">ISO 14001<\/a> standards. The process of risk management based on the ISO 31000 standard is described, and the options for treatment and the techniques that can be applied in the risk management process based on the latest ISO 31010 standard are grouped and indicated. Additionally, a literature review examines the reasons that have led laboratories to integrate risk management techniques into their <a href=\"https:\/\/www.limswiki.org\/index.php\/Quality_management_system\" title=\"Quality management system\" class=\"wiki-link\" data-key=\"dfecf3cd6f18d4a5e9ac49ca360b447d\">quality management systems<\/a>, the most common mistakes that occur in the various phases of laboratory tests, their causes, and their consequences, as well as the proposed treatments. The aim of this work is to highlight significant challenges concerning the need to implement management procedures in the daily routine, while warning, raising awareness of, and informing about existing risk management methods that can be implemented, methodologically and technically, to laboratories, under internationally recognized and updated standards.\n<\/p><p><b>Keywords<\/b>: risk-based thinking, risk management, risk assessment techniques, laboratories, control measures\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Introduction\">Introduction<\/span><\/h2>\n<p>The issue of <a href=\"https:\/\/www.limswiki.org\/index.php\/Risk_management\" title=\"Risk management\" class=\"wiki-link\" data-key=\"ecfbfb2550c23f053bd1aa0d9ea63e4e\">risk management<\/a> has existed for thousands of years.<sup id=\"rdp-ebb-cite_ref-1\" class=\"reference\"><a href=\"#cite_note-1\">[1]<\/a><\/sup> The first noted practice of risk management is in the Tigris-Euphrates valley in 3200 BC by the A\u0161ipu, who are considered to be, among others, an early example of risk management consultants.<sup id=\"rdp-ebb-cite_ref-:0_2-0\" class=\"reference\"><a href=\"#cite_note-:0-2\">[2]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-3\" class=\"reference\"><a href=\"#cite_note-3\">[3]<\/a><\/sup> The A\u0161ipu carried out risk analysis for each alternative action related to the risky event to be studied, and after the completion of the analysis they proposed the most favorable alternative. The last step was to issue a final report engraved on a clay tablet that was given to the customer.<sup id=\"rdp-ebb-cite_ref-4\" class=\"reference\"><a href=\"#cite_note-4\">[4]<\/a><\/sup>\n<\/p><p>The difference between modern risk analysts and the A\u0161ipu of ancient Babylon is that the former express their results as mathematical probabilities and intervals of confidence, while the latter with certainty, confidence, and power. However, to determine the causal relationship between cause and effect, both the ancient ancestors and current researchers rely on observational methods.<sup id=\"rdp-ebb-cite_ref-:0_2-1\" class=\"reference\"><a href=\"#cite_note-:0-2\">[2]<\/a><\/sup> After World War II, large companies with diversified portfolios of physical assets began to develop self-insurance, which covered the financial consequences of an adverse event or accidental losses.<sup id=\"rdp-ebb-cite_ref-5\" class=\"reference\"><a href=\"#cite_note-5\">[5]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-6\" class=\"reference\"><a href=\"#cite_note-6\">[6]<\/a><\/sup> Modern risk management was implemented after 1955 and was first applied in the insurance industry.<sup id=\"rdp-ebb-cite_ref-7\" class=\"reference\"><a href=\"#cite_note-7\">[7]<\/a><\/sup>\n<\/p><p>The English term \u201crisk\u201d comes from the Greek word \u201crhiza,\u201d which refers to the dangers of sailing around a cliff.<sup id=\"rdp-ebb-cite_ref-:0_2-2\" class=\"reference\"><a href=\"#cite_note-:0-2\">[2]<\/a><\/sup> According to Kumamoto and Henley<sup id=\"rdp-ebb-cite_ref-8\" class=\"reference\"><a href=\"#cite_note-8\">[8]<\/a><\/sup>, the term \u201crisk\u201d is defined as a combination of five factors: probability, outcome, significance, causal scenario, and affected population. As far as a <a href=\"https:\/\/www.limswiki.org\/index.php\/Laboratory\" title=\"Laboratory\" class=\"wiki-link\" data-key=\"c57fc5aac9e4abf31dccae81df664c33\">laboratory<\/a> is concerned, \u201crisk\u201d is the probability of a laboratory error which may have adverse consequences<sup id=\"rdp-ebb-cite_ref-:1_9-0\" class=\"reference\"><a href=\"#cite_note-:1-9\">[9]<\/a><\/sup>, as it includes factors that threaten health and safety of staff, environment, organization's facilities, organization's financial sustainability, operational productivity, and service quality.<sup id=\"rdp-ebb-cite_ref-:2_10-0\" class=\"reference\"><a href=\"#cite_note-:2-10\">[10]<\/a><\/sup> Therefore, for testing laboratories, as risk can be considered the inability to meet customer needs, the provision of incorrect analytical results and failure to meet accreditation requirements damage laboratory's reputation.<sup id=\"rdp-ebb-cite_ref-:3_11-0\" class=\"reference\"><a href=\"#cite_note-:3-11\">[11]<\/a><\/sup>\n<\/p><p>Plebani<sup id=\"rdp-ebb-cite_ref-:4_12-0\" class=\"reference\"><a href=\"#cite_note-:4-12\">[12]<\/a><\/sup> defines risk management as the process by which risk is assessed and strategies are developed to manage it. The goal of any risk management process is to identify, evaluate, address, and reduce the risk to an acceptable level.<sup id=\"rdp-ebb-cite_ref-:5_13-0\" class=\"reference\"><a href=\"#cite_note-:5-13\">[13]<\/a><\/sup> According to Dikmen <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-:6_14-0\" class=\"reference\"><a href=\"#cite_note-:6-14\">[14]<\/a><\/sup>, risk management involves identifying sources of uncertainty (<a href=\"https:\/\/www.limswiki.org\/index.php\/Risk_assessment\" title=\"Risk assessment\" class=\"wiki-link\" data-key=\"e06196a3e3b70b62af61a54e93579f37\">risk identification<\/a>) and assessing the consequences of uncertain events\/conditions (risk analysis), thus creating response strategies based on expected results and, finally, based on the feedback received from the actual results and the emerging risk, the steps of identification, analysis and repetitive response events are performed throughout the life cycle of a project to ensure that the project objectives are achieved. Kang <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-15\" class=\"reference\"><a href=\"#cite_note-15\">[15]<\/a><\/sup> define risk management as an act of classification, analysis, and response to unforeseen risks, which are involved during the implementation of a project. Risk management involves maximizing the opportunity and impact of positive events and reducing the likelihood and impact of negative events to achieve the project objectives.\n<\/p><p>The concept of risk is already known to laboratories as it was indirectly included and in previous versions of <a href=\"https:\/\/www.limswiki.org\/index.php\/International_Organization_for_Standardization\" title=\"International Organization for Standardization\" class=\"wiki-link\" data-key=\"116defc5d89c8a55f5b7c1be0790b442\">International Organization for Standardization<\/a> (ISO) standard <a href=\"https:\/\/www.limswiki.org\/index.php\/ISO_9000\" title=\"ISO 9000\" class=\"wiki-link\" data-key=\"53ace2d12e80a7d890ce881bc6fe244a\">ISO 9001<\/a> and, mainly via preventive measures to eliminate possible non-compliances and prevent their recurrence (i.e., ISO 9001:2008<sup id=\"rdp-ebb-cite_ref-16\" class=\"reference\"><a href=\"#cite_note-16\">[16]<\/a><\/sup>, <a href=\"https:\/\/www.limswiki.org\/index.php\/ISO\/IEC_17025\" title=\"ISO\/IEC 17025\" class=\"wiki-link\" data-key=\"0a89cebb34370dd860cce86881cbf29c\">ISO\/IEC 17025:2005<\/a><sup id=\"rdp-ebb-cite_ref-17\" class=\"reference\"><a href=\"#cite_note-17\">[17]<\/a><\/sup>). In the new versions of ISO 9001:2015<sup id=\"rdp-ebb-cite_ref-18\" class=\"reference\"><a href=\"#cite_note-18\">[18]<\/a><\/sup> and ISO\/IEC 17025:2017<sup id=\"rdp-ebb-cite_ref-:7_19-0\" class=\"reference\"><a href=\"#cite_note-:7-19\">[19]<\/a><\/sup>, however, the presence of risk-based thinking is more pronounced and imperative.\n<\/p><p>As the revised version of ISO\/IEC 17025 is in line with ISO 9001 in terms of management requirements, a laboratory should examine the impact of threats as well as seize opportunities to increase management system efficiency to achieve improved results and to avoid negative effects.<sup id=\"rdp-ebb-cite_ref-:8_20-0\" class=\"reference\"><a href=\"#cite_note-:8-20\">[20]<\/a><\/sup> There is no longer a separate clause on preventive measures, and the concept of preventive action is expressed through the application of the risk and opportunities approach. The concept of risk is implied in each paragraph of the standard related to the factors that affect the validity of the results. Such factors are staff, facilities, environmental conditions, equipment, metrological traceability, technical records, etc. In addition, the creation of a formal risk management system is not a requirement of the standard, but each laboratory can choose the approach which is satisfactory and can be implemented for its needs.<sup id=\"rdp-ebb-cite_ref-:7_19-1\" class=\"reference\"><a href=\"#cite_note-:7-19\">[19]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-:8_20-1\" class=\"reference\"><a href=\"#cite_note-:8-20\">[20]<\/a><\/sup>\n<\/p><p>The revised ISO 14001<sup id=\"rdp-ebb-cite_ref-:8_20-2\" class=\"reference\"><a href=\"#cite_note-:8-20\">[20]<\/a><\/sup> is also in line with ISO 9001. Risk-based thinking provides a structured approach to managing environmental issues that are likely to affect the organization. Identifying environmental risks and potential opportunities is vital to an organization's success.\n<\/p><p>Finally, in ISO 31000:2018<sup id=\"rdp-ebb-cite_ref-21\" class=\"reference\"><a href=\"#cite_note-21\">[21]<\/a><\/sup>, risk management is considered to be the coordinated activities carried out for the management and control of an organization in relation to risk. Therefore, in order for a laboratory to comply with the new versions of the standards, it is important to understand the risk-based thinking and to examine the functions, procedures, and activities related to risks and opportunities. To address the concern, this paper aims to explore the implementation of a risk-based thinking framework in testing or <a href=\"https:\/\/www.limswiki.org\/index.php\/Calibration_laboratory\" class=\"mw-redirect wiki-link\" title=\"Calibration laboratory\" data-key=\"d10028ed3743b40b00d657d2121ded53\">calibration laboratories<\/a> and highlight the challenges that arise as part of that implementation.\n<\/p>\n<h2><span class=\"mw-headline\" id=\"The_risk_management_process\">The risk management process<\/span><\/h2>\n<p>The risk management process can be applied at all levels of an organization, from strategy to project implementation. In addition, it must be an integral part of management and decision making and integrated into the structure, functions, and processes of the organization.<sup id=\"rdp-ebb-cite_ref-:1_9-1\" class=\"reference\"><a href=\"#cite_note-:1-9\">[9]<\/a><\/sup> The integrated risk management process relies on a well-structured risk-based thinking which encompasses the whole <a href=\"https:\/\/www.limswiki.org\/index.php\/Quality_management_system\" title=\"Quality management system\" class=\"wiki-link\" data-key=\"dfecf3cd6f18d4a5e9ac49ca360b447d\">quality management system<\/a> (QMS).\n<\/p><p>In this context, the risk assessment stage consists of three sub-stages: risk identification, risk analysis, and risk evaluation. The purpose of risk identification is to find, recognize, and describe the risks that positively or negatively affect the achievement of the objectives of the organization, even those whose sources are not under its control.<sup id=\"rdp-ebb-cite_ref-:1_9-2\" class=\"reference\"><a href=\"#cite_note-:1-9\">[9]<\/a><\/sup> According to Elkington and Smallman<sup id=\"rdp-ebb-cite_ref-:9_22-0\" class=\"reference\"><a href=\"#cite_note-:9-22\">[22]<\/a><\/sup>, risk identification is the most important phase of risk analysis, and emphasis is given in the fact that potential risks should be identified at each stage. Hallikas <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-23\" class=\"reference\"><a href=\"#cite_note-23\">[23]<\/a><\/sup> also state that the identification phase is fundamental to implement risk management, as by recognizing sources of risk, future uncertainties can be identified, and preventive measures can be taken. During risk analysis, the impact of a risk is assessed while during risk evaluation any additional action is determined.\n<\/p><p>After completing the risk assessment stage, the risk is addressed by avoiding risk, taking or increasing risk to pursue an opportunity, removing the risk source, changing the likelihood, changing the consequences, sharing the risk (e.g., through contracts, insurance), or maintaining the risk with a documented decision. All the above steps should be monitored and reviewed to ensure and improve the <a href=\"https:\/\/www.limswiki.org\/index.php\/Quality_(business)\" title=\"Quality (business)\" class=\"wiki-link\" data-key=\"c4ac43430d1c3a3a15d1255257aaea37\">quality<\/a> and effectiveness of risk management. The results of the process should be recorded and reported throughout the organization to provide information for decision making, for the improvement of risk management activities and for the interaction with stakeholders.<sup id=\"rdp-ebb-cite_ref-:1_9-3\" class=\"reference\"><a href=\"#cite_note-:1-9\">[9]<\/a><\/sup>\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Risk_assessment_techniques\">Risk assessment techniques<\/span><\/h2>\n<p>Risk assessment\u2014which is often expressed in relation to sources, possible events, consequences, and likelihood\u2014can be a very difficult process, especially when these relationships are complex. A variety of risk assessment techniques is depicted in Table 1. Though the choice of techniques is not random, some factors must be first taken into account, such as the purpose of the assessment, the needs of stakeholders, any legal, regulatory and contractual requirements, the operating environment and the scenario, how much important is the decision to be made, any defined decision criteria and their form, the time available before a decision is made, the given information and expertise, and the complexity of the situation.<sup id=\"rdp-ebb-cite_ref-:10_24-0\" class=\"reference\"><a href=\"#cite_note-:10-24\">[24]<\/a><\/sup>\n<\/p>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table class=\"wikitable\" border=\"1\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td colspan=\"2\" style=\"background-color:white; padding-left:10px; padding-right:10px;\"><b>Table 1.<\/b> Risk assessment techniques\n<\/td><\/tr>\n<tr>\n<th style=\"background-color:#e2e2e2; padding-left:10px; padding-right:10px;\">Technique for ...\n<\/th>\n<th style=\"background-color:#e2e2e2; padding-left:10px; padding-right:10px;\">Examples\n<\/th><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Eliciting views\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Brainstorming, Delfi technique, nominal group technique, structural or semi-structural interviews, surveys\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Identifying risk\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Checklists, classifications, and taxonomies; failure modes and effects analysis (FMEA); failure modes, effects, and criticality analysis (FMECA); hazard and operability analysis (HAZOP); scenario analysis; structured what-if technique (SWIFT)\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Determining sources, causes, and drivers of risk\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Cindynic approach, Ishikawa analysis\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Analyzing controls\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Bow tie analysis, hazard analysis and critical control points (HACCP), layers of protection analysis (LOPA)\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Understanding consequences and likelihood\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Bayesian analysis, Bayesian network and influence diagrams, business impact analysis, cause-consequence analysis, event tree analysis, fault tree analysis, human reliability analysis, Markov analysis, Monte Carlo simulation, Privacy impact analysis\/data protection impact analysis\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Analyzing dependencies and interactions\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Causal mapping, cross impact analysis\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Provide a measure of risk\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Toxicological risk assessment, value at risk, conditional value at risk or expected shortfall\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Evaluating the significance of risk\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">As low as reasonably practicable (ALARP)\/so far as is reasonably practicable (SFAIRP), frequency-number diagrams, Pareto chart, reliability centered maintenance, risk indices\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Selecting between options\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Cost\/benefit analysis, decision tree analysis, game theory, multi-criteria analysis\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Reporting and recording\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Risk registers, consequence\/likelihood matrix, S-curves\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<p>The most used techniques for identifying risk are the failure modes and effects analysis (FMEA), as well as the failure modes, effects, and criticality analysis (FMECA). FMEA\/FMECA can be applied at all levels of an organization and performed at any level of analysis of a system, from block diagrams to detailed elements of a system or steps of a process.<sup id=\"rdp-ebb-cite_ref-25\" class=\"reference\"><a href=\"#cite_note-25\">[25]<\/a><\/sup> This fact leads to several sub-types of FMEA such as system FMEA, design FMEA, process FMEA, and service delivery FMEA. As defined by its name, FMEA is a systematic method designed to identify potential failure modes for a product or process before it occurs and to assess the risk. In FMEA, the system or process under consideration is broken down into individual components. For each element, the ways in which it may fail, the causes and effects of failure are examined. FMECA is a FMEA followed by criticality analysis, which means that for each failure its importance is also assessed. The calculation of the risk in FMEA method includes the multiplication of the three risk parameters severity (S), occurrence (O), and detection (D) in order to produce a risk priority number (RPN, RPN\u2009=\u2009S\u2009\u00d7\u2009O\u2009\u00d7\u2009D). However, in FMECA, failure modes are classified by their criticality.<sup id=\"rdp-ebb-cite_ref-26\" class=\"reference\"><a href=\"#cite_note-26\">[26]<\/a><\/sup> A quantitative measure of criticality can be derived from actual failure rates and a quantitative measure of consequences, if known. FMEA can be used to provide information for analysis to other techniques such as fault tree analysis (FTA). FTA is a commonly used technique for understanding consequences and likelihood of risk. It is a logic diagram that represents the relationships between an adverse event, which is typically a system failure, and the causes of the event which are the component of failure. It uses logic gates and events to model the above-mentioned relationships. FTA can be used both qualitatively to identify the potential causes and pathways to the peak event and quantitatively to calculate the probability that the peak event will occur.<sup id=\"rdp-ebb-cite_ref-27\" class=\"reference\"><a href=\"#cite_note-27\">[27]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-28\" class=\"reference\"><a href=\"#cite_note-28\">[28]<\/a><\/sup>\n<\/p><p>Another technique which is commonly used in organizations is failure reporting, analysis and corrective action system (FRACAS). It is a technique for identifying and correcting identfied deficiencies in a system or a product and, thus, prevent further occurrence of them.<sup id=\"rdp-ebb-cite_ref-29\" class=\"reference\"><a href=\"#cite_note-29\">[29]<\/a><\/sup> It is based upon the systematic reporting and analysis of failures, making maintenance of historical data a crucial issue. It is also necessary for the organization to have a database management system. The database is established to store all the required data, which include records on all reported failures, failure analyses, and corrective actions.<sup id=\"rdp-ebb-cite_ref-30\" class=\"reference\"><a href=\"#cite_note-30\">[30]<\/a><\/sup>\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Risk_identification_and_treatment_in_laboratories\">Risk identification and treatment in laboratories<\/span><\/h2>\n<p>Risk identification is the first and most important phase of risk management.<sup id=\"rdp-ebb-cite_ref-:9_22-1\" class=\"reference\"><a href=\"#cite_note-:9-22\">[22]<\/a><\/sup> In the identification phase, the possible sources of risk which concern the entire activity of the laboratory are recorded.<sup id=\"rdp-ebb-cite_ref-31\" class=\"reference\"><a href=\"#cite_note-31\">[31]<\/a><\/sup>\n<\/p><p>To identify potential sources of risk associated with the testing process, laboratories should create a process map outlining the steps in the testing process from generating the request for test to reporting the testing result. This map should include all stages of the pre-analytical, analytical, and post-analytical process.<sup id=\"rdp-ebb-cite_ref-:2_10-1\" class=\"reference\"><a href=\"#cite_note-:2-10\">[10]<\/a><\/sup> An example of such a map is given in Fig. 1.\n<\/p><p><br \/>\n<\/p><p><a href=\"https:\/\/www.limswiki.org\/index.php\/File:Fig1_Tziakou_AccredQualAss23_28-3.png\" class=\"image wiki-link\" data-key=\"ccb2de00c013655c8f72460573287462\"><img alt=\"Fig1 Tziakou AccredQualAss23 28-3.png\" src=\"https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/f\/f9\/Fig1_Tziakou_AccredQualAss23_28-3.png\" decoding=\"async\" style=\"width: 100%;max-width: 400px;height: auto;\" \/><\/a>\n<\/p>\n<div style=\"clear:both;\"><\/div>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table border=\"0\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><blockquote><p><b>Figure 1.<\/b> Process map of the main functions of a testing laboratory.<sup id=\"rdp-ebb-cite_ref-:2_10-2\" class=\"reference\"><a href=\"#cite_note-:2-10\">[10]<\/a><\/sup><\/p><\/blockquote>\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<p>According to the research of both Plebani and Carraro<sup id=\"rdp-ebb-cite_ref-:11_32-0\" class=\"reference\"><a href=\"#cite_note-:11-32\">[32]<\/a><\/sup> and Plebani<sup id=\"rdp-ebb-cite_ref-:4_12-1\" class=\"reference\"><a href=\"#cite_note-:4-12\">[12]<\/a><\/sup>, most errors occur during the pre-analytical stages, ranging between 46 to 68%, followed by post-analytical errors, ranging from 19 to 47%, while during the analytical stage the fewest errors occur, ranging from 7 to 13%. Table 2 outlines the main sources of risk in each of these three stages.\n<\/p>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table class=\"wikitable\" border=\"1\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td colspan=\"4\" style=\"background-color:white; padding-left:10px; padding-right:10px;\"><b>Table 2.<\/b> The main sources of risk during the pre-analytical, analytical, and post-analytical stage in a laboratory\n<\/td><\/tr>\n<tr>\n<th colspan=\"3\" style=\"background-color:#e2e2e2; padding-left:10px; padding-right:10px;\">Main sources of risk during the ...\n<\/th>\n<th rowspan=\"2\" style=\"background-color:#e2e2e2; padding-left:10px; padding-right:10px;\">References\n<\/th><\/tr>\n<tr>\n<th style=\"background-color:#e2e2e2; padding-left:10px; padding-right:10px;\">Pre-analytical stage\n<\/th>\n<th style=\"background-color:#e2e2e2; padding-left:10px; padding-right:10px;\">Analytical stage\n<\/th>\n<th style=\"background-color:#e2e2e2; padding-left:10px; padding-right:10px;\">Post-analytical stage\n<\/th><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\u2022 Incorrect <a href=\"https:\/\/www.limswiki.org\/index.php\/Sample_(material)\" title=\"Sample (material)\" class=\"wiki-link\" data-key=\"7f8cd41a077a88d02370c02a3ba3d9d6\">sample<\/a> identification<br \/>\u2022 Absence of sample identification<br \/>\u2022 Incorrect sample labeling<br \/>\u2022 Insufficient homogenization of the sample<br \/>\u2022 Incorrect sampling<br \/>\u2022 Improper sampling container or sample storage<br \/>\u2022 Inadequate transport conditions<br \/>\u2022 Non-compliant sample<br \/>\u2022 Sample contamination<br \/>\u2022 Absence of sample or inappropriate test request<br \/>\u2022 Insufficient sample<br \/>\u2022 Inadequate storage of chemicals<br \/>\u2022 Improper transport of chemicals<br \/>\u2022 Missing or destroyed sample\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\u2022 Procedural non-conformity<br \/>\u2022 Wrong test<br \/>\u2022 Use of expired reagents<br \/>\u2022 Improper use of reagents<br \/>\u2022 Equipment malfunction<br \/>\u2022 Equipment failure<br \/>\u2022 Incorrect equipment calibration<br \/>\u2022 Incorrect sample dilutions<br \/>\u2022 Mixing samples<br \/>\u2022 Deviation in the results of the internal control sample<br \/>\u2022 Incorrect calculation of dilution factor<br \/>\u2022 Delay in sample analysis<br \/>\u2022 Unspecified <a href=\"https:\/\/www.limswiki.org\/index.php\/Quality_control\" title=\"Quality control\" class=\"wiki-link\" data-key=\"1e0e0c2eb3e45aff02f5d61799821f0f\">quality control<\/a> (QC) failure<br \/>\u2022 Improper management of chemicals<br \/>\u2022 Inadequate disposal of chemicals<br \/>\u2022 Inadequate disposal and management of liquid waste\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\u2022 Incorrect results<br \/>\u2022 Incorrect entry of results or related entry in the <a href=\"https:\/\/www.limswiki.org\/index.php\/Laboratory_information_management_system\" title=\"Laboratory information management system\" class=\"wiki-link\" data-key=\"8ff56a51d34c9b1806fcebdcde634d00\">laboratory information management system<\/a> (LIMS)<br \/>\u2022 Send results to another customer<br \/>\u2022 Ambiguous way of communicating the results<br \/>\u2022 Lack of information about the limits regarding the interpretation of the results<br \/>\u2022 Delayed reporting of results\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><sup id=\"rdp-ebb-cite_ref-:2_10-3\" class=\"reference\"><a href=\"#cite_note-:2-10\">[10]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-:5_13-1\" class=\"reference\"><a href=\"#cite_note-:5-13\">[13]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-:11_32-1\" class=\"reference\"><a href=\"#cite_note-:11-32\">[32]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-33\" class=\"reference\"><a href=\"#cite_note-33\">[33]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-:12_34-0\" class=\"reference\"><a href=\"#cite_note-:12-34\">[34]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-:13_35-0\" class=\"reference\"><a href=\"#cite_note-:13-35\">[35]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-:14_36-0\" class=\"reference\"><a href=\"#cite_note-:14-36\">[36]<\/a><\/sup>\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<p>After completing the risk assessment stage, the laboratory is asked to select an appropriate treatment to maintain the risk at an acceptable level.<sup id=\"rdp-ebb-cite_ref-:15_37-0\" class=\"reference\"><a href=\"#cite_note-:15-37\">[37]<\/a><\/sup> The measures taken should be monitored for their effectiveness to evaluate the success of any failure reduction effort. This evaluation is achieved by monitoring the values of the quality indicators set by the laboratory.<sup id=\"rdp-ebb-cite_ref-:13_35-1\" class=\"reference\"><a href=\"#cite_note-:13-35\">[35]<\/a><\/sup> Examples of quality indicators are given in Table 3. According to Lippi <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-38\" class=\"reference\"><a href=\"#cite_note-38\">[38]<\/a><\/sup>, the most effective strategy to reduce uncertainties in <a href=\"https:\/\/www.limswiki.org\/index.php\/Reference_laboratory\" title=\"Reference laboratory\" class=\"wiki-link\" data-key=\"f719f408e1660f86b53857eef2f13f32\">diagnostic laboratories<\/a> is to develop and implement an integrated QMS. The success of efforts to reduce errors must be monitored to assess the effectiveness of the measures taken.<sup id=\"rdp-ebb-cite_ref-39\" class=\"reference\"><a href=\"#cite_note-39\">[39]<\/a><\/sup>\n<\/p>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table class=\"wikitable\" border=\"1\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td colspan=\"4\" style=\"background-color:white; padding-left:10px; padding-right:10px;\"><b>Table 3.<\/b> Examples of pre-analytical indicators and their mathematical formulas\n<\/td><\/tr>\n<tr>\n<th style=\"background-color:#e2e2e2; padding-left:10px; padding-right:10px;\">Quality indicator\n<\/th>\n<th style=\"background-color:#e2e2e2; padding-left:10px; padding-right:10px;\">Mathematical formula\n<\/th>\n<th style=\"background-color:#e2e2e2; padding-left:10px; padding-right:10px;\">References\n<\/th><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Error in sample identification\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Number of samples with incorrect sample recording\u2009\u00d7\u2009100\/Total number of samples\n<\/td>\n<td rowspan=\"9\" style=\"background-color:white; padding-left:10px; padding-right:10px;\"><sup id=\"rdp-ebb-cite_ref-:15_37-1\" class=\"reference\"><a href=\"#cite_note-:15-37\">[37]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-40\" class=\"reference\"><a href=\"#cite_note-40\">[40]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-41\" class=\"reference\"><a href=\"#cite_note-41\">[41]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-42\" class=\"reference\"><a href=\"#cite_note-42\">[42]<\/a><\/sup>\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Error in sample transcription\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Number of requests with incorrect data logging (incorrect test)\u2009\u00d7\u2009100\/Total number of requests\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Wrong container\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Number of wrong containers for each sample type\u2009\u00d7\u2009100\/Total number of requests\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Insufficient sample\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Number of samples with insufficient quantity\u2009\u00d7\u2009100\/Total number of samples\n<\/td><\/tr>\n<tr>\n<td rowspan=\"5\" style=\"background-color:white; padding-left:10px; padding-right:10px;\">Inappropriate transport and storage conditions\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Number of samples with inappropriate storage conditions before analysis\u2009\u00d7\u2009100\/Total number of samples\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Number of samples missing during transport\u2009\u00d7\u2009100\/Total number of samples\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Number of samples destroyed during transport\u2009\u00d7\u2009100\/Total number of samples\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Number of samples with improper temperature during transport\u2009\u00d7\u2009100\/Total number of samples\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Number of samples with extended transfer time\u2009\u00d7\u2009100\/Total number of samples\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<p>Possible risks in laboratories are identified below in more detail along with their appropriate treatment.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Sample\">Sample<\/span><\/h3>\n<p>Samples are the items sent by customers to the laboratory for testing or <a href=\"https:\/\/www.limswiki.org\/index.php\/Calibration_laboratory\" class=\"mw-redirect wiki-link\" title=\"Calibration laboratory\" data-key=\"d10028ed3743b40b00d657d2121ded53\">calibration<\/a> in order for detailed and reliable results to be provided in a predefined time scale. Therefore, the consequences can be serious if there is loss or any other inconsistency with the samples, their analysis, and related procedures. Normally, samples taken from the laboratory go through a sampling process prior to analytical procedures. Heterogeneous samples must be homogenized before sampling, otherwise the results obtained are not reliable, especially when the analytes are contained in traces in the sample under study.<sup id=\"rdp-ebb-cite_ref-:4_12-2\" class=\"reference\"><a href=\"#cite_note-:4-12\">[12]<\/a><\/sup>\n<\/p><p>Sample-related inconsistencies of the pre-analytical phase have already been summarized in Table 2. The strategy to prevent pre-analytical errors consists of five interrelated steps<sup id=\"rdp-ebb-cite_ref-43\" class=\"reference\"><a href=\"#cite_note-43\">[43]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-44\" class=\"reference\"><a href=\"#cite_note-44\">[44]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-45\" class=\"reference\"><a href=\"#cite_note-45\">[45]<\/a><\/sup>:\n<\/p>\n<ol><li>Develop clear written procedures.<\/li>\n<li>Enhance professionals' training.<\/li>\n<li>Automate both support functions and executive functions.<\/li>\n<li>Monitor quality indicators.<\/li>\n<li>Improve communication between professionals and encourage interservice collaboration.<\/li><\/ol>\n<p>The written procedures should clearly describe how the sample is analyzed, collected, labeled, transported, and prepared. To ensure that written procedures are followed consistently, those performing the pre-analytical activities must be well-trained to understand, in addition to the appropriate procedures, their important steps and the consequences of not following the instructions faithfully.<sup id=\"rdp-ebb-cite_ref-46\" class=\"reference\"><a href=\"#cite_note-46\">[46]<\/a><\/sup>\n<\/p><p>Modern technologies, such as <a href=\"https:\/\/www.limswiki.org\/index.php\/Laboratory_automation\" title=\"Laboratory automation\" class=\"wiki-link\" data-key=\"0061880849aeaca05f8aa27ae171f331\">robotics<\/a> and <a href=\"https:\/\/www.limswiki.org\/index.php\/Information_management\" title=\"Information management\" class=\"wiki-link\" data-key=\"f8672d270c0750a858ed940158ca0a73\">information management systems<\/a>, should also help reduce errors. A LIMS is a computerized system that collects, processes, and stores <a href=\"https:\/\/www.limswiki.org\/index.php\/Information\" title=\"Information\" class=\"wiki-link\" data-key=\"6300a14d9c2776dcca0999b5ed940e7d\">information<\/a> produced by the laboratory. Although originally created solely to automate experimental data, it is nowadays used in many laboratory activities.<sup id=\"rdp-ebb-cite_ref-47\" class=\"reference\"><a href=\"#cite_note-47\">[47]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-48\" class=\"reference\"><a href=\"#cite_note-48\">[48]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-:16_49-0\" class=\"reference\"><a href=\"#cite_note-:16-49\">[49]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-50\" class=\"reference\"><a href=\"#cite_note-50\">[50]<\/a><\/sup> The typical LIMS will have sample management functions such as sample registration, <a href=\"https:\/\/www.limswiki.org\/index.php\/Barcode\" title=\"Barcode\" class=\"wiki-link\" data-key=\"e0952b5b262392be0995237aec36d355\">barcode<\/a> labeling, and sample tracking. Using an integrated LIMS, the <a href=\"https:\/\/www.limswiki.org\/index.php\/Chain_of_custody\" title=\"Chain of custody\" class=\"wiki-link\" data-key=\"6ba04fe2bb1c8375e133455821aa3894\">chain of custody<\/a> (CoC) and <a href=\"https:\/\/www.limswiki.org\/index.php\/Audit_trail\" title=\"Audit trail\" class=\"wiki-link\" data-key=\"96a617b543c5b2f26617288ba923c0f0\">audit trail<\/a> records of the samples can be systematically kept, and operations can be improved by adding features such as model management and sample testing, while statistics concerning the number and type of samples, analytical findings, reporting time, number and origin of customers, and many other attributes can be very easily estimated or tracked.<sup id=\"rdp-ebb-cite_ref-:4_12-3\" class=\"reference\"><a href=\"#cite_note-:4-12\">[12]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-51\" class=\"reference\"><a href=\"#cite_note-51\">[51]<\/a><\/sup> Thus, by automating certain steps at pre-analytic workstations, the number of people participating in this phase and the number of manual steps required are reduced. In addition, barcodes simplify the routing and tracking of samples. For example, a <a href=\"https:\/\/www.limswiki.org\/index.php\/Computerized_physician_order_entry\" title=\"Computerized physician order entry\" class=\"wiki-link\" data-key=\"f9e67e685f2b29f79e9b0991330f2b10\">computerized order entry system<\/a> (COES) simplifies the examination order by eliminating the need for the order to be transcribed by a second person.<sup id=\"rdp-ebb-cite_ref-:13_35-2\" class=\"reference\"><a href=\"#cite_note-:13-35\">[35]<\/a><\/sup>\n<\/p><p>To avoid problems caused by a lack of adequate storage space, the laboratory should regularly assess its capacity to handle samples, including available storage space. Therefore, the laboratory should know or proactively estimate the number of samples it can handle and store at a given time, in a manner that whenever the number of incoming samples exceeds its handling capacity, measures such as temporary reassignment of personnel or arrangement of makeshift storage areas can be taken in a timely manner.<sup id=\"rdp-ebb-cite_ref-:4_12-4\" class=\"reference\"><a href=\"#cite_note-:4-12\">[12]<\/a><\/sup>\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Personnel\">Personnel<\/span><\/h3>\n<p>The human factor is present at every stage of the pre-analytical, analytical, and post-analytical process. According to Ho and Chen<sup id=\"rdp-ebb-cite_ref-:17_52-0\" class=\"reference\"><a href=\"#cite_note-:17-52\">[52]<\/a><\/sup>, human error is the leading cause of laboratory accidents. Wurtz <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-53\" class=\"reference\"><a href=\"#cite_note-53\">[53]<\/a><\/sup> reported that reduced mental and physical condition, due to exhaustion, is often the cause of laboratory accidents. However, apart from causing accidents, the human factor is also responsible for any mistake that can occur at any stage of the analytical process, from the collection and recording of samples to the processing of results. The occurrence of human error and its subsequent outcome usually cannot be predicted.<sup id=\"rdp-ebb-cite_ref-:4_12-5\" class=\"reference\"><a href=\"#cite_note-:4-12\">[12]<\/a><\/sup>\n<\/p><p>The techniques used to assess the human factor's contribution to the reliability and security of a system are called the human factor reliability analysis (HRA).<sup id=\"rdp-ebb-cite_ref-:10_24-1\" class=\"reference\"><a href=\"#cite_note-:10-24\">[24]<\/a><\/sup> The first industry to develop and implement HRA was the nuclear industry<sup id=\"rdp-ebb-cite_ref-54\" class=\"reference\"><a href=\"#cite_note-54\">[54]<\/a><\/sup>, concluding that most accidents were due to human error rather than equipment malfunction. Since then, HRA has been applied to many \u201chigh risk\u201d industries, such as the aerospace, railways, shipping, automotive, oil, gas, chemical, military components, and air traffic control industries. HRA has been also applied in the healthcare sector, in the installation of telecommunications equipment, in the design of computer software and hardware, as well as in many manual operations such as lathe operation.\n<\/p><p>To avoid unpleasant consequences occurred by human factor, personnel throughout the organization should be trained appropriately and effectively to be able to perform procedures in accordance with the requirements of ISO standards or other regulations.<sup id=\"rdp-ebb-cite_ref-:13_35-3\" class=\"reference\"><a href=\"#cite_note-:13-35\">[35]<\/a><\/sup> Furthermore, to avoid staff burnout, some laboratory automation systems should be installed and implemented in laboratories, including electric wheeled vehicle systems to transport the samples and systems with automatic result verification procedures.<sup id=\"rdp-ebb-cite_ref-55\" class=\"reference\"><a href=\"#cite_note-55\">[55]<\/a><\/sup> McDonald <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-56\" class=\"reference\"><a href=\"#cite_note-56\">[56]<\/a><\/sup> argue that using a LIMS with highly automated laboratory equipment, researchers can perform repeatable experiments without human intervention. Finally, another measure that can reduce the occurrence of human errors is the continuous supervision of staff, followed by raising staff awareness of error causes through regular training.<sup id=\"rdp-ebb-cite_ref-:4_12-6\" class=\"reference\"><a href=\"#cite_note-:4-12\">[12]<\/a><\/sup>\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Reagents_and_waste\">Reagents and waste<\/span><\/h3>\n<p>The ever-increasing number of laboratories in recent years has led to an increase in industrial waste, such as solid waste, liquid waste, and sewage. Most liquid waste is hazardous industrial waste, which affects human health and causes environmental pollution. The management of this waste therefore involves many risks. There have been, for example, many accidents and injuries due to mismanagement of chemical waste.<sup id=\"rdp-ebb-cite_ref-:12_34-1\" class=\"reference\"><a href=\"#cite_note-:12-34\">[34]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-:17_52-1\" class=\"reference\"><a href=\"#cite_note-:17-52\">[52]<\/a><\/sup> Yu and Chou<sup id=\"rdp-ebb-cite_ref-57\" class=\"reference\"><a href=\"#cite_note-57\">[57]<\/a><\/sup> reported that the most common risk in laboratories is chemical reagents because they can cause immediate damage or cumulative pathological changes to the inside and outside of the human body, as they can cause fire, explosion, poisoning, and corrosion. Additionally, Lin <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-:12_34-2\" class=\"reference\"><a href=\"#cite_note-:12-34\">[34]<\/a><\/sup>, following their research on university laboratories-related fires and explosions related to chemical reagents, state that many causes of accidents were based on improper chemical management, including improper storage, use, transportation, and disposal of chemicals.\n<\/p><p>To mitigate or even avoid the adverse risks of chemicals, their proper management is required. For example, the storage of chemical reagents should be done by category, in a controlled environment and in well-ventilated areas. Flammable materials should be separated from non-flammable materials and stored in areas that provide protection from projectiles, while stock checks should be frequent. Special care should be also taken when transporting them. For example, wooden trays could be used for transport, and always with the use of personal protective equipment.<sup id=\"rdp-ebb-cite_ref-:18_58-0\" class=\"reference\"><a href=\"#cite_note-:18-58\">[58]<\/a><\/sup>\n<\/p><p>Waste should be recycled and disposed of properly. For example, chemicals should be neutralized before disposal. It is necessary to install smoke alarms, fire extinguishers, surveillance cameras, showers, and eyewash stations, as well as signs clearly marking escape corridors, collective protection, and personal protection. Detailed procedures, clear instructions, and appropriate training are also of crucial importance.<sup id=\"rdp-ebb-cite_ref-:17_52-2\" class=\"reference\"><a href=\"#cite_note-:17-52\">[52]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-:18_58-1\" class=\"reference\"><a href=\"#cite_note-:18-58\">[58]<\/a><\/sup>\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Environmental_conditions\">Environmental conditions<\/span><\/h3>\n<p>Laboratories are exposed to various types of hazards (e.g., biological, chemical, radioactive, and others), making them highly hazardous environments.<sup id=\"rdp-ebb-cite_ref-59\" class=\"reference\"><a href=\"#cite_note-59\">[59]<\/a><\/sup> Moreover, the work environment of the laboratories may be exposed to more than one hazard at the same time, which further increases risk. Marque <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-:18_58-2\" class=\"reference\"><a href=\"#cite_note-:18-58\">[58]<\/a><\/sup> emphasize that chemistry laboratories, for example, are unhealthy and dangerous environments, and those involved in research work are exposed to many potential sources of risk as they not only treat chemical reagents but also encounter equipment that is a source of heat and electricity. In chemical laboratories, there are many potential risks as they contain flammable, explosive, and poisonous chemicals. There are also risks in biological laboratories, especially for laboratory staff who treat pathogens, as they are much more likely to be infected with an infectious disease than anyone else.<sup id=\"rdp-ebb-cite_ref-60\" class=\"reference\"><a href=\"#cite_note-60\">[60]<\/a><\/sup>\n<\/p><p>Exposure to chemicals in the workplace can have adverse, acute, or long-term health effects. The dangers from potential exposure to chemicals are many and various, as some substances are toxic, carcinogenic, or irritating, and others are flammable or pose a risk of biological contamination.<sup id=\"rdp-ebb-cite_ref-61\" class=\"reference\"><a href=\"#cite_note-61\">[61]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-62\" class=\"reference\"><a href=\"#cite_note-62\">[62]<\/a><\/sup> In 2006, Chiozza and Plebani<sup id=\"rdp-ebb-cite_ref-63\" class=\"reference\"><a href=\"#cite_note-63\">[63]<\/a><\/sup> reported that two decades ago, laboratory workers performed their work without following any safety procedures and, thus, put themselves in danger. Ho and Chen<sup id=\"rdp-ebb-cite_ref-:17_52-3\" class=\"reference\"><a href=\"#cite_note-:17-52\">[52]<\/a><\/sup> noted that poor management of chemical waste in universities and non-profit laboratories has caused many accidents over the years. Poor management of chemical waste can harm laboratory workers and lead to environmental pollution.<sup id=\"rdp-ebb-cite_ref-:14_36-1\" class=\"reference\"><a href=\"#cite_note-:14-36\">[36]<\/a><\/sup>\n<\/p><p>The U.S. Commission on Chemical Safety and Hazard Investigation has studied 120 laboratory accidents that occurred at various universities across the country from 2001 to 2011.<sup id=\"rdp-ebb-cite_ref-64\" class=\"reference\"><a href=\"#cite_note-64\">[64]<\/a><\/sup> From 2000 to 2015, there were 34 laboratory accidents, which caused 49 deaths. These accidents were caused by explosion, exposure to biological agents, exposure to toxic substances, suffocation, electric shock, fire, exposure to ionizing radiation, and various other causes.\n<\/p><p>In addition to the risk to human health, of environmental pollution, and of destruction of laboratory property, there are other risk factors such as the production of unreliable results and customer dissatisfaction, which also lead to the laboratory's bad reputation, making the application of risk management process imperative to the sustainability of the laboratory.<sup id=\"rdp-ebb-cite_ref-:4_12-7\" class=\"reference\"><a href=\"#cite_note-:4-12\">[12]<\/a><\/sup>\n<\/p><p>In order to tackle risk effectively, estimates based on effective risk management must be integrated into the analytical framework.<sup id=\"rdp-ebb-cite_ref-:6_14-1\" class=\"reference\"><a href=\"#cite_note-:6-14\">[14]<\/a><\/sup> A prerequisite for the operation under appropriate environmental conditions, in a safe and competent laboratory, is the management by executives who can apply the theory of risk to reduce it to an acceptable level. Each laboratory should be able to assess the possible occurrence of errors and describe the steps needed to detect and prevent them to avoid any future adverse events.<sup id=\"rdp-ebb-cite_ref-65\" class=\"reference\"><a href=\"#cite_note-65\">[65]<\/a><\/sup>\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Test_methods\">Test methods<\/span><\/h3>\n<p>It is common practice that appropriate standards or formal methods, whenever available and after verification, be preferred over methods developed internally in laboratories. Otherwise, in-house methods shall be fully validated. In this case, the risk is hidden in non-properly or partially validated methods instead of fully validated methods. In addition, an analytical method may have critical test steps or parameters, such as the quantity of reagents to be added in a particular step, the reaction time, or a specific step to proceed without delay. The absence of critical steps leads to erroneous results.\n<\/p><p>To avoid the risk arisen from the use of internal analytical methods that are not properly validated, the laboratory should ensure that the method developed is fully validated for its intended use. To achieve this, a general method validation procedure shall exist, based on relevant international protocols, compiled from certified analysts involved in the design of method validation having extensive experience in related issues. In addition, according to the latest version of the ISO\/IEC 17025 standard, the specification of the method requirements must be recorded in detail during the method validation phase. Moreover, checks should be carried out to ensure that all requirements are met and, afterward, the declaration of method validity should be signed. Critical steps and parameters of the test methods should be appropriately marked in the respective written procedures to avoid any misunderstanding or omission by the analysts. Additionally, during staff methodological training, the importance of these points should be clearly explained.<sup id=\"rdp-ebb-cite_ref-:4_12-8\" class=\"reference\"><a href=\"#cite_note-:4-12\">[12]<\/a><\/sup>\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Measurement\">Measurement<\/span><\/h3>\n<p>In the measurement process, issues that have been already mentioned above, such as sample treatment, environmental conditions, personnel ,and test methods affect the measurement results.\n<\/p><p>Another critical aspect is the need for appropriate and valid (certified, if applicable) reference materials that must be used to determine the metrological traceability of the analytical results in accordance with the requirements of ISO\/IEC 17025. There are two types of reference materials involved in chemical testing which are the matrix reference materials for the validation of the methods and the pure reference standards used for the calibration of the equipment. The laboratory should retain procedures for safe handling, transport, storage, and use of reference materials to avoid possible contamination or deterioration. In addition, the laboratory should have studies on the stability of the solutions of the working standards prepared from reference standards. Matrix reference materials must be stored strictly in accordance with the storage conditions recommended by the manufacturers, and relevant records should be kept appropriately. Before use, at least a visual inspection should be performed to confirm that the materials are intact.<sup id=\"rdp-ebb-cite_ref-:4_12-9\" class=\"reference\"><a href=\"#cite_note-:4-12\">[12]<\/a><\/sup>\n<\/p><p>Although the occurrence and subsequent outcome of human error during test execution is usually unpredictable, it can nevertheless be minimized by strengthening personnel supervision and increasing awareness. Actions toward this effort include on-site monitoring, verbal review, and control of experimental records, including sampling, sample analysis, data handling, and reporting. The results of the monitoring actions should be maintained, and whenever a deviation is found, corrective actions should be immediately taken. To avoid the risk that may arise from any inappropriate environmental conditions during measurement, the critical requirements for environmental conditions should be clearly indicated in the written procedures of the method to raise the awareness of the involved analysts. In addition, the continuous monitoring and periodic review of environmental conditions and the maintenance of relevant records are significant prerequisites. These actions not only allow subsequent inspection or evaluation, but they also encourage analysts to stay aware of the appropriate environmental conditions when performing tests.<sup id=\"rdp-ebb-cite_ref-:8_20-3\" class=\"reference\"><a href=\"#cite_note-:8-20\">[20]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-66\" class=\"reference\"><a href=\"#cite_note-66\">[66]<\/a><\/sup>\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Quality_control\">Quality control<\/span><\/h3>\n<p>The laboratory must have quality control procedures to monitor the validity of the tests performed and the quality of the results. Procedures are divided into internal and external quality control procedures. The main objective of internal quality control is to ensure the reliability of the results of the analytical process.<sup id=\"rdp-ebb-cite_ref-67\" class=\"reference\"><a href=\"#cite_note-67\">[67]<\/a><\/sup> Internal quality control should be applied daily in the laboratory and for each laboratory test, to identify random and systematic errors as well as trends. For example, in each laboratory test, working standards of known concentration should be used to check the validity and accuracy of the test results through control charts, testing of internal blind samples, replicate tests using the same or different methods, or intermediate checks on measurement equipment. It is also useful for the laboratory to retain appropriate control of its QMS documents (e.g., procedures, instructions, calibration tables, specifications, alerts, etc.) for the purpose of updating and checking their validity, the control of the files, the control of the actions to treat threats and seizing opportunities, the control of corrective actions, etc.\n<\/p><p>External quality control, on the other hand, is performed by analyzing blind control samples sent to the laboratory by external, inter-laboratory comparison providers, to check the accuracy of results independently and objectively. The laboratory participating in an external quality control program must state the tests it performs, as well as the methods and instruments it uses, if required.<sup id=\"rdp-ebb-cite_ref-68\" class=\"reference\"><a href=\"#cite_note-68\">[68]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-69\" class=\"reference\"><a href=\"#cite_note-69\">[69]<\/a><\/sup> The successful participation of a laboratory in external quality control programs provides objective proof of the adequacy of the laboratory to its customers, as well as to the accreditation and regulatory bodies the lab answers to.<sup id=\"rdp-ebb-cite_ref-70\" class=\"reference\"><a href=\"#cite_note-70\">[70]<\/a><\/sup> Non-valid results, however, indicate the existence of inconsistencies in the analysis chain of the samples, e.g., in the used test method, equipment, or personnel<sup id=\"rdp-ebb-cite_ref-71\" class=\"reference\"><a href=\"#cite_note-71\">[71]<\/a><\/sup>, and they must be carefully reviewed and appropriately corrected. Although tests must be performed in the same way as routine samples, the pre-analytical procedure, however, often differs as the samples sent may be in a different form (e.g., in a lyophilized form) or in different containers (e.g., in different types of tubes) and require different pre-analytical treatment. Therefore, the program organizer must provide clear instructions on the maintenance and preparation of external quality control samples.<sup id=\"rdp-ebb-cite_ref-72\" class=\"reference\"><a href=\"#cite_note-72\">[72]<\/a><\/sup>\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Results_reporting\">Results reporting<\/span><\/h3>\n<p>The final step in the testing process is results reporting. The risk of this stage may be the incorrect sending of results to the customer due to some falsification or even loss of data that may occur during the receipt, transfer, processing, and storage of data. Even if data handling software is used, data can be violated or modified by error or deceit.<sup id=\"rdp-ebb-cite_ref-:19_73-0\" class=\"reference\"><a href=\"#cite_note-:19-73\">[73]<\/a><\/sup>\n<\/p><p>To avoid the risk of reporting incorrect results to clients, the laboratory shall have two- or even three-level data control procedures in place. When software is used to manipulate the data, these programs should be verified before use with appropriate protection to prevent tampering or accidental modification. However, for further improvement, these recording processes could be integrated into a LIMS which minimizes the need to manually transcribe data, and through appropriate electronic controls, <a href=\"https:\/\/www.limswiki.org\/index.php\/Data_integrity\" title=\"Data integrity\" class=\"wiki-link\" data-key=\"382a9bb77ee3e36bb3b37c79ed813167\">data integrity<\/a> can be ensured. The system could also record any failure as well as the corrective actions taken for reference. In cases where a declaration of conformity of the test to a specification or to a standard is requested, the laboratory is recommended to document the decision rules considering the relevant risk. This enhances the consistency of the results provided and avoids the risk of false acceptance or rejection.<sup id=\"rdp-ebb-cite_ref-:4_12-10\" class=\"reference\"><a href=\"#cite_note-:4-12\">[12]<\/a><\/sup>\n<\/p><p>To prevent late reporting of results to the client, the combination of a LIMS with a web-based reporting system can be used. This combination is an important tool with which clinical and analytical laboratories can significantly speed up the process of presenting their test results to their customers, increasing their satisfaction and trust with the laboratory.<sup id=\"rdp-ebb-cite_ref-:16_49-1\" class=\"reference\"><a href=\"#cite_note-:16-49\">[49]<\/a><\/sup>\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Impartiality_and_confidentiality\">Impartiality and confidentiality<\/span><\/h3>\n<p>Impartiality and confidentiality are two aspects that are included in the general requirements of the latest edition of ISO\/IEC 17025, giving special attention to the importance of effective risk management resulting from the lack of these aspects. In particular, the laboratory is obliged to identify the risk associated with its impartiality on an ongoing basis and to demonstrate how to eliminate or minimize this risk. For example, it should identify the risk arising from its activities, relationships with stakeholders (e.g., top management representatives, clients, service providers, etc.) or staff relationships. Impartiality is defined in ISO\/IEC 17025:2017 as the existence of subjectivity in relationships that may affect the laboratory's impartiality and are based on ownership, governance, administration, staff, shared resources, finances, contracts, and more.\n<\/p><p>However, impartiality is not always intentional; most of the time it is done unintentionally by hard-working, dedicated, honest, and competent employees who try to do their job impartially but still fail. It is then considered as cognitive bias, which is widespread and implicit.<sup id=\"rdp-ebb-cite_ref-74\" class=\"reference\"><a href=\"#cite_note-74\">[74]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-75\" class=\"reference\"><a href=\"#cite_note-75\">[75]<\/a><\/sup> The impact of such implicit bias is significant, as it affects not only the examiner's judgment, but also it creates phenomena known as \u201cbias cascade\u201d and \u201cbias snowball.\u201d The \u201cbias cascade\u201d effect occurs when irrelevant information spills from one stage to another, thereby creating bias. In the \u201csnowball bias\u201d effect, bias is not only simply carried over from one stage to the next but sequentially grows as unrelated information from a variety of sources integrate and influence one another.<sup id=\"rdp-ebb-cite_ref-76\" class=\"reference\"><a href=\"#cite_note-76\">[76]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-77\" class=\"reference\"><a href=\"#cite_note-77\">[77]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-78\" class=\"reference\"><a href=\"#cite_note-78\">[78]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-79\" class=\"reference\"><a href=\"#cite_note-79\">[79]<\/a><\/sup> Therefore, it is extremely important to take the necessary steps to prevent and address bias.\n<\/p><p>The laboratory is also obliged to ensure the protection of confidential information concerning its customers and is responsible for managing all information received or generated during the execution of its activities. As impartiality and confidentiality adversely affect the laboratory's goals and compliance with the requirements of the ISO\/IEC 17025 standard, they should be treated like any other risk. Therefore, an effective risk management system is required to deal with these risks.<sup id=\"rdp-ebb-cite_ref-:3_11-1\" class=\"reference\"><a href=\"#cite_note-:3-11\">[11]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-80\" class=\"reference\"><a href=\"#cite_note-80\">[80]<\/a><\/sup>\n<\/p><p>The above is achieved by upper management's commitment to impartiality and adopting appropriate policies, procedures, and best practices to monitor the risk of bias and, where necessary, taking action to prevent or mitigate it. Undoubtedly, appropriate training is a critical parameter to assure impartiality and confidentiality. Staff must be trained in relation to cognitive bias so that they understand the existence and importance of appropriate policies, procedures, and practices.<sup id=\"rdp-ebb-cite_ref-:3_11-2\" class=\"reference\"><a href=\"#cite_note-:3-11\">[11]<\/a><\/sup> Ensuring confidentiality in laboratories also requires an effective and clearly defined laboratory management system that provides all relevant information, in an accessible format, including documentation of the laboratory's confidentiality policies, procedures, and guidelines. By extension, a written confidentiality policy is essential, providing clear instructions to all laboratory workers and being signed by them. A confidentiality agreement is a standard practice for many businesses and can remain in place indefinitely, protecting the laboratory even after staff leave, as well as from outside partners. There should be also a plan that outlines exactly how laboratory personnel should react in case that workplace confidentiality policies or procedures are being violated.\n<\/p><p>Paper documents and records should be kept in a secure location inaccessible to non-laboratory personnel, and when no longer needed, are destroyed before disposal. Special care should be also taken with mobile phones to avoid pictures of classified documents to be taken for unintended use. In addition, the electronic documentation is stored on a secure network and viewed only on secure devices.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Digitalization\">Digitalization<\/span><\/h3>\n<p>Modern laboratories are increasingly dependent on computers and other electronic devices for both their administrative and analytical functions. For example, the results obtained from the laboratory equipment are automatically stored in raw data files. While these technological developments create new opportunities, they also create risks.<sup id=\"rdp-ebb-cite_ref-:19_73-1\" class=\"reference\"><a href=\"#cite_note-:19-73\">[73]<\/a><\/sup> Potential risks are data loss, the possibility of breaching and modifying raw data files generated by laboratory equipment, and incorrect input of information into the LIMS. According to Tully <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-81\" class=\"reference\"><a href=\"#cite_note-81\">[81]<\/a><\/sup>, the main risks faced by digital forensic laboratories that use quality standards include:\n<\/p>\n<ul><li>The existence of inaccurate or insufficient information in the technical files and the absence of a mechanism to detect subsequent changes in the files.<\/li>\n<li>Problems with computer systems security, energy supply, use of passwords for files opening or computers use, and data backup processes.<\/li>\n<li>Absence or insufficiency of detailed procedures for the processing of digital data, or the documented procedures are not followed consistently by the staff.<\/li>\n<li>Lack of strong quality control mechanisms and problems with validation of methods.<\/li><\/ul>\n<p>Computer systems used to store the data generated (raw and processed) by the laboratory can deal with problems that lead to information loss. Under some circumstances, the original data files can be recovered from hard drives using appropriate digital methods, but these can be costly and time consuming. However, even if digital data can be preserved, it is malleable and subject to undetectable changes in its content or metadata. The lack of proper data retention procedures makes it more difficult or even impossible to retrieve the original files and verify their integrity. In addition, standard backup procedures do not have the fidelity of digital forensic mechanisms.\n<\/p><p>One way to preserve digital data is to create <a href=\"https:\/\/www.limswiki.org\/index.php\/Backup\" title=\"Backup\" class=\"wiki-link\" data-key=\"e12548e6bf5f28bfee99099fe8662dde\">backups<\/a>. However, routine backup procedures do not have the fidelity of digital preservation mechanisms for some critical data, such as those of <a href=\"https:\/\/www.limswiki.org\/index.php\/Forensic_laboratory\" class=\"mw-redirect wiki-link\" title=\"Forensic laboratory\" data-key=\"dabef2566b55c1f13b395543b47ae81e\">forensic laboratories<\/a>. Data files created by laboratory equipment and stored on computers can be modified by mistake or intentionally. Depending on the data type and the modification method, it may be possible to detect changes or amendments. Normal backup procedures, even those updated to preserve digital forensics data, are not foolproof. Data can be falsified, and the computer system can be refreshed to make it appear that the change was made at some point in the past.<sup id=\"rdp-ebb-cite_ref-:19_73-2\" class=\"reference\"><a href=\"#cite_note-:19-73\">[73]<\/a><\/sup>\n<\/p><p>To manage the risks of inadvertent alteration, as well as intentional breach, the solution is to update the traditional practices of tracking data provenance and use digitized ledgers of global custody.<sup id=\"rdp-ebb-cite_ref-82\" class=\"reference\"><a href=\"#cite_note-82\">[82]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-83\" class=\"reference\"><a href=\"#cite_note-83\">[83]<\/a><\/sup> These ledgers can be implemented in such a way that they are inviolable and independently verifiable.\n<\/p><p>The use of automated systems by specialized laboratory staff who interpret the results of the analyses can help maintain consistency and increase the effectiveness of the analysis. However, these systems\u2014including those with <a href=\"https:\/\/www.limswiki.org\/index.php\/Artificial_intelligence\" title=\"Artificial intelligence\" class=\"wiki-link\" data-key=\"0c45a597361ca47e1cd8112af676276e\">artificial intelligence<\/a> (AI) and <a href=\"https:\/\/www.limswiki.org\/index.php\/Machine_learning\" title=\"Machine learning\" class=\"wiki-link\" data-key=\"79aab39cfa124c958cd1dbcab3dde122\">machine learning<\/a> (ML)\u2014can have errors, resulting in invalid results.<sup id=\"rdp-ebb-cite_ref-84\" class=\"reference\"><a href=\"#cite_note-84\">[84]<\/a><\/sup> In addition, they are sensitive to bias due to poorly selected data sets, as well as lead to misinterpretations when the results are not fully understood.<sup id=\"rdp-ebb-cite_ref-85\" class=\"reference\"><a href=\"#cite_note-85\">[85]<\/a><\/sup> For example, when automated AI\/ML systems are used to support forensic research and forensic analysis, such as comparing faces in digital video or photographs, false-positive algorithms can lead to erroneous results.<sup id=\"rdp-ebb-cite_ref-:19_73-3\" class=\"reference\"><a href=\"#cite_note-:19-73\">[73]<\/a><\/sup>\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Financial_risk\">Financial risk<\/span><\/h3>\n<p>Over the last years and due to the outbreak of the economic and health crises worldwide, the tight financial policy in many laboratories either of the public or the private sector, along with various bureaucratic obstacles, may have negative impacts on their overall technological or economic growth. Laboratories should made efforts for cost cutting assuming that accurate knowledge of their test costs exists. It is common sense that many laboratories do not exactly know the cost of services they provide or, additionally, do not take early measures to timely upgrade their equipment and analytical instruments as well as to restore staff losses from resignations or retirements maybe due to reduced financial budget or state subsidies.\n<\/p><p>Adequate test cost accounting requires a joint effort between financial experts and those with a broad knowledge of laboratory testing. The absence of a solid cost accounting may lead to a risky incremental costing. As such, up-to-date cost information to price laboratory services, along with adequate programming of laboratory's financial and human needs (e.g., compiling a business plan), can prove to be efficient control measures for their financial sustainability and future development. Furthermore, top management representatives play a crucial role in finding or securing financial resources to cover the laboratory's human and infrastructure needs.\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Conclusion\">Conclusion<\/span><\/h2>\n<p>The complex activities and the operational framework of a modern laboratory involve many risks with adverse consequences for the testing outcomes, the health of workers, and the environment. For this reason, risk management procedures should be integrated into the laboratory's QMS procedures and become an integral part of their daily routine. Many methods have been developed to identify and assess risk. Most of them are described in ISO 31010:2019, while the general method instructions are referred to in ISO 31000:2018.\n<\/p><p>The major sources of risk in a laboratory are the personnel themselves, samples to be analyzed, chemical reagents and waste, equipment, test methods, measurements, non-updated quality control procedures, results reporting, impartiality and confidentiality, digitalization of data and information, and financial aspects. Implementing an efficient QMS, the laboratory can reduce the risks to a tolerable level when clear procedures, continuous supervision, inspections, timely training and continuous education of its staff, and upgrades of its equipment with systems automation are maintained. A continuous management of risks is necessary for the emergence of new priorities and the continuous implementation of necessary actions for the purpose of safety and prevention.\n<\/p><p>Risk management is fundamental to ensure a safe internal and external laboratory environment, as well as to assure the delivery of reliable and competent services. Moreover, the implementation of risk-based thinking can positively affect the outcome of regular assessments in order to explore opportunities for increasing the effectiveness of the QMS and preventing further negative effects.\n<\/p>\n<h2><span id=\"rdp-ebb-Abbreviations,_acronyms,_and_initialisms\"><\/span><span class=\"mw-headline\" id=\"Abbreviations.2C_acronyms.2C_and_initialisms\">Abbreviations, acronyms, and initialisms<\/span><\/h2>\n<ul><li><b>AI<\/b>: artificial intelligence<\/li>\n<li><b>ALARP<\/b>: as low as reasonably practicable<\/li>\n<li><b>CoC<\/b>: chain of custody<\/li>\n<li><b>COES<\/b>: computerized order entry system<\/li>\n<li><b>FMEA<\/b>: failure modes and effects analysis<\/li>\n<li><b>FMECA<\/b>: failure modes, effects, and criticality analysis<\/li>\n<li><b>FRACAS<\/b>: failure reporting, analysis and corrective action system<\/li>\n<li><b>FTA<\/b>: fault tree analysis<\/li>\n<li><b>HACCP<\/b>: hazard analysis and critical control points<\/li>\n<li><b>HAZOP<\/b>: hazard and operability analysis<\/li>\n<li><b>HRA<\/b>: human factor reliability analysis<\/li>\n<li><b>ISO<\/b>: International Organization for Standardization<\/li>\n<li><b>LIMS<\/b>: laboratory information management system<\/li>\n<li><b>LOPA<\/b>: layers of protection analysis<\/li>\n<li><b>ML<\/b>: machine learning<\/li>\n<li><b>QMS<\/b>: quality management system<\/li>\n<li><b>SFAIRP<\/b>: so far as is reasonably practicable<\/li>\n<li><b>SWIFT<\/b>: structured what-if technique<\/li><\/ul>\n<h2><span class=\"mw-headline\" id=\"Acknowledgements\">Acknowledgements<\/span><\/h2>\n<h3><span class=\"mw-headline\" id=\"Author_contributions\">Author contributions<\/span><\/h3>\n<p>ET wrote the main manuscript text. AGF contributed to the writing process while both AGF and ANP made critical corrections. All authors reviewed the manuscript.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Funding\">Funding<\/span><\/h3>\n<p>Open access funding provided by HEAL-Link Greece.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Conflict_of_interest\">Conflict of interest<\/span><\/h3>\n<p>The authors declare no competing interests.\n<\/p>\n<h2><span class=\"mw-headline\" id=\"References\">References<\/span><\/h2>\n<div class=\"reflist references-column-width\" style=\"-moz-column-width: 30em; -webkit-column-width: 30em; column-width: 30em; list-style-type: decimal;\">\n<div class=\"mw-references-wrap mw-references-columns\"><ol class=\"references\">\n<li id=\"cite_note-1\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-1\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation book\">Dallas, Michael (2006). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.worldcat.org\/title\/mediawiki\/oclc\/ocm59879826\" target=\"_blank\"><i>Value and risk management: a guide to best practice<\/i><\/a>. Oxford ; Malden, MA: Blackwell Pub. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-1-4051-2069-2. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Online_Computer_Library_Center\" data-key=\"b53206e2204c7e657858a88b56c8ac4a\">OCLC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/oclc\/ocm59879826\" target=\"_blank\">ocm59879826<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.worldcat.org\/title\/mediawiki\/oclc\/ocm59879826\" target=\"_blank\">https:\/\/www.worldcat.org\/title\/mediawiki\/oclc\/ocm59879826<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=book&rft.btitle=Value+and+risk+management%3A+a+guide+to+best+practice&rft.aulast=Dallas&rft.aufirst=Michael&rft.au=Dallas%2C%26%2332%3BMichael&rft.date=2006&rft.place=Oxford+%3B+Malden%2C+MA&rft.pub=Blackwell+Pub&rft.isbn=978-1-4051-2069-2&rft_id=info:oclcnum\/ocm59879826&rft_id=https%3A%2F%2Fwww.worldcat.org%2Ftitle%2Fmediawiki%2Foclc%2Focm59879826&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:0-2\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:0_2-0\">2.0<\/a><\/sup> <sup><a href=\"#cite_ref-:0_2-1\">2.1<\/a><\/sup> <sup><a href=\"#cite_ref-:0_2-2\">2.2<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Covello, Vincent T.; Mumpower, Jeryl (1 June 1985). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/j.1539-6924.1985.tb00159.x\" target=\"_blank\">\"Risk Analysis and Risk Management: An Historical Perspective\"<\/a> (in en). <i>Risk Analysis<\/i> <b>5<\/b> (2): 103\u2013120. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1111%2Fj.1539-6924.1985.tb00159.x\" target=\"_blank\">10.1111\/j.1539-6924.1985.tb00159.x<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0272-4332\" target=\"_blank\">0272-4332<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/j.1539-6924.1985.tb00159.x\" target=\"_blank\">https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/j.1539-6924.1985.tb00159.x<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Risk+Analysis+and+Risk+Management%3A+An+Historical+Perspective&rft.jtitle=Risk+Analysis&rft.aulast=Covello&rft.aufirst=Vincent+T.&rft.au=Covello%2C%26%2332%3BVincent+T.&rft.au=Mumpower%2C%26%2332%3BJeryl&rft.date=1+June+1985&rft.volume=5&rft.issue=2&rft.pages=103%E2%80%93120&rft_id=info:doi\/10.1111%2Fj.1539-6924.1985.tb00159.x&rft.issn=0272-4332&rft_id=https%3A%2F%2Fonlinelibrary.wiley.com%2Fdoi%2F10.1111%2Fj.1539-6924.1985.tb00159.x&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-3\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-3\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Grier, B. (1981). \"The Early History of the Theory and Management of Risk\". <i>Paper presented at the Judgment and Decision Making Group Meeting, Philadelphia, Pennsylvania, 1981<\/i>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=The+Early+History+of+the+Theory+and+Management+of+Risk&rft.atitle=Paper+presented+at+the+Judgment+and+Decision+Making+Group+Meeting%2C+Philadelphia%2C+Pennsylvania%2C+1981&rft.aulast=Grier%2C+B.&rft.au=Grier%2C+B.&rft.date=1981&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-4\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-4\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation book\">Oppenheim, A. Leo (1977) (in en). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/doi.org\/10.7208\/chicago\/9780226177670.001.0001\" target=\"_blank\"><i>Ancient Mesopotamia<\/i><\/a>. University of Chicago Press. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.7208%2Fchicago%2F9780226177670.001.0001\" target=\"_blank\">10.7208\/chicago\/9780226177670.001.0001<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-0-226-63187-5<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/doi.org\/10.7208\/chicago\/9780226177670.001.0001\" target=\"_blank\">https:\/\/doi.org\/10.7208\/chicago\/9780226177670.001.0001<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=book&rft.btitle=Ancient+Mesopotamia&rft.aulast=Oppenheim&rft.aufirst=A.+Leo&rft.au=Oppenheim%2C%26%2332%3BA.+Leo&rft.date=1977&rft.pub=University+of+Chicago+Press&rft_id=info:doi\/10.7208%2Fchicago%2F9780226177670.001.0001&rft.isbn=978-0-226-63187-5&rft_id=https%3A%2F%2Fdoi.org%2F10.7208%2Fchicago%2F9780226177670.001.0001&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-5\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-5\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Ehrlich, Isaac; Becker, Gary S. (1 July 1972). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.journals.uchicago.edu\/doi\/10.1086\/259916\" target=\"_blank\">\"Market Insurance, Self-Insurance, and Self-Protection\"<\/a> (in en). <i>Journal of Political Economy<\/i> <b>80<\/b> (4): 623\u2013648. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1086%2F259916\" target=\"_blank\">10.1086\/259916<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0022-3808\" target=\"_blank\">0022-3808<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.journals.uchicago.edu\/doi\/10.1086\/259916\" target=\"_blank\">https:\/\/www.journals.uchicago.edu\/doi\/10.1086\/259916<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Market+Insurance%2C+Self-Insurance%2C+and+Self-Protection&rft.jtitle=Journal+of+Political+Economy&rft.aulast=Ehrlich&rft.aufirst=Isaac&rft.au=Ehrlich%2C%26%2332%3BIsaac&rft.au=Becker%2C%26%2332%3BGary+S.&rft.date=1+July+1972&rft.volume=80&rft.issue=4&rft.pages=623%E2%80%93648&rft_id=info:doi\/10.1086%2F259916&rft.issn=0022-3808&rft_id=https%3A%2F%2Fwww.journals.uchicago.edu%2Fdoi%2F10.1086%2F259916&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-6\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-6\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Dionne, Georges; Eeckhoudt, Louis (1 January 1985). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/0165176585901235\" target=\"_blank\">\"Self-insurance, self-protection and increased risk aversion\"<\/a> (in en). <i>Economics Letters<\/i> <b>17<\/b> (1-2): 39\u201342. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2F0165-1765%2885%2990123-5\" target=\"_blank\">10.1016\/0165-1765(85)90123-5<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/0165176585901235\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/0165176585901235<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Self-insurance%2C+self-protection+and+increased+risk+aversion&rft.jtitle=Economics+Letters&rft.aulast=Dionne&rft.aufirst=Georges&rft.au=Dionne%2C%26%2332%3BGeorges&rft.au=Eeckhoudt%2C%26%2332%3BLouis&rft.date=1+January+1985&rft.volume=17&rft.issue=1-2&rft.pages=39%E2%80%9342&rft_id=info:doi\/10.1016%2F0165-1765%2885%2990123-5&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2F0165176585901235&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-7\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-7\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Dionne, Georges (1 September 2013). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/rmir.12016\" target=\"_blank\">\"Risk Management: History, Definition, and Critique: Risk Management\"<\/a> (in en). <i>Risk Management and Insurance Review<\/i> <b>16<\/b> (2): 147\u2013166. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1111%2Frmir.12016\" target=\"_blank\">10.1111\/rmir.12016<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/rmir.12016\" target=\"_blank\">https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/rmir.12016<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Risk+Management%3A+History%2C+Definition%2C+and+Critique%3A+Risk+Management&rft.jtitle=Risk+Management+and+Insurance+Review&rft.aulast=Dionne&rft.aufirst=Georges&rft.au=Dionne%2C%26%2332%3BGeorges&rft.date=1+September+2013&rft.volume=16&rft.issue=2&rft.pages=147%E2%80%93166&rft_id=info:doi\/10.1111%2Frmir.12016&rft_id=https%3A%2F%2Fonlinelibrary.wiley.com%2Fdoi%2F10.1111%2Frmir.12016&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-8\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-8\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation book\">Kumamoto, Hiromitsu; Henley, Ernest J.; Henley, Ernest J. (1996). <i>Probabilistic risk assessment and management for engineers and scientists<\/i> (2nd ed ed.). New York: IEEE Press. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-0-7803-1004-9.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=book&rft.btitle=Probabilistic+risk+assessment+and+management+for+engineers+and+scientists&rft.aulast=Kumamoto&rft.aufirst=Hiromitsu&rft.au=Kumamoto%2C%26%2332%3BHiromitsu&rft.au=Henley%2C%26%2332%3BErnest+J.&rft.au=Henley%2C%26%2332%3BErnest+J.&rft.date=1996&rft.edition=2nd+ed&rft.place=New+York&rft.pub=IEEE+Press&rft.isbn=978-0-7803-1004-9&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:1-9\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:1_9-0\">9.0<\/a><\/sup> <sup><a href=\"#cite_ref-:1_9-1\">9.1<\/a><\/sup> <sup><a href=\"#cite_ref-:1_9-2\">9.2<\/a><\/sup> <sup><a href=\"#cite_ref-:1_9-3\">9.3<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Nichols, James H. (1 May 2011). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.annsaudimed.net\/doi\/10.4103\/0256-4947.81526\" target=\"_blank\">\"Laboratory Quality Control Based on Risk Management\"<\/a> (in en). <i>Annals of Saudi Medicine<\/i> <b>31<\/b> (3): 223\u2013228. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.4103%2F0256-4947.81526\" target=\"_blank\">10.4103\/0256-4947.81526<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0256-4947\" target=\"_blank\">0256-4947<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC3119960\/\" target=\"_blank\">PMC3119960<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/21623049\" target=\"_blank\">21623049<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/www.annsaudimed.net\/doi\/10.4103\/0256-4947.81526\" target=\"_blank\">http:\/\/www.annsaudimed.net\/doi\/10.4103\/0256-4947.81526<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Laboratory+Quality+Control+Based+on+Risk+Management&rft.jtitle=Annals+of+Saudi+Medicine&rft.aulast=Nichols&rft.aufirst=James+H.&rft.au=Nichols%2C%26%2332%3BJames+H.&rft.date=1+May+2011&rft.volume=31&rft.issue=3&rft.pages=223%E2%80%93228&rft_id=info:doi\/10.4103%2F0256-4947.81526&rft.issn=0256-4947&rft_id=info:pmc\/PMC3119960&rft_id=info:pmid\/21623049&rft_id=http%3A%2F%2Fwww.annsaudimed.net%2Fdoi%2F10.4103%2F0256-4947.81526&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:2-10\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:2_10-0\">10.0<\/a><\/sup> <sup><a href=\"#cite_ref-:2_10-1\">10.1<\/a><\/sup> <sup><a href=\"#cite_ref-:2_10-2\">10.2<\/a><\/sup> <sup><a href=\"#cite_ref-:2_10-3\">10.3<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Dror, Itiel E.; Pierce, Michal L. (1 May 2020). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/1556-4029.14265\" target=\"_blank\">\"ISO Standards Addressing Issues of Bias and Impartiality in Forensic Work\"<\/a> (in en). <i>Journal of Forensic Sciences<\/i> <b>65<\/b> (3): 800\u2013808. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1111%2F1556-4029.14265\" target=\"_blank\">10.1111\/1556-4029.14265<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0022-1198\" target=\"_blank\">0022-1198<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/1556-4029.14265\" target=\"_blank\">https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/1556-4029.14265<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=ISO+Standards+Addressing+Issues+of+Bias+and+Impartiality+in+Forensic+Work&rft.jtitle=Journal+of+Forensic+Sciences&rft.aulast=Dror&rft.aufirst=Itiel+E.&rft.au=Dror%2C%26%2332%3BItiel+E.&rft.au=Pierce%2C%26%2332%3BMichal+L.&rft.date=1+May+2020&rft.volume=65&rft.issue=3&rft.pages=800%E2%80%93808&rft_id=info:doi\/10.1111%2F1556-4029.14265&rft.issn=0022-1198&rft_id=https%3A%2F%2Fonlinelibrary.wiley.com%2Fdoi%2F10.1111%2F1556-4029.14265&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:3-11\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:3_11-0\">11.0<\/a><\/sup> <sup><a href=\"#cite_ref-:3_11-1\">11.1<\/a><\/sup> <sup><a href=\"#cite_ref-:3_11-2\">11.2<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Wong, Siu-kay (1 April 2017). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/link.springer.com\/10.1007\/s00769-017-1256-x\" target=\"_blank\">\"Risk-based thinking for chemical testing\"<\/a> (in en). <i>Accreditation and Quality Assurance<\/i> <b>22<\/b> (2): 103\u2013108. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1007%2Fs00769-017-1256-x\" target=\"_blank\">10.1007\/s00769-017-1256-x<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0949-1775\" target=\"_blank\">0949-1775<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/link.springer.com\/10.1007\/s00769-017-1256-x\" target=\"_blank\">http:\/\/link.springer.com\/10.1007\/s00769-017-1256-x<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Risk-based+thinking+for+chemical+testing&rft.jtitle=Accreditation+and+Quality+Assurance&rft.aulast=Wong&rft.aufirst=Siu-kay&rft.au=Wong%2C%26%2332%3BSiu-kay&rft.date=1+April+2017&rft.volume=22&rft.issue=2&rft.pages=103%E2%80%93108&rft_id=info:doi\/10.1007%2Fs00769-017-1256-x&rft.issn=0949-1775&rft_id=http%3A%2F%2Flink.springer.com%2F10.1007%2Fs00769-017-1256-x&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:4-12\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:4_12-0\">12.00<\/a><\/sup> <sup><a href=\"#cite_ref-:4_12-1\">12.01<\/a><\/sup> <sup><a href=\"#cite_ref-:4_12-2\">12.02<\/a><\/sup> <sup><a href=\"#cite_ref-:4_12-3\">12.03<\/a><\/sup> <sup><a href=\"#cite_ref-:4_12-4\">12.04<\/a><\/sup> <sup><a href=\"#cite_ref-:4_12-5\">12.05<\/a><\/sup> <sup><a href=\"#cite_ref-:4_12-6\">12.06<\/a><\/sup> <sup><a href=\"#cite_ref-:4_12-7\">12.07<\/a><\/sup> <sup><a href=\"#cite_ref-:4_12-8\">12.08<\/a><\/sup> <sup><a href=\"#cite_ref-:4_12-9\">12.09<\/a><\/sup> <sup><a href=\"#cite_ref-:4_12-10\">12.10<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Plebani, Mario (1 January 2006). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.degruyter.com\/document\/doi\/10.1515\/CCLM.2006.123\/html\" target=\"_blank\">\"Errors in clinical laboratories or errors in laboratory medicine?\"<\/a>. <i>Clinical Chemistry and Laboratory Medicine (CCLM)<\/i> <b>44<\/b> (6). <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1515%2FCCLM.2006.123\" target=\"_blank\">10.1515\/CCLM.2006.123<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1434-6621\" target=\"_blank\">1434-6621<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.degruyter.com\/document\/doi\/10.1515\/CCLM.2006.123\/html\" target=\"_blank\">https:\/\/www.degruyter.com\/document\/doi\/10.1515\/CCLM.2006.123\/html<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Errors+in+clinical+laboratories+or+errors+in+laboratory+medicine%3F&rft.jtitle=Clinical+Chemistry+and+Laboratory+Medicine+%28CCLM%29&rft.aulast=Plebani&rft.aufirst=Mario&rft.au=Plebani%2C%26%2332%3BMario&rft.date=1+January+2006&rft.volume=44&rft.issue=6&rft_id=info:doi\/10.1515%2FCCLM.2006.123&rft.issn=1434-6621&rft_id=https%3A%2F%2Fwww.degruyter.com%2Fdocument%2Fdoi%2F10.1515%2FCCLM.2006.123%2Fhtml&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:5-13\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:5_13-0\">13.0<\/a><\/sup> <sup><a href=\"#cite_ref-:5_13-1\">13.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation\" id=\"rdp-ebb-CITEREFLemosAlmeida2001\">Lemos, T.; Almeida, L. T. (2001), Linkov, Igor; Palma-Oliveira, Jose, eds., <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/link.springer.com\/10.1007\/978-94-010-0987-4_44\" target=\"_blank\">\"Whole Life Cycle Risk Management\"<\/a>, <i>Assessment and Management of Environmental Risks<\/i> (Dordrecht: Springer Netherlands): 401\u2013407, <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1007%2F978-94-010-0987-4_44\" target=\"_blank\">10.1007\/978-94-010-0987-4_44<\/a>, <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-1-4020-0024-9<span class=\"printonly\">, <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/link.springer.com\/10.1007\/978-94-010-0987-4_44\" target=\"_blank\">http:\/\/link.springer.com\/10.1007\/978-94-010-0987-4_44<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 2023-05-16<\/span><\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Whole+Life+Cycle+Risk+Management&rft.jtitle=Assessment+and+Management+of+Environmental+Risks&rft.aulast=Lemos&rft.aufirst=T.&rft.au=Lemos%2C%26%2332%3BT.&rft.au=Almeida%2C%26%2332%3BL.+T.&rft.date=2001&rft.pages=401%E2%80%93407&rft.place=Dordrecht&rft.pub=Springer+Netherlands&rft_id=info:doi\/10.1007%2F978-94-010-0987-4_44&rft.isbn=978-1-4020-0024-9&rft_id=http%3A%2F%2Flink.springer.com%2F10.1007%2F978-94-010-0987-4_44&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:6-14\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:6_14-0\">14.0<\/a><\/sup> <sup><a href=\"#cite_ref-:6_14-1\">14.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Dikmen, I.; Birgonul, M.T.; Anac, C.; Tah, J.H.M.; Aouad, G. (1 December 2008). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0926580508000691\" target=\"_blank\">\"Learning from risks: A tool for post-project risk assessment\"<\/a> (in en). <i>Automation in Construction<\/i> <b>18<\/b> (1): 42\u201350. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.autcon.2008.04.008\" target=\"_blank\">10.1016\/j.autcon.2008.04.008<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0926580508000691\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0926580508000691<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Learning+from+risks%3A+A+tool+for+post-project+risk+assessment&rft.jtitle=Automation+in+Construction&rft.aulast=Dikmen&rft.aufirst=I.&rft.au=Dikmen%2C%26%2332%3BI.&rft.au=Birgonul%2C%26%2332%3BM.T.&rft.au=Anac%2C%26%2332%3BC.&rft.au=Tah%2C%26%2332%3BJ.H.M.&rft.au=Aouad%2C%26%2332%3BG.&rft.date=1+December+2008&rft.volume=18&rft.issue=1&rft.pages=42%E2%80%9350&rft_id=info:doi\/10.1016%2Fj.autcon.2008.04.008&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS0926580508000691&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-15\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-15\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Kang, Leen Seok; Kim, Sung-Keun; Moon, Hyoun Seok; Kim, Hyeon Seung (1 May 2013). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0926580512002336\" target=\"_blank\">\"Development of a 4D object-based system for visualizing the risk information of construction projects\"<\/a> (in en). <i>Automation in Construction<\/i> <b>31<\/b>: 186\u2013203. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.autcon.2012.11.038\" target=\"_blank\">10.1016\/j.autcon.2012.11.038<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0926580512002336\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0926580512002336<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Development+of+a+4D+object-based+system+for+visualizing+the+risk+information+of+construction+projects&rft.jtitle=Automation+in+Construction&rft.aulast=Kang&rft.aufirst=Leen+Seok&rft.au=Kang%2C%26%2332%3BLeen+Seok&rft.au=Kim%2C%26%2332%3BSung-Keun&rft.au=Moon%2C%26%2332%3BHyoun+Seok&rft.au=Kim%2C%26%2332%3BHyeon+Seung&rft.date=1+May+2013&rft.volume=31&rft.pages=186%E2%80%93203&rft_id=info:doi\/10.1016%2Fj.autcon.2012.11.038&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS0926580512002336&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-16\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-16\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">International Organization for Standardization (November 2008). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.iso.org\/standard\/46486.html\" target=\"_blank\">\"ISO 9001:2008 Quality management systems \u2014 Requirements\"<\/a>. International Organization for Standardization<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.iso.org\/standard\/46486.html\" target=\"_blank\">https:\/\/www.iso.org\/standard\/46486.html<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=ISO+9001%3A2008+Quality+management+systems+%E2%80%94+Requirements&rft.atitle=&rft.aulast=International+Organization+for+Standardization&rft.au=International+Organization+for+Standardization&rft.date=November+2008&rft.pub=International+Organization+for+Standardization&rft_id=https%3A%2F%2Fwww.iso.org%2Fstandard%2F46486.html&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-17\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-17\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">International Organization for Standardization (May 2005). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.iso.org\/standard\/39883.html\" target=\"_blank\">\"ISO\/IEC 17025:2005 General requirements for the competence of testing and calibration laboratories\"<\/a>. International Organization for Standardization<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.iso.org\/standard\/39883.html\" target=\"_blank\">https:\/\/www.iso.org\/standard\/39883.html<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=ISO%2FIEC+17025%3A2005+General+requirements+for+the+competence+of+testing+and+calibration+laboratories&rft.atitle=&rft.aulast=International+Organization+for+Standardization&rft.au=International+Organization+for+Standardization&rft.date=May+2005&rft.pub=International+Organization+for+Standardization&rft_id=https%3A%2F%2Fwww.iso.org%2Fstandard%2F39883.html&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-18\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-18\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">International Organization for Standardization (September 2015). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.iso.org\/standard\/62085.html\" target=\"_blank\">\"ISO 9001:2015 Quality management systems \u2014 Requirements\"<\/a>. International Organization for Standardization<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.iso.org\/standard\/62085.html\" target=\"_blank\">https:\/\/www.iso.org\/standard\/62085.html<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=ISO+9001%3A2015+Quality+management+systems+%E2%80%94+Requirements&rft.atitle=&rft.aulast=International+Organization+for+Standardization&rft.au=International+Organization+for+Standardization&rft.date=September+2015&rft.pub=International+Organization+for+Standardization&rft_id=https%3A%2F%2Fwww.iso.org%2Fstandard%2F62085.html&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:7-19\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:7_19-0\">19.0<\/a><\/sup> <sup><a href=\"#cite_ref-:7_19-1\">19.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation web\">International Organization for Standardization (November 2017). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.iso.org\/standard\/66912.html\" target=\"_blank\">\"ISO\/IEC 17025:2017 General requirements for the competence of testing and calibration laboratories\"<\/a>. International Organization for Standardization<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.iso.org\/standard\/66912.html\" target=\"_blank\">https:\/\/www.iso.org\/standard\/66912.html<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=ISO%2FIEC+17025%3A2017+General+requirements+for+the+competence+of+testing+and+calibration+laboratories&rft.atitle=&rft.aulast=International+Organization+for+Standardization&rft.au=International+Organization+for+Standardization&rft.date=November+2017&rft.pub=International+Organization+for+Standardization&rft_id=https%3A%2F%2Fwww.iso.org%2Fstandard%2F66912.html&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:8-20\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:8_20-0\">20.0<\/a><\/sup> <sup><a href=\"#cite_ref-:8_20-1\">20.1<\/a><\/sup> <sup><a href=\"#cite_ref-:8_20-2\">20.2<\/a><\/sup> <sup><a href=\"#cite_ref-:8_20-3\">20.3<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation web\">International Organization for Standardization (September 2015). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.iso.org\/standard\/60857.html\" target=\"_blank\">\"ISO 14001:2015 Environmental management systems \u2014 Requirements with guidance for use\"<\/a>. International Organization for Standardization<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.iso.org\/standard\/60857.html\" target=\"_blank\">https:\/\/www.iso.org\/standard\/60857.html<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=ISO+14001%3A2015+Environmental+management+systems+%E2%80%94+Requirements+with+guidance+for+use&rft.atitle=&rft.aulast=International+Organization+for+Standardization&rft.au=International+Organization+for+Standardization&rft.date=September+2015&rft.pub=International+Organization+for+Standardization&rft_id=https%3A%2F%2Fwww.iso.org%2Fstandard%2F60857.html&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-21\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-21\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">International Organization for Standardization (February 2018). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.iso.org\/standard\/65694.html\" target=\"_blank\">\"ISO 31000:2018 Risk management \u2014 Guidelines\"<\/a>. International Organization for Standardization<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.iso.org\/standard\/65694.html\" target=\"_blank\">https:\/\/www.iso.org\/standard\/65694.html<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=ISO+31000%3A2018+Risk+management+%E2%80%94+Guidelines&rft.atitle=&rft.aulast=International+Organization+for+Standardization&rft.au=International+Organization+for+Standardization&rft.date=February+2018&rft.pub=International+Organization+for+Standardization&rft_id=https%3A%2F%2Fwww.iso.org%2Fstandard%2F65694.html&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:9-22\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:9_22-0\">22.0<\/a><\/sup> <sup><a href=\"#cite_ref-:9_22-1\">22.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Elkington, Paul; Smallman, Clive (1 January 2002). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S026378630000034X\" target=\"_blank\">\"Managing project risks: a case study from the utilities sector\"<\/a> (in en). <i>International Journal of Project Management<\/i> <b>20<\/b> (1): 49\u201357. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2FS0263-7863%2800%2900034-X\" target=\"_blank\">10.1016\/S0263-7863(00)00034-X<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S026378630000034X\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S026378630000034X<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Managing+project+risks%3A+a+case+study+from+the+utilities+sector&rft.jtitle=International+Journal+of+Project+Management&rft.aulast=Elkington&rft.aufirst=Paul&rft.au=Elkington%2C%26%2332%3BPaul&rft.au=Smallman%2C%26%2332%3BClive&rft.date=1+January+2002&rft.volume=20&rft.issue=1&rft.pages=49%E2%80%9357&rft_id=info:doi\/10.1016%2FS0263-7863%2800%2900034-X&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS026378630000034X&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-23\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-23\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Hallikas, Jukka; Karvonen, Iris; Pulkkinen, Urho; Virolainen, Veli-Matti; Tuominen, Markku (1 July 2004). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0925527304000477\" target=\"_blank\">\"Risk management processes in supplier networks\"<\/a> (in en). <i>International Journal of Production Economics<\/i> <b>90<\/b> (1): 47\u201358. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.ijpe.2004.02.007\" target=\"_blank\">10.1016\/j.ijpe.2004.02.007<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0925527304000477\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0925527304000477<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Risk+management+processes+in+supplier+networks&rft.jtitle=International+Journal+of+Production+Economics&rft.aulast=Hallikas&rft.aufirst=Jukka&rft.au=Hallikas%2C%26%2332%3BJukka&rft.au=Karvonen%2C%26%2332%3BIris&rft.au=Pulkkinen%2C%26%2332%3BUrho&rft.au=Virolainen%2C%26%2332%3BVeli-Matti&rft.au=Tuominen%2C%26%2332%3BMarkku&rft.date=1+July+2004&rft.volume=90&rft.issue=1&rft.pages=47%E2%80%9358&rft_id=info:doi\/10.1016%2Fj.ijpe.2004.02.007&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS0925527304000477&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:10-24\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:10_24-0\">24.0<\/a><\/sup> <sup><a href=\"#cite_ref-:10_24-1\">24.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation web\">International Organization for Standardization (June 2019). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.iso.org\/standard\/72140.html\" target=\"_blank\">\"IEC 31010:2019 Risk management \u2014 Risk assessment techniques\"<\/a>. International Organization for Standardization<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.iso.org\/standard\/72140.html\" target=\"_blank\">https:\/\/www.iso.org\/standard\/72140.html<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=IEC+31010%3A2019+Risk+management+%E2%80%94+Risk+assessment+techniques&rft.atitle=&rft.aulast=International+Organization+for+Standardization&rft.au=International+Organization+for+Standardization&rft.date=June+2019&rft.pub=International+Organization+for+Standardization&rft_id=https%3A%2F%2Fwww.iso.org%2Fstandard%2F72140.html&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-25\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-25\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Huang, Jia; You, Jian-Xin; Liu, Hu-Chen; Song, Ming-Shun (1 July 2020). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S095183201930105X\" target=\"_blank\">\"Failure mode and effect analysis improvement: A systematic literature review and future research agenda\"<\/a> (in en). <i>Reliability Engineering & System Safety<\/i> <b>199<\/b>: 106885. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.ress.2020.106885\" target=\"_blank\">10.1016\/j.ress.2020.106885<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S095183201930105X\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S095183201930105X<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Failure+mode+and+effect+analysis+improvement%3A+A+systematic+literature+review+and+future+research+agenda&rft.jtitle=Reliability+Engineering+%26+System+Safety&rft.aulast=Huang&rft.aufirst=Jia&rft.au=Huang%2C%26%2332%3BJia&rft.au=You%2C%26%2332%3BJian-Xin&rft.au=Liu%2C%26%2332%3BHu-Chen&rft.au=Song%2C%26%2332%3BMing-Shun&rft.date=1+July+2020&rft.volume=199&rft.pages=106885&rft_id=info:doi\/10.1016%2Fj.ress.2020.106885&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS095183201930105X&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-26\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-26\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Pillay, Anand; Wang, Jin (1 January 2003). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0951832002001795\" target=\"_blank\">\"Modified failure mode and effects analysis using approximate reasoning\"<\/a> (in en). <i>Reliability Engineering & System Safety<\/i> <b>79<\/b> (1): 69\u201385. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2FS0951-8320%2802%2900179-5\" target=\"_blank\">10.1016\/S0951-8320(02)00179-5<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0951832002001795\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0951832002001795<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Modified+failure+mode+and+effects+analysis+using+approximate+reasoning&rft.jtitle=Reliability+Engineering+%26+System+Safety&rft.aulast=Pillay&rft.aufirst=Anand&rft.au=Pillay%2C%26%2332%3BAnand&rft.au=Wang%2C%26%2332%3BJin&rft.date=1+January+2003&rft.volume=79&rft.issue=1&rft.pages=69%E2%80%9385&rft_id=info:doi\/10.1016%2FS0951-8320%2802%2900179-5&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS0951832002001795&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-27\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-27\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Bhattacharyya, S.K.; Cheliyan, A.S. (1 May 2019). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0951832017314515\" target=\"_blank\">\"Optimization of a subsea production system for cost and reliability using its fault tree model\"<\/a> (in en). <i>Reliability Engineering & System Safety<\/i> <b>185<\/b>: 213\u2013219. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.ress.2018.12.030\" target=\"_blank\">10.1016\/j.ress.2018.12.030<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0951832017314515\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0951832017314515<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Optimization+of+a+subsea+production+system+for+cost+and+reliability+using+its+fault+tree+model&rft.jtitle=Reliability+Engineering+%26+System+Safety&rft.aulast=Bhattacharyya&rft.aufirst=S.K.&rft.au=Bhattacharyya%2C%26%2332%3BS.K.&rft.au=Cheliyan%2C%26%2332%3BA.S.&rft.date=1+May+2019&rft.volume=185&rft.pages=213%E2%80%93219&rft_id=info:doi\/10.1016%2Fj.ress.2018.12.030&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS0951832017314515&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-28\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-28\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Zio, E. (1 February 2009). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0951832008001749\" target=\"_blank\">\"Reliability engineering: Old problems and new challenges\"<\/a> (in en). <i>Reliability Engineering & System Safety<\/i> <b>94<\/b> (2): 125\u2013141. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.ress.2008.06.002\" target=\"_blank\">10.1016\/j.ress.2008.06.002<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0951832008001749\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0951832008001749<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Reliability+engineering%3A+Old+problems+and+new+challenges&rft.jtitle=Reliability+Engineering+%26+System+Safety&rft.aulast=Zio&rft.aufirst=E.&rft.au=Zio%2C%26%2332%3BE.&rft.date=1+February+2009&rft.volume=94&rft.issue=2&rft.pages=125%E2%80%93141&rft_id=info:doi\/10.1016%2Fj.ress.2008.06.002&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS0951832008001749&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-29\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-29\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Chang, Jeonghyun; Yoo, Soo Jin; Kim, Sollip (11 May 2021). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.mdpi.com\/1648-9144\/57\/5\/477\" target=\"_blank\">\"Development and Application of Computerized Risk Registry and Management Tool Based on FMEA and FRACAS for Total Testing Process\"<\/a> (in en). <i>Medicina<\/i> <b>57<\/b> (5): 477. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.3390%2Fmedicina57050477\" target=\"_blank\">10.3390\/medicina57050477<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1648-9144\" target=\"_blank\">1648-9144<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC8151538\/\" target=\"_blank\">PMC8151538<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/34065022\" target=\"_blank\">34065022<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.mdpi.com\/1648-9144\/57\/5\/477\" target=\"_blank\">https:\/\/www.mdpi.com\/1648-9144\/57\/5\/477<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Development+and+Application+of+Computerized+Risk+Registry+and+Management+Tool+Based+on+FMEA+and+FRACAS+for+Total+Testing+Process&rft.jtitle=Medicina&rft.aulast=Chang&rft.aufirst=Jeonghyun&rft.au=Chang%2C%26%2332%3BJeonghyun&rft.au=Yoo%2C%26%2332%3BSoo+Jin&rft.au=Kim%2C%26%2332%3BSollip&rft.date=11+May+2021&rft.volume=57&rft.issue=5&rft.pages=477&rft_id=info:doi\/10.3390%2Fmedicina57050477&rft.issn=1648-9144&rft_id=info:pmc\/PMC8151538&rft_id=info:pmid\/34065022&rft_id=https%3A%2F%2Fwww.mdpi.com%2F1648-9144%2F57%2F5%2F477&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-30\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-30\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Lee, Jae Hoon; Chan, SungIl; Jang, Joong Soon (5 July 2010). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.hindawi.com\/journals\/jqre\/2010\/213690\/\" target=\"_blank\">\"Process-Oriented Development of Failure Reporting, Analysis, and Corrective Action System\"<\/a> (in en). <i>International Journal of Quality, Statistics, and Reliability<\/i> <b>2010<\/b>: 1\u20138. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1155%2F2010%2F213690\" target=\"_blank\">10.1155\/2010\/213690<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1687-7144\" target=\"_blank\">1687-7144<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.hindawi.com\/journals\/jqre\/2010\/213690\/\" target=\"_blank\">https:\/\/www.hindawi.com\/journals\/jqre\/2010\/213690\/<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Process-Oriented+Development+of+Failure+Reporting%2C+Analysis%2C+and+Corrective+Action+System&rft.jtitle=International+Journal+of+Quality%2C+Statistics%2C+and+Reliability&rft.aulast=Lee&rft.aufirst=Jae+Hoon&rft.au=Lee%2C%26%2332%3BJae+Hoon&rft.au=Chan%2C%26%2332%3BSungIl&rft.au=Jang%2C%26%2332%3BJoong+Soon&rft.date=5+July+2010&rft.volume=2010&rft.pages=1%E2%80%938&rft_id=info:doi\/10.1155%2F2010%2F213690&rft.issn=1687-7144&rft_id=https%3A%2F%2Fwww.hindawi.com%2Fjournals%2Fjqre%2F2010%2F213690%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-31\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-31\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation\" id=\"rdp-ebb-CITEREFVasilnakova2018\">Vasilnakova, Andrea (2018), Katalinic, Branko, ed., <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.daaam.info\/Downloads\/Pdfs\/proceedings\/proceedings_2018\/153.pdf\" target=\"_blank\">\"Risk Management in Accredited Testing Laboratories\"<\/a>, <i>DAAAM Proceedings<\/i> (DAAAM International Vienna) <b>1<\/b>: 1071\u20131075, <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.2507%2F29th.daaam.proceedings.153\" target=\"_blank\">10.2507\/29th.daaam.proceedings.153<\/a>, <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-3-902734-20-4<span class=\"printonly\">, <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/www.daaam.info\/Downloads\/Pdfs\/proceedings\/proceedings_2018\/153.pdf\" target=\"_blank\">http:\/\/www.daaam.info\/Downloads\/Pdfs\/proceedings\/proceedings_2018\/153.pdf<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 2023-05-16<\/span><\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Risk+Management+in+Accredited+Testing+Laboratories&rft.jtitle=DAAAM+Proceedings&rft.aulast=Vasilnakova&rft.aufirst=Andrea&rft.au=Vasilnakova%2C%26%2332%3BAndrea&rft.date=2018&rft.volume=1&rft.pages=1071%E2%80%931075&rft.edition=1&rft.pub=DAAAM+International+Vienna&rft_id=info:doi\/10.2507%2F29th.daaam.proceedings.153&rft.isbn=978-3-902734-20-4&rft_id=http%3A%2F%2Fwww.daaam.info%2FDownloads%2FPdfs%2Fproceedings%2Fproceedings_2018%2F153.pdf&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:11-32\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:11_32-0\">32.0<\/a><\/sup> <sup><a href=\"#cite_ref-:11_32-1\">32.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Plebani, Mario; Carraro, Paolo (1 August 1997). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/academic.oup.com\/clinchem\/article\/43\/8\/1348\/5641004\" target=\"_blank\">\"Mistakes in a stat laboratory: types and frequency\"<\/a> (in en). <i>Clinical Chemistry<\/i> <b>43<\/b> (8): 1348\u20131351. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1093%2Fclinchem%2F43.8.1348\" target=\"_blank\">10.1093\/clinchem\/43.8.1348<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0009-9147\" target=\"_blank\">0009-9147<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/academic.oup.com\/clinchem\/article\/43\/8\/1348\/5641004\" target=\"_blank\">https:\/\/academic.oup.com\/clinchem\/article\/43\/8\/1348\/5641004<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Mistakes+in+a+stat+laboratory%3A+types+and+frequency&rft.jtitle=Clinical+Chemistry&rft.aulast=Plebani&rft.aufirst=Mario&rft.au=Plebani%2C%26%2332%3BMario&rft.au=Carraro%2C%26%2332%3BPaolo&rft.date=1+August+1997&rft.volume=43&rft.issue=8&rft.pages=1348%E2%80%931351&rft_id=info:doi\/10.1093%2Fclinchem%2F43.8.1348&rft.issn=0009-9147&rft_id=https%3A%2F%2Facademic.oup.com%2Fclinchem%2Farticle%2F43%2F8%2F1348%2F5641004&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-33\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-33\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Piton, Alain (2008). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/pubmed.ncbi.nlm.nih.gov\/19352000\" target=\"_blank\">\"Risk-based assessment applied to QA GLP audits. How to fulfill regulatory requirements while making the best use of our common sense, knowledge, talents, and resources?\"<\/a>. <i>Annali dell'Istituto Superiore Di Sanita<\/i> <b>44<\/b> (4): 379\u2013384. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2384-8553\" target=\"_blank\">2384-8553<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/19352000\" target=\"_blank\">19352000<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/pubmed.ncbi.nlm.nih.gov\/19352000\" target=\"_blank\">https:\/\/pubmed.ncbi.nlm.nih.gov\/19352000<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Risk-based+assessment+applied+to+QA+GLP+audits.+How+to+fulfill+regulatory+requirements+while+making+the+best+use+of+our+common+sense%2C+knowledge%2C+talents%2C+and+resources%3F&rft.jtitle=Annali+dell%27Istituto+Superiore+Di+Sanita&rft.aulast=Piton&rft.aufirst=Alain&rft.au=Piton%2C%26%2332%3BAlain&rft.date=2008&rft.volume=44&rft.issue=4&rft.pages=379%E2%80%93384&rft.issn=2384-8553&rft_id=info:pmid\/19352000&rft_id=https%3A%2F%2Fpubmed.ncbi.nlm.nih.gov%2F19352000&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:12-34\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:12_34-0\">34.0<\/a><\/sup> <sup><a href=\"#cite_ref-:12_34-1\">34.1<\/a><\/sup> <sup><a href=\"#cite_ref-:12_34-2\">34.2<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Kuo, Y.C.; Lin, C.W.; Wu, H.C. (2004). \"Investigation on the Fires and Explosions in Chemicals-related University Laboratories\". <i>Chemical Technology<\/i> <b>137<\/b> (8): 195\u2013208.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Investigation+on+the+Fires+and+Explosions+in+Chemicals-related+University+Laboratories&rft.jtitle=Chemical+Technology&rft.aulast=Kuo%2C+Y.C.%3B+Lin%2C+C.W.%3B+Wu%2C+H.C.&rft.au=Kuo%2C+Y.C.%3B+Lin%2C+C.W.%3B+Wu%2C+H.C.&rft.date=2004&rft.volume=137&rft.issue=8&rft.pages=195%E2%80%93208&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:13-35\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:13_35-0\">35.0<\/a><\/sup> <sup><a href=\"#cite_ref-:13_35-1\">35.1<\/a><\/sup> <sup><a href=\"#cite_ref-:13_35-2\">35.2<\/a><\/sup> <sup><a href=\"#cite_ref-:13_35-3\">35.3<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Da Rin, Giorgio (1 June 2009). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0009898109001454\" target=\"_blank\">\"Pre-analytical workstations: A tool for reducing laboratory errors\"<\/a> (in en). <i>Clinica Chimica Acta<\/i> <b>404<\/b> (1): 68\u201374. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.cca.2009.03.024\" target=\"_blank\">10.1016\/j.cca.2009.03.024<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0009898109001454\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0009898109001454<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Pre-analytical+workstations%3A+A+tool+for+reducing+laboratory+errors&rft.jtitle=Clinica+Chimica+Acta&rft.aulast=Da+Rin&rft.aufirst=Giorgio&rft.au=Da+Rin%2C%26%2332%3BGiorgio&rft.date=1+June+2009&rft.volume=404&rft.issue=1&rft.pages=68%E2%80%9374&rft_id=info:doi\/10.1016%2Fj.cca.2009.03.024&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS0009898109001454&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:14-36\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:14_36-0\">36.0<\/a><\/sup> <sup><a href=\"#cite_ref-:14_36-1\">36.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation web\">Kuo, T.-Y. (7 September 2006). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/ir.lib.ncu.edu.tw\/handle\/987654321\/3318\" target=\"_blank\">\"Discussion of waste liquid flowing arrangement and control system in lab of college\"<\/a>. National Central University Library<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/ir.lib.ncu.edu.tw\/handle\/987654321\/3318\" target=\"_blank\">http:\/\/ir.lib.ncu.edu.tw\/handle\/987654321\/3318<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Discussion+of+waste+liquid+flowing+arrangement+and+control+system+in+lab+of+college&rft.atitle=&rft.aulast=Kuo%2C+T.-Y.&rft.au=Kuo%2C+T.-Y.&rft.date=7+September+2006&rft.pub=National+Central+University+Library&rft_id=http%3A%2F%2Fir.lib.ncu.edu.tw%2Fhandle%2F987654321%2F3318&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:15-37\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:15_37-0\">37.0<\/a><\/sup> <sup><a href=\"#cite_ref-:15_37-1\">37.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Eliza, David Remona; Minodora, Dobreanu (1 December 2015). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.sciendo.com\/article\/10.1515\/amma-2015-0086\" target=\"_blank\">\"Risk Management in Clinical Laboratory: from Theory to Practice\"<\/a> (in en). <i>Acta Medica Marisiensis<\/i> <b>61<\/b> (4): 372\u2013377. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1515%2Famma-2015-0086\" target=\"_blank\">10.1515\/amma-2015-0086<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2247-6113\" target=\"_blank\">2247-6113<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.sciendo.com\/article\/10.1515\/amma-2015-0086\" target=\"_blank\">https:\/\/www.sciendo.com\/article\/10.1515\/amma-2015-0086<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Risk+Management+in+Clinical+Laboratory%3A+from+Theory+to+Practice&rft.jtitle=Acta+Medica+Marisiensis&rft.aulast=Eliza&rft.aufirst=David+Remona&rft.au=Eliza%2C%26%2332%3BDavid+Remona&rft.au=Minodora%2C%26%2332%3BDobreanu&rft.date=1+December+2015&rft.volume=61&rft.issue=4&rft.pages=372%E2%80%93377&rft_id=info:doi\/10.1515%2Famma-2015-0086&rft.issn=2247-6113&rft_id=https%3A%2F%2Fwww.sciendo.com%2Farticle%2F10.1515%2Famma-2015-0086&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-38\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-38\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Lippi, Giuseppe; Simundic, Ana-Maria; Mattiuzzi, Camilla (2010). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.biochemia-medica.com\/en\/journal\/20\/2\/10.11613\/BM.2010.015\" target=\"_blank\">\"Overview on patient safety in healthcare and laboratory diagnostics\"<\/a>. <i>Biochemia Medica<\/i>: 131\u2013143. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.11613%2FBM.2010.015\" target=\"_blank\">10.11613\/BM.2010.015<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/www.biochemia-medica.com\/en\/journal\/20\/2\/10.11613\/BM.2010.015\" target=\"_blank\">http:\/\/www.biochemia-medica.com\/en\/journal\/20\/2\/10.11613\/BM.2010.015<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Overview+on+patient+safety+in+healthcare+and+laboratory+diagnostics&rft.jtitle=Biochemia+Medica&rft.aulast=Lippi&rft.aufirst=Giuseppe&rft.au=Lippi%2C%26%2332%3BGiuseppe&rft.au=Simundic%2C%26%2332%3BAna-Maria&rft.au=Mattiuzzi%2C%26%2332%3BCamilla&rft.date=2010&rft.pages=131%E2%80%93143&rft_id=info:doi\/10.11613%2FBM.2010.015&rft_id=http%3A%2F%2Fwww.biochemia-medica.com%2Fen%2Fjournal%2F20%2F2%2F10.11613%2FBM.2010.015&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-39\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-39\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Fragkaki, A.G.; Leontiou, I.-P.; Kioukia-Fougia, N.; Tsivou, M.; Spyridaki, M.-\u0397.\u0395.; Georgakopoulos, C.G. (1 October 2006). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0166497205001197\" target=\"_blank\">\"Organization of the doping control laboratory in the Athens 2004 Olympic Games: A case study\"<\/a> (in en). <i>Technovation<\/i> <b>26<\/b> (10): 1162\u20131169. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.technovation.2005.09.003\" target=\"_blank\">10.1016\/j.technovation.2005.09.003<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0166497205001197\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0166497205001197<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Organization+of+the+doping+control+laboratory+in+the+Athens+2004+Olympic+Games%3A+A+case+study&rft.jtitle=Technovation&rft.aulast=Fragkaki&rft.aufirst=A.G.&rft.au=Fragkaki%2C%26%2332%3BA.G.&rft.au=Leontiou%2C%26%2332%3BI.-P.&rft.au=Kioukia-Fougia%2C%26%2332%3BN.&rft.au=Tsivou%2C%26%2332%3BM.&rft.au=Spyridaki%2C%26%2332%3BM.-%CE%97.%CE%95.&rft.au=Georgakopoulos%2C%26%2332%3BC.G.&rft.date=1+October+2006&rft.volume=26&rft.issue=10&rft.pages=1162%E2%80%931169&rft_id=info:doi\/10.1016%2Fj.technovation.2005.09.003&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS0166497205001197&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-40\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-40\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Gimenez-Marin, Angeles; Rivas-Ruiz, Francisco; Perez-Hidalgo, Maria del Mar; Molina-Mendoza, Pedro (2014). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.biochemia-medica.com\/en\/journal\/24\/2\/10.11613\/BM.2014.027\" target=\"_blank\">\"Pre-analytical errors management in the clinical laboratory: a five-year study\"<\/a>. <i>Biochemia Medica<\/i> <b>24<\/b> (2): 248\u2013257. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.11613%2FBM.2014.027\" target=\"_blank\">10.11613\/BM.2014.027<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC4083576\/\" target=\"_blank\">PMC4083576<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/24969918\" target=\"_blank\">24969918<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/www.biochemia-medica.com\/en\/journal\/24\/2\/10.11613\/BM.2014.027\" target=\"_blank\">http:\/\/www.biochemia-medica.com\/en\/journal\/24\/2\/10.11613\/BM.2014.027<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Pre-analytical+errors+management+in+the+clinical+laboratory%3A+a+five-year+study&rft.jtitle=Biochemia+Medica&rft.aulast=Gimenez-Marin&rft.aufirst=Angeles&rft.au=Gimenez-Marin%2C%26%2332%3BAngeles&rft.au=Rivas-Ruiz%2C%26%2332%3BFrancisco&rft.au=Perez-Hidalgo%2C%26%2332%3BMaria+del+Mar&rft.au=Molina-Mendoza%2C%26%2332%3BPedro&rft.date=2014&rft.volume=24&rft.issue=2&rft.pages=248%E2%80%93257&rft_id=info:doi\/10.11613%2FBM.2014.027&rft_id=info:pmc\/PMC4083576&rft_id=info:pmid\/24969918&rft_id=http%3A%2F%2Fwww.biochemia-medica.com%2Fen%2Fjournal%2F24%2F2%2F10.11613%2FBM.2014.027&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-41\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-41\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Plebani, Mario; Sciacovelli, Laura; Aita, Ada; Chiozza, Maria Laura (2014). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.biochemia-medica.com\/en\/journal\/24\/1\/10.11613\/BM.2014.012\" target=\"_blank\">\"Harmonization of pre-analytical quality indicators\"<\/a>. <i>Biochemia Medica<\/i>: 105\u2013113. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.11613%2FBM.2014.012\" target=\"_blank\">10.11613\/BM.2014.012<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC3936970\/\" target=\"_blank\">PMC3936970<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/24627719\" target=\"_blank\">24627719<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/www.biochemia-medica.com\/en\/journal\/24\/1\/10.11613\/BM.2014.012\" target=\"_blank\">http:\/\/www.biochemia-medica.com\/en\/journal\/24\/1\/10.11613\/BM.2014.012<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Harmonization+of+pre-analytical+quality+indicators&rft.jtitle=Biochemia+Medica&rft.aulast=Plebani&rft.aufirst=Mario&rft.au=Plebani%2C%26%2332%3BMario&rft.au=Sciacovelli%2C%26%2332%3BLaura&rft.au=Aita%2C%26%2332%3BAda&rft.au=Chiozza%2C%26%2332%3BMaria+Laura&rft.date=2014&rft.pages=105%E2%80%93113&rft_id=info:doi\/10.11613%2FBM.2014.012&rft_id=info:pmc\/PMC3936970&rft_id=info:pmid\/24627719&rft_id=http%3A%2F%2Fwww.biochemia-medica.com%2Fen%2Fjournal%2F24%2F1%2F10.11613%2FBM.2014.012&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-42\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-42\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Sciacovelli, Laura; Plebani, Mario (1 June 2009). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0009898109001478\" target=\"_blank\">\"The IFCC Working Group on laboratory errors and patient safety\"<\/a> (in en). <i>Clinica Chimica Acta<\/i> <b>404<\/b> (1): 79\u201385. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.cca.2009.03.025\" target=\"_blank\">10.1016\/j.cca.2009.03.025<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0009898109001478\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0009898109001478<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=The+IFCC+Working+Group+on+laboratory+errors+and+patient+safety&rft.jtitle=Clinica+Chimica+Acta&rft.aulast=Sciacovelli&rft.aufirst=Laura&rft.au=Sciacovelli%2C%26%2332%3BLaura&rft.au=Plebani%2C%26%2332%3BMario&rft.date=1+June+2009&rft.volume=404&rft.issue=1&rft.pages=79%E2%80%9385&rft_id=info:doi\/10.1016%2Fj.cca.2009.03.025&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS0009898109001478&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-43\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-43\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Bates, David W.; Gawande, Atul A. (19 June 2003). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.nejm.org\/doi\/abs\/10.1056\/NEJMsa020847\" target=\"_blank\">\"Improving Safety with Information Technology\"<\/a> (in en). <i>New England Journal of Medicine<\/i> <b>348<\/b> (25): 2526\u20132534. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1056%2FNEJMsa020847\" target=\"_blank\">10.1056\/NEJMsa020847<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0028-4793\" target=\"_blank\">0028-4793<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/www.nejm.org\/doi\/abs\/10.1056\/NEJMsa020847\" target=\"_blank\">http:\/\/www.nejm.org\/doi\/abs\/10.1056\/NEJMsa020847<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Improving+Safety+with+Information+Technology&rft.jtitle=New+England+Journal+of+Medicine&rft.aulast=Bates&rft.aufirst=David+W.&rft.au=Bates%2C%26%2332%3BDavid+W.&rft.au=Gawande%2C%26%2332%3BAtul+A.&rft.date=19+June+2003&rft.volume=348&rft.issue=25&rft.pages=2526%E2%80%932534&rft_id=info:doi\/10.1056%2FNEJMsa020847&rft.issn=0028-4793&rft_id=http%3A%2F%2Fwww.nejm.org%2Fdoi%2Fabs%2F10.1056%2FNEJMsa020847&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-44\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-44\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Plebani, Mario; Bonini, Pierangelo (16 February 2002). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/pubmed.ncbi.nlm.nih.gov\/11855391\" target=\"_blank\">\"Wrong biochemistry results. Interdepartmental cooperation may help avoid errors in medical laboratories\"<\/a>. <i>BMJ (Clinical research ed.)<\/i> <b>324<\/b> (7334): 423\u2013424. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1756-1833\" target=\"_blank\">1756-1833<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/11855391\" target=\"_blank\">11855391<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/pubmed.ncbi.nlm.nih.gov\/11855391\" target=\"_blank\">https:\/\/pubmed.ncbi.nlm.nih.gov\/11855391<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Wrong+biochemistry+results.+Interdepartmental+cooperation+may+help+avoid+errors+in+medical+laboratories&rft.jtitle=BMJ+%28Clinical+research+ed.%29&rft.aulast=Plebani&rft.aufirst=Mario&rft.au=Plebani%2C%26%2332%3BMario&rft.au=Bonini%2C%26%2332%3BPierangelo&rft.date=16+February+2002&rft.volume=324&rft.issue=7334&rft.pages=423%E2%80%93424&rft.issn=1756-1833&rft_id=info:pmid\/11855391&rft_id=https%3A%2F%2Fpubmed.ncbi.nlm.nih.gov%2F11855391&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-45\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-45\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Lippi, Giuseppe; Guidi, Gian Cesare (1 January 2007). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.degruyter.com\/document\/doi\/10.1515\/CCLM.2007.167\/html\" target=\"_blank\">\"Risk management in the preanalytical phase of laboratory testing\"<\/a>. <i>Clinical Chemical Laboratory Medicine<\/i> <b>45<\/b> (6). <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1515%2FCCLM.2007.167\" target=\"_blank\">10.1515\/CCLM.2007.167<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.degruyter.com\/document\/doi\/10.1515\/CCLM.2007.167\/html\" target=\"_blank\">https:\/\/www.degruyter.com\/document\/doi\/10.1515\/CCLM.2007.167\/html<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Risk+management+in+the+preanalytical+phase+of+laboratory+testing&rft.jtitle=Clinical+Chemical+Laboratory+Medicine&rft.aulast=Lippi&rft.aufirst=Giuseppe&rft.au=Lippi%2C%26%2332%3BGiuseppe&rft.au=Guidi%2C%26%2332%3BGian+Cesare&rft.date=1+January+2007&rft.volume=45&rft.issue=6&rft_id=info:doi\/10.1515%2FCCLM.2007.167&rft_id=https%3A%2F%2Fwww.degruyter.com%2Fdocument%2Fdoi%2F10.1515%2FCCLM.2007.167%2Fhtml&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-46\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-46\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Da Rin, Giorgio (1 June 2009). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0009898109001454\" target=\"_blank\">\"Pre-analytical workstations: A tool for reducing laboratory errors\"<\/a> (in en). <i>Clinica Chimica Acta<\/i> <b>404<\/b> (1): 68\u201374. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.cca.2009.03.024\" target=\"_blank\">10.1016\/j.cca.2009.03.024<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0009898109001454\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0009898109001454<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Pre-analytical+workstations%3A+A+tool+for+reducing+laboratory+errors&rft.jtitle=Clinica+Chimica+Acta&rft.aulast=Da+Rin&rft.aufirst=Giorgio&rft.au=Da+Rin%2C%26%2332%3BGiorgio&rft.date=1+June+2009&rft.volume=404&rft.issue=1&rft.pages=68%E2%80%9374&rft_id=info:doi\/10.1016%2Fj.cca.2009.03.024&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS0009898109001454&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-47\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-47\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Gibbon, Gerst A. (1 May 1996). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/1381141X9500024K\" target=\"_blank\">\"A brief history of LIMS\"<\/a> (in en). <i>Laboratory Automation & Information Management<\/i> <b>32<\/b> (1): 1\u20135. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2F1381-141X%2895%2900024-K\" target=\"_blank\">10.1016\/1381-141X(95)00024-K<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/1381141X9500024K\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/1381141X9500024K<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=A+brief+history+of+LIMS&rft.jtitle=Laboratory+Automation+%26+Information+Management&rft.aulast=Gibbon&rft.aufirst=Gerst+A.&rft.au=Gibbon%2C%26%2332%3BGerst+A.&rft.date=1+May+1996&rft.volume=32&rft.issue=1&rft.pages=1%E2%80%935&rft_id=info:doi\/10.1016%2F1381-141X%2895%2900024-K&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2F1381141X9500024K&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-48\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-48\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Goodman, N.; Rozen, S.; Stein, L. D. (1998). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/pubmed.ncbi.nlm.nih.gov\/9783211\" target=\"_blank\">\"The LabFlow system for workflow management in large scale biology research laboratories\"<\/a>. <i>Proceedings. International Conference on Intelligent Systems for Molecular Biology<\/i> <b>6<\/b>: 69\u201377. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1553-0833\" target=\"_blank\">1553-0833<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/9783211\" target=\"_blank\">9783211<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/pubmed.ncbi.nlm.nih.gov\/9783211\" target=\"_blank\">https:\/\/pubmed.ncbi.nlm.nih.gov\/9783211<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=The+LabFlow+system+for+workflow+management+in+large+scale+biology+research+laboratories&rft.jtitle=Proceedings.+International+Conference+on+Intelligent+Systems+for+Molecular+Biology&rft.aulast=Goodman&rft.aufirst=N.&rft.au=Goodman%2C%26%2332%3BN.&rft.au=Rozen%2C%26%2332%3BS.&rft.au=Stein%2C%26%2332%3BL.+D.&rft.date=1998&rft.volume=6&rft.pages=69%E2%80%9377&rft.issn=1553-0833&rft_id=info:pmid\/9783211&rft_id=https%3A%2F%2Fpubmed.ncbi.nlm.nih.gov%2F9783211&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:16-49\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:16_49-0\">49.0<\/a><\/sup> <sup><a href=\"#cite_ref-:16_49-1\">49.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Skobelev, D. O.; Zaytseva, T. M.; Kozlov, A. D.; Perepelitsa, V. L.; Makarova, A. S. (1 January 2011). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/link.springer.com\/10.1007\/s11018-011-9638-7\" target=\"_blank\">\"Laboratory information management systems in the work of the analytic laboratory\"<\/a> (in en). <i>Measurement Techniques<\/i> <b>53<\/b> (10): 1182\u20131189. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1007%2Fs11018-011-9638-7\" target=\"_blank\">10.1007\/s11018-011-9638-7<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0543-1972\" target=\"_blank\">0543-1972<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/link.springer.com\/10.1007\/s11018-011-9638-7\" target=\"_blank\">http:\/\/link.springer.com\/10.1007\/s11018-011-9638-7<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Laboratory+information+management+systems+in+the+work+of+the+analytic+laboratory&rft.jtitle=Measurement+Techniques&rft.aulast=Skobelev&rft.aufirst=D.+O.&rft.au=Skobelev%2C%26%2332%3BD.+O.&rft.au=Zaytseva%2C%26%2332%3BT.+M.&rft.au=Kozlov%2C%26%2332%3BA.+D.&rft.au=Perepelitsa%2C%26%2332%3BV.+L.&rft.au=Makarova%2C%26%2332%3BA.+S.&rft.date=1+January+2011&rft.volume=53&rft.issue=10&rft.pages=1182%E2%80%931189&rft_id=info:doi\/10.1007%2Fs11018-011-9638-7&rft.issn=0543-1972&rft_id=http%3A%2F%2Flink.springer.com%2F10.1007%2Fs11018-011-9638-7&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-50\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-50\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Casey, Eoghan (1 March 2020). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1742287619303147\" target=\"_blank\">\"Standardization of forming and expressing preliminary evaluative opinions on digital evidence\"<\/a> (in en). <i>Forensic Science International: Digital Investigation<\/i> <b>32<\/b>: 200888. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.fsidi.2019.200888\" target=\"_blank\">10.1016\/j.fsidi.2019.200888<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1742287619303147\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1742287619303147<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Standardization+of+forming+and+expressing+preliminary+evaluative+opinions+on+digital+evidence&rft.jtitle=Forensic+Science+International%3A+Digital+Investigation&rft.aulast=Casey&rft.aufirst=Eoghan&rft.au=Casey%2C%26%2332%3BEoghan&rft.date=1+March+2020&rft.volume=32&rft.pages=200888&rft_id=info:doi\/10.1016%2Fj.fsidi.2019.200888&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS1742287619303147&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-51\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-51\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Sun, Dingzhong; Wu, Linhuan; Fan, Guomei (1 June 2021). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2588933821000042\" target=\"_blank\">\"Laboratory information management system for biosafety laboratory: Safety and efficiency\"<\/a> (in en). <i>Journal of Biosafety and Biosecurity<\/i> <b>3<\/b> (1): 28\u201334. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.jobb.2021.03.001\" target=\"_blank\">10.1016\/j.jobb.2021.03.001<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2588933821000042\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2588933821000042<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Laboratory+information+management+system+for+biosafety+laboratory%3A+Safety+and+efficiency&rft.jtitle=Journal+of+Biosafety+and+Biosecurity&rft.aulast=Sun&rft.aufirst=Dingzhong&rft.au=Sun%2C%26%2332%3BDingzhong&rft.au=Wu%2C%26%2332%3BLinhuan&rft.au=Fan%2C%26%2332%3BGuomei&rft.date=1+June+2021&rft.volume=3&rft.issue=1&rft.pages=28%E2%80%9334&rft_id=info:doi\/10.1016%2Fj.jobb.2021.03.001&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS2588933821000042&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:17-52\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:17_52-0\">52.0<\/a><\/sup> <sup><a href=\"#cite_ref-:17_52-1\">52.1<\/a><\/sup> <sup><a href=\"#cite_ref-:17_52-2\">52.2<\/a><\/sup> <sup><a href=\"#cite_ref-:17_52-3\">52.3<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Ho, Chao-Chung; Chen, Ming-Shu (1 January 2018). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0956053X17306979\" target=\"_blank\">\"Risk assessment and quality improvement of liquid waste management in Taiwan University chemical laboratories\"<\/a> (in en). <i>Waste Management<\/i> <b>71<\/b>: 578\u2013588. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.wasman.2017.09.029\" target=\"_blank\">10.1016\/j.wasman.2017.09.029<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0956053X17306979\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0956053X17306979<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Risk+assessment+and+quality+improvement+of+liquid+waste+management+in+Taiwan+University+chemical+laboratories&rft.jtitle=Waste+Management&rft.aulast=Ho&rft.aufirst=Chao-Chung&rft.au=Ho%2C%26%2332%3BChao-Chung&rft.au=Chen%2C%26%2332%3BMing-Shu&rft.date=1+January+2018&rft.volume=71&rft.pages=578%E2%80%93588&rft_id=info:doi\/10.1016%2Fj.wasman.2017.09.029&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS0956053X17306979&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-53\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-53\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Wurtz, N.; Papa, A.; Hukic, M.; Di Caro, A.; Leparc-Goffart, I.; Leroy, E.; Landini, M. P.; Sekeyova, Z. <i>et al.<\/i> (1 August 2016). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/link.springer.com\/10.1007\/s10096-016-2657-1\" target=\"_blank\">\"Survey of laboratory-acquired infections around the world in biosafety level 3 and 4 laboratories\"<\/a> (in en). <i>European Journal of Clinical Microbiology & Infectious Diseases<\/i> <b>35<\/b> (8): 1247\u20131258. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1007%2Fs10096-016-2657-1\" target=\"_blank\">10.1007\/s10096-016-2657-1<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0934-9723\" target=\"_blank\">0934-9723<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC7088173\/\" target=\"_blank\">PMC7088173<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/27234593\" target=\"_blank\">27234593<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/link.springer.com\/10.1007\/s10096-016-2657-1\" target=\"_blank\">http:\/\/link.springer.com\/10.1007\/s10096-016-2657-1<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Survey+of+laboratory-acquired+infections+around+the+world+in+biosafety+level+3+and+4+laboratories&rft.jtitle=European+Journal+of+Clinical+Microbiology+%26+Infectious+Diseases&rft.aulast=Wurtz&rft.aufirst=N.&rft.au=Wurtz%2C%26%2332%3BN.&rft.au=Papa%2C%26%2332%3BA.&rft.au=Hukic%2C%26%2332%3BM.&rft.au=Di+Caro%2C%26%2332%3BA.&rft.au=Leparc-Goffart%2C%26%2332%3BI.&rft.au=Leroy%2C%26%2332%3BE.&rft.au=Landini%2C%26%2332%3BM.+P.&rft.au=Sekeyova%2C%26%2332%3BZ.&rft.au=Dumler%2C%26%2332%3BJ.+S.&rft.date=1+August+2016&rft.volume=35&rft.issue=8&rft.pages=1247%E2%80%931258&rft_id=info:doi\/10.1007%2Fs10096-016-2657-1&rft.issn=0934-9723&rft_id=info:pmc\/PMC7088173&rft_id=info:pmid\/27234593&rft_id=http%3A%2F%2Flink.springer.com%2F10.1007%2Fs10096-016-2657-1&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-54\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-54\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation book\">Kirwan, B. (1994). <i>A guide to practical human reliability assessment<\/i>. Bristol, PA: Taylor & Francis. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-0-7484-0052-2.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=book&rft.btitle=A+guide+to+practical+human+reliability+assessment&rft.aulast=Kirwan&rft.aufirst=B.&rft.au=Kirwan%2C%26%2332%3BB.&rft.date=1994&rft.place=Bristol%2C+PA&rft.pub=Taylor+%26+Francis&rft.isbn=978-0-7484-0052-2&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-55\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-55\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Lou, Amy H.; Elnenaei, Manal O.; Sadek, Irene; Thompson, Shauna; Crocker, Bryan D.; Nassar, Bassam A. (1 October 2017). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0009912017303284\" target=\"_blank\">\"Multiple pre- and post-analytical lean approaches to the improvement of the laboratory turnaround time in a large core laboratory\"<\/a> (in en). <i>Clinical Biochemistry<\/i> <b>50<\/b> (15): 864\u2013869. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.clinbiochem.2017.04.019\" target=\"_blank\">10.1016\/j.clinbiochem.2017.04.019<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0009912017303284\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0009912017303284<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Multiple+pre-+and+post-analytical+lean+approaches+to+the+improvement+of+the+laboratory+turnaround+time+in+a+large+core+laboratory&rft.jtitle=Clinical+Biochemistry&rft.aulast=Lou&rft.aufirst=Amy+H.&rft.au=Lou%2C%26%2332%3BAmy+H.&rft.au=Elnenaei%2C%26%2332%3BManal+O.&rft.au=Sadek%2C%26%2332%3BIrene&rft.au=Thompson%2C%26%2332%3BShauna&rft.au=Crocker%2C%26%2332%3BBryan+D.&rft.au=Nassar%2C%26%2332%3BBassam+A.&rft.date=1+October+2017&rft.volume=50&rft.issue=15&rft.pages=864%E2%80%93869&rft_id=info:doi\/10.1016%2Fj.clinbiochem.2017.04.019&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS0009912017303284&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-56\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-56\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">McDonald, Michael J.; Rice, Daniel P.; Desai, Michael M. (1 March 2016). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.nature.com\/articles\/nature17143\" target=\"_blank\">\"Sex speeds adaptation by altering the dynamics of molecular evolution\"<\/a> (in en). <i>Nature<\/i> <b>531<\/b> (7593): 233\u2013236. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1038%2Fnature17143\" target=\"_blank\">10.1038\/nature17143<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0028-0836\" target=\"_blank\">0028-0836<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC4855304\/\" target=\"_blank\">PMC4855304<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/26909573\" target=\"_blank\">26909573<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/www.nature.com\/articles\/nature17143\" target=\"_blank\">http:\/\/www.nature.com\/articles\/nature17143<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Sex+speeds+adaptation+by+altering+the+dynamics+of+molecular+evolution&rft.jtitle=Nature&rft.aulast=McDonald&rft.aufirst=Michael+J.&rft.au=McDonald%2C%26%2332%3BMichael+J.&rft.au=Rice%2C%26%2332%3BDaniel+P.&rft.au=Desai%2C%26%2332%3BMichael+M.&rft.date=1+March+2016&rft.volume=531&rft.issue=7593&rft.pages=233%E2%80%93236&rft_id=info:doi\/10.1038%2Fnature17143&rft.issn=0028-0836&rft_id=info:pmc\/PMC4855304&rft_id=info:pmid\/26909573&rft_id=http%3A%2F%2Fwww.nature.com%2Farticles%2Fnature17143&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-57\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-57\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation book\">Yu, S.W.; Chou, K.S. (2001). <i>Introduction to Chemical Process Safety<\/i>. GauLih Book Co., Ltd.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=book&rft.btitle=Introduction+to+Chemical+Process+Safety&rft.aulast=Yu%2C+S.W.%3B+Chou%2C+K.S.&rft.au=Yu%2C+S.W.%3B+Chou%2C+K.S.&rft.date=2001&rft.pub=GauLih+Book+Co.%2C+Ltd&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:18-58\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:18_58-0\">58.0<\/a><\/sup> <sup><a href=\"#cite_ref-:18_58-1\">58.1<\/a><\/sup> <sup><a href=\"#cite_ref-:18_58-2\">58.2<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Oliveira Marques, Karuliny Cristie; Yoshida, Lucas Silva; Teixeira de Siqueira Neto, Abilio; Dias, Acires (2017). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/abcm.org.br\/anais-de-eventos\/COB17\/1364\" target=\"_blank\">\"Risk analysis in chemistry laboratory\"<\/a>. <i>Procceedings of the 24th ABCM International Congress of Mechanicl Engineering<\/i> (ABCM). <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.26678%2FABCM.COBEM2017.COB17-1364\" target=\"_blank\">10.26678\/ABCM.COBEM2017.COB17-1364<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/abcm.org.br\/anais-de-eventos\/COB17\/1364\" target=\"_blank\">http:\/\/abcm.org.br\/anais-de-eventos\/COB17\/1364<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Risk+analysis+in+chemistry+laboratory&rft.jtitle=Procceedings+of+the+24th+ABCM+International+Congress+of+Mechanicl+Engineering&rft.aulast=Oliveira+Marques&rft.aufirst=Karuliny+Cristie&rft.au=Oliveira+Marques%2C%26%2332%3BKaruliny+Cristie&rft.au=Yoshida%2C%26%2332%3BLucas+Silva&rft.au=Teixeira+de+Siqueira+Neto%2C%26%2332%3BAbilio&rft.au=Dias%2C%26%2332%3BAcires&rft.date=2017&rft.pub=ABCM&rft_id=info:doi\/10.26678%2FABCM.COBEM2017.COB17-1364&rft_id=http%3A%2F%2Fabcm.org.br%2Fanais-de-eventos%2FCOB17%2F1364&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-59\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-59\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Raab, Stephen S. (1 May 2006). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/meridian.allenpress.com\/aplm\/article\/130\/5\/633\/459841\/Improving-Patient-Safety-Through-Quality-Assurance\" target=\"_blank\">\"Improving Patient Safety Through Quality Assurance\"<\/a> (in en). <i>Archives of Pathology & Laboratory Medicine<\/i> <b>130<\/b> (5): 633\u2013637. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.5858%2F2006-130-633-IPSTQA\" target=\"_blank\">10.5858\/2006-130-633-IPSTQA<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1543-2165\" target=\"_blank\">1543-2165<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/meridian.allenpress.com\/aplm\/article\/130\/5\/633\/459841\/Improving-Patient-Safety-Through-Quality-Assurance\" target=\"_blank\">https:\/\/meridian.allenpress.com\/aplm\/article\/130\/5\/633\/459841\/Improving-Patient-Safety-Through-Quality-Assurance<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Improving+Patient+Safety+Through+Quality+Assurance&rft.jtitle=Archives+of+Pathology+%26+Laboratory+Medicine&rft.aulast=Raab&rft.aufirst=Stephen+S.&rft.au=Raab%2C%26%2332%3BStephen+S.&rft.date=1+May+2006&rft.volume=130&rft.issue=5&rft.pages=633%E2%80%93637&rft_id=info:doi\/10.5858%2F2006-130-633-IPSTQA&rft.issn=1543-2165&rft_id=https%3A%2F%2Fmeridian.allenpress.com%2Faplm%2Farticle%2F130%2F5%2F633%2F459841%2FImproving-Patient-Safety-Through-Quality-Assurance&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-60\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-60\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Skinhoj, P; Soeby, M (1 April 1981). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/jcp.bmj.com\/cgi\/doi\/10.1136\/jcp.34.4.408\" target=\"_blank\">\"Viral hepatitis in Danish health care personnel, 1974-78.\"<\/a> (in en). <i>Journal of Clinical Pathology<\/i> <b>34<\/b> (4): 408\u2013411. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1136%2Fjcp.34.4.408\" target=\"_blank\">10.1136\/jcp.34.4.408<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0021-9746\" target=\"_blank\">0021-9746<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC493301\/\" target=\"_blank\">PMC493301<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/7240429\" target=\"_blank\">7240429<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/jcp.bmj.com\/cgi\/doi\/10.1136\/jcp.34.4.408\" target=\"_blank\">http:\/\/jcp.bmj.com\/cgi\/doi\/10.1136\/jcp.34.4.408<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Viral+hepatitis+in+Danish+health+care+personnel%2C+1974-78.&rft.jtitle=Journal+of+Clinical+Pathology&rft.aulast=Skinhoj&rft.aufirst=P&rft.au=Skinhoj%2C%26%2332%3BP&rft.au=Soeby%2C%26%2332%3BM&rft.date=1+April+1981&rft.volume=34&rft.issue=4&rft.pages=408%E2%80%93411&rft_id=info:doi\/10.1136%2Fjcp.34.4.408&rft.issn=0021-9746&rft_id=info:pmc\/PMC493301&rft_id=info:pmid\/7240429&rft_id=http%3A%2F%2Fjcp.bmj.com%2Fcgi%2Fdoi%2F10.1136%2Fjcp.34.4.408&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-61\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-61\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Hollensead, Sandra C.; Lockwood, William B.; Elin, Ronald J. (1 December 2004). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/jso.20125\" target=\"_blank\">\"Errors in pathology and laboratory medicine: Consequences and prevention\"<\/a> (in en). <i>Journal of Surgical Oncology<\/i> <b>88<\/b> (3): 161\u2013181. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1002%2Fjso.20125\" target=\"_blank\">10.1002\/jso.20125<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0022-4790\" target=\"_blank\">0022-4790<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/jso.20125\" target=\"_blank\">https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/jso.20125<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Errors+in+pathology+and+laboratory+medicine%3A+Consequences+and+prevention&rft.jtitle=Journal+of+Surgical+Oncology&rft.aulast=Hollensead&rft.aufirst=Sandra+C.&rft.au=Hollensead%2C%26%2332%3BSandra+C.&rft.au=Lockwood%2C%26%2332%3BWilliam+B.&rft.au=Elin%2C%26%2332%3BRonald+J.&rft.date=1+December+2004&rft.volume=88&rft.issue=3&rft.pages=161%E2%80%93181&rft_id=info:doi\/10.1002%2Fjso.20125&rft.issn=0022-4790&rft_id=https%3A%2F%2Fonlinelibrary.wiley.com%2Fdoi%2F10.1002%2Fjso.20125&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-62\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-62\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">U.S. Food and Drug Administration (2020). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.fda.gov\/inspections-compliance-enforcement-and-criminal-investigations\/inspection-references\/investigations-operations-manual\" target=\"_blank\">\"Investigations Operations Manual\"<\/a>. U.S. Food and Drug Administration<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.fda.gov\/inspections-compliance-enforcement-and-criminal-investigations\/inspection-references\/investigations-operations-manual\" target=\"_blank\">https:\/\/www.fda.gov\/inspections-compliance-enforcement-and-criminal-investigations\/inspection-references\/investigations-operations-manual<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Investigations+Operations+Manual&rft.atitle=&rft.aulast=U.S.+Food+and+Drug+Administration&rft.au=U.S.+Food+and+Drug+Administration&rft.date=2020&rft.pub=U.S.+Food+and+Drug+Administration&rft_id=https%3A%2F%2Fwww.fda.gov%2Finspections-compliance-enforcement-and-criminal-investigations%2Finspection-references%2Finvestigations-operations-manual&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-63\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-63\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Chiozza, Maria Laura; Plebani, Mario (1 January 2006). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.degruyter.com\/document\/doi\/10.1515\/CCLM.2006.127\/html\" target=\"_blank\">\"Clinical Governance: from clinical risk management to continuous quality improvement\"<\/a>. <i>Clinical Chemistry and Laboratory Medicine (CCLM)<\/i> <b>44<\/b> (6). <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1515%2FCCLM.2006.127\" target=\"_blank\">10.1515\/CCLM.2006.127<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1434-6621\" target=\"_blank\">1434-6621<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.degruyter.com\/document\/doi\/10.1515\/CCLM.2006.127\/html\" target=\"_blank\">https:\/\/www.degruyter.com\/document\/doi\/10.1515\/CCLM.2006.127\/html<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Clinical+Governance%3A+from+clinical+risk+management+to+continuous+quality+improvement&rft.jtitle=Clinical+Chemistry+and+Laboratory+Medicine+%28CCLM%29&rft.aulast=Chiozza&rft.aufirst=Maria+Laura&rft.au=Chiozza%2C%26%2332%3BMaria+Laura&rft.au=Plebani%2C%26%2332%3BMario&rft.date=1+January+2006&rft.volume=44&rft.issue=6&rft_id=info:doi\/10.1515%2FCCLM.2006.127&rft.issn=1434-6621&rft_id=https%3A%2F%2Fwww.degruyter.com%2Fdocument%2Fdoi%2F10.1515%2FCCLM.2006.127%2Fhtml&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-64\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-64\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">U.S. Chemical Safety Board (19 October 2011). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.csb.gov\/texas-tech-university-chemistry-lab-explosion\/\" target=\"_blank\">\"Texas Tech University Chemistry Lab Explosion, No. 2010-05-I-TX\"<\/a>. U.S. Chemical Safety Board<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.csb.gov\/texas-tech-university-chemistry-lab-explosion\/\" target=\"_blank\">https:\/\/www.csb.gov\/texas-tech-university-chemistry-lab-explosion\/<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Texas+Tech+University+Chemistry+Lab+Explosion%2C+No.+2010-05-I-TX&rft.atitle=&rft.aulast=U.S.+Chemical+Safety+Board&rft.au=U.S.+Chemical+Safety+Board&rft.date=19+October+2011&rft.pub=U.S.+Chemical+Safety+Board&rft_id=https%3A%2F%2Fwww.csb.gov%2Ftexas-tech-university-chemistry-lab-explosion%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-65\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-65\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation book\">Mortimer, Sharon T.; Mortimer, David (28 February 2015). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.cambridge.org\/core\/product\/identifier\/9781139680936\/type\/book\" target=\"_blank\"><i>Quality and Risk Management in the IVF Laboratory<\/i><\/a> (2 ed.). Cambridge University Press. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1017%2Fcbo9781139680936\" target=\"_blank\">10.1017\/cbo9781139680936<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-1-139-68093-6<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.cambridge.org\/core\/product\/identifier\/9781139680936\/type\/book\" target=\"_blank\">https:\/\/www.cambridge.org\/core\/product\/identifier\/9781139680936\/type\/book<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=book&rft.btitle=Quality+and+Risk+Management+in+the+IVF+Laboratory&rft.aulast=Mortimer&rft.aufirst=Sharon+T.&rft.au=Mortimer%2C%26%2332%3BSharon+T.&rft.au=Mortimer%2C%26%2332%3BDavid&rft.date=28+February+2015&rft.edition=2&rft.pub=Cambridge+University+Press&rft_id=info:doi\/10.1017%2Fcbo9781139680936&rft.isbn=978-1-139-68093-6&rft_id=https%3A%2F%2Fwww.cambridge.org%2Fcore%2Fproduct%2Fidentifier%2F9781139680936%2Ftype%2Fbook&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-66\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-66\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Lemos, Jana\u00edna; Gaspar, Pedro D.; Lima, T\u00e2nia M. (17 August 2022). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.mdpi.com\/2075-1702\/10\/8\/702\" target=\"_blank\">\"Environmental Risk Assessment and Management in Industry 4.0: A Review of Technologies and Trends\"<\/a> (in en). <i>Machines<\/i> <b>10<\/b> (8): 702. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.3390%2Fmachines10080702\" target=\"_blank\">10.3390\/machines10080702<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2075-1702\" target=\"_blank\">2075-1702<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.mdpi.com\/2075-1702\/10\/8\/702\" target=\"_blank\">https:\/\/www.mdpi.com\/2075-1702\/10\/8\/702<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Environmental+Risk+Assessment+and+Management+in+Industry+4.0%3A+A+Review+of+Technologies+and+Trends&rft.jtitle=Machines&rft.aulast=Lemos&rft.aufirst=Jana%C3%ADna&rft.au=Lemos%2C%26%2332%3BJana%C3%ADna&rft.au=Gaspar%2C%26%2332%3BPedro+D.&rft.au=Lima%2C%26%2332%3BT%C3%A2nia+M.&rft.date=17+August+2022&rft.volume=10&rft.issue=8&rft.pages=702&rft_id=info:doi\/10.3390%2Fmachines10080702&rft.issn=2075-1702&rft_id=https%3A%2F%2Fwww.mdpi.com%2F2075-1702%2F10%2F8%2F702&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-67\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-67\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">van Rossum, Huub H. (17 November 2022). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.tandfonline.com\/doi\/full\/10.1080\/10408363.2022.2088685\" target=\"_blank\">\"Technical quality assurance and quality control for medical laboratories: a review and proposal of a new concept to obtain integrated and validated QA\/QC plans\"<\/a> (in en). <i>Critical Reviews in Clinical Laboratory Sciences<\/i> <b>59<\/b> (8): 586\u2013600. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1080%2F10408363.2022.2088685\" target=\"_blank\">10.1080\/10408363.2022.2088685<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1040-8363\" target=\"_blank\">1040-8363<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.tandfonline.com\/doi\/full\/10.1080\/10408363.2022.2088685\" target=\"_blank\">https:\/\/www.tandfonline.com\/doi\/full\/10.1080\/10408363.2022.2088685<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Technical+quality+assurance+and+quality+control+for+medical+laboratories%3A+a+review+and+proposal+of+a+new+concept+to+obtain+integrated+and+validated+QA%2FQC+plans&rft.jtitle=Critical+Reviews+in+Clinical+Laboratory+Sciences&rft.aulast=van+Rossum&rft.aufirst=Huub+H.&rft.au=van+Rossum%2C%26%2332%3BHuub+H.&rft.date=17+November+2022&rft.volume=59&rft.issue=8&rft.pages=586%E2%80%93600&rft_id=info:doi\/10.1080%2F10408363.2022.2088685&rft.issn=1040-8363&rft_id=https%3A%2F%2Fwww.tandfonline.com%2Fdoi%2Ffull%2F10.1080%2F10408363.2022.2088685&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-68\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-68\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Buratta, A. (1995). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/chemport-n.cas.org\/\/chemport-n\/?APP=ftslink&action=reflink&origin=npg&version=1.0&coi=1%3ACAS%3A528%3ADyaK2MXps1CrsL4%3D&md5=56d3b0432762c6ffc0cc078edf26b8a5\" target=\"_blank\">\"External quality assessment programs in Lombardy, Italy\"<\/a>. <i>Annali dell'Istituto Superiore di Sanita<\/i> <b>31<\/b> (1): 157\u201361<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/chemport-n.cas.org\/\/chemport-n\/?APP=ftslink&action=reflink&origin=npg&version=1.0&coi=1%3ACAS%3A528%3ADyaK2MXps1CrsL4%3D&md5=56d3b0432762c6ffc0cc078edf26b8a5\" target=\"_blank\">https:\/\/chemport-n.cas.org\/\/chemport-n\/?APP=ftslink&action=reflink&origin=npg&version=1.0&coi=1%3ACAS%3A528%3ADyaK2MXps1CrsL4%3D&md5=56d3b0432762c6ffc0cc078edf26b8a5<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=External+quality+assessment+programs+in+Lombardy%2C+Italy&rft.jtitle=Annali+dell%27Istituto+Superiore+di+Sanita&rft.aulast=Buratta%2C+A.&rft.au=Buratta%2C+A.&rft.date=1995&rft.volume=31&rft.issue=1&rft.pages=157%E2%80%9361&rft_id=https%3A%2F%2Fchemport-n.cas.org%2F%2Fchemport-n%2F%3FAPP%3Dftslink%26action%3Dreflink%26origin%3Dnpg%26version%3D1.0%26coi%3D1%253ACAS%253A528%253ADyaK2MXps1CrsL4%253D%26md5%3D56d3b0432762c6ffc0cc078edf26b8a5&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-69\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-69\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Badrick, Tony (1 September 2021). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0009912021001442\" target=\"_blank\">\"Integrating quality control and external quality assurance\"<\/a> (in en). <i>Clinical Biochemistry<\/i> <b>95<\/b>: 15\u201327. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.clinbiochem.2021.05.003\" target=\"_blank\">10.1016\/j.clinbiochem.2021.05.003<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0009912021001442\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0009912021001442<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Integrating+quality+control+and+external+quality+assurance&rft.jtitle=Clinical+Biochemistry&rft.aulast=Badrick&rft.aufirst=Tony&rft.au=Badrick%2C%26%2332%3BTony&rft.date=1+September+2021&rft.volume=95&rft.pages=15%E2%80%9327&rft_id=info:doi\/10.1016%2Fj.clinbiochem.2021.05.003&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS0009912021001442&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-70\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-70\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation book\">World Health Organization (2016) (in en). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/apps.who.int\/iris\/handle\/10665\/250117\" target=\"_blank\"><i>WHO manual for organizing a national external quality assessment programme for health laboratories and other testing sites<\/i><\/a>. Geneva: World Health Organization. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 9789241549677<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/apps.who.int\/iris\/handle\/10665\/250117\" target=\"_blank\">https:\/\/apps.who.int\/iris\/handle\/10665\/250117<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=book&rft.btitle=WHO+manual+for+organizing+a+national+external+quality+assessment+programme+for+health+laboratories+and+other+testing+sites&rft.aulast=World+Health+Organization&rft.au=World+Health+Organization&rft.date=2016&rft.place=Geneva&rft.pub=World+Health+Organization&rft.isbn=9789241549677&rft_id=https%3A%2F%2Fapps.who.int%2Firis%2Fhandle%2F10665%2F250117&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-71\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-71\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Libeer, Jean-Claude (2 April 2001). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/link.springer.com\/10.1007\/PL00013513\" target=\"_blank\">\"External quality assurance programmes in medical laboratories\"<\/a> (in en). <i>Accreditation and Quality Assurance<\/i> <b>6<\/b> (4-5): 151\u2013153. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1007%2FPL00013513\" target=\"_blank\">10.1007\/PL00013513<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0949-1775\" target=\"_blank\">0949-1775<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/link.springer.com\/10.1007\/PL00013513\" target=\"_blank\">http:\/\/link.springer.com\/10.1007\/PL00013513<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=External+quality+assurance+programmes+in+medical+laboratories&rft.jtitle=Accreditation+and+Quality+Assurance&rft.aulast=Libeer&rft.aufirst=Jean-Claude&rft.au=Libeer%2C%26%2332%3BJean-Claude&rft.date=2+April+2001&rft.volume=6&rft.issue=4-5&rft.pages=151%E2%80%93153&rft_id=info:doi\/10.1007%2FPL00013513&rft.issn=0949-1775&rft_id=http%3A%2F%2Flink.springer.com%2F10.1007%2FPL00013513&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-72\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-72\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation\" id=\"rdp-ebb-CITEREFSturgeon2013\">Sturgeon, Catharine (2013), Wheeler, Michael J., ed., <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/link.springer.com\/10.1007\/978-1-62703-616-0_19\" target=\"_blank\">\"External Quality Assessment Schemes for Immunoassays\"<\/a> (in en), <i>Hormone Assays in Biological Fluids<\/i> (Totowa, NJ: Humana Press) <b>1065<\/b>: 291\u2013305, <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1007%2F978-1-62703-616-0_19\" target=\"_blank\">10.1007\/978-1-62703-616-0_19<\/a>, <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-1-62703-615-3<span class=\"printonly\">, <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/link.springer.com\/10.1007\/978-1-62703-616-0_19\" target=\"_blank\">https:\/\/link.springer.com\/10.1007\/978-1-62703-616-0_19<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 2023-05-16<\/span><\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=External+Quality+Assessment+Schemes+for+Immunoassays&rft.jtitle=Hormone+Assays+in+Biological+Fluids&rft.aulast=Sturgeon&rft.aufirst=Catharine&rft.au=Sturgeon%2C%26%2332%3BCatharine&rft.date=2013&rft.volume=1065&rft.pages=291%E2%80%93305&rft.place=Totowa%2C+NJ&rft.pub=Humana+Press&rft_id=info:doi\/10.1007%2F978-1-62703-616-0_19&rft.isbn=978-1-62703-615-3&rft_id=https%3A%2F%2Flink.springer.com%2F10.1007%2F978-1-62703-616-0_19&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:19-73\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:19_73-0\">73.0<\/a><\/sup> <sup><a href=\"#cite_ref-:19_73-1\">73.1<\/a><\/sup> <sup><a href=\"#cite_ref-:19_73-2\">73.2<\/a><\/sup> <sup><a href=\"#cite_ref-:19_73-3\">73.3<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Casey, Eoghan; Souvignet, Thomas R. (1 November 2020). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0379073820303480\" target=\"_blank\">\"Digital transformation risk management in forensic science laboratories\"<\/a> (in en). <i>Forensic Science International<\/i> <b>316<\/b>: 110486. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.forsciint.2020.110486\" target=\"_blank\">10.1016\/j.forsciint.2020.110486<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0379073820303480\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0379073820303480<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Digital+transformation+risk+management+in+forensic+science+laboratories&rft.jtitle=Forensic+Science+International&rft.aulast=Casey&rft.aufirst=Eoghan&rft.au=Casey%2C%26%2332%3BEoghan&rft.au=Souvignet%2C%26%2332%3BThomas+R.&rft.date=1+November+2020&rft.volume=316&rft.pages=110486&rft_id=info:doi\/10.1016%2Fj.forsciint.2020.110486&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS0379073820303480&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-74\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-74\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Dror, Itiel E. (20 April 2018). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.science.org\/doi\/10.1126\/science.aat8443\" target=\"_blank\">\"Biases in forensic experts\"<\/a> (in en). <i>Science<\/i> <b>360<\/b> (6386): 243\u2013243. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1126%2Fscience.aat8443\" target=\"_blank\">10.1126\/science.aat8443<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0036-8075\" target=\"_blank\">0036-8075<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.science.org\/doi\/10.1126\/science.aat8443\" target=\"_blank\">https:\/\/www.science.org\/doi\/10.1126\/science.aat8443<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Biases+in+forensic+experts&rft.jtitle=Science&rft.aulast=Dror&rft.aufirst=Itiel+E.&rft.au=Dror%2C%26%2332%3BItiel+E.&rft.date=20+April+2018&rft.volume=360&rft.issue=6386&rft.pages=243%E2%80%93243&rft_id=info:doi\/10.1126%2Fscience.aat8443&rft.issn=0036-8075&rft_id=https%3A%2F%2Fwww.science.org%2Fdoi%2F10.1126%2Fscience.aat8443&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-75\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-75\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Dror, Itiel E. (1 June 2016). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/doi.apa.org\/getdoi.cfm?doi=10.1016\/j.jarmac.2016.03.001\" target=\"_blank\">\"A hierarchy of expert performance.\"<\/a> (in en). <i>Journal of Applied Research in Memory and Cognition<\/i> <b>5<\/b> (2): 121\u2013127. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.jarmac.2016.03.001\" target=\"_blank\">10.1016\/j.jarmac.2016.03.001<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2211-369X\" target=\"_blank\">2211-369X<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/doi.apa.org\/getdoi.cfm?doi=10.1016\/j.jarmac.2016.03.001\" target=\"_blank\">http:\/\/doi.apa.org\/getdoi.cfm?doi=10.1016\/j.jarmac.2016.03.001<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=A+hierarchy+of+expert+performance.&rft.jtitle=Journal+of+Applied+Research+in+Memory+and+Cognition&rft.aulast=Dror&rft.aufirst=Itiel+E.&rft.au=Dror%2C%26%2332%3BItiel+E.&rft.date=1+June+2016&rft.volume=5&rft.issue=2&rft.pages=121%E2%80%93127&rft_id=info:doi\/10.1016%2Fj.jarmac.2016.03.001&rft.issn=2211-369X&rft_id=http%3A%2F%2Fdoi.apa.org%2Fgetdoi.cfm%3Fdoi%3D10.1016%2Fj.jarmac.2016.03.001&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-76\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-76\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Dror, I. (2012) (in en). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.accessscience.com\/content\/article\/aYB120321\" target=\"_blank\"><i>Cognitive bias in forensic science<\/i><\/a>. pp. 43\u20135. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1036%2F1097-8542.yb120321\" target=\"_blank\">10.1036\/1097-8542.yb120321<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.accessscience.com\/content\/article\/aYB120321\" target=\"_blank\">https:\/\/www.accessscience.com\/content\/article\/aYB120321<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=book&rft.btitle=Cognitive+bias+in+forensic+science&rft.aulast=Dror%2C+I.&rft.au=Dror%2C+I.&rft.date=2012&rft.pages=pp.+43%E2%80%935&rft_id=info:doi\/10.1036%2F1097-8542.yb120321&rft_id=https%3A%2F%2Fwww.accessscience.com%2Fcontent%2Farticle%2FaYB120321&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-77\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-77\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Kassin, Saul M.; Dror, Itiel E.; Kukucka, Jeff (1 March 2013). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/doi.apa.org\/getdoi.cfm?doi=10.1016\/j.jarmac.2013.01.001\" target=\"_blank\">\"The forensic confirmation bias: Problems, perspectives, and proposed solutions.\"<\/a> (in en). <i>Journal of Applied Research in Memory and Cognition<\/i> <b>2<\/b> (1): 42\u201352. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.jarmac.2013.01.001\" target=\"_blank\">10.1016\/j.jarmac.2013.01.001<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2211-369X\" target=\"_blank\">2211-369X<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/doi.apa.org\/getdoi.cfm?doi=10.1016\/j.jarmac.2013.01.001\" target=\"_blank\">http:\/\/doi.apa.org\/getdoi.cfm?doi=10.1016\/j.jarmac.2013.01.001<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=The+forensic+confirmation+bias%3A+Problems%2C+perspectives%2C+and+proposed+solutions.&rft.jtitle=Journal+of+Applied+Research+in+Memory+and+Cognition&rft.aulast=Kassin&rft.aufirst=Saul+M.&rft.au=Kassin%2C%26%2332%3BSaul+M.&rft.au=Dror%2C%26%2332%3BItiel+E.&rft.au=Kukucka%2C%26%2332%3BJeff&rft.date=1+March+2013&rft.volume=2&rft.issue=1&rft.pages=42%E2%80%9352&rft_id=info:doi\/10.1016%2Fj.jarmac.2013.01.001&rft.issn=2211-369X&rft_id=http%3A%2F%2Fdoi.apa.org%2Fgetdoi.cfm%3Fdoi%3D10.1016%2Fj.jarmac.2013.01.001&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-78\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-78\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation\" id=\"rdp-ebb-CITEREFDrorStoel2014\">Dror, Itiel E.; Stoel, Reinoud D. (2014), Bruinsma, Gerben; Weisburd, David, eds., <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/link.springer.com\/10.1007\/978-1-4614-5690-2_147\" target=\"_blank\">\"Cognitive Forensics: Human Cognition, Contextual Information, and Bias\"<\/a> (in en), <i>Encyclopedia of Criminology and Criminal Justice<\/i> (New York, NY: Springer New York): 353\u2013363, <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1007%2F978-1-4614-5690-2_147\" target=\"_blank\">10.1007\/978-1-4614-5690-2_147<\/a>, <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-1-4614-5689-6<span class=\"printonly\">, <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/link.springer.com\/10.1007\/978-1-4614-5690-2_147\" target=\"_blank\">https:\/\/link.springer.com\/10.1007\/978-1-4614-5690-2_147<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 2023-05-16<\/span><\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Cognitive+Forensics%3A+Human+Cognition%2C+Contextual+Information%2C+and+Bias&rft.jtitle=Encyclopedia+of+Criminology+and+Criminal+Justice&rft.aulast=Dror&rft.aufirst=Itiel+E.&rft.au=Dror%2C%26%2332%3BItiel+E.&rft.au=Stoel%2C%26%2332%3BReinoud+D.&rft.date=2014&rft.pages=353%E2%80%93363&rft.place=New+York%2C+NY&rft.pub=Springer+New+York&rft_id=info:doi\/10.1007%2F978-1-4614-5690-2_147&rft.isbn=978-1-4614-5689-6&rft_id=https%3A%2F%2Flink.springer.com%2F10.1007%2F978-1-4614-5690-2_147&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-79\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-79\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Edmond, G.; Tangen, J. M.; Searston, R. A.; Dror, I. E. (1 March 2015). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/academic.oup.com\/lpr\/article-lookup\/doi\/10.1093\/lpr\/mgu018\" target=\"_blank\">\"Contextual bias and cross-contamination in the forensic sciences: the corrosive implications for investigations, plea bargains, trials and appeals\"<\/a> (in en). <i>Law, Probability and Risk<\/i> <b>14<\/b> (1): 1\u201325. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1093%2Flpr%2Fmgu018\" target=\"_blank\">10.1093\/lpr\/mgu018<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1470-8396\" target=\"_blank\">1470-8396<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/academic.oup.com\/lpr\/article-lookup\/doi\/10.1093\/lpr\/mgu018\" target=\"_blank\">https:\/\/academic.oup.com\/lpr\/article-lookup\/doi\/10.1093\/lpr\/mgu018<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Contextual+bias+and+cross-contamination+in+the+forensic+sciences%3A+the+corrosive+implications+for+investigations%2C+plea+bargains%2C+trials+and+appeals&rft.jtitle=Law%2C+Probability+and+Risk&rft.aulast=Edmond&rft.aufirst=G.&rft.au=Edmond%2C%26%2332%3BG.&rft.au=Tangen%2C%26%2332%3BJ.+M.&rft.au=Searston%2C%26%2332%3BR.+A.&rft.au=Dror%2C%26%2332%3BI.+E.&rft.date=1+March+2015&rft.volume=14&rft.issue=1&rft.pages=1%E2%80%9325&rft_id=info:doi\/10.1093%2Flpr%2Fmgu018&rft.issn=1470-8396&rft_id=https%3A%2F%2Facademic.oup.com%2Flpr%2Farticle-lookup%2Fdoi%2F10.1093%2Flpr%2Fmgu018&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-80\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-80\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Mianes, Rodrigo Le\u00e3o; ten Caten, Carla Schwengber (1 June 2017). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/link.springer.com\/10.1007\/s00769-017-1260-1\" target=\"_blank\">\"Organisation of proficiency schemes by testing and calibration laboratories\"<\/a> (in en). <i>Accreditation and Quality Assurance<\/i> <b>22<\/b> (3): 119\u2013123. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1007%2Fs00769-017-1260-1\" target=\"_blank\">10.1007\/s00769-017-1260-1<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0949-1775\" target=\"_blank\">0949-1775<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/link.springer.com\/10.1007\/s00769-017-1260-1\" target=\"_blank\">http:\/\/link.springer.com\/10.1007\/s00769-017-1260-1<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Organisation+of+proficiency+schemes+by+testing+and+calibration+laboratories&rft.jtitle=Accreditation+and+Quality+Assurance&rft.aulast=Mianes&rft.aufirst=Rodrigo+Le%C3%A3o&rft.au=Mianes%2C%26%2332%3BRodrigo+Le%C3%A3o&rft.au=ten+Caten%2C%26%2332%3BCarla+Schwengber&rft.date=1+June+2017&rft.volume=22&rft.issue=3&rft.pages=119%E2%80%93123&rft_id=info:doi\/10.1007%2Fs00769-017-1260-1&rft.issn=0949-1775&rft_id=http%3A%2F%2Flink.springer.com%2F10.1007%2Fs00769-017-1260-1&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-81\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-81\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Tully, Gillian; Cohen, Neil; Compton, David; Davies, Gareth; Isbell, Roy; Watson, Tim (1 March 2020). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2666282519300374\" target=\"_blank\">\"Quality standards for digital forensics: Learning from experience in England & Wales\"<\/a> (in en). <i>Forensic Science International: Digital Investigation<\/i> <b>32<\/b>: 200905. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.fsidi.2020.200905\" target=\"_blank\">10.1016\/j.fsidi.2020.200905<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2666282519300374\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2666282519300374<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Quality+standards+for+digital+forensics%3A+Learning+from+experience+in+England+%26+Wales&rft.jtitle=Forensic+Science+International%3A+Digital+Investigation&rft.aulast=Tully&rft.aufirst=Gillian&rft.au=Tully%2C%26%2332%3BGillian&rft.au=Cohen%2C%26%2332%3BNeil&rft.au=Compton%2C%26%2332%3BDavid&rft.au=Davies%2C%26%2332%3BGareth&rft.au=Isbell%2C%26%2332%3BRoy&rft.au=Watson%2C%26%2332%3BTim&rft.date=1+March+2020&rft.volume=32&rft.pages=200905&rft_id=info:doi\/10.1016%2Fj.fsidi.2020.200905&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS2666282519300374&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-82\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-82\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Burri, Xavier; Casey, Eoghan; Boll\u00e9, Timothy; Jaquet-Chiffelle, David-Olivier (1 June 2020). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2666281720300780\" target=\"_blank\">\"Chronological independently verifiable electronic chain of custody ledger using blockchain technology\"<\/a> (in en). <i>Forensic Science International: Digital Investigation<\/i> <b>33<\/b>: 300976. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.fsidi.2020.300976\" target=\"_blank\">10.1016\/j.fsidi.2020.300976<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2666281720300780\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2666281720300780<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Chronological+independently+verifiable+electronic+chain+of+custody+ledger+using+blockchain+technology&rft.jtitle=Forensic+Science+International%3A+Digital+Investigation&rft.aulast=Burri&rft.aufirst=Xavier&rft.au=Burri%2C%26%2332%3BXavier&rft.au=Casey%2C%26%2332%3BEoghan&rft.au=Boll%C3%A9%2C%26%2332%3BTimothy&rft.au=Jaquet-Chiffelle%2C%26%2332%3BDavid-Olivier&rft.date=1+June+2020&rft.volume=33&rft.pages=300976&rft_id=info:doi\/10.1016%2Fj.fsidi.2020.300976&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS2666281720300780&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-83\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-83\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Jaquet-Chiffelle, David-Olivier; Casey, Eoghan; Bourquenoud, Jonathan (1 June 2020). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2666281720300834\" target=\"_blank\">\"Tamperproof timestamped provenance ledger using blockchain technology\"<\/a> (in en). <i>Forensic Science International: Digital Investigation<\/i> <b>33<\/b>: 300977. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.fsidi.2020.300977\" target=\"_blank\">10.1016\/j.fsidi.2020.300977<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2666281720300834\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2666281720300834<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Tamperproof+timestamped+provenance+ledger+using+blockchain+technology&rft.jtitle=Forensic+Science+International%3A+Digital+Investigation&rft.aulast=Jaquet-Chiffelle&rft.aufirst=David-Olivier&rft.au=Jaquet-Chiffelle%2C%26%2332%3BDavid-Olivier&rft.au=Casey%2C%26%2332%3BEoghan&rft.au=Bourquenoud%2C%26%2332%3BJonathan&rft.date=1+June+2020&rft.volume=33&rft.pages=300977&rft_id=info:doi\/10.1016%2Fj.fsidi.2020.300977&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS2666281720300834&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-84\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-84\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Murray, D. (20 March 2015). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.couriermail.com.au\/news\/queensland\/queensland-authorities-confirm-miscode-affects-dna-evidence-in-criminal-cases\/news-story\/833c580d3f1c59039efd1a2ef55af92b\" target=\"_blank\">\"Queensland authorities confirm \u2018miscode\u2019 affects DNA evidence in criminal cases\"<\/a>. <i>The Courier Mail<\/i><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.couriermail.com.au\/news\/queensland\/queensland-authorities-confirm-miscode-affects-dna-evidence-in-criminal-cases\/news-story\/833c580d3f1c59039efd1a2ef55af92b\" target=\"_blank\">https:\/\/www.couriermail.com.au\/news\/queensland\/queensland-authorities-confirm-miscode-affects-dna-evidence-in-criminal-cases\/news-story\/833c580d3f1c59039efd1a2ef55af92b<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 10 November 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Queensland+authorities+confirm+%E2%80%98miscode%E2%80%99+affects+DNA+evidence+in+criminal+cases&rft.atitle=The+Courier+Mail&rft.aulast=Murray%2C+D.&rft.au=Murray%2C+D.&rft.date=20+March+2015&rft_id=https%3A%2F%2Fwww.couriermail.com.au%2Fnews%2Fqueensland%2Fqueensland-authorities-confirm-miscode-affects-dna-evidence-in-criminal-cases%2Fnews-story%2F833c580d3f1c59039efd1a2ef55af92b&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-85\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-85\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Margagliotti, Giulia; Boll\u00e9, Timothy (1 May 2019). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0379073819300726\" target=\"_blank\">\"Machine learning & forensic science\"<\/a> (in en). <i>Forensic Science International<\/i> <b>298<\/b>: 138\u2013139. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.forsciint.2019.02.045\" target=\"_blank\">10.1016\/j.forsciint.2019.02.045<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0379073819300726\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0379073819300726<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Machine+learning+%26+forensic+science&rft.jtitle=Forensic+Science+International&rft.aulast=Margagliotti&rft.aufirst=Giulia&rft.au=Margagliotti%2C%26%2332%3BGiulia&rft.au=Boll%C3%A9%2C%26%2332%3BTimothy&rft.date=1+May+2019&rft.volume=298&rft.pages=138%E2%80%93139&rft_id=info:doi\/10.1016%2Fj.forsciint.2019.02.045&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS0379073819300726&rfr_id=info:sid\/en.wikipedia.org:Journal:Identifying_risk_management_challenges_in_laboratories\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<\/ol><\/div><\/div>\n<h2><span class=\"mw-headline\" id=\"Notes\">Notes<\/span><\/h2>\n<p>This presentation is faithful to the original, with changes to presentation, spelling, and grammar as needed. The PMCID and DOI were added when they were missing from the original reference.\n<\/p>\n<!-- \nNewPP limit report\nCached time: 20230629224445\nCache expiry: 86400\nDynamic content: false\nComplications: []\nCPU time usage: 1.121 seconds\nReal time usage: 1.194 seconds\nPreprocessor visited node count: 77077\/1000000\nPost\u2010expand include size: 601195\/2097152 bytes\nTemplate argument size: 195378\/2097152 bytes\nHighest expansion depth: 25\/40\nExpensive parser function count: 0\/100\nUnstrip recursion depth: 0\/20\nUnstrip post\u2010expand size: 182702\/5000000 bytes\n-->\n<!--\nTransclusion expansion time report (%,ms,calls,template)\n100.00% 966.194 1 -total\n 89.87% 868.364 1 Template:Reflist\n 74.35% 718.380 85 Template:Citation\/core\n 57.53% 555.823 62 Template:Cite_journal\n 14.02% 135.435 80 Template:Date\n 9.58% 92.582 7 Template:Cite_book\n 9.07% 87.638 12 Template:Cite_web\n 7.53% 72.798 120 Template:Citation\/identifier\n 4.89% 47.236 4 Template:Citation\n 3.71% 35.801 1 Template:Infobox_journal_article\n-->\n\n<!-- Saved in parser cache with key limswiki:pcache:idhash:14127-0!canonical and timestamp 20230629224444 and revision id 51943. Serialized with JSON.\n -->\n<\/div><\/div><div class=\"printfooter\">Source: <a rel=\"external_link\" class=\"external\" href=\"https:\/\/www.limswiki.org\/index.php\/Journal:Identifying_risk_management_challenges_in_laboratories\">https:\/\/www.limswiki.org\/index.php\/Journal:Identifying_risk_management_challenges_in_laboratories<\/a><\/div>\n<!-- end content --><div class=\"visualClear\"><\/div><\/div><\/div><div class=\"visualClear\"><\/div><\/div><!-- end of the left (by default at least) column --><div class=\"visualClear\"><\/div><\/div>\n\n\n\n<\/body>","e100dcbf45911d7ebdcd67493dc727aa_images":["https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/f\/f9\/Fig1_Tziakou_AccredQualAss23_28-3.png"],"e100dcbf45911d7ebdcd67493dc727aa_timestamp":1688138451,"da73605127ec78cc7d7d98765f3fbcc2_type":"article","da73605127ec78cc7d7d98765f3fbcc2_title":"The modeling of laboratory information systems in higher education based on enterprise architecture planning (EAP) for optimizing monitoring and equipment maintenance (Ifriza et al. 2023)","da73605127ec78cc7d7d98765f3fbcc2_url":"https:\/\/www.limswiki.org\/index.php\/Journal:The_modeling_of_laboratory_information_systems_in_higher_education_based_on_enterprise_architecture_planning_(EAP)_for_optimizing_monitoring_and_equipment_maintenance","da73605127ec78cc7d7d98765f3fbcc2_plaintext":"\n\nJournal:The modeling of laboratory information systems in higher education based on enterprise architecture planning (EAP) for optimizing monitoring and equipment maintenanceFrom LIMSWikiJump to navigationJump to searchFull article title\n \nThe modeling of laboratory information systems in higher education based on enterprise architecture planning (EAP) for optimizing monitoring and equipment maintenanceJournal\n \nMatrix: Jurnal Manajemen Teknologi Dan InformatikaAuthor(s)\n \nIfriza, Yahya N.; Veronika, Trisni W.; Suryarini, Trisni; Supriyadi, AntoniusAuthor affiliation(s)\n \nUniversitas Negeri SemarangYear published\n \n2023Volume and issue\n \n13(1)Page(s)\n \n1\u201311DOI\n \n10.31940\/matrix.v13i1.1-11ISSN\n \n2580-5630Distribution license\n \nCreative Commons Attribution 4.0 InternationalWebsite\n \nhttps:\/\/ojs2.pnb.ac.id\/index.php\/MATRIX\/article\/view\/928Download\n \nhttps:\/\/ojs2.pnb.ac.id\/index.php\/MATRIX\/article\/view\/928\/516\n\nContents \n\n1 Abstract \n2 Introduction \n3 Methodology \n4 Results and discussion \n\n4.1 Initial planning \n4.2 Business modeling \n4.3 System architecture and technology \n4.4 Development of an EA model \n4.5 Implementation and testing \n\n\n5 Conclusion \n6 Abbreviations, acronyms, and initialisms \n7 Acknowledgements \n\n7.1 Conflicts of interest \n\n\n8 References \n9 Notes \n\n\n\nAbstract \nThe laboratory is a place to conduct scientific research, experiments, measurements, or scientific training. Fakultas Matematika dan Ilmu Pengetahuan Alam, Universitas Negeri Semarang (FMIPA UNNES) has several laboratories distributed in each department to support student lectures. Through the implementation of practicum in the laboratory, students are expected to be able to find a concept, as well as foster scientific attitudes and critical thinking skills. Good laboratory management is expected to be able to utilize laboratory resources effectively and efficiently. Laboratory equipment must be ensured to function properly and be ready to be used for practicum. To support this, it is necessary to monitor the condition of the equipment and immediately repair the equipment if any damage is found. The current obstacle is monitoring tool repairs manually, so there are shortcomings such as poor documentation and equipment conditions that cannot be monitored online. \nIn this study, an information system for monitoring the maintenance of laboratory equipment in the departments in the FMIPA UNNES environment will be built. The research method begins with a literature study, initial data collection and observation, enterprise architecture planning (EAP)-based system design, system testing, system analysis, and system evaluation. This study uses the systems development life cycle (SDLC) approach to develop a monitoring information system for the maintenance of laboratory equipment. Testing is done using black box testing. From the results of development and testing, it can be concluded that the system can be used to simplify the process of managing laboratory equipment with a user acceptance testing (UAT) value of 88% suitable for use.\nKeywords: enterprise architecture planning, information systems, laboratory, maintenance, optimization\n\nIntroduction \nA laboratory is a place to conduct scientific research, experiments, measurements, or scientific training. Now lab management has followed technological developments, through to the application of information management systems. This is because technology can facilitate human work. One of them is the existence of digital applications. Applications have various capabilities to help human work, ranging from office applications to management, personal, entertainment, and other fields of human work. With this equipment, human tasks become easier, faster, more thorough, and more efficient.[1]\nThe implementation of lecture practicum in the laboratory is expected so that students can find a concept and then foster scientific attitudes and critical thinking skills. As such, laboratory management needs to be empowered effectively and efficiently.[2] Laboratory equipment must be ensured to function properly and be ready to be used for practicum. To support this, it is necessary to monitor the maintenance of the equipment systematically. The current obstacle is that monitoring of tool repair is done manually, so there are shortcomings such as poor documentation and being able to track the condition of equipment that cannot be monitored online.[3]\nCurrently, the Fakultas Matematika dan Ilmu Pengetahuan Alam, Universitas Negeri Semarang (FMIPA UNNES) laboratory does not yet have an information management system that can monitor the maintenance of laboratory equipment, starting from the condition of laboratory equipment to the repair process if there is damage.[4] Therefore, this study aims to create and implementan information system for monitoring the maintenance of laboratory equipment in the Department of Mathematics and Natural Sciences. Based on the description of the importance of laboratories to supporting lectures, the authors initiated the idea of researching the development of information systems that could monitor laboratory equipment maintenance.[5] This is in-line with the recommendation of the Minister of Administrative and Bureaucratic Reform (PANRB), which implies the use of IT and modern tools in completing work.[6] This monitoring system aims to perform two purposes at once, namely preventing laboratory equipment from being lost or damaged and making it easier for laboratory technicians to carry out maintenance of laboratory equipment.[7]\n\nMethodology \nThe stages in this research are data collection, analysis and design, stages of developing laboratory systems, and testing information systems.[8] The stage of data collection is done by using the method of interview and observation.[9] Interviews were conducted with lecturers, students, and department managers to obtain an overview of the needs and flow of laboratory management. Meanwhile, observations were made by observing what data would be used in the management, borrowing, and processing of laboratory equipment at FMIPA UNNES.[10]\nThe system design stage was carried out using the Waterfall method. The Waterfall method is a sequential software development method and consists of five interrelated and influencing stages.[11][12] With this method, there are several stages, namely the analysis, design, implementation\/coding, testing\/verification, and maintenance stages. The stages of the Waterfall method are shown in Figure 1.\n\r\n\n\n\n\n\n\n\n\n\n\nFigure 1. Waterfall method.\n\n\n\nAt the system design stage, a design was produced for the database using entity-relationship diagrams (ERDs) and data flow diagrams (DFDs) to describe the system framework that would later be built, making it easier to make the system needed by the user.[13] The development stage implemented the results of the design carried out. The information systems development process used the CodeIgniter framework with the PHP and JavaScript programming languages. The next stage of this research involved testing the information system for bugs using the black-box testing method. This test was carried out to find out what deficiencies and errors are in the system.[14] The system was also tested by the end users by attempting to conduct experiments directly using the system. This user testing was carried out using black-box testing and a mean opinion score (MOS). In this case, black-box testing checks one by one the functions that have been created, and whether they have been made in accordance with user requirements.[15] The MOS test involves several respondents who are encouraged to use the system, then afterwards asking them to assess several activities with a range of one to four, where a value of one represents the worst value and a value of four represents the best value. Then the average rating of all respondents was calculated so that the MOS is obtained for the system.[16]\nEnterprise architecture (EA) is a logical organization for the main business processes and information technology (IT) capabilities that reflect the need for integration and standardization of the company's operating model based on the Center for Information Systems Research.[17] EA is a set of principles, methods, and models used in the design and realization of a company's organizational structure, business processes, information systems, and infrastructure.[18] Enterprise architecture planning (EAP) is a process of defining the architecture for the use of information to support the business and planning to implement the architecture.[19][20][21]\nEAP methodologies and models are an early part of a major body of EA knowledge that is still relevant and has influenced many frameworks, methodologies, and best practices in the public and private sectors.[22][12] As such, the research methodology used herein was adapted to the architectural modeling steps of EAP, namely planning initiation, business modeling, current system architecture and technology, development of EA models in the form of data architecture, application architecture, technology architecture, and implementation.[23]\n\nResults and discussion \nThe end result of this research has been an information system for the management of laboratory equipment. This system can be used to simplify the process of data collection, borrowing, and also processing the value of laboratory equipment results. The modeling steps of the EAP were taken into account when building a blueprint for the system architecture. Following the steps of the EAP concept, the system was used to model the laboratory system at FMIPA UNNES. However, this implementation required initial EAP-related planning, business modeling, system architecture and technology consideration, development of an EA model, and implementation and testing of the system.\n\nInitial planning \nThe users of this system were to be department laboratory administrators, who are tasked with inputting lab asset data in their respective departments, including conditions and suggestions for repairing tools. Also involved with initial planning were faculty administrators, who are tasked with making decisions about whether to approve or postpone the proposed repairs, and financial administrators, who are tasked with approving budget allocations\/ceilings.\nThe initial stage of the EAP is planning, which defines the organization as an object by describing the organization's vision and mission, which is linked to the vision associated with information system planning, so that the development of the architecture can be carried out in accordance with business objectives. In accordance with its existence as a university, the core business of a university consists of three main components, namely education and teaching, community service, and research, which make up the Tri Dharma Perguruan Tinggi (Tri Dharma) of higher education. In return for providing educational services to the community, graduates will return to the community with greater purpose. Determining the future vision and mission is necessary as a guideline for determining various IT strategies needed to support the vision and mission. The selection of the planning methodology approach determines the results of the blueprint that is ultimately made. \nThe primary vision and mission of FMIPA UNNES is to develop mathematics and natural science education in superior educational and non-educational programs with conservation insight and positive international reputation. Second, FMIPA UNNES seeks to develop and create science and technological innovation in the fields of mathematics and natural sciences, as well as civilizations with conservation insight and international reputation. Third, the department seeks to have that science and technological innovation disseminate more broadly into the fields of mathematics and natural sciences. Fourth, the departments seeks to build and develop institutional cooperation in supporting the institutional strengthening of the department's international reputation.\nThe goal of FMIPA UNNES is to develop students of mathematics and natural sciences that are superior at the international level, with superior conservation insight. The department can do this by providing modern professional education services in the field of mathematics and natural sciences to the community, and implementing cooperation in the field of mathematics and natural sciences to support the strengthening of institutions of international reputation.\n\nBusiness modeling \nThe inherent organizational structure within universities provides the impetus for conducting business modeling. The organizational structure will show what parts will be handled by a university. As a higher education institution, it focuses on the educational Tri Dharma of education and teaching, research, and community service. This paper will only discuss the fields of education and research\u2014especially as they relate to laboratories\u2014and not include community service. Based on the value chain concept, the main functional areas for the education model in higher education can generally be grouped into main activities and supporting activities. The main activities consist of student admissions, academic operations, and graduation. Meanwhile, supporting activities consist of activities related to resource management (general), financial management, planning and information systems, and publishing and publication. Figure 2 shows the value chain for a university's education and research model.\n\r\n\n\n\n\n\n\n\n\n\n\nFigure 2. The laboratory value chain as found in academic operations.\n\n\n\nEach of the main activities in the value chain can be described. First, student admissions are all activities starting from the process of new student admissions and selection of new student administration. Second, academic operations are all activities related to teaching and learning activities during the student's academic period. Third, graduation is an activity to release students academically at the end of student studies.\nThere is also a variety of support activities. First, the general affairs division is the part responsible for the smooth operation of educational facilities and carries out the development of infrastructure from year to year, for both primary physical facilities and facilities to support educational activities. Second, finance and personnel management are activities that relate to financial management, determination of investment budgets and needs, and monitoring and allocation of human resources. Third, planning and information systems are activities related to the management and development of information system equipment and networks. Fourth, publishing and publication are activities related to the management and publication of journals, bulletins, and student textbooks.\nAfter initiating the organization's business function areas by utilizing Porter's value chain[24], it is possible to arrange the decomposition structure of the business functions using a function hierarchy chart. In accordance with the scope and limitations of this journal, the functions that are decomposed are those related to academics as the main functions with elaboration on student admissions, academic operations, graduation implementation, general division, financial and staffing management, and planning and information systems, as well as publishing and publications. This is depicted in Table 1.\n\n\n\n\n\n\n\nTable 1. Details of business activities in higher education\n\n\nActivity\n\nDetailed activities\n\n\nStudent admission\n\n1. Student admission planning\r\n2. Implementation of selection\r\n3. Re-registration of new students\n\n\nAcademic operations\n\n1. Planning the implementation of academic activities\r\n2. Re-registration\r\n3. Study process\r\n4. Laboratory use\r\n5. Re-registration of new students\r\n6. Evaluation process\r\n7. Implementation of student academic leave\r\n8. Student final exam\n\n\nFinancial and personnel management\n\n1. Budgeting\r\n2. Budget allocation\r\n3. Monitoring and evaluation\r\n4. Budget revision\r\n5. Financial accounting system\r\n6. Employee development planning\r\n7. Payment calculation\r\n8. Employee performance evaluation\n\n\nGraduation implementation\n\n1. Determination of graduation requirements\r\n2. Diploma making\r\n3. Generating transcripts of grades\n\n\nPlanning and information systems\n\n1. Implementation of information system administration\r\n2. Information system administration reporting\r\n3. Development of software or information systems\n\n\nGeneral affairs\n\n1. Implementation of the procurement of facilities and infrastructure\r\n2. Implementation of inventory management\r\n3. Supervision and evaluation of the use of facilities and infrastructure\r\n4. Office inventory reporting\n\n\nPublishing and publication\n\n1. Implementation of journal administration\r\n2. Implementation of bulletin administration\r\n3. Implementation of textbook administration\n\n\n\nFigure 3 below shows the relationship between stakeholders and the main and supporting business functions in a university.\n\n\n\n\n\n\n\n\n\nFigure 3. The main stakeholders of higher education.\n\n\n\nSystem architecture and technology \nAssessing the current information system and technology provides an overview of the current state of information technology and systems, the future development of IT, and the desire and direction of IT development in universities today. In this step, several things need to be considered and used as the main key in conducting the analysis, namely the condition of the organization, the direction of IT development strategy, and the condition of the current information system and technology.\n\nDevelopment of an EA model \nIn building an architectural model, the first thing to do is create a data architecture. The data architecture that will be defined this time is the definition of the data usage that will be used in the application architecture later, which will be delivered at this stage according to the EAP stage in the data architecture.\nAn entity candidate is an entity that will be part of the EAP so that the determination can be based on the condition of the main business functions in the previously defined value chain (thus the entity that will be defined as a business entity) and based on the business entity data entities will be defined by. In accordance with the condition of the value chain, the list of business entities and their data entities can be identified as found in Table 2.\n\n\n\n\n\n\n\nTable 2. Entity list\n\n\nBusiness entity\n\nData entities\n\n\nTool repair entity\n\n1. Tool entity\r\n2. Period entity\r\n3. Date entity\r\n4. Urgency entity\r\n5. Entity status\n\n\nTool\/Material lending entity\n\n1. Tool entity\r\n2. Course entities\r\n3. Class entities\r\n4. Major entity\r\n5. Lecture room entities\n\n\nLoan repayment entity\n\n1. Tool entity\r\n2. Course entities\r\n3. Class entities\r\n4. Lecturer entity\r\n5. Rombel's entity\n\n\nPracticum entity\n\n1. Tool entity\r\n2. Space entity\r\n3. Entity type practicum\r\n4. Lecturer entity\r\n5. Entity status\n\n\nTransaction recap entity\n\n1. Tool entity\r\n2. Lecturer entity\r\n3. Course entities\n\n\n\nTo describe the relationship between entities, the conceptual depiction of the relationship uses an ERD for the laboratory. The ERD is a logical data conceptual model that shows the relationship between entities in laboratories in universities. The last stage in modeling the architecture is defining the technology architecture. The EAP concept defines technology requirements that need to be provided in the business environment to run a data architecture that can manage data based on the application architecture. In other words, the technology architecture is an infrastructure requirement that must be provided to support the running of data and applications used by the organization. The principles and technology platforms were created to identify the main types of technology platforms needed to support shared data and application environments in universities. This principle is determined by considering trends and developments in information technology, business models, data architecture, application architecture, existing systems, and technologies, as well as requests and findings from business people within the organization. Table 3 shows the technology platforms that can be used to support data and applications in universities.\n\n\n\n\n\n\n\nTable 3. Platform\/technology architecture\n\n\nPrinciple area\n\nDescription\n\n\nOperating system\n\nThe selected operating system is portable (can run on multiple platforms), scalable (can run on small to large-scale computers), interoperable (can run in heterogeneous environments), and compatible (maintains existing software investments and allows technological advances to be applied to the environment).\n\n\nHardware\n\nHardware must be reliable and highly available while supporting future technologies.\n\n\nCommunication and network\n\nThe network environment is provided with sufficient bandwidth and a set of standard protocols to support network services and real-time access to information.\n\n\nApplication\n\nAll application designs should be modular and should be testable.\n\n\nDatabase management\n\nThe database model used is a relational database, which is relatively easier to understand and more popular.\n\n\nSecurity\n\nSecurity requirements include secrecy (requirements in information systems that can only be read), availability (needs that information resources can only be obtained and used by authorized users), and integrity (needs that information resources can only be modified and maintained by authorized units).\n\n\n\nImplementation and testing \nThe laboratory system development stage is the implementation stage of the design stage. At this stage of development, it is done by coding the required pages on the laboratory system using the CodeIgniter framework. Figure 4 shows the results of developing logins. The login page is a page that is used to verify users, and there are username and password inputs that must be filled in by system users to be able to enter the system. If the username and password inputs do not match, then the user cannot enter the system.\n\r\n\n\n\n\n\n\n\n\n\n\nFigure 4. Login page.\n\n\n\nAdmin users who have entered the correct username and password will enter the admin page. Figure 5 is a view of the admin page (Admin Data). On the admin data page, admin users can view, add, and change information, and they can delete admin data.\n\r\n\n\n\n\n\n\n\n\n\n\nFigure 5. Admin page.\n\n\n\nThe system testing stage or testing is the stage carried out to match and observe the results of the implementation that has been carried out. System testing or testing was carried out in this study using the black-box method and the MOS. The testing process with the black-box method was carried out by testing one by one the functions that have been made to determine whether they were in accordance with user requirements and whether the output of these functions were in accordance with what was expected. As for MOS testing, it was carried out by subjective assessment of the quality associated with the system. The results of the tests carried out on the website-based Pendadaran Information System using the MOS test method, based on user acceptance testing (UAT), can be seen in Table 4.\n\n\n\n\n\n\n\nTable 4. Eligibility result by expert\n\n\nCode\n\nRating indicator\n\nResult\n\n\nA1\n\nAttractive laboratory system design\n\n93%\n\n\nA2\n\nLaboratory system color match\n\n87%\n\n\nA3\n\nComponent location in laboratory system appropriate\n\n93%\n\n\nA4\n\nLaboratory system size appropriate\n\n67%\n\n\nA5\n\nEasy-to-use laboratory system\n\n93%\n\n\nA6\n\nLaboratory system convenient to use\n\n87%\n\n\nA7\n\nColors in laboratory system clear\n\n93%\n\n\nA8\n\nImages in laboratory system clear\n\n87%\n\n\n\nWe also present expert validity data in the graph of each component, which can be seen in Figure 6.\n\r\n\n\n\n\n\n\n\n\n\n\nFigure 6. Expert validity of each component.\n\n\n\nBased on tool validation by UAT experts selected by the research team to validate the laboratory system for system validation sheets, the results of product feasibility from experts show valid and very valid results, starting from A1 with 93% results, and A2 with 87% results. A3 results in 93%, A4 results in 67%, A5 results in 93%, A6 results in 87%, A7 results in 93%, and A8 results in 87%. If the overall validity component is obtained on average, 88% of the products are very valid. These results are presented in the form of Table 4 and Figure 6.\n\nConclusion \nBased on the results of the study, it can be concluded that the use of laboratory systems for monitoring and maintenance in laboratory management has proven to be very valid. Before implementing the laboratory system identification method, laboratory maintenance and tracking tools and materials were still handled manual. However, EAP proves to be an effective approach to modeling laboratory-based information systems in higher education. EAP helps align the business and technology within laboratory-based information systems, making it easier to monitor and maintain equipment. Monitoring and maintenance of laboratory equipment play a critical role in ensuring the quality of collected data. EAP helps ensure that laboratory equipment is functioning properly and strengthens the software system. \nModeling becomes an effective tool for applying the EAP concept in laboratory-based information systems. Modeling helps align the business and technology goals of the organization with the system to be implemented, ensuring the quality of collected data. The implementation of EAP with lab-based information systems in higher education has the potential to increase efficiency and effectiveness in monitoring and maintenance of equipment. It helps ensure that collected data is accurate and of high quality, making it easier to process, analyze, and make decisions about. After implementing the EAP method, the laboratory system is safer, and access to tools and materials can be monitored properly. A test of the validity of our laboratory system for monitoring and maintenance saw an average validity of the expert team reaching 88%, based on tool validation by UAT experts.\n\n Abbreviations, acronyms, and initialisms \nDFD: data flow diagram\nEA: enterprise architecture\nEAP: enterprise architecture planning\nERD: entity-relationship diagram\nFMIPA UNNES: Fakultas Matematika dan Ilmu Pengetahuan Alam, Universitas Negeri Semarang\nIT: information technology\nMOS: mean opinion score\nPANRB: Minister of Administrative and Bureaucratic Reform\nSDLC: systems development life cycle\nUAT: user acceptance testing\nAcknowledgements \nThe author expresses his gratitude and appreciation to LPPM State University of Semarang for the opportunity given to conduct research on the Functional Tendik scheme in 2022.\n\nConflicts of interest \nNone stated.\n\nReferences \n\n\n\u2191 Uysal, Murat Pasa; Mergen, A. Erhan (1 June 2021). \"Smart manufacturing in intelligent digital mesh: Integration of enterprise architecture and software product line engineering\" (in en). Journal of Industrial Information Integration 22: 100202. doi:10.1016\/j.jii.2021.100202. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2452414X21000030 .   \n \n\n\u2191 Pebrioni, N.M.; Iriani, A.; Dwikurnaningsih, Y. (2021). \"Development of Vocabulary Training Module Using Games for Vocational English Teachers to Improve Teachers\u2019 Competency\". Indonesian Journal of Informatics Education 5 (2): 37-45. doi:10.20961\/ijie.v5i2.54534. https:\/\/jurnal.uns.ac.id\/ijie\/article\/view\/54534 .   \n \n\n\u2191 Loft, Paul; He, Ying; Yevseyeva, Iryna; Wagner, Isabel (1 November 2022). \"CAESAR8: An agile enterprise architecture approach to managing information security risks\" (in en). Computers & Security 122: 102877. doi:10.1016\/j.cose.2022.102877. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0167404822002711 .   \n \n\n\u2191 Darmita, I B G A; Dantes, G R; Candiasa, I M (1 April 2020). \"Regional income management information system with Enterprise Architecture Planning Approach (EAP): a case study in BPKPD Klungkung Regency\". Journal of Physics: Conference Series 1516 (1): 012016. doi:10.1088\/1742-6596\/1516\/1\/012016. ISSN 1742-6588. https:\/\/iopscience.iop.org\/article\/10.1088\/1742-6596\/1516\/1\/012016 .   \n \n\n\u2191 Afuan, I.; Nofiyati, N.; Ridlwan, A.F. (2022). \"Rancang Bangun Sistem Informasi Pengelolaan Pendadaran Menggunakan Framework Laravel\". Jurnal Sistem dan Teknologi Informasi 10 (1): 113\u2013122. doi:10.26418\/justin.v10i1.45678. https:\/\/jurnal.untan.ac.id\/index.php\/justin\/article\/view\/45678 .   \n \n\n\u2191 Ahlemann, Frederik; Legner, Christine; Lux, Johannes (1 January 2021). \"A resource-based perspective of value generation through enterprise architecture management\" (in en). Information & Management 58 (1): 103266. doi:10.1016\/j.im.2020.103266. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0378720619302101 .   \n \n\n\u2191 Lee, Hsien-Yu; Wang, Nai-Jian (1 May 2019). \"Cloud-based enterprise resource planning with elastic model\u2013view\u2013controller architecture for Internet realization\" (in en). Computer Standards & Interfaces 64: 11\u201323. doi:10.1016\/j.csi.2018.11.005. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0920548918301697 .   \n \n\n\u2191 Kurnia, Sherah; Kotusev, Svyatoslav; Shanks, Graeme; Dilnutt, Rod; Milton, Simon (1 June 2021). \"Stakeholder engagement in enterprise architecture practice: What inhibitors are there?\" (in en). Information and Software Technology 134: 106536. doi:10.1016\/j.infsof.2021.106536. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0950584921000240 .   \n \n\n\u2191 Tavakoli, Mansoor; Tavakol, Mahbube (1 January 2018). \"Problematizing EAP education in Iran: A critical ethnographic study of educational, political, and sociocultural roots\" (in en). Journal of English for Academic Purposes 31: 28\u201343. doi:10.1016\/j.jeap.2017.12.007. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1475158517301364 .   \n \n\n\u2191 Putri, Seni; Hayati, Umi; Dzulkarnaen, Rizal (2 March 2020). \"Architectural Design of Electronic Medical Record (EMR) using Enterprise Architecture Planning (EAP) Method\" (in id). Journal of Information Technology 2 (1): 25\u201330. doi:10.47292\/joint.v2i1.005. ISSN 2656-7539. https:\/\/jurnal.stmik-amikbandung.ac.id\/joint\/article\/view\/21 .   \n \n\n\u2191 Agievich, Vadim; Skripkin, Kirill (2014). \"Enterprise Architecture Migration Planning Using the Matrix of Change\" (in en). Procedia Computer Science 31: 231\u2013235. doi:10.1016\/j.procs.2014.05.264. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1877050914004414 .   \n \n\n\u2191 12.0 12.1 Politeknik Unggul LP3M, Indonesia; Purba, Ramen Antonov (28 November 2021). \"Application design to help predict market demand using the waterfall method\". Matrix : Jurnal Manajemen Teknologi dan Informatika 11 (3): 140\u2013149. doi:10.31940\/matrix.v11i3.140-149. https:\/\/ojs2.pnb.ac.id\/index.php\/MATRIX\/article\/view\/39 .   \n \n\n\u2191 Tutaj, Jerzy; Rutkowska, Ma\u0142gorzata; Bartoszczuk, Pawe\u0142 (2021). \"Enterprise Business Architecture as a Tool for Sustainable Development in an Enterprise - case study\" (in en). Procedia Computer Science 192: 5050\u20135057. doi:10.1016\/j.procs.2021.09.283. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1877050921020226 .   \n \n\n\u2191 Liana, V.I.; Dewi, L.P.; Yulia, Y. (2019). \"Enterprise Architecture Pada CV. Grande Zangrandi Dengan Metode Enterprise Architecture Planning (EAP)\". Jurnal Infra 7 (1): 164\u2013169. https:\/\/publication.petra.ac.id\/index.php\/teknik-informatika\/article\/view\/8066 .   \n \n\n\u2191 Supriadi, Hari; Amalia, Endang (10 May 2019). \"University\u2019s Enterprise Architecture Design Using Enterprise Architecture Planning (EAP) Based on the Zachman\u2019s Framework Approach\". International Journal of Higher Education 8 (3): 13. doi:10.5430\/ijhe.v8n3p13. ISSN 1927-6052. http:\/\/www.sciedu.ca\/journal\/index.php\/ijhe\/article\/view\/15469 .   \n \n\n\u2191 Petrov, Igor; Malysheva, Natalia; Lukmanova, Inessa; Panfilova, Elena (2022). \"Transport enterprise architecture and features of its personnel management\" (in en). Transportation Research Procedia 63: 1462\u20131472. doi:10.1016\/j.trpro.2022.06.157. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2352146522004124 .   \n \n\n\u2191 Indrawan, B; Sumitra, I D (1 November 2019). \"Enterprise Architecture for Higher Education Using Enterprise Architecture Planning Based Three Pillars of Higher Education\". IOP Conference Series: Materials Science and Engineering 662 (3): 032030. doi:10.1088\/1757-899X\/662\/3\/032030. ISSN 1757-8981. https:\/\/iopscience.iop.org\/article\/10.1088\/1757-899X\/662\/3\/032030 .   \n \n\n\u2191 Utomo, Andy Prasetyo (1 April 2014). \"PEMODELAN ARSITEKTUR ENTERPRISE SISTEM INFORMASI AKADEMIK PADA PERGURUAN TINGGI MENGGUNAKAN ENTERPRISE ARCHITECTURE PLANNING\". Simetris: Jurnal Teknik Mesin, Elektro dan Ilmu Komputer 5 (1): 33\u201340. doi:10.24176\/simet.v5i1.129. ISSN 2549-3108. https:\/\/jurnal.umk.ac.id\/index.php\/simet\/article\/view\/129 .   \n \n\n\u2191 Tavana, Madjid; Hajipour, Vahid; Oveisi, Shahrzad (1 September 2020). \"IoT-based enterprise resource planning: Challenges, open issues, applications, architecture, and future research directions\" (in en). Internet of Things 11: 100262. doi:10.1016\/j.iot.2020.100262. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2542660520300962 .   \n \n\n\u2191 Subagjo, R.T. (2012). \"Pemodelan Arsitektur Enterprise STMIK CIC Cirebon Menggunakan Enterprise Architecture Planning\". Jurnal Teknik Informatika dan Sistem Informasi 7 (2). https:\/\/www.neliti.com\/publications\/219753\/pemodelan-arsitektur-enterprise-stmik-cic-cirebon-menggunakan-enterprise-archite#cite .   \n \n\n\u2191 Pattij, Maurice; van de Wetering, Rogier; Kusters, Rob (2022). \"Enhanced digital transformation supporting capabilities through enterprise architecture management: A fsQCA perspective\" (in en). Digital Business 2 (2): 100036. doi:10.1016\/j.digbus.2022.100036. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2666954422000163 .   \n \n\n\u2191 Universitas Flores; Tute, Kristianus Jago; Londa, Maria Adelvin; Universitas Flores; Mude, Anastasia; Universitas Flores (31 July 2022). \"Delone and McLean Models for measuring the success of Flores University e-learning information system\". MATRIX : Jurnal Manajemen Teknologi dan Informatika 12 (2): 68\u201378. doi:10.31940\/matrix.v12i2.68-78. https:\/\/ojs2.pnb.ac.id\/index.php\/MATRIX\/article\/view\/453 .   \n \n\n\u2191 Universitas Katolik Musi Charitas, Indonesia; Wibagso, Stefanus Setyo; Celesta, Ivana; Universitas Katolik Musi Charitas, Indonesia (28 November 2021). \"Implementation of human-centered design methods in designing application interfaces for nursing home service\". Matrix : Jurnal Manajemen Teknologi dan Informatika 11 (3): 150\u2013161. doi:10.31940\/matrix.v11i3.150-161. https:\/\/ojs2.pnb.ac.id\/index.php\/MATRIX\/article\/view\/36 .   \n \n\n\u2191 Tarver, E. (1 September 2021). \"What Are the Primary Activities of Michael Porter's Value Chain?\". Investopedia. https:\/\/www.investopedia.com\/ask\/answers\/050115\/what-are-primary-activities-michael-porters-value-chain.asp .   \n \n\n\nNotes \nThis presentation is faithful to the original, with only a few minor changes to presentation. Grammar was cleaned up for smoother reading. In some cases important information was missing from the references, and that information was added. The original article duplicates a paragraph in the methodology, with new references, which is confusing; for this version, the duplicated content was removed, along with the associated references, putting the article at three fewer references. Additionally, no citation was associated with the mention of Porter's value chain (originally mispelled as \"Potter's\") and a citation was added for this version.\n\n\n\n\n\nSource: <a rel=\"external_link\" class=\"external\" href=\"https:\/\/www.limswiki.org\/index.php\/Journal:The_modeling_of_laboratory_information_systems_in_higher_education_based_on_enterprise_architecture_planning_(EAP)_for_optimizing_monitoring_and_equipment_maintenance\">https:\/\/www.limswiki.org\/index.php\/Journal:The_modeling_of_laboratory_information_systems_in_higher_education_based_on_enterprise_architecture_planning_(EAP)_for_optimizing_monitoring_and_equipment_maintenance<\/a>\nCategories: LIMSwiki journal articles (added in 2023)LIMSwiki journal articles (all)LIMSwiki journal articles on laboratory informaticsLIMSwiki journal articles on information technologyNavigation menuPage actionsJournalDiscussionView sourceHistoryPage actionsJournalDiscussionMoreToolsIn other languagesPersonal toolsLog inNavigationMain pageEncyclopedic articlesRecent changesRandom pageHelp about MediaWikiSearch\u00a0 ToolsWhat links hereRelated changesSpecial pagesPermanent linkPage informationPopular publications\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\nPrint\/exportCreate a bookDownload as PDFDownload as PDFDownload as Plain textPrintable version This page was last edited on 30 May 2023, at 18:04.Content is available under a Creative Commons Attribution-ShareAlike 4.0 International License unless otherwise noted.This page has been accessed 141 times.Privacy policyAbout LIMSWikiDisclaimers\n\n\n\n","da73605127ec78cc7d7d98765f3fbcc2_html":"<body class=\"mediawiki ltr sitedir-ltr mw-hide-empty-elt ns-206 ns-subject page-Journal_The_modeling_of_laboratory_information_systems_in_higher_education_based_on_enterprise_architecture_planning_EAP_for_optimizing_monitoring_and_equipment_maintenance rootpage-Journal_The_modeling_of_laboratory_information_systems_in_higher_education_based_on_enterprise_architecture_planning_EAP_for_optimizing_monitoring_and_equipment_maintenance skin-monobook action-view skin--responsive\"><div id=\"rdp-ebb-globalWrapper\"><div id=\"rdp-ebb-column-content\"><div id=\"rdp-ebb-content\" class=\"mw-body\" role=\"main\"><a id=\"rdp-ebb-top\"><\/a>\n<h1 id=\"rdp-ebb-firstHeading\" class=\"firstHeading\" lang=\"en\">Journal:The modeling of laboratory information systems in higher education based on enterprise architecture planning (EAP) for optimizing monitoring and equipment maintenance<\/h1><div id=\"rdp-ebb-bodyContent\" class=\"mw-body-content\"><!-- start content --><div id=\"rdp-ebb-mw-content-text\" lang=\"en\" dir=\"ltr\" class=\"mw-content-ltr\"><div class=\"mw-parser-output\">\n\n\n<h2><span class=\"mw-headline\" id=\"Abstract\">Abstract<\/span><\/h2>\n<p>The <a href=\"https:\/\/www.limswiki.org\/index.php\/Laboratory\" title=\"Laboratory\" class=\"wiki-link\" data-key=\"c57fc5aac9e4abf31dccae81df664c33\">laboratory<\/a> is a place to conduct scientific <a href=\"https:\/\/www.limswiki.org\/index.php\/Research\" title=\"Research\" class=\"wiki-link\" data-key=\"409634fd90113f119362927fe222f549\">research<\/a>, experiments, measurements, or scientific training. Fakultas Matematika dan Ilmu Pengetahuan Alam, Universitas Negeri Semarang (FMIPA UNNES) has several laboratories distributed in each department to support student lectures. Through the implementation of practicum in the laboratory, students are expected to be able to find a concept, as well as foster scientific attitudes and critical thinking skills. Good laboratory management is expected to be able to utilize laboratory resources effectively and efficiently. <a href=\"https:\/\/www.limswiki.org\/index.php\/Scientific_instrument\" title=\"Scientific instrument\" class=\"wiki-link\" data-key=\"b25152b8b4d5b59f8644bed8bd3a660d\">Laboratory equipment<\/a> must be ensured to function properly and be ready to be used for practicum. To support this, it is necessary to <a href=\"https:\/\/en.wikipedia.org\/wiki\/Condition_monitoring\" class=\"extiw wiki-link\" title=\"wikipedia:Condition monitoring\" data-key=\"44fc7b254400902a353d684eabf415f9\">monitor the condition<\/a> of the equipment and immediately repair the equipment if any damage is found. The current obstacle is monitoring tool repairs manually, so there are shortcomings such as poor documentation and equipment conditions that cannot be monitored online. \n<\/p><p>In this study, an information system for monitoring the maintenance of laboratory equipment in the departments in the FMIPA UNNES environment will be built. The research method begins with a literature study, initial data collection and observation, enterprise architecture planning (EAP)-based system design, <a href=\"https:\/\/www.limswiki.org\/index.php\/Software_testing\" title=\"Software testing\" class=\"wiki-link\" data-key=\"644785b90e5efed4719cba2d99967701\">system testing<\/a>, system analysis, and system evaluation. This study uses the systems development life cycle (SDLC) approach to develop a monitoring information system for the maintenance of laboratory equipment. Testing is done using black box testing. From the results of development and testing, it can be concluded that the system can be used to simplify the process of managing laboratory equipment with a user acceptance testing (UAT) value of 88% suitable for use.\n<\/p><p><b>Keywords<\/b>: enterprise architecture planning, information systems, laboratory, maintenance, optimization\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Introduction\">Introduction<\/span><\/h2>\n<p>A <a href=\"https:\/\/www.limswiki.org\/index.php\/Laboratory\" title=\"Laboratory\" class=\"wiki-link\" data-key=\"c57fc5aac9e4abf31dccae81df664c33\">laboratory<\/a> is a place to conduct scientific <a href=\"https:\/\/www.limswiki.org\/index.php\/Research\" title=\"Research\" class=\"wiki-link\" data-key=\"409634fd90113f119362927fe222f549\">research<\/a>, experiments, measurements, or scientific training. Now lab management has followed technological developments, through to the application of <a href=\"https:\/\/www.limswiki.org\/index.php\/Information_management\" title=\"Information management\" class=\"wiki-link\" data-key=\"f8672d270c0750a858ed940158ca0a73\">information management<\/a> systems. This is because technology can facilitate human work. One of them is the existence of digital applications. Applications have various capabilities to help human work, ranging from office applications to management, personal, entertainment, and other fields of human work. With this equipment, human tasks become easier, faster, more thorough, and more efficient.<sup id=\"rdp-ebb-cite_ref-1\" class=\"reference\"><a href=\"#cite_note-1\">[1]<\/a><\/sup>\n<\/p><p>The implementation of lecture practicum in the laboratory is expected so that students can find a concept and then foster <a href=\"https:\/\/www.limswiki.org\/index.php\/Scientific_method\" title=\"Scientific method\" class=\"wiki-link\" data-key=\"2ffc424b8b12075dcbcc0a730c63cb1c\">scientific attitudes<\/a> and critical thinking skills. As such, laboratory management needs to be empowered effectively and efficiently.<sup id=\"rdp-ebb-cite_ref-2\" class=\"reference\"><a href=\"#cite_note-2\">[2]<\/a><\/sup> <a href=\"https:\/\/www.limswiki.org\/index.php\/Scientific_instrument\" title=\"Scientific instrument\" class=\"wiki-link\" data-key=\"b25152b8b4d5b59f8644bed8bd3a660d\">Laboratory equipment<\/a> must be ensured to function properly and be ready to be used for practicum. To support this, it is necessary to monitor the maintenance of the equipment systematically. The current obstacle is that monitoring of tool repair is done manually, so there are shortcomings such as poor documentation and being able to track the condition of equipment that cannot be monitored online.<sup id=\"rdp-ebb-cite_ref-3\" class=\"reference\"><a href=\"#cite_note-3\">[3]<\/a><\/sup>\n<\/p><p>Currently, the Fakultas Matematika dan Ilmu Pengetahuan Alam, Universitas Negeri Semarang (FMIPA UNNES) laboratory does not yet have an information management system that can monitor the maintenance of laboratory equipment, starting from the condition of laboratory equipment to the repair process if there is damage.<sup id=\"rdp-ebb-cite_ref-4\" class=\"reference\"><a href=\"#cite_note-4\">[4]<\/a><\/sup> Therefore, this study aims to create and implementan information system for monitoring the maintenance of laboratory equipment in the Department of Mathematics and Natural Sciences. Based on the description of the importance of laboratories to supporting lectures, the authors initiated the idea of researching the development of information systems that could monitor laboratory equipment maintenance.<sup id=\"rdp-ebb-cite_ref-5\" class=\"reference\"><a href=\"#cite_note-5\">[5]<\/a><\/sup> This is in-line with the recommendation of the Minister of Administrative and Bureaucratic Reform (PANRB), which implies the use of IT and modern tools in completing work.<sup id=\"rdp-ebb-cite_ref-6\" class=\"reference\"><a href=\"#cite_note-6\">[6]<\/a><\/sup> This monitoring system aims to perform two purposes at once, namely preventing laboratory equipment from being lost or damaged and making it easier for laboratory technicians to carry out maintenance of laboratory equipment.<sup id=\"rdp-ebb-cite_ref-7\" class=\"reference\"><a href=\"#cite_note-7\">[7]<\/a><\/sup>\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Methodology\">Methodology<\/span><\/h2>\n<p>The stages in this research are data collection, analysis and design, stages of developing laboratory systems, and <a href=\"https:\/\/www.limswiki.org\/index.php\/Software_testing\" title=\"Software testing\" class=\"wiki-link\" data-key=\"644785b90e5efed4719cba2d99967701\">testing information systems<\/a>.<sup id=\"rdp-ebb-cite_ref-8\" class=\"reference\"><a href=\"#cite_note-8\">[8]<\/a><\/sup> The stage of data collection is done by using the method of interview and observation.<sup id=\"rdp-ebb-cite_ref-9\" class=\"reference\"><a href=\"#cite_note-9\">[9]<\/a><\/sup> Interviews were conducted with lecturers, students, and department managers to obtain an overview of the needs and flow of laboratory management. Meanwhile, observations were made by observing what data would be used in the management, borrowing, and processing of laboratory equipment at FMIPA UNNES.<sup id=\"rdp-ebb-cite_ref-10\" class=\"reference\"><a href=\"#cite_note-10\">[10]<\/a><\/sup>\n<\/p><p>The system design stage was carried out using the Waterfall method. The Waterfall method is a sequential software development method and consists of five interrelated and influencing stages.<sup id=\"rdp-ebb-cite_ref-11\" class=\"reference\"><a href=\"#cite_note-11\">[11]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-:0_12-0\" class=\"reference\"><a href=\"#cite_note-:0-12\">[12]<\/a><\/sup> With this method, there are several stages, namely the analysis, design, implementation\/coding, testing\/verification, and maintenance stages. The stages of the Waterfall method are shown in Figure 1.\n<\/p><p><br \/>\n<a href=\"https:\/\/www.limswiki.org\/index.php\/File:Fig1_Ifriza_Matrix23_13-1.png\" class=\"image wiki-link\" data-key=\"3ca0faa69083672702bceb60144fd957\"><img alt=\"Fig1 Ifriza Matrix23 13-1.png\" src=\"https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/2\/29\/Fig1_Ifriza_Matrix23_13-1.png\" decoding=\"async\" style=\"width: 100%;max-width: 400px;height: auto;\" \/><\/a>\n<\/p>\n<div style=\"clear:both;\"><\/div>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table border=\"0\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><blockquote><p><b>Figure 1.<\/b> Waterfall method.<\/p><\/blockquote>\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<p>At the system design stage, a design was produced for the database using entity-relationship diagrams (ERDs) and data flow diagrams (DFDs) to describe the system framework that would later be built, making it easier to make the system needed by the user.<sup id=\"rdp-ebb-cite_ref-13\" class=\"reference\"><a href=\"#cite_note-13\">[13]<\/a><\/sup> The development stage implemented the results of the design carried out. The information systems development process used the CodeIgniter framework with the PHP and JavaScript programming languages. The next stage of this research involved testing the information system for bugs using the black-box testing method. This test was carried out to find out what deficiencies and errors are in the system.<sup id=\"rdp-ebb-cite_ref-14\" class=\"reference\"><a href=\"#cite_note-14\">[14]<\/a><\/sup> The system was also tested by the end users by attempting to conduct experiments directly using the system. This user testing was carried out using black-box testing and a mean opinion score (MOS). In this case, black-box testing checks one by one the functions that have been created, and whether they have been made in accordance with user requirements.<sup id=\"rdp-ebb-cite_ref-15\" class=\"reference\"><a href=\"#cite_note-15\">[15]<\/a><\/sup> The MOS test involves several respondents who are encouraged to use the system, then afterwards asking them to assess several activities with a range of one to four, where a value of one represents the worst value and a value of four represents the best value. Then the average rating of all respondents was calculated so that the MOS is obtained for the system.<sup id=\"rdp-ebb-cite_ref-16\" class=\"reference\"><a href=\"#cite_note-16\">[16]<\/a><\/sup>\n<\/p><p>Enterprise architecture (EA) is a logical organization for the main business processes and information technology (IT) capabilities that reflect the need for integration and standardization of the company's operating model based on the Center for Information Systems Research.<sup id=\"rdp-ebb-cite_ref-17\" class=\"reference\"><a href=\"#cite_note-17\">[17]<\/a><\/sup> EA is a set of principles, methods, and models used in the design and realization of a company's organizational structure, business processes, information systems, and infrastructure.<sup id=\"rdp-ebb-cite_ref-18\" class=\"reference\"><a href=\"#cite_note-18\">[18]<\/a><\/sup> Enterprise architecture planning (EAP) is a process of defining the architecture for the use of information to support the business and planning to implement the architecture.<sup id=\"rdp-ebb-cite_ref-19\" class=\"reference\"><a href=\"#cite_note-19\">[19]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-20\" class=\"reference\"><a href=\"#cite_note-20\">[20]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-21\" class=\"reference\"><a href=\"#cite_note-21\">[21]<\/a><\/sup>\n<\/p><p>EAP methodologies and models are an early part of a major body of EA knowledge that is still relevant and has influenced many frameworks, methodologies, and best practices in the public and private sectors.<sup id=\"rdp-ebb-cite_ref-22\" class=\"reference\"><a href=\"#cite_note-22\">[22]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-:0_12-1\" class=\"reference\"><a href=\"#cite_note-:0-12\">[12]<\/a><\/sup> As such, the research methodology used herein was adapted to the architectural modeling steps of EAP, namely planning initiation, business modeling, current system architecture and technology, development of EA models in the form of data architecture, application architecture, technology architecture, and implementation.<sup id=\"rdp-ebb-cite_ref-23\" class=\"reference\"><a href=\"#cite_note-23\">[23]<\/a><\/sup>\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Results_and_discussion\">Results and discussion<\/span><\/h2>\n<p>The end result of this research has been an information system for the management of laboratory equipment. This system can be used to simplify the process of data collection, borrowing, and also processing the value of laboratory equipment results. The modeling steps of the EAP were taken into account when building a blueprint for the system architecture. Following the steps of the EAP concept, the system was used to model the laboratory system at FMIPA UNNES. However, this implementation required initial EAP-related planning, business modeling, system architecture and technology consideration, development of an EA model, and implementation and testing of the system.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Initial_planning\">Initial planning<\/span><\/h3>\n<p>The users of this system were to be department laboratory administrators, who are tasked with inputting lab asset data in their respective departments, including conditions and suggestions for repairing tools. Also involved with initial planning were faculty administrators, who are tasked with making decisions about whether to approve or postpone the proposed repairs, and financial administrators, who are tasked with approving budget allocations\/ceilings.\n<\/p><p>The initial stage of the EAP is planning, which defines the organization as an object by describing the organization's vision and mission, which is linked to the vision associated with information system planning, so that the development of the architecture can be carried out in accordance with business objectives. In accordance with its existence as a university, the core business of a university consists of three main components, namely education and teaching, community service, and research, which make up the Tri Dharma Perguruan Tinggi (Tri Dharma) of higher education. In return for providing educational services to the community, graduates will return to the community with greater purpose. Determining the future vision and mission is necessary as a guideline for determining various IT strategies needed to support the vision and mission. The selection of the planning methodology approach determines the results of the blueprint that is ultimately made. \n<\/p><p>The primary vision and mission of FMIPA UNNES is to develop mathematics and natural science education in superior educational and non-educational programs with conservation insight and positive international reputation. Second, FMIPA UNNES seeks to develop and create science and technological innovation in the fields of mathematics and natural sciences, as well as civilizations with conservation insight and international reputation. Third, the department seeks to have that science and technological innovation disseminate more broadly into the fields of mathematics and natural sciences. Fourth, the departments seeks to build and develop institutional cooperation in supporting the institutional strengthening of the department's international reputation.\n<\/p><p>The goal of FMIPA UNNES is to develop students of mathematics and natural sciences that are superior at the international level, with superior conservation insight. The department can do this by providing modern professional education services in the field of mathematics and natural sciences to the community, and implementing cooperation in the field of mathematics and natural sciences to support the strengthening of institutions of international reputation.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Business_modeling\">Business modeling<\/span><\/h3>\n<p>The inherent organizational structure within universities provides the impetus for conducting business modeling. The organizational structure will show what parts will be handled by a university. As a higher education institution, it focuses on the educational Tri Dharma of education and teaching, research, and community service. This paper will only discuss the fields of education and research\u2014especially as they relate to laboratories\u2014and not include community service. Based on the value chain concept, the main functional areas for the education model in higher education can generally be grouped into main activities and supporting activities. The main activities consist of student admissions, academic operations, and graduation. Meanwhile, supporting activities consist of activities related to resource management (general), financial management, planning and information systems, and publishing and publication. Figure 2 shows the value chain for a university's education and research model.\n<\/p><p><br \/>\n<a href=\"https:\/\/www.limswiki.org\/index.php\/File:Fig2_Ifriza_Matrix23_13-1.png\" class=\"image wiki-link\" data-key=\"18aa52e6979d82bc2ec0c00ddc570859\"><img alt=\"Fig2 Ifriza Matrix23 13-1.png\" src=\"https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/a\/a8\/Fig2_Ifriza_Matrix23_13-1.png\" decoding=\"async\" style=\"width: 100%;max-width: 400px;height: auto;\" \/><\/a>\n<\/p>\n<div style=\"clear:both;\"><\/div>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table border=\"0\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><blockquote><p><b>Figure 2.<\/b> The laboratory value chain as found in academic operations.<\/p><\/blockquote>\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<p>Each of the main activities in the value chain can be described. First, student admissions are all activities starting from the process of new student admissions and selection of new student administration. Second, academic operations are all activities related to teaching and learning activities during the student's academic period. Third, graduation is an activity to release students academically at the end of student studies.\n<\/p><p>There is also a variety of support activities. First, the general affairs division is the part responsible for the smooth operation of educational facilities and carries out the development of infrastructure from year to year, for both primary physical facilities and facilities to support educational activities. Second, finance and personnel management are activities that relate to financial management, determination of investment budgets and needs, and monitoring and allocation of human resources. Third, planning and information systems are activities related to the management and development of information system equipment and networks. Fourth, publishing and publication are activities related to the management and publication of journals, bulletins, and student textbooks.\n<\/p><p>After initiating the organization's business function areas by utilizing Porter's value chain<sup id=\"rdp-ebb-cite_ref-TarverWhat21_24-0\" class=\"reference\"><a href=\"#cite_note-TarverWhat21-24\">[24]<\/a><\/sup>, it is possible to arrange the decomposition structure of the business functions using a function hierarchy chart. In accordance with the scope and limitations of this journal, the functions that are decomposed are those related to academics as the main functions with elaboration on student admissions, academic operations, graduation implementation, general division, financial and staffing management, and planning and information systems, as well as publishing and publications. This is depicted in Table 1.\n<\/p>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table class=\"wikitable\" border=\"1\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td colspan=\"2\" style=\"background-color:white; padding-left:10px; padding-right:10px;\"><b>Table 1.<\/b> Details of business activities in higher education\n<\/td><\/tr>\n<tr>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Activity\n<\/th>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Detailed activities\n<\/th><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Student admission\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">1. Student admission planning<br \/>2. Implementation of selection<br \/>3. Re-registration of new students\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Academic operations\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">1. Planning the implementation of academic activities<br \/>2. Re-registration<br \/>3. Study process<br \/>4. Laboratory use<br \/>5. Re-registration of new students<br \/>6. Evaluation process<br \/>7. Implementation of student academic leave<br \/>8. Student final exam\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Financial and personnel management\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">1. Budgeting<br \/>2. Budget allocation<br \/>3. Monitoring and evaluation<br \/>4. Budget revision<br \/>5. Financial accounting system<br \/>6. Employee development planning<br \/>7. Payment calculation<br \/>8. Employee performance evaluation\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Graduation implementation\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">1. Determination of graduation requirements<br \/>2. Diploma making<br \/>3. Generating transcripts of grades\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Planning and information systems\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">1. Implementation of information system administration<br \/>2. Information system administration reporting<br \/>3. Development of software or information systems\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">General affairs\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">1. Implementation of the procurement of facilities and infrastructure<br \/>2. Implementation of inventory management<br \/>3. Supervision and evaluation of the use of facilities and infrastructure<br \/>4. Office inventory reporting\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Publishing and publication\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">1. Implementation of journal administration<br \/>2. Implementation of bulletin administration<br \/>3. Implementation of textbook administration\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<p>Figure 3 below shows the relationship between stakeholders and the main and supporting business functions in a university.\n<\/p><p><a href=\"https:\/\/www.limswiki.org\/index.php\/File:Fig3_Ifriza_Matrix23_13-1.png\" class=\"image wiki-link\" data-key=\"212e6ed19b7de6bcd9c0b99be35b85b5\"><img alt=\"Fig3 Ifriza Matrix23 13-1.png\" src=\"https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/0\/09\/Fig3_Ifriza_Matrix23_13-1.png\" decoding=\"async\" style=\"width: 100%;max-width: 400px;height: auto;\" \/><\/a>\n<\/p>\n<div style=\"clear:both;\"><\/div>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table border=\"0\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><blockquote><p><b>Figure 3.<\/b> The main stakeholders of higher education.<\/p><\/blockquote>\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<h3><span class=\"mw-headline\" id=\"System_architecture_and_technology\">System architecture and technology<\/span><\/h3>\n<p>Assessing the current information system and technology provides an overview of the current state of information technology and systems, the future development of IT, and the desire and direction of IT development in universities today. In this step, several things need to be considered and used as the main key in conducting the analysis, namely the condition of the organization, the direction of IT development strategy, and the condition of the current information system and technology.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Development_of_an_EA_model\">Development of an EA model<\/span><\/h3>\n<p>In building an architectural model, the first thing to do is create a data architecture. The data architecture that will be defined this time is the definition of the data usage that will be used in the application architecture later, which will be delivered at this stage according to the EAP stage in the data architecture.\n<\/p><p>An entity candidate is an entity that will be part of the EAP so that the determination can be based on the condition of the main business functions in the previously defined value chain (thus the entity that will be defined as a business entity) and based on the business entity data entities will be defined by. In accordance with the condition of the value chain, the list of business entities and their data entities can be identified as found in Table 2.\n<\/p>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table class=\"wikitable\" border=\"1\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td colspan=\"2\" style=\"background-color:white; padding-left:10px; padding-right:10px;\"><b>Table 2.<\/b> Entity list\n<\/td><\/tr>\n<tr>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Business entity\n<\/th>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Data entities\n<\/th><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Tool repair entity\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">1. Tool entity<br \/>2. Period entity<br \/>3. Date entity<br \/>4. Urgency entity<br \/>5. Entity status\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Tool\/Material lending entity\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">1. Tool entity<br \/>2. Course entities<br \/>3. Class entities<br \/>4. Major entity<br \/>5. Lecture room entities\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Loan repayment entity\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">1. Tool entity<br \/>2. Course entities<br \/>3. Class entities<br \/>4. Lecturer entity<br \/>5. Rombel's entity\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Practicum entity\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">1. Tool entity<br \/>2. Space entity<br \/>3. Entity type practicum<br \/>4. Lecturer entity<br \/>5. Entity status\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Transaction recap entity\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">1. Tool entity<br \/>2. Lecturer entity<br \/>3. Course entities\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<p>To describe the relationship between entities, the conceptual depiction of the relationship uses an ERD for the laboratory. The ERD is a logical data conceptual model that shows the relationship between entities in laboratories in universities. The last stage in modeling the architecture is defining the technology architecture. The EAP concept defines technology requirements that need to be provided in the business environment to run a data architecture that can manage data based on the application architecture. In other words, the technology architecture is an infrastructure requirement that must be provided to support the running of data and applications used by the organization. The principles and technology platforms were created to identify the main types of technology platforms needed to support shared data and application environments in universities. This principle is determined by considering trends and developments in information technology, business models, data architecture, application architecture, existing systems, and technologies, as well as requests and findings from business people within the organization. Table 3 shows the technology platforms that can be used to support data and applications in universities.\n<\/p>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table class=\"wikitable\" border=\"1\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td colspan=\"2\" style=\"background-color:white; padding-left:10px; padding-right:10px;\"><b>Table 3.<\/b> Platform\/technology architecture\n<\/td><\/tr>\n<tr>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Principle area\n<\/th>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Description\n<\/th><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Operating system\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">The selected operating system is portable (can run on multiple platforms), scalable (can run on small to large-scale computers), interoperable (can run in heterogeneous environments), and compatible (maintains existing software investments and allows technological advances to be applied to the environment).\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Hardware\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Hardware must be reliable and highly available while supporting future technologies.\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Communication and network\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">The network environment is provided with sufficient bandwidth and a set of standard protocols to support network services and real-time access to information.\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Application\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">All application designs should be modular and should be testable.\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Database management\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">The database model used is a relational database, which is relatively easier to understand and more popular.\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Security\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Security requirements include secrecy (requirements in information systems that can only be read), availability (needs that information resources can only be obtained and used by authorized users), and integrity (needs that information resources can only be modified and maintained by authorized units).\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<h3><span class=\"mw-headline\" id=\"Implementation_and_testing\">Implementation and testing<\/span><\/h3>\n<p>The laboratory system development stage is the implementation stage of the design stage. At this stage of development, it is done by coding the required pages on the laboratory system using the CodeIgniter framework. Figure 4 shows the results of developing logins. The login page is a page that is used to verify users, and there are username and password inputs that must be filled in by system users to be able to enter the system. If the username and password inputs do not match, then the user cannot enter the system.\n<\/p><p><br \/>\n<a href=\"https:\/\/www.limswiki.org\/index.php\/File:Fig4_Ifriza_Matrix23_13-1.png\" class=\"image wiki-link\" data-key=\"57b1fa9b20383713bb9ac958dc4ea3ff\"><img alt=\"Fig4 Ifriza Matrix23 13-1.png\" src=\"https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/b\/b6\/Fig4_Ifriza_Matrix23_13-1.png\" decoding=\"async\" width=\"329\" height=\"302\" \/><\/a>\n<\/p>\n<div style=\"clear:both;\"><\/div>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table border=\"0\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><blockquote><p><b>Figure 4.<\/b> Login page.<\/p><\/blockquote>\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<p>Admin users who have entered the correct username and password will enter the admin page. Figure 5 is a view of the admin page (Admin Data). On the admin data page, admin users can view, add, and change information, and they can delete admin data.\n<\/p><p><br \/>\n<a href=\"https:\/\/www.limswiki.org\/index.php\/File:Fig5_Ifriza_Matrix23_13-1.png\" class=\"image wiki-link\" data-key=\"921ea50ce966fd27bfa5954a82030f02\"><img alt=\"Fig5 Ifriza Matrix23 13-1.png\" src=\"https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/0\/0d\/Fig5_Ifriza_Matrix23_13-1.png\" decoding=\"async\" style=\"width: 100%;max-width: 400px;height: auto;\" \/><\/a>\n<\/p>\n<div style=\"clear:both;\"><\/div>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table border=\"0\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><blockquote><p><b>Figure 5.<\/b> Admin page.<\/p><\/blockquote>\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<p>The system testing stage or testing is the stage carried out to match and observe the results of the implementation that has been carried out. System testing or testing was carried out in this study using the black-box method and the MOS. The testing process with the black-box method was carried out by testing one by one the functions that have been made to determine whether they were in accordance with user requirements and whether the output of these functions were in accordance with what was expected. As for MOS testing, it was carried out by subjective assessment of the quality associated with the system. The results of the tests carried out on the website-based Pendadaran Information System using the MOS test method, based on user acceptance testing (UAT), can be seen in Table 4.\n<\/p>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table class=\"wikitable\" border=\"1\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td colspan=\"3\" style=\"background-color:white; padding-left:10px; padding-right:10px;\"><b>Table 4.<\/b> Eligibility result by expert\n<\/td><\/tr>\n<tr>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Code\n<\/th>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Rating indicator\n<\/th>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Result\n<\/th><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">A1\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Attractive laboratory system design\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">93%\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">A2\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Laboratory system color match\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">87%\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">A3\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Component location in laboratory system appropriate\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">93%\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">A4\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Laboratory system size appropriate\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">67%\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">A5\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Easy-to-use laboratory system\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">93%\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">A6\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Laboratory system convenient to use\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">87%\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">A7\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Colors in laboratory system clear\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">93%\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">A8\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Images in laboratory system clear\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">87%\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<p>We also present expert validity data in the graph of each component, which can be seen in Figure 6.\n<\/p><p><br \/>\n<a href=\"https:\/\/www.limswiki.org\/index.php\/File:Fig6_Ifriza_Matrix23_13-1.png\" class=\"image wiki-link\" data-key=\"21ebf6077f41bad4cbeaf22596a5826e\"><img alt=\"Fig6 Ifriza Matrix23 13-1.png\" src=\"https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/1\/19\/Fig6_Ifriza_Matrix23_13-1.png\" decoding=\"async\" style=\"width: 100%;max-width: 400px;height: auto;\" \/><\/a>\n<\/p>\n<div style=\"clear:both;\"><\/div>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table border=\"0\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><blockquote><p><b>Figure 6.<\/b> Expert validity of each component.<\/p><\/blockquote>\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<p>Based on tool validation by UAT experts selected by the research team to validate the laboratory system for system validation sheets, the results of product feasibility from experts show valid and very valid results, starting from A1 with 93% results, and A2 with 87% results. A3 results in 93%, A4 results in 67%, A5 results in 93%, A6 results in 87%, A7 results in 93%, and A8 results in 87%. If the overall validity component is obtained on average, 88% of the products are very valid. These results are presented in the form of Table 4 and Figure 6.\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Conclusion\">Conclusion<\/span><\/h2>\n<p>Based on the results of the study, it can be concluded that the use of laboratory systems for monitoring and maintenance in laboratory management has proven to be very valid. Before implementing the laboratory system identification method, laboratory maintenance and tracking tools and materials were still handled manual. However, EAP proves to be an effective approach to modeling laboratory-based information systems in higher education. EAP helps align the business and technology within laboratory-based information systems, making it easier to monitor and maintain equipment. Monitoring and maintenance of laboratory equipment play a critical role in ensuring the quality of collected data. EAP helps ensure that laboratory equipment is functioning properly and strengthens the software system. \n<\/p><p>Modeling becomes an effective tool for applying the EAP concept in laboratory-based information systems. Modeling helps align the business and technology goals of the organization with the system to be implemented, ensuring the quality of collected data. The implementation of EAP with lab-based information systems in higher education has the potential to increase efficiency and effectiveness in monitoring and maintenance of equipment. It helps ensure that collected data is accurate and of high quality, making it easier to process, analyze, and make decisions about. After implementing the EAP method, the laboratory system is safer, and access to tools and materials can be monitored properly. A test of the validity of our laboratory system for monitoring and maintenance saw an average validity of the expert team reaching 88%, based on tool validation by UAT experts.\n<\/p>\n<h2><span id=\"rdp-ebb-Abbreviations,_acronyms,_and_initialisms\"><\/span><span class=\"mw-headline\" id=\"Abbreviations.2C_acronyms.2C_and_initialisms\">Abbreviations, acronyms, and initialisms<\/span><\/h2>\n<ul><li><b>DFD<\/b>: data flow diagram<\/li>\n<li><b>EA<\/b>: enterprise architecture<\/li>\n<li><b>EAP<\/b>: enterprise architecture planning<\/li>\n<li><b>ERD<\/b>: entity-relationship diagram<\/li>\n<li><b>FMIPA UNNES<\/b>: Fakultas Matematika dan Ilmu Pengetahuan Alam, Universitas Negeri Semarang<\/li>\n<li><b>IT<\/b>: information technology<\/li>\n<li><b>MOS<\/b>: mean opinion score<\/li>\n<li><b>PANRB<\/b>: Minister of Administrative and Bureaucratic Reform<\/li>\n<li><b>SDLC<\/b>: systems development life cycle<\/li>\n<li><b>UAT<\/b>: user acceptance testing<\/li><\/ul>\n<h2><span class=\"mw-headline\" id=\"Acknowledgements\">Acknowledgements<\/span><\/h2>\n<p>The author expresses his gratitude and appreciation to LPPM State University of Semarang for the opportunity given to conduct research on the Functional Tendik scheme in 2022.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Conflicts_of_interest\">Conflicts of interest<\/span><\/h3>\n<p>None stated.\n<\/p>\n<h2><span class=\"mw-headline\" id=\"References\">References<\/span><\/h2>\n<div class=\"reflist references-column-width\" style=\"-moz-column-width: 30em; -webkit-column-width: 30em; column-width: 30em; list-style-type: decimal;\">\n<div class=\"mw-references-wrap mw-references-columns\"><ol class=\"references\">\n<li id=\"cite_note-1\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-1\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Uysal, Murat Pasa; Mergen, A. Erhan (1 June 2021). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2452414X21000030\" target=\"_blank\">\"Smart manufacturing in intelligent digital mesh: Integration of enterprise architecture and software product line engineering\"<\/a> (in en). <i>Journal of Industrial Information Integration<\/i> <b>22<\/b>: 100202. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.jii.2021.100202\" target=\"_blank\">10.1016\/j.jii.2021.100202<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2452414X21000030\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2452414X21000030<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Smart+manufacturing+in+intelligent+digital+mesh%3A+Integration+of+enterprise+architecture+and+software+product+line+engineering&rft.jtitle=Journal+of+Industrial+Information+Integration&rft.aulast=Uysal&rft.aufirst=Murat+Pasa&rft.au=Uysal%2C%26%2332%3BMurat+Pasa&rft.au=Mergen%2C%26%2332%3BA.+Erhan&rft.date=1+June+2021&rft.volume=22&rft.pages=100202&rft_id=info:doi\/10.1016%2Fj.jii.2021.100202&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS2452414X21000030&rfr_id=info:sid\/en.wikipedia.org:Journal:The_modeling_of_laboratory_information_systems_in_higher_education_based_on_enterprise_architecture_planning_(EAP)_for_optimizing_monitoring_and_equipment_maintenance\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-2\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-2\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Pebrioni, N.M.; Iriani, A.; Dwikurnaningsih, Y. (2021). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/jurnal.uns.ac.id\/ijie\/article\/view\/54534\" target=\"_blank\">\"Development of Vocabulary Training Module Using Games for Vocational English Teachers to Improve Teachers\u2019 Competency\"<\/a>. <i>Indonesian Journal of Informatics Education<\/i> <b>5<\/b> (2): 37-45. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.20961%2Fijie.v5i2.54534\" target=\"_blank\">10.20961\/ijie.v5i2.54534<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/jurnal.uns.ac.id\/ijie\/article\/view\/54534\" target=\"_blank\">https:\/\/jurnal.uns.ac.id\/ijie\/article\/view\/54534<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Development+of+Vocabulary+Training+Module+Using+Games+for+Vocational+English+Teachers+to+Improve+Teachers%E2%80%99+Competency&rft.jtitle=Indonesian+Journal+of+Informatics+Education&rft.aulast=Pebrioni%2C+N.M.%3B+Iriani%2C+A.%3B+Dwikurnaningsih%2C+Y.&rft.au=Pebrioni%2C+N.M.%3B+Iriani%2C+A.%3B+Dwikurnaningsih%2C+Y.&rft.date=2021&rft.volume=5&rft.issue=2&rft.pages=37-45&rft_id=info:doi\/10.20961%2Fijie.v5i2.54534&rft_id=https%3A%2F%2Fjurnal.uns.ac.id%2Fijie%2Farticle%2Fview%2F54534&rfr_id=info:sid\/en.wikipedia.org:Journal:The_modeling_of_laboratory_information_systems_in_higher_education_based_on_enterprise_architecture_planning_(EAP)_for_optimizing_monitoring_and_equipment_maintenance\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-3\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-3\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Loft, Paul; He, Ying; Yevseyeva, Iryna; Wagner, Isabel (1 November 2022). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0167404822002711\" target=\"_blank\">\"CAESAR8: An agile enterprise architecture approach to managing information security risks\"<\/a> (in en). <i>Computers & Security<\/i> <b>122<\/b>: 102877. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.cose.2022.102877\" target=\"_blank\">10.1016\/j.cose.2022.102877<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0167404822002711\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0167404822002711<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=CAESAR8%3A+An+agile+enterprise+architecture+approach+to+managing+information+security+risks&rft.jtitle=Computers+%26+Security&rft.aulast=Loft&rft.aufirst=Paul&rft.au=Loft%2C%26%2332%3BPaul&rft.au=He%2C%26%2332%3BYing&rft.au=Yevseyeva%2C%26%2332%3BIryna&rft.au=Wagner%2C%26%2332%3BIsabel&rft.date=1+November+2022&rft.volume=122&rft.pages=102877&rft_id=info:doi\/10.1016%2Fj.cose.2022.102877&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS0167404822002711&rfr_id=info:sid\/en.wikipedia.org:Journal:The_modeling_of_laboratory_information_systems_in_higher_education_based_on_enterprise_architecture_planning_(EAP)_for_optimizing_monitoring_and_equipment_maintenance\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-4\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-4\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Darmita, I B G A; Dantes, G R; Candiasa, I M (1 April 2020). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/iopscience.iop.org\/article\/10.1088\/1742-6596\/1516\/1\/012016\" target=\"_blank\">\"Regional income management information system with Enterprise Architecture Planning Approach (EAP): a case study in BPKPD Klungkung Regency\"<\/a>. <i>Journal of Physics: Conference Series<\/i> <b>1516<\/b> (1): 012016. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1088%2F1742-6596%2F1516%2F1%2F012016\" target=\"_blank\">10.1088\/1742-6596\/1516\/1\/012016<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1742-6588\" target=\"_blank\">1742-6588<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/iopscience.iop.org\/article\/10.1088\/1742-6596\/1516\/1\/012016\" target=\"_blank\">https:\/\/iopscience.iop.org\/article\/10.1088\/1742-6596\/1516\/1\/012016<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Regional+income+management+information+system+with+Enterprise+Architecture+Planning+Approach+%28EAP%29%3A+a+case+study+in+BPKPD+Klungkung+Regency&rft.jtitle=Journal+of+Physics%3A+Conference+Series&rft.aulast=Darmita&rft.aufirst=I+B+G+A&rft.au=Darmita%2C%26%2332%3BI+B+G+A&rft.au=Dantes%2C%26%2332%3BG+R&rft.au=Candiasa%2C%26%2332%3BI+M&rft.date=1+April+2020&rft.volume=1516&rft.issue=1&rft.pages=012016&rft_id=info:doi\/10.1088%2F1742-6596%2F1516%2F1%2F012016&rft.issn=1742-6588&rft_id=https%3A%2F%2Fiopscience.iop.org%2Farticle%2F10.1088%2F1742-6596%2F1516%2F1%2F012016&rfr_id=info:sid\/en.wikipedia.org:Journal:The_modeling_of_laboratory_information_systems_in_higher_education_based_on_enterprise_architecture_planning_(EAP)_for_optimizing_monitoring_and_equipment_maintenance\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-5\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-5\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Afuan, I.; Nofiyati, N.; Ridlwan, A.F. (2022). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/jurnal.untan.ac.id\/index.php\/justin\/article\/view\/45678\" target=\"_blank\">\"Rancang Bangun Sistem Informasi Pengelolaan Pendadaran Menggunakan Framework Laravel\"<\/a>. <i>Jurnal Sistem dan Teknologi Informasi<\/i> <b>10<\/b> (1): 113\u2013122. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.26418%2Fjustin.v10i1.45678\" target=\"_blank\">10.26418\/justin.v10i1.45678<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/jurnal.untan.ac.id\/index.php\/justin\/article\/view\/45678\" target=\"_blank\">https:\/\/jurnal.untan.ac.id\/index.php\/justin\/article\/view\/45678<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Rancang+Bangun+Sistem+Informasi+Pengelolaan+Pendadaran+Menggunakan+Framework+Laravel&rft.jtitle=Jurnal+Sistem+dan+Teknologi+Informasi&rft.aulast=Afuan%2C+I.%3B+Nofiyati%2C+N.%3B+Ridlwan%2C+A.F.&rft.au=Afuan%2C+I.%3B+Nofiyati%2C+N.%3B+Ridlwan%2C+A.F.&rft.date=2022&rft.volume=10&rft.issue=1&rft.pages=113%E2%80%93122&rft_id=info:doi\/10.26418%2Fjustin.v10i1.45678&rft_id=https%3A%2F%2Fjurnal.untan.ac.id%2Findex.php%2Fjustin%2Farticle%2Fview%2F45678&rfr_id=info:sid\/en.wikipedia.org:Journal:The_modeling_of_laboratory_information_systems_in_higher_education_based_on_enterprise_architecture_planning_(EAP)_for_optimizing_monitoring_and_equipment_maintenance\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-6\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-6\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Ahlemann, Frederik; Legner, Christine; Lux, Johannes (1 January 2021). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0378720619302101\" target=\"_blank\">\"A resource-based perspective of value generation through enterprise architecture management\"<\/a> (in en). <i>Information & Management<\/i> <b>58<\/b> (1): 103266. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.im.2020.103266\" target=\"_blank\">10.1016\/j.im.2020.103266<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0378720619302101\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0378720619302101<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=A+resource-based+perspective+of+value+generation+through+enterprise+architecture+management&rft.jtitle=Information+%26+Management&rft.aulast=Ahlemann&rft.aufirst=Frederik&rft.au=Ahlemann%2C%26%2332%3BFrederik&rft.au=Legner%2C%26%2332%3BChristine&rft.au=Lux%2C%26%2332%3BJohannes&rft.date=1+January+2021&rft.volume=58&rft.issue=1&rft.pages=103266&rft_id=info:doi\/10.1016%2Fj.im.2020.103266&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS0378720619302101&rfr_id=info:sid\/en.wikipedia.org:Journal:The_modeling_of_laboratory_information_systems_in_higher_education_based_on_enterprise_architecture_planning_(EAP)_for_optimizing_monitoring_and_equipment_maintenance\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-7\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-7\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Lee, Hsien-Yu; Wang, Nai-Jian (1 May 2019). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0920548918301697\" target=\"_blank\">\"Cloud-based enterprise resource planning with elastic model\u2013view\u2013controller architecture for Internet realization\"<\/a> (in en). <i>Computer Standards & Interfaces<\/i> <b>64<\/b>: 11\u201323. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.csi.2018.11.005\" target=\"_blank\">10.1016\/j.csi.2018.11.005<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0920548918301697\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0920548918301697<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Cloud-based+enterprise+resource+planning+with+elastic+model%E2%80%93view%E2%80%93controller+architecture+for+Internet+realization&rft.jtitle=Computer+Standards+%26+Interfaces&rft.aulast=Lee&rft.aufirst=Hsien-Yu&rft.au=Lee%2C%26%2332%3BHsien-Yu&rft.au=Wang%2C%26%2332%3BNai-Jian&rft.date=1+May+2019&rft.volume=64&rft.pages=11%E2%80%9323&rft_id=info:doi\/10.1016%2Fj.csi.2018.11.005&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS0920548918301697&rfr_id=info:sid\/en.wikipedia.org:Journal:The_modeling_of_laboratory_information_systems_in_higher_education_based_on_enterprise_architecture_planning_(EAP)_for_optimizing_monitoring_and_equipment_maintenance\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-8\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-8\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Kurnia, Sherah; Kotusev, Svyatoslav; Shanks, Graeme; Dilnutt, Rod; Milton, Simon (1 June 2021). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0950584921000240\" target=\"_blank\">\"Stakeholder engagement in enterprise architecture practice: What inhibitors are there?\"<\/a> (in en). <i>Information and Software Technology<\/i> <b>134<\/b>: 106536. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.infsof.2021.106536\" target=\"_blank\">10.1016\/j.infsof.2021.106536<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0950584921000240\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0950584921000240<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Stakeholder+engagement+in+enterprise+architecture+practice%3A+What+inhibitors+are+there%3F&rft.jtitle=Information+and+Software+Technology&rft.aulast=Kurnia&rft.aufirst=Sherah&rft.au=Kurnia%2C%26%2332%3BSherah&rft.au=Kotusev%2C%26%2332%3BSvyatoslav&rft.au=Shanks%2C%26%2332%3BGraeme&rft.au=Dilnutt%2C%26%2332%3BRod&rft.au=Milton%2C%26%2332%3BSimon&rft.date=1+June+2021&rft.volume=134&rft.pages=106536&rft_id=info:doi\/10.1016%2Fj.infsof.2021.106536&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS0950584921000240&rfr_id=info:sid\/en.wikipedia.org:Journal:The_modeling_of_laboratory_information_systems_in_higher_education_based_on_enterprise_architecture_planning_(EAP)_for_optimizing_monitoring_and_equipment_maintenance\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-9\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-9\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Tavakoli, Mansoor; Tavakol, Mahbube (1 January 2018). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1475158517301364\" target=\"_blank\">\"Problematizing EAP education in Iran: A critical ethnographic study of educational, political, and sociocultural roots\"<\/a> (in en). <i>Journal of English for Academic Purposes<\/i> <b>31<\/b>: 28\u201343. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.jeap.2017.12.007\" target=\"_blank\">10.1016\/j.jeap.2017.12.007<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1475158517301364\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1475158517301364<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Problematizing+EAP+education+in+Iran%3A+A+critical+ethnographic+study+of+educational%2C+political%2C+and+sociocultural+roots&rft.jtitle=Journal+of+English+for+Academic+Purposes&rft.aulast=Tavakoli&rft.aufirst=Mansoor&rft.au=Tavakoli%2C%26%2332%3BMansoor&rft.au=Tavakol%2C%26%2332%3BMahbube&rft.date=1+January+2018&rft.volume=31&rft.pages=28%E2%80%9343&rft_id=info:doi\/10.1016%2Fj.jeap.2017.12.007&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS1475158517301364&rfr_id=info:sid\/en.wikipedia.org:Journal:The_modeling_of_laboratory_information_systems_in_higher_education_based_on_enterprise_architecture_planning_(EAP)_for_optimizing_monitoring_and_equipment_maintenance\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-10\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-10\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Putri, Seni; Hayati, Umi; Dzulkarnaen, Rizal (2 March 2020). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/jurnal.stmik-amikbandung.ac.id\/joint\/article\/view\/21\" target=\"_blank\">\"Architectural Design of Electronic Medical Record (EMR) using Enterprise Architecture Planning (EAP) Method\"<\/a> (in id). <i>Journal of Information Technology<\/i> <b>2<\/b> (1): 25\u201330. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.47292%2Fjoint.v2i1.005\" target=\"_blank\">10.47292\/joint.v2i1.005<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2656-7539\" target=\"_blank\">2656-7539<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/jurnal.stmik-amikbandung.ac.id\/joint\/article\/view\/21\" target=\"_blank\">https:\/\/jurnal.stmik-amikbandung.ac.id\/joint\/article\/view\/21<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Architectural+Design+of+Electronic+Medical+Record+%28EMR%29+using+Enterprise+Architecture+Planning+%28EAP%29+Method&rft.jtitle=Journal+of+Information+Technology&rft.aulast=Putri&rft.aufirst=Seni&rft.au=Putri%2C%26%2332%3BSeni&rft.au=Hayati%2C%26%2332%3BUmi&rft.au=Dzulkarnaen%2C%26%2332%3BRizal&rft.date=2+March+2020&rft.volume=2&rft.issue=1&rft.pages=25%E2%80%9330&rft_id=info:doi\/10.47292%2Fjoint.v2i1.005&rft.issn=2656-7539&rft_id=https%3A%2F%2Fjurnal.stmik-amikbandung.ac.id%2Fjoint%2Farticle%2Fview%2F21&rfr_id=info:sid\/en.wikipedia.org:Journal:The_modeling_of_laboratory_information_systems_in_higher_education_based_on_enterprise_architecture_planning_(EAP)_for_optimizing_monitoring_and_equipment_maintenance\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-11\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-11\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Agievich, Vadim; Skripkin, Kirill (2014). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1877050914004414\" target=\"_blank\">\"Enterprise Architecture Migration Planning Using the Matrix of Change\"<\/a> (in en). <i>Procedia Computer Science<\/i> <b>31<\/b>: 231\u2013235. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.procs.2014.05.264\" target=\"_blank\">10.1016\/j.procs.2014.05.264<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1877050914004414\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1877050914004414<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Enterprise+Architecture+Migration+Planning+Using+the+Matrix+of+Change&rft.jtitle=Procedia+Computer+Science&rft.aulast=Agievich&rft.aufirst=Vadim&rft.au=Agievich%2C%26%2332%3BVadim&rft.au=Skripkin%2C%26%2332%3BKirill&rft.date=2014&rft.volume=31&rft.pages=231%E2%80%93235&rft_id=info:doi\/10.1016%2Fj.procs.2014.05.264&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS1877050914004414&rfr_id=info:sid\/en.wikipedia.org:Journal:The_modeling_of_laboratory_information_systems_in_higher_education_based_on_enterprise_architecture_planning_(EAP)_for_optimizing_monitoring_and_equipment_maintenance\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:0-12\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:0_12-0\">12.0<\/a><\/sup> <sup><a href=\"#cite_ref-:0_12-1\">12.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Politeknik Unggul LP3M, Indonesia; Purba, Ramen Antonov (28 November 2021). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/ojs2.pnb.ac.id\/index.php\/MATRIX\/article\/view\/39\" target=\"_blank\">\"Application design to help predict market demand using the waterfall method\"<\/a>. <i>Matrix : Jurnal Manajemen Teknologi dan Informatika<\/i> <b>11<\/b> (3): 140\u2013149. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.31940%2Fmatrix.v11i3.140-149\" target=\"_blank\">10.31940\/matrix.v11i3.140-149<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/ojs2.pnb.ac.id\/index.php\/MATRIX\/article\/view\/39\" target=\"_blank\">https:\/\/ojs2.pnb.ac.id\/index.php\/MATRIX\/article\/view\/39<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Application+design+to+help+predict+market+demand+using+the+waterfall+method&rft.jtitle=Matrix+%3A+Jurnal+Manajemen+Teknologi+dan+Informatika&rft.aulast=Politeknik+Unggul+LP3M%2C+Indonesia&rft.au=Politeknik+Unggul+LP3M%2C+Indonesia&rft.au=Purba%2C%26%2332%3BRamen+Antonov&rft.date=28+November+2021&rft.volume=11&rft.issue=3&rft.pages=140%E2%80%93149&rft_id=info:doi\/10.31940%2Fmatrix.v11i3.140-149&rft_id=https%3A%2F%2Fojs2.pnb.ac.id%2Findex.php%2FMATRIX%2Farticle%2Fview%2F39&rfr_id=info:sid\/en.wikipedia.org:Journal:The_modeling_of_laboratory_information_systems_in_higher_education_based_on_enterprise_architecture_planning_(EAP)_for_optimizing_monitoring_and_equipment_maintenance\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-13\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-13\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Tutaj, Jerzy; Rutkowska, Ma\u0142gorzata; Bartoszczuk, Pawe\u0142 (2021). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1877050921020226\" target=\"_blank\">\"Enterprise Business Architecture as a Tool for Sustainable Development in an Enterprise - case study\"<\/a> (in en). <i>Procedia Computer Science<\/i> <b>192<\/b>: 5050\u20135057. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.procs.2021.09.283\" target=\"_blank\">10.1016\/j.procs.2021.09.283<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1877050921020226\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1877050921020226<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Enterprise+Business+Architecture+as+a+Tool+for+Sustainable+Development+in+an+Enterprise+-+case+study&rft.jtitle=Procedia+Computer+Science&rft.aulast=Tutaj&rft.aufirst=Jerzy&rft.au=Tutaj%2C%26%2332%3BJerzy&rft.au=Rutkowska%2C%26%2332%3BMa%C5%82gorzata&rft.au=Bartoszczuk%2C%26%2332%3BPawe%C5%82&rft.date=2021&rft.volume=192&rft.pages=5050%E2%80%935057&rft_id=info:doi\/10.1016%2Fj.procs.2021.09.283&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS1877050921020226&rfr_id=info:sid\/en.wikipedia.org:Journal:The_modeling_of_laboratory_information_systems_in_higher_education_based_on_enterprise_architecture_planning_(EAP)_for_optimizing_monitoring_and_equipment_maintenance\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-14\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-14\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Liana, V.I.; Dewi, L.P.; Yulia, Y. (2019). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/publication.petra.ac.id\/index.php\/teknik-informatika\/article\/view\/8066\" target=\"_blank\">\"Enterprise Architecture Pada CV. Grande Zangrandi Dengan Metode Enterprise Architecture Planning (EAP)\"<\/a>. <i>Jurnal Infra<\/i> <b>7<\/b> (1): 164\u2013169<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/publication.petra.ac.id\/index.php\/teknik-informatika\/article\/view\/8066\" target=\"_blank\">https:\/\/publication.petra.ac.id\/index.php\/teknik-informatika\/article\/view\/8066<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Enterprise+Architecture+Pada+CV.+Grande+Zangrandi+Dengan+Metode+Enterprise+Architecture+Planning+%28EAP%29&rft.jtitle=Jurnal+Infra&rft.aulast=Liana%2C+V.I.%3B+Dewi%2C+L.P.%3B+Yulia%2C+Y.&rft.au=Liana%2C+V.I.%3B+Dewi%2C+L.P.%3B+Yulia%2C+Y.&rft.date=2019&rft.volume=7&rft.issue=1&rft.pages=164%E2%80%93169&rft_id=https%3A%2F%2Fpublication.petra.ac.id%2Findex.php%2Fteknik-informatika%2Farticle%2Fview%2F8066&rfr_id=info:sid\/en.wikipedia.org:Journal:The_modeling_of_laboratory_information_systems_in_higher_education_based_on_enterprise_architecture_planning_(EAP)_for_optimizing_monitoring_and_equipment_maintenance\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-15\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-15\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Supriadi, Hari; Amalia, Endang (10 May 2019). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.sciedu.ca\/journal\/index.php\/ijhe\/article\/view\/15469\" target=\"_blank\">\"University\u2019s Enterprise Architecture Design Using Enterprise Architecture Planning (EAP) Based on the Zachman\u2019s Framework Approach\"<\/a>. <i>International Journal of Higher Education<\/i> <b>8<\/b> (3): 13. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.5430%2Fijhe.v8n3p13\" target=\"_blank\">10.5430\/ijhe.v8n3p13<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1927-6052\" target=\"_blank\">1927-6052<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/www.sciedu.ca\/journal\/index.php\/ijhe\/article\/view\/15469\" target=\"_blank\">http:\/\/www.sciedu.ca\/journal\/index.php\/ijhe\/article\/view\/15469<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=University%E2%80%99s+Enterprise+Architecture+Design+Using+Enterprise+Architecture+Planning+%28EAP%29+Based+on+the+Zachman%E2%80%99s+Framework+Approach&rft.jtitle=International+Journal+of+Higher+Education&rft.aulast=Supriadi&rft.aufirst=Hari&rft.au=Supriadi%2C%26%2332%3BHari&rft.au=Amalia%2C%26%2332%3BEndang&rft.date=10+May+2019&rft.volume=8&rft.issue=3&rft.pages=13&rft_id=info:doi\/10.5430%2Fijhe.v8n3p13&rft.issn=1927-6052&rft_id=http%3A%2F%2Fwww.sciedu.ca%2Fjournal%2Findex.php%2Fijhe%2Farticle%2Fview%2F15469&rfr_id=info:sid\/en.wikipedia.org:Journal:The_modeling_of_laboratory_information_systems_in_higher_education_based_on_enterprise_architecture_planning_(EAP)_for_optimizing_monitoring_and_equipment_maintenance\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-16\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-16\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Petrov, Igor; Malysheva, Natalia; Lukmanova, Inessa; Panfilova, Elena (2022). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2352146522004124\" target=\"_blank\">\"Transport enterprise architecture and features of its personnel management\"<\/a> (in en). <i>Transportation Research Procedia<\/i> <b>63<\/b>: 1462\u20131472. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.trpro.2022.06.157\" target=\"_blank\">10.1016\/j.trpro.2022.06.157<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2352146522004124\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2352146522004124<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Transport+enterprise+architecture+and+features+of+its+personnel+management&rft.jtitle=Transportation+Research+Procedia&rft.aulast=Petrov&rft.aufirst=Igor&rft.au=Petrov%2C%26%2332%3BIgor&rft.au=Malysheva%2C%26%2332%3BNatalia&rft.au=Lukmanova%2C%26%2332%3BInessa&rft.au=Panfilova%2C%26%2332%3BElena&rft.date=2022&rft.volume=63&rft.pages=1462%E2%80%931472&rft_id=info:doi\/10.1016%2Fj.trpro.2022.06.157&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS2352146522004124&rfr_id=info:sid\/en.wikipedia.org:Journal:The_modeling_of_laboratory_information_systems_in_higher_education_based_on_enterprise_architecture_planning_(EAP)_for_optimizing_monitoring_and_equipment_maintenance\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-17\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-17\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Indrawan, B; Sumitra, I D (1 November 2019). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/iopscience.iop.org\/article\/10.1088\/1757-899X\/662\/3\/032030\" target=\"_blank\">\"Enterprise Architecture for Higher Education Using Enterprise Architecture Planning Based Three Pillars of Higher Education\"<\/a>. <i>IOP Conference Series: Materials Science and Engineering<\/i> <b>662<\/b> (3): 032030. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1088%2F1757-899X%2F662%2F3%2F032030\" target=\"_blank\">10.1088\/1757-899X\/662\/3\/032030<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1757-8981\" target=\"_blank\">1757-8981<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/iopscience.iop.org\/article\/10.1088\/1757-899X\/662\/3\/032030\" target=\"_blank\">https:\/\/iopscience.iop.org\/article\/10.1088\/1757-899X\/662\/3\/032030<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Enterprise+Architecture+for+Higher+Education+Using+Enterprise+Architecture+Planning+Based+Three+Pillars+of+Higher+Education&rft.jtitle=IOP+Conference+Series%3A+Materials+Science+and+Engineering&rft.aulast=Indrawan&rft.aufirst=B&rft.au=Indrawan%2C%26%2332%3BB&rft.au=Sumitra%2C%26%2332%3BI+D&rft.date=1+November+2019&rft.volume=662&rft.issue=3&rft.pages=032030&rft_id=info:doi\/10.1088%2F1757-899X%2F662%2F3%2F032030&rft.issn=1757-8981&rft_id=https%3A%2F%2Fiopscience.iop.org%2Farticle%2F10.1088%2F1757-899X%2F662%2F3%2F032030&rfr_id=info:sid\/en.wikipedia.org:Journal:The_modeling_of_laboratory_information_systems_in_higher_education_based_on_enterprise_architecture_planning_(EAP)_for_optimizing_monitoring_and_equipment_maintenance\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-18\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-18\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Utomo, Andy Prasetyo (1 April 2014). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/jurnal.umk.ac.id\/index.php\/simet\/article\/view\/129\" target=\"_blank\">\"PEMODELAN ARSITEKTUR ENTERPRISE SISTEM INFORMASI AKADEMIK PADA PERGURUAN TINGGI MENGGUNAKAN ENTERPRISE ARCHITECTURE PLANNING\"<\/a>. <i>Simetris: Jurnal Teknik Mesin, Elektro dan Ilmu Komputer<\/i> <b>5<\/b> (1): 33\u201340. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.24176%2Fsimet.v5i1.129\" target=\"_blank\">10.24176\/simet.v5i1.129<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2549-3108\" target=\"_blank\">2549-3108<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/jurnal.umk.ac.id\/index.php\/simet\/article\/view\/129\" target=\"_blank\">https:\/\/jurnal.umk.ac.id\/index.php\/simet\/article\/view\/129<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=PEMODELAN+ARSITEKTUR+ENTERPRISE+SISTEM+INFORMASI+AKADEMIK+PADA+PERGURUAN+TINGGI+MENGGUNAKAN+ENTERPRISE+ARCHITECTURE+PLANNING&rft.jtitle=Simetris%3A+Jurnal+Teknik+Mesin%2C+Elektro+dan+Ilmu+Komputer&rft.aulast=Utomo&rft.aufirst=Andy+Prasetyo&rft.au=Utomo%2C%26%2332%3BAndy+Prasetyo&rft.date=1+April+2014&rft.volume=5&rft.issue=1&rft.pages=33%E2%80%9340&rft_id=info:doi\/10.24176%2Fsimet.v5i1.129&rft.issn=2549-3108&rft_id=https%3A%2F%2Fjurnal.umk.ac.id%2Findex.php%2Fsimet%2Farticle%2Fview%2F129&rfr_id=info:sid\/en.wikipedia.org:Journal:The_modeling_of_laboratory_information_systems_in_higher_education_based_on_enterprise_architecture_planning_(EAP)_for_optimizing_monitoring_and_equipment_maintenance\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-19\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-19\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Tavana, Madjid; Hajipour, Vahid; Oveisi, Shahrzad (1 September 2020). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2542660520300962\" target=\"_blank\">\"IoT-based enterprise resource planning: Challenges, open issues, applications, architecture, and future research directions\"<\/a> (in en). <i>Internet of Things<\/i> <b>11<\/b>: 100262. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.iot.2020.100262\" target=\"_blank\">10.1016\/j.iot.2020.100262<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2542660520300962\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2542660520300962<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=IoT-based+enterprise+resource+planning%3A+Challenges%2C+open+issues%2C+applications%2C+architecture%2C+and+future+research+directions&rft.jtitle=Internet+of+Things&rft.aulast=Tavana&rft.aufirst=Madjid&rft.au=Tavana%2C%26%2332%3BMadjid&rft.au=Hajipour%2C%26%2332%3BVahid&rft.au=Oveisi%2C%26%2332%3BShahrzad&rft.date=1+September+2020&rft.volume=11&rft.pages=100262&rft_id=info:doi\/10.1016%2Fj.iot.2020.100262&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS2542660520300962&rfr_id=info:sid\/en.wikipedia.org:Journal:The_modeling_of_laboratory_information_systems_in_higher_education_based_on_enterprise_architecture_planning_(EAP)_for_optimizing_monitoring_and_equipment_maintenance\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-20\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-20\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Subagjo, R.T. (2012). <a rel=\"nofollow\" class=\"external text\" href=\"#cite\">\"Pemodelan Arsitektur Enterprise STMIK CIC Cirebon Menggunakan Enterprise Architecture Planning\"<\/a>. <i>Jurnal Teknik Informatika dan Sistem Informasi<\/i> <b>7<\/b> (2)<span class=\"printonly\">. <a rel=\"nofollow\" class=\"external free\" href=\"#cite\">https:\/\/www.neliti.com\/publications\/219753\/pemodelan-arsitektur-enterprise-stmik-cic-cirebon-menggunakan-enterprise-archite#cite<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Pemodelan+Arsitektur+Enterprise+STMIK+CIC+Cirebon+Menggunakan+Enterprise+Architecture+Planning&rft.jtitle=Jurnal+Teknik+Informatika+dan+Sistem+Informasi&rft.aulast=Subagjo%2C+R.T.&rft.au=Subagjo%2C+R.T.&rft.date=2012&rft.volume=7&rft.issue=2&rft_id=https%3A%2F%2Fwww.neliti.com%2Fpublications%2F219753%2Fpemodelan-arsitektur-enterprise-stmik-cic-cirebon-menggunakan-enterprise-archite%23cite&rfr_id=info:sid\/en.wikipedia.org:Journal:The_modeling_of_laboratory_information_systems_in_higher_education_based_on_enterprise_architecture_planning_(EAP)_for_optimizing_monitoring_and_equipment_maintenance\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-21\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-21\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Pattij, Maurice; van de Wetering, Rogier; Kusters, Rob (2022). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2666954422000163\" target=\"_blank\">\"Enhanced digital transformation supporting capabilities through enterprise architecture management: A fsQCA perspective\"<\/a> (in en). <i>Digital Business<\/i> <b>2<\/b> (2): 100036. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.digbus.2022.100036\" target=\"_blank\">10.1016\/j.digbus.2022.100036<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2666954422000163\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2666954422000163<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Enhanced+digital+transformation+supporting+capabilities+through+enterprise+architecture+management%3A+A+fsQCA+perspective&rft.jtitle=Digital+Business&rft.aulast=Pattij&rft.aufirst=Maurice&rft.au=Pattij%2C%26%2332%3BMaurice&rft.au=van+de+Wetering%2C%26%2332%3BRogier&rft.au=Kusters%2C%26%2332%3BRob&rft.date=2022&rft.volume=2&rft.issue=2&rft.pages=100036&rft_id=info:doi\/10.1016%2Fj.digbus.2022.100036&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS2666954422000163&rfr_id=info:sid\/en.wikipedia.org:Journal:The_modeling_of_laboratory_information_systems_in_higher_education_based_on_enterprise_architecture_planning_(EAP)_for_optimizing_monitoring_and_equipment_maintenance\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-22\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-22\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Universitas Flores; Tute, Kristianus Jago; Londa, Maria Adelvin; Universitas Flores; Mude, Anastasia; Universitas Flores (31 July 2022). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/ojs2.pnb.ac.id\/index.php\/MATRIX\/article\/view\/453\" target=\"_blank\">\"Delone and McLean Models for measuring the success of Flores University e-learning information system\"<\/a>. <i>MATRIX : Jurnal Manajemen Teknologi dan Informatika<\/i> <b>12<\/b> (2): 68\u201378. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.31940%2Fmatrix.v12i2.68-78\" target=\"_blank\">10.31940\/matrix.v12i2.68-78<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/ojs2.pnb.ac.id\/index.php\/MATRIX\/article\/view\/453\" target=\"_blank\">https:\/\/ojs2.pnb.ac.id\/index.php\/MATRIX\/article\/view\/453<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Delone+and+McLean+Models+for+measuring+the+success+of+Flores+University+e-learning+information+system&rft.jtitle=MATRIX+%3A+Jurnal+Manajemen+Teknologi+dan+Informatika&rft.aulast=Universitas+Flores&rft.au=Universitas+Flores&rft.au=Tute%2C%26%2332%3BKristianus+Jago&rft.au=Londa%2C%26%2332%3BMaria+Adelvin&rft.au=Universitas+Flores&rft.au=Mude%2C%26%2332%3BAnastasia&rft.au=Universitas+Flores&rft.date=31+July+2022&rft.volume=12&rft.issue=2&rft.pages=68%E2%80%9378&rft_id=info:doi\/10.31940%2Fmatrix.v12i2.68-78&rft_id=https%3A%2F%2Fojs2.pnb.ac.id%2Findex.php%2FMATRIX%2Farticle%2Fview%2F453&rfr_id=info:sid\/en.wikipedia.org:Journal:The_modeling_of_laboratory_information_systems_in_higher_education_based_on_enterprise_architecture_planning_(EAP)_for_optimizing_monitoring_and_equipment_maintenance\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-23\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-23\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Universitas Katolik Musi Charitas, Indonesia; Wibagso, Stefanus Setyo; Celesta, Ivana; Universitas Katolik Musi Charitas, Indonesia (28 November 2021). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/ojs2.pnb.ac.id\/index.php\/MATRIX\/article\/view\/36\" target=\"_blank\">\"Implementation of human-centered design methods in designing application interfaces for nursing home service\"<\/a>. <i>Matrix : Jurnal Manajemen Teknologi dan Informatika<\/i> <b>11<\/b> (3): 150\u2013161. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.31940%2Fmatrix.v11i3.150-161\" target=\"_blank\">10.31940\/matrix.v11i3.150-161<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/ojs2.pnb.ac.id\/index.php\/MATRIX\/article\/view\/36\" target=\"_blank\">https:\/\/ojs2.pnb.ac.id\/index.php\/MATRIX\/article\/view\/36<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Implementation+of+human-centered+design+methods+in+designing+application+interfaces+for+nursing+home+service&rft.jtitle=Matrix+%3A+Jurnal+Manajemen+Teknologi+dan+Informatika&rft.aulast=Universitas+Katolik+Musi+Charitas%2C+Indonesia&rft.au=Universitas+Katolik+Musi+Charitas%2C+Indonesia&rft.au=Wibagso%2C%26%2332%3BStefanus+Setyo&rft.au=Celesta%2C%26%2332%3BIvana&rft.au=Universitas+Katolik+Musi+Charitas%2C+Indonesia&rft.date=28+November+2021&rft.volume=11&rft.issue=3&rft.pages=150%E2%80%93161&rft_id=info:doi\/10.31940%2Fmatrix.v11i3.150-161&rft_id=https%3A%2F%2Fojs2.pnb.ac.id%2Findex.php%2FMATRIX%2Farticle%2Fview%2F36&rfr_id=info:sid\/en.wikipedia.org:Journal:The_modeling_of_laboratory_information_systems_in_higher_education_based_on_enterprise_architecture_planning_(EAP)_for_optimizing_monitoring_and_equipment_maintenance\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-TarverWhat21-24\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-TarverWhat21_24-0\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Tarver, E. (1 September 2021). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.investopedia.com\/ask\/answers\/050115\/what-are-primary-activities-michael-porters-value-chain.asp\" target=\"_blank\">\"What Are the Primary Activities of Michael Porter's Value Chain?\"<\/a>. <i>Investopedia<\/i><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.investopedia.com\/ask\/answers\/050115\/what-are-primary-activities-michael-porters-value-chain.asp\" target=\"_blank\">https:\/\/www.investopedia.com\/ask\/answers\/050115\/what-are-primary-activities-michael-porters-value-chain.asp<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=What+Are+the+Primary+Activities+of+Michael+Porter%27s+Value+Chain%3F&rft.atitle=Investopedia&rft.aulast=Tarver%2C+E.&rft.au=Tarver%2C+E.&rft.date=1+September+2021&rft_id=https%3A%2F%2Fwww.investopedia.com%2Fask%2Fanswers%2F050115%2Fwhat-are-primary-activities-michael-porters-value-chain.asp&rfr_id=info:sid\/en.wikipedia.org:Journal:The_modeling_of_laboratory_information_systems_in_higher_education_based_on_enterprise_architecture_planning_(EAP)_for_optimizing_monitoring_and_equipment_maintenance\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<\/ol><\/div><\/div>\n<h2><span class=\"mw-headline\" id=\"Notes\">Notes<\/span><\/h2>\n<p>This presentation is faithful to the original, with only a few minor changes to presentation. Grammar was cleaned up for smoother reading. In some cases important information was missing from the references, and that information was added. The original article duplicates a paragraph in the methodology, with new references, which is confusing; for this version, the duplicated content was removed, along with the associated references, putting the article at three fewer references. Additionally, no citation was associated with the mention of Porter's value chain (originally mispelled as \"Potter's\") and a citation was added for this version.\n<\/p>\n<!-- \nNewPP limit report\nCached time: 20230630152051\nCache expiry: 86400\nDynamic content: false\nComplications: []\nCPU time usage: 0.777 seconds\nReal time usage: 1.094 seconds\nPreprocessor visited node count: 23240\/1000000\nPost\u2010expand include size: 195366\/2097152 bytes\nTemplate argument size: 66740\/2097152 bytes\nHighest expansion depth: 21\/40\nExpensive parser function count: 0\/100\nUnstrip recursion depth: 0\/20\nUnstrip post\u2010expand size: 54608\/5000000 bytes\n-->\n<!--\nTransclusion expansion time report (%,ms,calls,template)\n100.00% 547.071 1 -total\n 84.81% 463.954 1 Template:Reflist\n 70.09% 383.426 23 Template:Cite_journal\n 67.97% 371.847 24 Template:Citation\/core\n 11.98% 65.548 20 Template:Date\n 10.03% 54.853 1 Template:Infobox_journal_article\n 8.78% 48.051 1 Template:Infobox\n 7.21% 39.424 26 Template:Citation\/identifier\n 4.30% 23.536 1 Template:Cite_web\n 4.30% 23.498 80 Template:Infobox\/row\n-->\n\n<!-- Saved in parser cache with key limswiki:pcache:idhash:14199-0!canonical and timestamp 20230630152050 and revision id 52148. Serialized with JSON.\n -->\n<\/div><\/div><div class=\"printfooter\">Source: <a rel=\"external_link\" class=\"external\" href=\"https:\/\/www.limswiki.org\/index.php\/Journal:The_modeling_of_laboratory_information_systems_in_higher_education_based_on_enterprise_architecture_planning_(EAP)_for_optimizing_monitoring_and_equipment_maintenance\">https:\/\/www.limswiki.org\/index.php\/Journal:The_modeling_of_laboratory_information_systems_in_higher_education_based_on_enterprise_architecture_planning_(EAP)_for_optimizing_monitoring_and_equipment_maintenance<\/a><\/div>\n<!-- end content --><div class=\"visualClear\"><\/div><\/div><\/div><div class=\"visualClear\"><\/div><\/div><!-- end of the left (by default at least) column --><div class=\"visualClear\"><\/div><\/div>\n\n\n\n<\/body>","da73605127ec78cc7d7d98765f3fbcc2_images":["https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/2\/29\/Fig1_Ifriza_Matrix23_13-1.png","https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/a\/a8\/Fig2_Ifriza_Matrix23_13-1.png","https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/0\/09\/Fig3_Ifriza_Matrix23_13-1.png","https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/b\/b6\/Fig4_Ifriza_Matrix23_13-1.png","https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/0\/0d\/Fig5_Ifriza_Matrix23_13-1.png","https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/1\/19\/Fig6_Ifriza_Matrix23_13-1.png"],"da73605127ec78cc7d7d98765f3fbcc2_timestamp":1688138450,"c85ecad158b719016ec41928421b862e_type":"article","c85ecad158b719016ec41928421b862e_title":"Integrative diagnostics: The time is now\u2014a report from the International Society for Strategic Studies in Radiology (Beauchamp et al. 2022)","c85ecad158b719016ec41928421b862e_url":"https:\/\/www.limswiki.org\/index.php\/Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology","c85ecad158b719016ec41928421b862e_plaintext":"\n\nJournal:Integrative diagnostics: The time is now\u2014a report from the International Society for Strategic Studies in RadiologyFrom LIMSWikiJump to navigationJump to searchFull article title\n \nIntegrative diagnostics: The time is now\u2014a report from the International Society for Strategic Studies in RadiologyJournal\n \nInsights into ImagingAuthor(s)\n \nBeauchamp, Norman J.; Bryan R. Nick; Bui, Marilyn M.; Krestin, Gabriel P.; McGinty, Geraldine B.; Meltzer, Carolyn C.; Neumaier, MichaelAuthor affiliation(s)\n \nMichigan State University, University of Pennsylvania, Moffitt Cancer Center and Research Institute, University Medical Center Rotterdam, Weill Cornell Medicine, University of Southern California, University of HeidelbergPrimary contact\n \nEmail: robert dot bryan at pennmedicine dot upenn dot eduYear published\n \n2022Volume and issue\n \n14Article #\n \n54DOI\n \n10.1186\/s13244-023-01379-9ISSN\n \n1869-4101Distribution license\n \nCreative Commons Attribution 4.0 InternationalWebsite\n \nhttps:\/\/insightsimaging.springeropen.com\/articles\/10.1186\/s13244-023-01379-9Download\n \nhttps:\/\/insightsimaging.springeropen.com\/counter\/pdf\/10.1186\/s13244-023-01379-9.pdf (PDF)\n\nContents \n\n1 Abstract \n2 Background \n3 Method \n\n3.1 What is ID? \n3.2 The ID process \n3.3 ID in tandem with radiology and pathology: \u201cIn vivo\u201d meets \u201cIn vitro\u201d \n3.4 Why ID? \n\n3.4.1 Added clinical value \n3.4.2 Discovery \n3.4.3 Medical education \n\n\n3.5 ID now? \n\n\n4 Recommendations \n5 Abbreviations, acronyms, and initialisms \n6 Acknowledgements \n\n6.1 Funding \n6.2 Contributions \n6.3 Competing interest \n\n\n7 Notes \n\n\n\nAbstract \nEnormous recent progress in diagnostic testing can enable more accurate diagnosis and improved clinical outcomes. Yet these tests are increasingly challenging and frustrating; the volume and diversity of results may overwhelm the diagnostic acumen of even the most dedicated and experienced clinician. Because they are gathered and processed within the \u201csilo\u201d of each diagnostic discipline, diagnostic data are fragmented, and the electronic health record (EHR) does little to synthesize new and existing data into usable information. Therefore, despite great promise, diagnoses may still be incorrect, delayed, or never made. Integrative diagnostics represents a vision for the future, wherein diagnostic data, together with clinical data from the EHR, are aggregated and contextualized by informatics tools to direct clinical action. Integrative diagnostics has the potential to identify correct therapies more quickly, modify treatment when appropriate, and terminate treatment when not effective, ultimately decreasing morbidity, improving outcomes, and avoiding unnecessary costs. Radiology, laboratory medicine, and pathology already play major roles in medical diagnostics. Our specialties can increase the value of our examinations by taking a holistic approach to their selection, interpretation, and application to the patient\u2019s care pathway. We have the means and rationale to incorporate integrative diagnostics into our specialties and guide its implementation in clinical practice.\nThe following overall points can be made about this research:\n\nDespite being an overall boon to clinical diagnosis, increasingly voluminous, diverse, and fragmented diagnostic data can overwhelm physicians and frustrate patients.\nData are gathered and processed within \u201csilos\u201d of the diagnostic disciplines, including radiology and pathology. The EHR does little to intelligently organize and synthesize these disparate data to facilitate diagnosis.\nIntegrative diagnostics envisions a process in which data from the entire arsenal of in vivo and in vitro diagnostics, together with clinical data from the EHR, are aggregated and contextualized to enhance diagnosis and direct clinical action.\nKeywords: diagnostics, integrative diagnostics, radiology, pathology, informatics, clinical informatics\nGraphic abstract:\n\n\nBackground \nDespite digital imaging, widespread adoption of electronic health records (EHRs), and advances in precision medicine tools, diagnosis often remains a fragmented and frustrating process for clinicians and patients. Data are still gathered and presented asynchronously, and EHRs do little to organize and synthesize information. Although team practice, such as tumor boards, is increasing, routine physician interaction is limited by clinical workflow, high volumes, and information technology (IT) boundaries. Despite an abundance of relevant diagnostic data, diagnoses may be incorrect, delayed, or never made. Allegations of diagnostic errors account for 28% of malpractice cases in the United States.[1] Experts estimate a diagnostic error rate of 10% to 15%, with 40,000\u201380,000 preventable deaths each year.[2][3] As physicians and diagnosticians, it is our responsibility to minimize these errors. Integrative diagnostics (ID) has been proposed as one means to reduce diagnostic errors.\n\nMethod \nThis paper is designed to address ID from the perspectives of radiology and our sister diagnostic specialty, pathology. The paper was developed in response to a request for proposal from the International Society of Strategic Studies in Radiology (IS3R) to its members for an annual white paper to foster its mission \u201cto actively shape the future of medical imaging and image-guided therapies by leveraging the knowledge and influence of world leaders in these disciplines and related industries.\u201d Proposals from self-organized writing groups were reviewed by the IS3R Publications Committee, with the final selection approved for drafting by the IS3R Executive Committee. Our writing group was designed to include departmental and institutional leaders in radiology and pathology who have interest and experience in ID. After preliminary approval by the Publications Committee, the draft paper was posted to the entire IS3R membership for comments, which were incorporated into this final document. This paper was approved for internal dissemination and publication by the IS3R Executive Committee.\n\n What is ID? \nMore than seven billion diagnostic examinations are performed each year in the United States, influencing 70% of health care decisions.[4] Although diagnostic tests differ in personnel, infrastructure, and technology, they have a shared commonality: providing data for clinical diagnosis.[5] ID has been proposed to better manage, organize, and present diagnostic data and bridge intellectual silos. ID represents a convergence of imaging, pathology, and clinical laboratory medicine, plus advanced levels of IT.[6] In this framework, integrated (versus isolated) practices plus clinical decision support (CDS) tools drive appropriate care. Data from the entire diagnostic arsenal are aggregated to enhance insights, and EHRs present information in a consumable way to facilitate collaborative decision making and accurate clinical diagnosis. ID uses medical informatics (in which data are data, regardless of their nature or source) to organize and analyze vast, disparate diagnostic data sets to achieve timely and accurate diagnosis, precise therapeutics, accurate assessment of prognosis, and maintenance of population health.[7]\nRadiology, clinical laboratories, and pathology departments, which perform the preponderance of diagnostic tests, currently play a central role in medical diagnostics. However, our disciplines have not worked as an integrated unit. Rather, we are islands of vast data and extraordinary intradisciplinary expertise separated from one another and from our clinical colleagues by informatics, physical, and specialty barriers. We have not integrated our data or communicated them in a coordinated fashion to our clinical colleagues, instead expecting clinicians to integrate and interpret these data themselves. Although of immense potential value, our petabytes of data are increasingly overwhelming providers and systems as we \u201cthrow our work over the fence\u201d and hope that someone figures out what it all means (Fig. 1A). It is no longer possible for individual health care providers to perform this complex task. ID offers a helping hand.\n\r\n\n\n\n\n\n\n\n\n\n\nFigure 1. Diagram describing (A') segregated diagnostics versus (B) integrative diagnostics.\n\n\n\nIn ID, radiologists, pathologists, and other diagnosticians work as teams with shared access to continuously updated patient data, from which experts and CDS tools extract relevant clinical information and formulate dynamic differential diagnosis and management pathways (Fig. 1B). Given our in-depth knowledge of our test data, understanding of the pathobiochemical and physiological basis of our diagnostic findings, technological skills, and strong informatics resources and expertise, the practices of radiology and pathology should strive for leadership roles in the ID environment.\nPredictive analytic tools based on aggregated clinical data can streamline care pathways so that appropriate diagnostic tests (including those performed by radiology, laboratory medicine, and pathology) are expedited on the basis of reason for referral, even in advance of a patient\u2019s visit with a provider. This requires real-time data entry from all sources, continual analytics, and timely interactive communication among laboratories, providers, and patients. Triaging patients in this manner could streamline and more appropriately prioritize health care access. For example, by identifying patients who need to be seen sooner, a decrease in wait times for specialists would provide reassurance to patients earlier in their care journey and prevent them from turning to high-cost settings such as the emergency department for care. ID could direct patients to the correct therapy sooner, modify treatment when appropriate, and terminate it when not effective, ultimately decreasing morbidity, improving outcomes, and avoiding unnecessary cost. Earlier access and more appropriate care are increasingly rewarded in value-based care payment arrangements. Additionally, ID could assess information that affects both individual patient well-being and population health, including identification of emerging infections, antibiotic resistance, exposure to toxic substances, and chemical or biologic threats.\nDespite a clear need and sound theoretical reasons for expanding the role of radiologists and pathologists in ID, real-world efforts remain meager. Our purpose is to stimulate more ID activity in our specialties by presenting the rationale for such efforts, highlighting successful ID programs that might be emulated at other sites, and recommending specific endeavors that are feasible now and should be prioritized in our departments and institutions.\n\nThe ID process \nAs outlined by the Institute of Medicine Committee on Diagnostic Error in Health Care, the diagnostic examination process is divided into three phases: pre-analytic, analytic, and post-analytic.[7][8] (Fig. 2)\n\r\n\n\n\n\n\n\n\n\n\n\nFigure 2. Integrative diagnostic workflow phases. CDS\u2009= clinical decision support; SPOC\u2009= single point of contact.\n\n\n\nThe analytic phase is the least susceptible to errors because of attention to technical performance and procedural standards, rigorous internal management and external quality assessment, and precise quantitative measurements. In contrast, our relative inattention to the pre- and post-analytic phases now warrants modification. In laboratory medicine, the analytic phase accounts for approximately 25% of total effort and workflow, the pre-analytic phase for 57%, and the post-analytic phase for 17%.[9] A disease process that requires inputs from multiple diagnostic disciplines is typically interrogated in a stepwise and discontinuous way. Although this is sometimes unavoidable (including subsequent testing whose utility only becomes apparent on the basis of preceding tests), the fragmented, sequential nature of the diagnostic process can cause treatment delays with negative impacts on outcomes.[10] ID can accelerate medical diagnosis, transforming this discontinuous, slow, and fragmented approach into a highly coordinated process with faster information flow through these test phases.\nIn the pre-examination phase, the referring provider is responsible for performing and\/or requesting the most appropriate examinations. In an estimated 10 to 15% of cases, the referring provider needs, and would value, assistance with these decisions. Inappropriate laboratory testing involves both under- and overutilization and occurs in 20 to 30% of cases.[11] Extra support may be needed for primary care providers, who see a wide variety of patients and diseases.[12] Modern health care informatics can help providers request the most appropriate examinations by integrating CDS tools into clinical workflow.[13] For example, use of a real-time radiology appropriateness CDS application decreased inappropriate utilization of brain and spine MRI and sinus CT[14], and computer-generated reminders to clinicians in Kenya improved CD4 laboratory monitoring of patients with HIV infection.[15] CDS tools should be available on platforms that integrate seamlessly into providers\u2019 workflow without adding unnecessary steps, and the appropriate use criteria underpinning these tools must be evidence-based. Feedback to providers must be supportive and advance learning, rather than being punitive. Additionally, CDS systems should be adapted to local circumstances, including local patient demographics and resources (such as the availability of diagnostic test equipment and the competencies of diagnosticians). CDS systems must also be capable of incorporating all relevant patient data. Moreover, CDS should be \u201cintegrated,\u201d reflecting not only the appropriateness of a single diagnostic discipline but also the benefit of combinations of tests across disciplines.\n\r\n\nAlthough referring physicians are responsible for maximizing the likelihood that patients will get needed examinations, approximately 20% of requested examinations in the United States are never performed.[16] Well-designed health care systems using contemporary, web-connected logistic support tools can improve this by coordinating examination times across disciplines at sites that match patients\u2019 circumstances and preferences to local health care resources. Point-of-care (POC) testing and service increases patient test completion, satisfaction, and clinical outcomes, although it presents efficiency and quality control (QC) challenges. POC laboratory testing has improved clinical outcomes in influenza and pneumonia, HIV infection, heart attack, and strep throat.[17] In Berlin, the use of mobile stroke units with CT scans and POC laboratory tests resulted in decreased time to treatment and lower global disability at three-month follow-up.[18]\nThe analytic phase of the diagnostic process centers on the performance of each specific examination, which are currently relatively independent events. Most picture archiving and communication systems (PACS) and radiology information systems (RIS) are separate from laboratory information systems (LIS), resulting in each pathologist and radiologist interpreting their own studies without easy access to the others\u2019 results. Bridging this disconnect should be a radiology and pathology IT priority. Diagnostic accuracy and management recommendations are improved when examinations are tailored and interpreted using knowledge from previous tests. Modern informatics, through optimizing the EHR, should make the complete medical record available to every examiner at the time of an examination, along with appropriate management guidelines. Each study\u2019s unique information should be intelligently and intuitively encapsulated in each sequential result. For example, POC CDS for management of incidental lung nodules improved adherence to nationally recommended guidelines for follow-up.[19]\nThe post-analytic phase of diagnostics initially focuses on the application of test results to the individual patient\u2019s diagnosis and care plan. The aggregation and diagnostic inferences from all of a patient\u2019s examinations leads to the most accurate and specific diagnosis. Examination results should be promptly and intuitively incorporated into the EHR and made easily available to health care providers and the patient. Until the past decade, these medical data were analyzed by a single or small number of providers, primarily using heuristics. Although an invaluable human thought process, heuristics takes shortcuts in reasoning, may not use all available data, and has well-known sources of error, including cognitive, selective, and availability biases.[20] Furthermore, heuristics suffers reduced accuracy and efficiency with increasing volumes and diversity of data types and greater task complexity.\nDeficiencies in current practice and EHRs extend from the most basic error\u2014missing data\u2014to data overload, as with radiopathogenomics. For example, in a Veterans Affairs setting, 30% of providers reported encountering at least one patient with a missed test result over the previous two weeks that caused a delay in diagnosis or treatment.[21] Tumor boards, with their extensive clinical, imaging, laboratory, and anatomic pathology content, may represent the epitome of data overload. No single human can master all the information of even one patient in any reasonable period of time, which was the topic of an RSNA\/American Association of Physicists in Medicine symposium on ID in 2019.[22] The current explosion of remote health monitoring tools and diagnostic tests with exponentially larger data units can easily overwhelm a single astute physician. It is estimated that every patient generates 80 MB of data each year, and the volume of health care data is predicted to increase faster than any other business sector.[23][24] ID can bring more human and computational resources to bear on these essentially raw data to yield useful information to diagnose and treat individual patient problems as well as address population disease and health management.[25]\nAn intelligent informatics infrastructure leveraging all these individual and population data can greatly augment the traditional human analysis. Integrated structured reports with discrete data are critical for data aggregation, which, in conjunction with outcome data, allows the development and optimization of front-end CDS systems. CDS tools, incorporating artificial intelligence (AI) and machine learning (ML) methodology, can provide referring providers with real-time probabilistic differential diagnoses for individual patients and enable the development of management paradigms for specific diseases and large populations.[26] Unfortunately, many CDS systems are monodisciplinary, prematurely obsolete, and incompatible with efficient clinical workflow. Modern health care informatics must develop fully integrated CDS tools that are multidisciplinary, continuously updated, and adapted to the local situation. These new management paradigms can close the loop from the post-analytic back to the pre-analytic phase by suggesting the most appropriate examinations for the referring physician\u2019s next patient with a similar problem set. Furthermore, this information can help health care systems identify their most burdensome and needy patients for proactive health care management.\nIn the United States, the 21st Century Cures Act emphasizes the patient\u2019s role in the post-analytic phase. The program rule on interoperability, information blocking, and Office of National Health Coordinator (ONHC) health IT certification, which implements this act, requires that health care providers give patients access without charge to all the health information in their EHR \u201cwithout delay.\u201d[27] This legislative directive, predicated on evidence that optimal diagnosis and treatment are enhanced by the convenient availability of patients\u2019 medical records to their physicians, will further drive the aggregation of medical information, regardless of initial source or current repository. This initiative should better enable all physicians involved in a patient\u2019s care to have immediate access to all of that patient\u2019s health care information. Although providing invaluable information to providers, including radiologists and pathologists, the technical and legal demands of this act on provider practices, health systems, and IT vendors will be significant. The requirement that all components of the EHR be promptly provided to the patient, including all laboratory, anatomic pathology, and radiology reports, presents a communication challenge and an opportunity for ID. We will have to modify our reports for patients\u2019 consumption through health care portals, offering the opportunity to integrate and summarize test results for patients and referring physicians.\n\n ID in tandem with radiology and pathology: \u201cIn vivo\u201d meets \u201cIn vitro\u201d \nIn 2020, the European Society of Radiology and the European Federation of Laboratory Medicine signed a memorandum of understanding confirming international support of ID between both disciplines.[28] Underlying this alliance is the favorable complementarity of diagnostic scope and data generated by the two fields. Modern imaging technologies provide high-resolution morphologic information but limited information on tissue metabolism and potential function and no systems information. In contrast, clinical laboratory medicine measures thousands of biochemical and molecular markers with moderate to high tissue specificity in various bodily fluids, but it rarely gives the pinpoint morphologic information that radiology can provide. For example, molecular biomarkers can sensitively indicate the presence of minute brain lesions, but these markers cannot localize a defect within the organ, assess the size of a lesion, or even count the number of lesions, functions that are easily provided by high-resolution in vivo imaging.[29]\nTable 1 demonstrates the clinical potential of ID between imaging and laboratory medicine. Each diagnosis or medical condition requires the results of a specific set of clinical, laboratory, radiology, and pathology tests to achieve a precise diagnosis. To make efficient use of our siloed data for ID, we must define interdisciplinary biomarker sets for specific clinical indications. Currently, physicians order examinations or tests from different disciplines and integrate the data themselves. With ID, clinical questions can be addressed by in vivo and in vitro diagnostic medicine, with different disciplines integrating their respective data and reporting interpreted results to other providers and patients in a combined report. Now is the time for radiologists and pathologists to venture beyond our disciplines and engage the broader diagnostic challenges confronted by ID. In the \u201cRecommendations\u201d section, we provide concrete advice on integration of ID into current practices.\n\n\n\n\n\n\n\nTable 1. Examples of integrative diagnostics. ADH = antidiuretic hormone; BNP = B-type natriuretic peptide; CA = 15\u20133 cancer antigen; CA = 19\u20139 carbohydrate antigen; CEA = carcinoembryonic antigen; CKD = chronic kidney disease; CRH = corticotropin-releasing hormone; CRP = C-reactive protein; CSF = cerebrospinal fluid; CYFRA 21\u20131 = cytokeratin fragment; DRE = digital rectal examination; Dx = diagnosis; ECG = electrocardiography; ER = estrogen receptor; FT3 = free T3; FT4 = free T4; GADD45 = growth arrest and DNA damage; GFAP = glial fibrillary acidic protein; GFR = glomerular filtration rate; GGT = gamma-glutamyl transferase; HbA1c = glycated hemoglobin; HER2neu = human epidermal growth factor receptor 2; HR = heart rate; IA-2 = islet antigen; IEF = isoelectric focusing; Ig = immunoglobulin; IL = interleukin; MEN = multiple endocrine neoplasm; MSI = multisatellite instability; NSE = neuron-specific enolase; NT-proBNP = N-terminal pro\u2013B-type natriuretic peptide; OHase = hydroxyvitamin hydroxylase; PCT = procalcitonin; PR = progesterone receptor; PSA = prostate-specific antigen; Ret = rearranged during transfection; SCC = squamous cell carcinoma; Tg = thyroglobulin; TnI = troponin I; TnT = troponin T; TPO = thyroid peroxidase; TRAK = thyrotropin receptor antibodies; TSH = thyroid-stimulating hormone; VHL = Von Hippel Lindau.\n\n\nDisease\n\nClinical findings\n\nIn vivo Dx (Imaging)\n\nIn vitro Dx (Laboratory medicine)\n\nIn vitro Dx (Pathology)\n\nReferences\n\n\nCancer\n\n\nProstate\n\nDRE, osseous lesion\n\nTransrectal ultrasound, MRI, PET\n\nPSA, acid phosphatase\n\n\n\n[30][31]\n\n\nColorectal\n\nOccult blood, ileus\n\nCT, MRI, PET\n\nCEA, CA 19\u20139, blood count\n\nHistopathology, MSI assessment\n\n[32]\n\n\nPancreatic\n\nJaundice\n\nMRI\n\nCA 19\u20139, bilirubin, GGT\n\nHistopathology\n\n[33]\n\n\nBreast\n\nClinical examination\n\nCT\n\nCA 15\u20133\n\nHistopathology, ER and PR status, HER2neu\n\n[34]\n\n\nBrain\n\nNeurologic deficit\n\nCT, MRI\n\nS100\u03b2\n\n\n\n[35]\n\n\nLung\n\n\n\n\n\nCEA, SCC, NSE, CYFRA 21\u20131\n\n\n\n[36]\n\n\nPlasmocytoma\n\nSpontaneous fractures\n\nWhole-body MRI\n\nBlood count, serum electrophoresis, IEF\n\n\n\n[37][38]\n\n\nCardiovascular\n\n\nChest pain\n\n\n\nTriple-rule-out ECG-gated CT\n\nTnI\/TnT, NT-proBNP, BNP, D-dimer\n\n\n\n[39]\n\n\nDyspnea\n\n\n\nThorax\n\nNT-proBNP, BNP, differential blood count, creatinine, GFR, CRP, PCT\n\n\n\n[40]\n\n\nNeurological\n\n\nStroke\n\nHemiparesis\n\nCT angiography, MRI\n\nGFAP, S100\u03b2\n\n\n\n[41]\n\n\nMeningitis\n\nNeurologic deficit, meningitis sign (eg, Kernig sign)\n\n\n\nCSF cell count, albumin, IgG, IgA, IgM, glucose, lactate, bacteria, CRP, PCT, sepsis parameter, bacterial culture\n\n\n\n[42]\n\n\nMultiple sclerosis\n\nSpecific neurologic deficit\n\n\n\nCSF cell count, albumin, IgG, IgA, IgM, glucose, CRP, oligoclonal bands\n\n\n\n[43]\n\n\nEncephalitis\n\n\n\n\n\n\n\n\n\n\n\n\nInflammation\n\n\nSepsis\n\n\n\nFocus search\n\nCRP, PCT, cytokine profiles IL-6, IL-8, differential blood count, blood culture\n\n\n\n[44]\n\n\nRheumatoid arthritis\n\n\n\nBone imaging\n\nCRP, sedimentation rate\n\n\n\n[45][46]\n\n\nEndocrinology\n\n\nAddison or Conn syndrome\n\nHypertension\/hypotension, cardiovascular symptoms, stress\n\nMRI, selective adrenal venous sampling\n\nAdrenal hormones, orthostasis test, salt exposure test\n\n\n\n[47][48]\n\n\nHypophysitis\n\nHeadache, altered vision, diabetes insipidus, signs of adrenal insufficiency\n\nCT, MRI\n\nAdrenal hormones, TSH, CRH, CRP, drugs and therapeutic medications\n\n\n\n[49]\n\n\nMultiple endocrine neoplasia syndromes\n\n\n\n\n\n\n\nMutation status: MEN, Ret, VHL1\n\n\n\n\nDiabetes\n\nPolyuria, polydipsia, fatigue, weight change, CKD, retinopathy\n\n\n\nGlucose, HbA1c, C-peptide, urine-Stix, blood gases and blood pH, lactate, ADH, copeptin, GADD45 antibodies, islet cell antibodies, IA-2 antibodies, insulin\n\n\n\n[50][51]\n\n\nHypothyroidism\n\nFatigue, weight gain, low activity, depression, blood pressure, HR\n\nThyroid ultrasound\n\nTSH, FT4, FT3, Tg, TRAK and TPO antibodies\n\n\n\n[52]\n\n\nCongenital adrenal hyperplasia\n\nVirilization, salt loss\n\nUltrasound\n\nCortisol, aldosterone, electrolytes\n\nKaryotyping, mutation status: 21-OHase, 17a-OHase\n\n[53]\n\n\n\n Why ID? \nAdded clinical value \nGood medical practice demands that only clinically appropriate examinations be performed, with minimum achievable risk. Socioeconomics requires that medical examinations be performed in a cost-effective fashion, while minimizing discomfort or inconvenience. The search for value in health care spending often casts imaging and diagnostics as drivers of cost and wasteful overutilization. However, diagnostic examination results are directly or indirectly involved in approximately 70% of medical decision making, while requiring less than 3% of the money spent on health care expenditures. In an effort to ensure value, hospitals, payers, and regulatory agencies track cost and quality performance; ID has the potential to improve both. Predictive analytic tools based on aggregated clinical data can streamline care pathways so that appropriate imaging and diagnostics are prioritized and expedited, on the basis of continual asynchronous informatics tools operating outside of, but in parallel with, direct communications and visits with patient providers.\nOur health care delivery system is rife with opportunity for streamlining care and reducing cost. We must find more cost-effective approaches to evaluating and bringing better health care not only to an individual patient but to our populations of patients, especially those who may have been historically disadvantaged. Since 2002, the American Medical Association (AMA) has emphasized the roles and responsibilities of physicians to promote the public\u2019s health.[54] Patients in rural areas often experience barriers to health care, including radiology and laboratory services, that limit their ability to receive appropriate care. Not surprisingly, these deleterious effects are magnified for minority, underserved, and underdeveloped populations.[55] ID offers unique and necessary tools to address these broader social demands on health care.\nLocal reimbursement systems present formidable barriers to change, including the implementation of ID. The prevailing fee-for-service reimbursement system in the United States offers little incentive to pool intellectual and informatics resources to develop an ID approach. Regulatory constraints around fee sharing have been reduced by the accountable care and bundled payment programs (i.e., the Affordable Care Act), but these programs still represent a minority of health care reimbursement. Even in single-payer systems such as the United Kingdom\u2019s National Health Service, cultural barriers may exist arising from the desire to maintain individual department resources. Importantly, the large capital investments in informatics infrastructure that will be required to manage a robust ID workflow could actually delay innovation when new, more integrated IT systems are needed in the future. The Health Information Technology for Economic and Clinical Health Act of 2009 incentivizing the adoption of EHRs included $27 billion to help finance the endeavor.[56] The current Cures Act does not have comparable governmental financial support. The lack of clarity on how the significant investment required of medical informatics companies will be rewarded represents another reimbursement-related barrier to innovation.\n\nDiscovery \nImaging and advanced molecular diagnostics have hastened the pace of discovery by providing quantitative outcome measures and decreasing subject variability in clinical trials, while lessening required sample size.[57] ID can expand our ability to perform efficient clinical trials with diverse patient populations. Using \u201creal-world\u201d data allows pragmatic research based on \u201ccomputable phenotypes,\u201d resulting in clinical cohorts from multiple sources containing data gathered in clinical care, home, or community settings.[57] It also enables more practical \u201cpseudorandomized\u201d clinical trials, which is important in a setting of decreased margins and demand for faster discovery. Furthermore, many diseases respond to multimodality therapy, and as such, evaluating single therapy interventions using traditional outcome measures and randomized clinical trials may miss therapies with important subclinical effects.\n\nMedical education \nID principles should be formally introduced in the first year of medical school, beginning with the concepts of team medicine and differential diagnosis on the basis of Bayesian inference, and pathologists and radiologists should be active participants. The current organization of undergraduate and graduate medical education fosters departmental silos, compounding fragmented informatics and information infrastructure. Traditional teaching must be changed to reflect the ID workflow, as in the problem-oriented curricula adopted in the Netherlands.[58] Table 2 includes recommendations for ways to encourage ID in medical education.\n\n\n\n\n\n\n\nTable 2. Recommendations for ways to encourage ID in medical education. CDS = clinical decision support; CME = continuing medical education; dx = diagnosis; EHR = electronic health record; GME = graduate medical education; ID = integrative diagnostics; IS = information systems; POC = point-of-care; QC = quality control; rx = treatment; UME = undergraduate medical education.\n\n\nOrganizational\n\nEducational\n\nOperational\n\nResearch\n\n\n\u25aa Expand multidisciplinary teams, e.g., \u201ctumor boards\u201d for all disciplines\r\n\u25aa Develop national organizational support\r\n\u25aa Incorporate ID sessions into annual professional meetings\r\n\u25aa Hold joint leadership meetings\r\n\u25aa Develop and implement cross-departmental professional and administrative structure\r\n\u25aa Designate an associate dean for ID\r\n\u25aa Form a joint committee of radiology\/pathology leadership\n\n\u25aa UME: Learn principles of diagnosis radiology, laboratory, and pathology from instructors\r\n\u25aa GME: Attend joint radiology and pathology presentations and conferences\r\n\u25aa CME: Participate in joint professional society courses\n\n\u25aa Integrate radiology and pathology IS (with EHR)\r\n\u25aa Monitor and improve joint workflow\r\n\u25aa Develop coordinated diagnostic test scheduling\r\n\u25aa Increase POC testing\r\n\u25aa Improve ID turnaround time: test 1 to 2 to 3 to dx to rx\r\n\u25aa Document and QC diagnostic errors\r\n\u25aa Apply a routine 360\u00b0 follow-up for all diagnostic tests: missed examinations, missing reports; missing referral physician follow-up\n\n\u25aa Implement integrated reporting mechanisms\r\n\u25aa Implement advanced CDS functions\r\n\u25aa Develop ID financial models\r\n\u25aa Conduct real-world trials for diagnostic tests\n\n\n\n ID now? \nAlthough separate radiology and pathology departments remain the norm at academic medical centers, early efforts at ID departments have been made. At Erasmus MC, University Medical Center Rotterdam, one of the largest academic hospitals in the Netherlands, clinical departments are organized in themes (G.P. Krestin, personal observation, 2022). The theme \"Diagnostics and Advice\" gathers all diagnostic departments (radiology and nuclear medicine, pathology, laboratory medicine, microbiology, virology, immunology, and pharmacy). The leadership of the theme consists of the department chairs and is committed to implementing the concept of ID to deliver high-quality ID reports to the referring physicians of the hospital. However, in the initial phase there was resistance from both clinical and diagnostic staff: referring clinicians considered that decision for the choice of diagnostic tests needed to remain their domain, while the diagnostic staff was reluctant to take on board additional \u201cburdensome\u201d exchanges with their colleagues in other diagnostic specialties. To break the deadlock, leadership started with a number of pilot cases (lung cancer, adrenal incidentaloma, primary liver lesions) that all turned out to benefit from an ID approach.\nIn 2018, the new Dell Medical School of the University of Texas at Austin established the Department of Diagnostic Medicine, which incorporated radiology and pathology (R.N. Bryan, personal observation, 2022). The organization of this department features a tripartite leadership of the chair and co-chairs or chiefs of clinical radiology and pathology. The chair has primary responsibility for the research program, while the clinical chiefs have primary responsibility for their respective clinical services. Responsibility for the educational programs is shared by these three departmental leaders, who are supported by appropriate vice-chairs for education and research from radiology and pathology faculty members. Although still nascent, progress of the program is internally viewed as \u201cencouraging.\u201d Newly Accreditation Council for Graduate Medical Education (ACGME)-credentialed radiology and pathology residency programs will accentuate radiology and pathology teaching conferences and multidisciplinary clinical conferences.\nA major limitation to these joint efforts is IT infrastructure. At Erasmus MC, the recent digitization of the pathology department and use of similar image management systems in pathology and radiology is expected to further facilitate integration between these specialties and the health system EHR. At the Dell Medical School, IT remains separate and fragmented, not only between radiology and pathology but also with the hospital EHR and other specialty information systems. Although technological integration of IT infrastructure (RIS, LIS, PACS, EHR, etc.) is necessary for the success of ID, it is not sufficient. Coordinated, multispecialty oversight of the ensemble is critical and must still address the specific needs of each specialty, while at the same time presenting a seamless overview to the clinical, research, and educational communities.\n\nRecommendations \nProgress toward a more integrated approach to medical diagnostics has been slow, even in organizations that have created structures to foster it. Silos of expertise and incentives are deeply ingrained. Some might argue that it will take regulation or significant payment innovation to break them down. The digitization of pathology, pathology\u2019s \u201cthird revolution,\u201d and the application of AI to medical data create a sense of both possibility and urgency around this effort. Key drivers of success will be organizational matrices that foster communication and collaboration, supported by robust informatics infrastructure. A general model of this concept is the integrated practice unit (IPU), which defines a multidisciplinary team of appropriate clinical and patient support personnel to address the full care cycle of a patient condition, supported by necessary physical, financial, and IT elements.[59] A relatively unique view of the currently ill-defined roles of radiologists and pathologists in an IPU is that of an information specialist.[60] Here, the radiologist\u2019s or pathologist\u2019s responsibility is not just the extraction of information from images or histology but management of that information (plus information extracted by AI) in the clinical context of the patient.\nChange must begin with small, easy steps, such as preclinical ID presentations by radiologists and pathologists, more joint radiology and pathology teaching sessions in our graduate medical education programs, focused postgraduate training programs jointly sponsored by our professional organizations, and extension of the tumor board concept into other disciplines, such as heart failure and infectious disease. However, the initial smaller steps should culminate in an organization with the will to implement a strong ID program and a way to support it through robust informatics. Table 2 lists recommendations for changes, some more immediately \u201cdoable,\u201d others more demanding but achievable. The previous section described early ID efforts at Erasmus MC and the Dell Medical School. A third example, the Center for Integrated Diagnostics at the Massachusetts General Hospital, with the mission \u201cto foster development of clinical actionable diagnostics and accelerate the adoption of personalized medicine,\u201d also recognizes the need to extend the concept beyond oncology and expand its testing to other disciplines.[61]\nThe failure of widespread adoption of the IPU concept of disease-focused care does not bode well for the health care system\u2019s ability to adapt.[62] Creating financial models that demonstrate the economic value proposition of ID will be a necessary catalyst for change. We believe creating a clear vision of the value created by ID for patient outcomes and quality of care will be most effective. Berwick\u2019s \u201cdimensions of total quality\u201d are all served by ID: don\u2019t kill me (no needless deaths from improper diagnosis); do help me (with a quick diagnosis); don\u2019t hurt me (no needless pain or unnecessarily invasive tests); don\u2019t make me feel helpless (inform patients of the reason and results of diagnostic tests); don\u2019t keep me waiting (or running between multiple test sites); and don\u2019t waste resources, mine or anyone else\u2019s (perform the fewest, best, least expensive tests).[63]\n\n Abbreviations, acronyms, and initialisms \nACGME: Accreditation Council for Graduate Medical Education\nAI: artificial intelligence\nAMA: American Medical Association\nCDS: clinical decision support\nEHR: electronic health record\nID: integrative diagnostics\nIPU: integrated practice unit\nIS: information systems\nIT: information technology\nIS3R: International Society of Strategic Studies in Radiology\nLIS: laboratory information system\nML: machine learning\nPACS: picture archiving and communication system\nPOC: point-of-care\nRIS: radiology information system\nSPOC: single point of contact\nAcknowledgements \nThis paper is published simultaneously in the Journal of the American College of Radiology (DOI: 10.1016\/j.jacr.2022.11.015) and Insights into Imaging (DOI: 10.1186\/s13244-023-01379-9).\n\nFunding \nThis work has not received any funding.\n\nContributions \nAll authors read and approved the final manuscript.\n\nCompeting interest \nThe authors state that they have no conflict of interest related to the material discussed in this article.\n\nNotes \nThis presentation is faithful to the original, with only a few minor changes to presentation, grammar, and punctuation. In some cases important information was missing from the references, and that information was added. Several URLs were dead in the original; substitute URLs were found for this version. The order of the references in this version differs from the original; the original continues from 40 at Table 2, but this version, by design, lists the references in order of appearance.\n\n\n\u2191 Saber Tehrani, Ali S; Lee, HeeWon; Mathews, Simon C; Shore, Andrew; Makary, Martin A; Pronovost, Peter J; Newman-Toker, David E (1 August 2013). \"25-Year summary of US malpractice claims for diagnostic errors 1986\u20132010: an analysis from the National Practitioner Data Bank\" (in en). BMJ Quality & Safety 22 (8): 672\u2013680. doi:10.1136\/bmjqs-2012-001550. ISSN 2044-5415. https:\/\/qualitysafety.bmj.com\/lookup\/doi\/10.1136\/bmjqs-2012-001550 .   \n \n\n\u2191 Graber, Mark L (1 October 2013). \"The incidence of diagnostic error in medicine\" (in en). BMJ Quality & Safety 22 (Suppl 2): ii21\u2013ii27. doi:10.1136\/bmjqs-2012-001615. ISSN 2044-5415. PMC PMC3786666. PMID 23771902. https:\/\/qualitysafety.bmj.com\/lookup\/doi\/10.1136\/bmjqs-2012-001615 .   \n \n\n\u2191 Schwartz, A.; Elstein, A.S. (2019). \"Clinical reasoning in medicine\". In Higgs, Joy; Jensen, Gail M.; Loftus, Stephen et al.. Clinical reasoning in the health professions (Fourth edition ed.). Edinburgh London New York: Elsevier. pp. 223\u2013234. ISBN 978-0-7020-6224-7.   \n \n\n\u2191 AdvaMedDx (June 2011). \"A Policy Primer on Diagnostics\". Archived from the original on 01 December 2020. https:\/\/web.archive.org\/web\/20201201141722\/https:\/\/dx.advamed.org\/resource-center?page=4 .   \n \n\n\u2191 Van Leeuwen, Anne M.; Bladh, Mickey Lynn (2021). Davis's comprehensive manual of laboratory and diagnostic tests with nursing implications (Ninth edition ed.). Philadelphia: F.A. Davis. ISBN 978-1-7196-4058-9.   \n \n\n\u2191 Lippi, Giuseppe; Plebani, Mario (15 February 2020). \"Integrated diagnostics: the future of laboratory medicine?\". Biochemia medica 30 (1): 18\u201330. doi:10.11613\/BM.2020.010501. PMC PMC6904966. PMID 31839719. https:\/\/www.biochemia-medica.com\/en\/journal\/30\/1\/10.11613\/BM.2020.010501 .   \n \n\n\u2191 7.0 7.1 Committee on Diagnostic Error in Health Care; Board on Health Care Services; Institute of Medicine; The National Academies of Sciences, Engineering, and Medicine (29 December 2015). Balogh, Erin P.; Miller, Bryan T.; Ball, John R.. eds. Improving Diagnosis in Health Care. Washington, D.C.: National Academies Press. doi:10.17226\/21794.. ISBN 978-0-309-37769-0. http:\/\/www.nap.edu\/catalog\/21794 .   \n \n\n\u2191 Stern, Scott D. C.; Cifu, Adam S.; Altkorn, Diane (2015). Symptom to diagnosis: an evidence-based guide (3rd edition ed.). New York Chicago San Francisco: McGraw-Hill Education Medical. ISBN 978-1-259-25253-2.   \n \n\n\u2191 Lundberg, George D. (2 February 1990). \"Critical (Panic) Value Notification: An Established Laboratory Practice Policy (Parameter)\" (in en). JAMA: The Journal of the American Medical Association 263 (5): 709. doi:10.1001\/jama.1990.03440050103044. ISSN 0098-7484. http:\/\/jama.jamanetwork.com\/article.aspx?doi=10.1001\/jama.1990.03440050103044 .   \n \n\n\u2191 Bleicher, Richard J.; Ruth, Karen; Sigurdson, Elin R.; Beck, J. Robert; Ross, Eric; Wong, Yu-Ning; Patel, Sameer A.; Boraas, Marcia et al. (1 March 2016). \"Time to Surgery and Breast Cancer Survival in the United States\" (in en). JAMA Oncology 2 (3): 330. doi:10.1001\/jamaoncol.2015.4508. ISSN 2374-2437. PMC PMC4788555. PMID 26659430. http:\/\/oncology.jamanetwork.com\/article.aspx?doi=10.1001\/jamaoncol.2015.4508 .   \n \n\n\u2191 Zhi, Ming; Ding, Eric L.; Theisen-Toupal, Jesse; Whelan, Julia; Arnaout, Ramy (15 November 2013). Szecsi, Pal Bela. ed. \"The Landscape of Inappropriate Laboratory Testing: A 15-Year Meta-Analysis\" (in en). PLoS ONE 8 (11): e78962. doi:10.1371\/journal.pone.0078962. ISSN 1932-6203. PMC PMC3829815. PMID 24260139. https:\/\/dx.plos.org\/10.1371\/journal.pone.0078962 .   \n \n\n\u2191 Hughes, Danny R.; Jiang, Miao; Duszak, Richard (1 January 2015). \"A Comparison of Diagnostic Imaging Ordering Patterns Between Advanced Practice Clinicians and Primary Care Physicians Following Office-Based Evaluation and Management Visits\" (in en). JAMA Internal Medicine 175 (1): 101. doi:10.1001\/jamainternmed.2014.6349. ISSN 2168-6106. http:\/\/archinte.jamanetwork.com\/article.aspx?doi=10.1001\/jamainternmed.2014.6349 .   \n \n\n\u2191 Berner, E.S. (June 2009). \"Clinical decision support systems: State of the Art\" (PDF). Agency for Healthcare Research and Quality. https:\/\/digital.ahrq.gov\/sites\/default\/files\/docs\/page\/09-0069-EF_1.pdf .   \n \n\n\u2191 Blackmore, C. Craig; Mecklenburg, Robert S.; Kaplan, Gary S. (1 January 2011). \"Effectiveness of Clinical Decision Support in Controlling Inappropriate Imaging\" (in en). Journal of the American College of Radiology 8 (1): 19\u201325. doi:10.1016\/j.jacr.2010.07.009. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1546144010003893 .   \n \n\n\u2191 Were, M. C.; Shen, C.; Tierney, W. M.; Mamlin, J. J.; Biondich, P. G.; Li, X.; Kimaiyo, S.; Mamlin, B. W. (1 March 2011). \"Evaluation of computer-generated reminders to improve CD4 laboratory monitoring in sub-Saharan Africa: a prospective comparative study\" (in en). Journal of the American Medical Informatics Association 18 (2): 150\u2013155. doi:10.1136\/jamia.2010.005520. ISSN 1067-5027. PMC PMC3116261. PMID 21252053. https:\/\/academic.oup.com\/jamia\/article-lookup\/doi\/10.1136\/jamia.2010.005520 .   \n \n\n\u2191 Lacy, N. L. (1 November 2004). \"Why We Don't Come: Patient Perceptions on No-Shows\" (in en). The Annals of Family Medicine 2 (6): 541\u2013545. doi:10.1370\/afm.123. ISSN 1544-1709. PMC PMC1466756. PMID 15576538. http:\/\/www.annfammed.org\/cgi\/doi\/10.1370\/afm.123 .   \n \n\n\u2191 AdvaMedDx (14 November 2019). \"From Test To Treatment: The Value Of Diagnostics\". https:\/\/dx.advamed.org\/member-center\/resource-library\/from-test-to-treatment-the-value-of-diagnostics\/ . Retrieved 25 February 2022 .   \n \n\n\u2191 Ebinger, Martin; Siegerink, Bob; Kunz, Alexander; Wendt, Matthias; Weber, Joachim E.; Schwabauer, Eugen; Geisler, Frederik; Freitag, Erik et al. (2 February 2021). \"Association Between Dispatch of Mobile Stroke Units and Functional Outcomes Among Patients With Acute Ischemic Stroke in Berlin\" (in en). JAMA 325 (5): 454. doi:10.1001\/jama.2020.26345. ISSN 0098-7484. PMC PMC7856548. PMID 33528537. https:\/\/jamanetwork.com\/journals\/jama\/fullarticle\/2775714 .   \n \n\n\u2191 Lu, Michael T.; Rosman, David A.; Wu, Carol C.; Gilman, Matthew D.; Harvey, H. Benjamin; Gervais, Debra A.; Alkasab, Tarik K.; Shepard, Jo-Anne O. et al. (1 February 2016). \"Radiologist Point-of-Care Clinical Decision Support and Adherence to Guidelines for Incidental Lung Nodules\" (in en). Journal of the American College of Radiology 13 (2): 156\u2013162. doi:10.1016\/j.jacr.2015.09.029. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1546144015009667 .   \n \n\n\u2191 Zwaan, Laura; Thijs, Abel; Wagner, Cordula; Timmermans, Dani\u00eblle R.M. (1 August 2013). \"Does inappropriate selectivity in information use relate to diagnostic errors and patient harm? The diagnosis of patients with dyspnea\" (in en). Social Science & Medicine 91: 32\u201338. doi:10.1016\/j.socscimed.2013.05.001. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0277953613002682 .   \n \n\n\u2191 Wahls, Terry L; Cram, Peter M (1 December 2007). \"The frequency of missed test results and associated treatment delays in a highly computerized health system\" (in en). BMC Family Practice 8 (1): 32. doi:10.1186\/1471-2296-8-32. ISSN 1471-2296. PMC PMC1891295. PMID 17519017. https:\/\/bmcfampract.biomedcentral.com\/articles\/10.1186\/1471-2296-8-32 .   \n \n\n\u2191 Allyn, J. (29 August 2019). \"RSNA\/AAPM Symposium Addresses Integrated Diagnostics at RSNA 2019\". Radiological Society of North America. https:\/\/www.rsna.org\/news\/2019\/August\/Integrated-Diagnostics .   \n \n\n\u2191 Harmony Healthcare IT (4 August 2020). \"Health Data Volumes Skyrocket, Legacy Data Archives On the Rise\". https:\/\/www.harmonyhit.com\/health-data-volumes-skyrocket-legacy-data-archives-rise-hie\/ . Retrieved 15 November 2021 .   \n \n\n\u2191 RBC Capital Markets (2021). \"The Healthcare Data Explosion\". RBC Dominion Securities Inc. https:\/\/www.rbccm.com\/en\/gib\/healthcare\/episode\/the_healthcare_data_explosion#content-panel . Retrieved 15 November 2021 .   \n \n\n\u2191 Association of State and Territorial Health Officials (2016). \"Public Health Informatics\". Medicaid and Public Health Integration Learning Series. Archived from the original on 08 November 2019. https:\/\/web.archive.org\/web\/20191108083841\/http:\/\/www.astho.org\/Health-Systems-Transformation\/Medicaid-and-Public-Health-Partnerships\/Learning-Series\/Public-Health-Informatics\/ .   \n \n\n\u2191 Riches, Nicholas; Panagioti, Maria; Alam, Rahul; Cheraghi-Sohi, Sudeh; Campbell, Stephen; Esmail, Aneez; Bower, Peter (8 March 2016). Schmidt, Robert L. ed. \"The Effectiveness of Electronic Differential Diagnoses (DDX) Generators: A Systematic Review and Meta-Analysis\" (in en). PLOS ONE 11 (3): e0148991. doi:10.1371\/journal.pone.0148991. ISSN 1932-6203. PMC PMC4782994. PMID 26954234. https:\/\/dx.plos.org\/10.1371\/journal.pone.0148991 .   \n \n\n\u2191 \"21st Century Cures Act: Interoperability, Information Blocking, and the ONC Health IT Certification Program - 85 FR 25642\". Federal Register. U.S. Government Publishing Office. 1 May 2020. https:\/\/www.federalregister.gov\/documents\/2020\/05\/01\/2020-07419\/21st-century-cures-act-interoperability-information-blocking-and-the-onc-health-it-certification .   \n \n\n\u2191 \"ESR reaches out to Clinical Chemistry and Laboratory Medicine\". European Society of Radiology. September 2019. http:\/\/www.myesr.link\/Mailings\/esr@work-september-2019\/ . Retrieved 26 May 2022 .   \n \n\n\u2191 Pelsers, Maurice M A L; Hanhoff, Thorsten; Van der Voort, Dani\u00eblle; Arts, Baer; Peters, Maarten; Ponds, Rudolf; Honig, Adriaan; Rudzinski, Wojtek et al. (1 September 2004). \"Brain- and Heart-Type Fatty Acid-Binding Proteins in the Brain: Tissue Distribution and Clinical Utility\" (in en). Clinical Chemistry 50 (9): 1568\u20131575. doi:10.1373\/clinchem.2003.030361. ISSN 0009-9147. https:\/\/academic.oup.com\/clinchem\/article\/50\/9\/1568\/5640128 .   \n \n\n\u2191 Ponti, Giovanni; Maccaferri, Monia; Percesepe, Antonio; Tomasi, Aldo; Ozben, Tomris (2 January 2021). \"Liquid biopsy with cell free DNA: new horizons for prostate cancer\" (in en). Critical Reviews in Clinical Laboratory Sciences 58 (1): 60\u201376. doi:10.1080\/10408363.2020.1803789. ISSN 1040-8363. https:\/\/www.tandfonline.com\/doi\/full\/10.1080\/10408363.2020.1803789 .   \n \n\n\u2191 Gao, Yanyun; Zhang, Meng; Li, Xiulian; Zeng, Pengjiao; Wang, Peitao; Zhang, Lijuan (2019), \"Serum PSA levels in patients with prostate cancer and other 33 different types of diseases\" (in en), Progress in Molecular Biology and Translational Science (Elsevier) 162: 377\u2013390, doi:10.1016\/bs.pmbts.2018.12.013, ISBN 978-0-12-817738-9, https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1877117318301613 . Retrieved 2023-04-04   \n \n\n\u2191 Bhalla, Amarpreet; Zulfiqar, Muhammad; Bluth, Martin H. (1 June 2018). \"Molecular Diagnostics in Colorectal Carcinoma\" (in en). Clinics in Laboratory Medicine 38 (2): 311\u2013342. doi:10.1016\/j.cll.2018.02.008. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0272271218300088 .   \n \n\n\u2191 Delgado, Jose Antonio; Ballesteros, Maria Antonieta; Parera, Mar\u00eda Magdalena; Bau\u00e7a, Josep Miquel (2 November 2021). \"Pancreatic Cancer Insights: Optimization of the Diagnostic Capacity of Tumor Biomarkers\" (in en). Laboratory Medicine 52 (6): 550\u2013557. doi:10.1093\/labmed\/lmab016. ISSN 0007-5027. https:\/\/academic.oup.com\/labmed\/article\/52\/6\/550\/6253743 .   \n \n\n\u2191 Li, Xiulian; Xu, Yan; Zhang, Lijuan (2019), \"Serum CA153 as biomarker for cancer and noncancer diseases\" (in en), Progress in Molecular Biology and Translational Science (Elsevier) 162: 265\u2013276, doi:10.1016\/bs.pmbts.2019.01.005, ISBN 978-0-12-817738-9, https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S187711731930016X . Retrieved 2023-04-04   \n \n\n\u2191 Heizmann, Claus W. (1 July 2019). \"S100 proteins: Diagnostic and prognostic biomarkers in laboratory medicine\" (in en). Biochimica et Biophysica Acta (BBA) - Molecular Cell Research 1866 (7): 1197\u20131206. doi:10.1016\/j.bbamcr.2018.10.015. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0167488918304786 .   \n \n\n\u2191 Wang, Hongchun; Zhang, Jian; Li, Xiaoli; Zhang, Cheng; Zheng, Shuli; Chi, Yihong; Sheng, Xia; Zhang, Yi (1 November 2020). \"The utilization pattern of serum tumor markers in lung cancer patients: A population\u2010based retrospective descriptive study\" (in en). Journal of Clinical Laboratory Analysis 34 (11). doi:10.1002\/jcla.23465. ISSN 0887-8013. PMC PMC7676212. PMID 32638440. https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/jcla.23465 .   \n \n\n\u2191 Milani, Paolo; Palladini, Giovanni; Merlini, Giampaolo (13 July 2016). \"Serum-free light-chain analysis in diagnosis and management of multiple myeloma and related conditions\" (in en). Scandinavian Journal of Clinical and Laboratory Investigation 76 (sup245): S113\u2013S118. doi:10.1080\/00365513.2016.1210337. ISSN 0036-5513. https:\/\/www.tandfonline.com\/doi\/full\/10.1080\/00365513.2016.1210337 .   \n \n\n\u2191 Shi, Min; Xiao, Ruobing; Woda, Bruce A.; Yu, Hongbo (1 March 2014). \"Five Important Advances in Hematopathology\" (in en). Archives of Pathology & Laboratory Medicine 138 (3): 410\u2013419. doi:10.5858\/ARPA.2012-0645-RA. ISSN 1543-2165. http:\/\/meridian.allenpress.com\/aplm\/article\/138\/3\/410\/132807\/Five-Important-Advances-in-Hematopathology .   \n \n\n\u2191 Jacob, Rachel; Khan, Mahmood (1 December 2018). \"Cardiac Biomarkers: What Is and What Can Be\" (in en). Indian Journal of Cardiovascular Disease in Women WINCARS 03 (04): 240\u2013244. doi:10.1055\/s-0039-1679104. ISSN 2455-7854. PMC PMC6957084. PMID 31934672. http:\/\/www.thieme-connect.de\/DOI\/DOI?10.1055\/s-0039-1679104 .   \n \n\n\u2191 Ferry, Olivia R.; Huang, Yao C.; Masel, Philip J.; Hamilton, Michael; Fong, Kwun M.; Bowman, Rayleen V.; McKenzie, Scott C.; Yang, Ian A. (1 October 2019). \"Diagnostic approach to chronic dyspnoea in adults\". Journal of Thoracic Disease 11 (S17): S2117\u2013S2128. doi:10.21037\/jtd.2019.10.53. PMC PMC6831921. PMID 31737340. http:\/\/jtd.amegroups.com\/article\/view\/32611\/22932 .   \n \n\n\u2191 Dagonnier, Marie; Donnan, Geoffrey A.; Davis, Stephen M.; Dewey, Helen M.; Howells, David W. (5 February 2021). \"Acute Stroke Biomarkers: Are We There Yet?\". Frontiers in Neurology 12: 619721. doi:10.3389\/fneur.2021.619721. ISSN 1664-2295. PMC PMC7902038. PMID 33633673. https:\/\/www.frontiersin.org\/articles\/10.3389\/fneur.2021.619721\/full .   \n \n\n\u2191 Wall, Emma C.; Chan, Jia Mun; Gil, Eliza; Heyderman, Robert S. (1 June 2021). \"Acute bacterial meningitis\" (in en). Current Opinion in Neurology 34 (3): 386\u2013395. doi:10.1097\/WCO.0000000000000934. ISSN 1350-7540. PMC PMC7610733. PMID 33767093. https:\/\/journals.lww.com\/10.1097\/WCO.0000000000000934 .   \n \n\n\u2191 Goldsmith, Joshua F.; Herskovits, A. Zara (1 September 2020). \"Cerebrospinal Fluid Testing for Multiple Sclerosis\" (in en). Clinics in Laboratory Medicine 40 (3): 369\u2013377. doi:10.1016\/j.cll.2020.06.002. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S027227122030041X .   \n \n\n\u2191 Schuurman, Alex R.; Reijnders, Tom D. Y.; Kullberg, Robert F. J.; Butler, Joe M.; van der Poll, Tom; Wiersinga, W. Joost (1 December 2021). \"Sepsis: deriving biological meaning and clinical applications from high-dimensional data\" (in en). Intensive Care Medicine Experimental 9 (1): 27. doi:10.1186\/s40635-021-00383-x. ISSN 2197-425X. PMC PMC8105470. PMID 33961170. https:\/\/icm-experimental.springeropen.com\/articles\/10.1186\/s40635-021-00383-x .   \n \n\n\u2191 Espinoza, Gianna; Maldonado, Genessis; Narvaez, Jemina; Guerrero, Roberto; Citera, Gustavo; Rios, Carlos (1 March 2021). \"Beyond Rheumatoid Arthritis Evaluation: What are We Missing?\" (in en). Open Access Rheumatology: Research and Reviews Volume 13: 45\u201355. doi:10.2147\/OARRR.S298393. ISSN 1179-156X. PMC PMC8007602. PMID 33790666. https:\/\/www.dovepress.com\/beyond-rheumatoid-arthritis-evaluation-what-are-we-missing-peer-reviewed-article-OARRR .   \n \n\n\u2191 Petrovsk\u00e1, Nora; Prajzlerov\u00e1, Kl\u00e1ra; Vencovsk\u00fd, Ji\u0159\u00ed; \u0160enolt, Ladislav; Filkov\u00e1, M\u00e1ria (1 May 2021). \"The pre-clinical phase of rheumatoid arthritis: From risk factors to prevention of arthritis\" (in en). Autoimmunity Reviews 20 (5): 102797. doi:10.1016\/j.autrev.2021.102797. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1568997221000616 .   \n \n\n\u2191 Betterle, C.; Presotto, F.; Furmaniak, J. (1 December 2019). \"Epidemiology, pathogenesis, and diagnosis of Addison\u2019s disease in adults\" (in en). Journal of Endocrinological Investigation 42 (12): 1407\u20131433. doi:10.1007\/s40618-019-01079-6. ISSN 1720-8386. https:\/\/link.springer.com\/10.1007\/s40618-019-01079-6 .   \n \n\n\u2191 Stavropoulos, Konstantinos; Imprialos, Konstantinos; Papademetriou, Vasilios; Faselis, Charles; Tsioufis, Kostas; Dimitriadis, Kyriakos; Doumas, Michael (2020). \"Primary Aldosteronism: Novel Insights\". Current Hypertension Reviews 16 (1): 19\u201323. doi:10.2174\/1573402115666190415155512. ISSN 1875-6506. PMID 30987572. https:\/\/pubmed.ncbi.nlm.nih.gov\/30987572 .   \n \n\n\u2191 Honegger, J\u00fcrgen; Buchfelder, Michael; Schlaffer, Sven; Droste, Michael; Werner, Sandy; Strasburger, Christian; St\u00f6rmann, Sylv\u00e8re; Schopohl, Jochen et al. (1 September 2015). \"Treatment of Primary Hypophysitis in Germany\" (in en). The Journal of Clinical Endocrinology & Metabolism 100 (9): 3460\u20133469. doi:10.1210\/jc.2015-2146. ISSN 0021-972X. https:\/\/academic.oup.com\/jcem\/article-lookup\/doi\/10.1210\/jc.2015-2146 .   \n \n\n\u2191 Serbis, Anastasios; Giapros, Vasileios; Kotanidou, Eleni P; Galli-Tsinopoulou, Assimina; Siomou, Ekaterini (15 April 2021). \"Diagnosis, treatment and prevention of type 2 diabetes mellitus in children and adolescents\". World Journal of Diabetes 12 (4): 344\u2013365. doi:10.4239\/wjd.v12.i4.344. ISSN 1948-9358. PMC PMC8040084. PMID 33889284. https:\/\/www.wjgnet.com\/1948-9358\/full\/v12\/i4\/344.htm .   \n \n\n\u2191 Supabphol, Suangson; Seubwai, Wunchana; Wongkham, Sopit; Saengboonmee, Charupong (1 September 2021). \"High glucose: an emerging association between diabetes mellitus and cancer progression\" (in en). Journal of Molecular Medicine 99 (9): 1175\u20131193. doi:10.1007\/s00109-021-02096-w. ISSN 0946-2716. https:\/\/link.springer.com\/10.1007\/s00109-021-02096-w .   \n \n\n\u2191 LeGrys, Vicky A.; Hartmann, Katherine; Walsh, Joan F. (2004). \"The clinical consequences and diagnosis of hypothyroidism\". Clinical Laboratory Science: Journal of the American Society for Medical Technology 17 (4): 203\u2013208. ISSN 0894-959X. PMID 15559725. https:\/\/pubmed.ncbi.nlm.nih.gov\/15559725 .   \n \n\n\u2191 Pignatelli, Duarte; Carvalho, Berta L.; Palmeiro, Aida; Barros, Alberto; Guerreiro, Susana G.; Macut, Djuro (4 July 2019). \"The Complexities in Genotyping of Congenital Adrenal Hyperplasia: 21-Hydroxylase Deficiency\". Frontiers in Endocrinology 10: 432. doi:10.3389\/fendo.2019.00432. ISSN 1664-2392. PMC PMC6620563. PMID 31333583. https:\/\/www.frontiersin.org\/article\/10.3389\/fendo.2019.00432\/full .   \n \n\n\u2191 Elster, A (1 April 2002). \"Physician roles in medicine-public health collaboration future directions of the American Medical Association\". American Journal of Preventive Medicine 22 (3): 211\u2013213. doi:10.1016\/S0749-3797(01)00422-6. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0749379701004226 .   \n \n\n\u2191 Emerson, Marc A.; Golightly, Yvonne M.; Aiello, Allison E.; Reeder\u2010Hayes, Katherine E.; Tan, Xianming; Maduekwe, Ugwuji; Johnson\u2010Thompson, Marian; Olshan, Andrew F. et al. (15 November 2020). \"Breast cancer treatment delays by socioeconomic and health care access latent classes in Black and White women\" (in en). Cancer 126 (22): 4957\u20134966. doi:10.1002\/cncr.33121. ISSN 0008-543X. PMC PMC7789230. PMID 32954493. https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/cncr.33121 .   \n \n\n\u2191 Schilling, B. (2011). \"The Federal Government Has Put Billions into Promoting Electronic Health Record Use: How Is It Going?\". The Commonwealth Fund. https:\/\/www.commonwealthfund.org\/publications\/newsletter-article\/federal-government-has-put-billions-promoting-electronic-health . Retrieved 26 August 2022 .   \n \n\n\u2191 57.0 57.1 Sherman, Rachel E.; Anderson, Steven A.; Dal Pan, Gerald J.; Gray, Gerry W.; Gross, Thomas; Hunter, Nina L.; LaVange, Lisa; Marinac-Dabic, Danica et al. (8 December 2016). \"Real-World Evidence \u2014 What Is It and What Can It Tell Us?\" (in en). New England Journal of Medicine 375 (23): 2293\u20132297. doi:10.1056\/NEJMsb1609216. ISSN 0028-4793. http:\/\/www.nejm.org\/doi\/10.1056\/NEJMsb1609216 .   \n \n\n\u2191 Bate, Emily; Hommes, Juliette; Duvivier, Robbert; Taylor, David C. M. (1 January 2014). \"Problem-based learning (PBL): Getting the most out of your students \u2013 Their roles and responsibilities: AMEE Guide No. 84\" (in en). Medical Teacher 36 (1): 1\u201312. doi:10.3109\/0142159X.2014.848269. ISSN 0142-159X. http:\/\/www.tandfonline.com\/doi\/full\/10.3109\/0142159X.2014.848269 .   \n \n\n\u2191 Porter, Michael E.; Lee, Thomas H. (1 January 2021). \"Integrated Practice Units: A Playbook for Health Care Leaders\" (in en). NEJM Catalyst 2 (1): CAT.20.0237. doi:10.1056\/CAT.20.0237. ISSN 2642-0007. http:\/\/catalyst.nejm.org\/doi\/10.1056\/CAT.20.0237 .   \n \n\n\u2191 Jha, Saurabh; Topol, Eric J. (13 December 2016). \"Adapting to Artificial Intelligence: Radiologists and Pathologists as Information Specialists\" (in en). JAMA 316 (22): 2353. doi:10.1001\/jama.2016.17438. ISSN 0098-7484. http:\/\/jama.jamanetwork.com\/article.aspx?doi=10.1001\/jama.2016.17438 .   \n \n\n\u2191 \"Department of Pathology, Center for Integrated Diagnostics\". Massachusetts General Hospital. https:\/\/www.massgeneral.org\/pathology\/services\/center-for-integrated-diagnostics . Retrieved 15 November 2021 .   \n \n\n\u2191 Eickholt, Lynne (1 January 2020). \"Why Many Integrated Delivery Systems Have Not Enhanced Consumer Value, and What\u2019s Next\" (in en). NEJM Catalyst 1 (1): CAT.19.1086. doi:10.1056\/CAT.19.1086. ISSN 2642-0007. http:\/\/catalyst.nejm.org\/doi\/10.1056\/CAT.19.1086 .   \n \n\n\u2191 Berwick, Donald M. (18 January 2005). \"My Right Knee\" (in en). Annals of Internal Medicine 142 (2): 121-5. doi:10.7326\/0003-4819-142-2-200501180-00011. ISSN 0003-4819. http:\/\/annals.org\/article.aspx?doi=10.7326\/0003-4819-142-2-200501180-00011 .   \n \n\n\n\n\n\n\nSource: <a rel=\"external_link\" class=\"external\" href=\"https:\/\/www.limswiki.org\/index.php\/Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\">https:\/\/www.limswiki.org\/index.php\/Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology<\/a>\nCategories: LIMSwiki journal articles (added in 2023)LIMSwiki journal articles (all)LIMSwiki journal articles on data management and sharingLIMSwiki journal articles on health informaticsLIMSwiki journal articles on imaging informaticsNavigation menuPage actionsJournalDiscussionView sourceHistoryPage actionsJournalDiscussionMoreToolsIn other languagesPersonal toolsLog inNavigationMain pageEncyclopedic articlesRecent changesRandom pageHelp about MediaWikiSearch\u00a0 ToolsWhat links hereRelated changesSpecial pagesPermanent linkPage informationPopular publications\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\nPrint\/exportCreate a bookDownload as PDFDownload as PDFDownload as Plain textPrintable version This page was last edited on 11 April 2023, at 19:05.Content is available under a Creative Commons Attribution-ShareAlike 4.0 International License unless otherwise noted.This page has been accessed 275 times.Privacy policyAbout LIMSWikiDisclaimers\n\n\n\n","c85ecad158b719016ec41928421b862e_html":"<body class=\"mediawiki ltr sitedir-ltr mw-hide-empty-elt ns-206 ns-subject page-Journal_Integrative_diagnostics_The_time_is_now\u2014a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology rootpage-Journal_Integrative_diagnostics_The_time_is_now\u2014a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology skin-monobook action-view skin--responsive\"><div id=\"rdp-ebb-globalWrapper\"><div id=\"rdp-ebb-column-content\"><div id=\"rdp-ebb-content\" class=\"mw-body\" role=\"main\"><a id=\"rdp-ebb-top\"><\/a>\n<h1 id=\"rdp-ebb-firstHeading\" class=\"firstHeading\" lang=\"en\">Journal:Integrative diagnostics: The time is now\u2014a report from the International Society for Strategic Studies in Radiology<\/h1><div id=\"rdp-ebb-bodyContent\" class=\"mw-body-content\"><!-- start content --><div id=\"rdp-ebb-mw-content-text\" lang=\"en\" dir=\"ltr\" class=\"mw-content-ltr\"><div class=\"mw-parser-output\">\n\n\n<h2><span class=\"mw-headline\" id=\"Abstract\">Abstract<\/span><\/h2>\n<p>Enormous recent progress in <a href=\"https:\/\/www.limswiki.org\/index.php\/Medical_test\" title=\"Medical test\" class=\"wiki-link\" data-key=\"0e5a509a721423b5cae83265bbb80c85\">diagnostic testing<\/a> can enable more accurate <a href=\"https:\/\/www.limswiki.org\/index.php\/Medical_diagnosis\" title=\"Medical diagnosis\" class=\"wiki-link\" data-key=\"6fd078bb38b5c9089d7271b4ba20fe7c\">diagnosis<\/a> and improved clinical outcomes. Yet these tests are increasingly challenging and frustrating; the volume and diversity of results may overwhelm the diagnostic acumen of even the most dedicated and experienced clinician. Because they are gathered and processed within the \u201csilo\u201d of each diagnostic discipline, diagnostic data are fragmented, and the <a href=\"https:\/\/www.limswiki.org\/index.php\/Electronic_health_record\" title=\"Electronic health record\" class=\"wiki-link\" data-key=\"f2e31a73217185bb01389404c1fd5255\">electronic health record<\/a> (EHR) does little to synthesize new and existing data into usable <a href=\"https:\/\/www.limswiki.org\/index.php\/Information\" title=\"Information\" class=\"wiki-link\" data-key=\"6300a14d9c2776dcca0999b5ed940e7d\">information<\/a>. Therefore, despite great promise, diagnoses may still be incorrect, delayed, or never made. Integrative diagnostics represents a vision for the future, wherein diagnostic data, together with clinical data from the EHR, are aggregated and contextualized by <a href=\"https:\/\/www.limswiki.org\/index.php\/Informatics_(academic_field)\" title=\"Informatics (academic field)\" class=\"wiki-link\" data-key=\"0391318826a5d9f9a1a1bcc88394739f\">informatics<\/a> tools to direct clinical action. Integrative diagnostics has the potential to identify correct therapies more quickly, modify treatment when appropriate, and terminate treatment when not effective, ultimately decreasing morbidity, improving outcomes, and avoiding unnecessary costs. Radiology, laboratory medicine, and <a href=\"https:\/\/www.limswiki.org\/index.php\/Pathology\" title=\"Pathology\" class=\"wiki-link\" data-key=\"5d8e2230b55d8760dcb729fc7dcd3dc1\">pathology<\/a> already play major roles in medical diagnostics. Our specialties can increase the value of our examinations by taking a holistic approach to their selection, interpretation, and application to the patient\u2019s care pathway. We have the means and rationale to incorporate integrative diagnostics into our specialties and guide its implementation in clinical practice.\n<\/p><p>The following overall points can be made about this research:\n<\/p>\n<ul><li>Despite being an overall boon to clinical diagnosis, increasingly voluminous, diverse, and fragmented diagnostic data can overwhelm physicians and frustrate patients.<\/li>\n<li>Data are gathered and processed within \u201csilos\u201d of the diagnostic disciplines, including radiology and pathology. The EHR does little to intelligently organize and synthesize these disparate data to facilitate diagnosis.<\/li>\n<li>Integrative diagnostics envisions a process in which data from the entire arsenal of <i>in vivo<\/i> and <i>in vitro<\/i> diagnostics, together with clinical data from the EHR, are aggregated and contextualized to enhance diagnosis and direct clinical action.<\/li><\/ul>\n<p><b>Keywords<\/b>: diagnostics, integrative diagnostics, radiology, pathology, informatics, clinical informatics\n<\/p><p><b>Graphic abstract<\/b>:<a href=\"https:\/\/www.limswiki.org\/index.php\/File:GA_Beauchamp_InsightsImaging2022_14.png\" class=\"image wiki-link\" data-key=\"cdcc0ee9e478fa11cbffef14d1671811\"><img alt=\"GA Beauchamp InsightsImaging2022 14.png\" src=\"https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/8\/83\/GA_Beauchamp_InsightsImaging2022_14.png\" decoding=\"async\" style=\"width: 100%;max-width: 400px;height: auto;\" \/><\/a>\n<\/p>\n<div style=\"clear:both;\"><\/div>\n<h2><span class=\"mw-headline\" id=\"Background\">Background<\/span><\/h2>\n<p>Despite <a href=\"https:\/\/www.limswiki.org\/index.php\/Digital_radiography\" title=\"Digital radiography\" class=\"wiki-link\" data-key=\"25a157f0f3cc6a25883121991b4c0df1\">digital imaging<\/a>, widespread adoption of <a href=\"https:\/\/www.limswiki.org\/index.php\/Electronic_health_record\" title=\"Electronic health record\" class=\"wiki-link\" data-key=\"f2e31a73217185bb01389404c1fd5255\">electronic health records<\/a> (EHRs), and advances in precision medicine tools, <a href=\"https:\/\/www.limswiki.org\/index.php\/Medical_diagnosis\" title=\"Medical diagnosis\" class=\"wiki-link\" data-key=\"6fd078bb38b5c9089d7271b4ba20fe7c\">diagnosis<\/a> often remains a fragmented and frustrating process for clinicians and patients. Data are still gathered and presented asynchronously, and EHRs do little to organize and synthesize <a href=\"https:\/\/www.limswiki.org\/index.php\/Information\" title=\"Information\" class=\"wiki-link\" data-key=\"6300a14d9c2776dcca0999b5ed940e7d\">information<\/a>. Although team practice, such as tumor boards, is increasing, routine physician interaction is limited by clinical <a href=\"https:\/\/www.limswiki.org\/index.php\/Workflow\" title=\"Workflow\" class=\"wiki-link\" data-key=\"92bd8748272e20d891008dcb8243e8a8\">workflow<\/a>, high volumes, and information technology (IT) boundaries. Despite an abundance of relevant diagnostic data, diagnoses may be incorrect, delayed, or never made. Allegations of diagnostic errors account for 28% of malpractice cases in the United States.<sup id=\"rdp-ebb-cite_ref-1\" class=\"reference\"><a href=\"#cite_note-1\">[1]<\/a><\/sup> Experts estimate a diagnostic error rate of 10% to 15%, with 40,000\u201380,000 preventable deaths each year.<sup id=\"rdp-ebb-cite_ref-2\" class=\"reference\"><a href=\"#cite_note-2\">[2]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-3\" class=\"reference\"><a href=\"#cite_note-3\">[3]<\/a><\/sup> As physicians and diagnosticians, it is our responsibility to minimize these errors. Integrative diagnostics (ID) has been proposed as one means to reduce diagnostic errors.\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Method\">Method<\/span><\/h2>\n<p>This paper is designed to address ID from the perspectives of radiology and our sister diagnostic specialty, <a href=\"https:\/\/www.limswiki.org\/index.php\/Pathology\" title=\"Pathology\" class=\"wiki-link\" data-key=\"5d8e2230b55d8760dcb729fc7dcd3dc1\">pathology<\/a>. The paper was developed in response to a request for proposal from the International Society of Strategic Studies in Radiology (IS3R) to its members for an annual white paper to foster its mission \u201cto actively shape the future of <a href=\"https:\/\/www.limswiki.org\/index.php\/Medical_imaging\" title=\"Medical imaging\" class=\"wiki-link\" data-key=\"dddd7e2b5706415d7af0375386e6eafa\">medical imaging<\/a> and image-guided therapies by leveraging the knowledge and influence of world leaders in these disciplines and related industries.\u201d Proposals from self-organized writing groups were reviewed by the IS3R Publications Committee, with the final selection approved for drafting by the IS3R Executive Committee. Our writing group was designed to include departmental and institutional leaders in radiology and pathology who have interest and experience in ID. After preliminary approval by the Publications Committee, the draft paper was posted to the entire IS3R membership for comments, which were incorporated into this final document. This paper was approved for internal dissemination and publication by the IS3R Executive Committee.\n<\/p>\n<h3><span id=\"rdp-ebb-What_is_ID?\"><\/span><span class=\"mw-headline\" id=\"What_is_ID.3F\">What is ID?<\/span><\/h3>\n<p>More than seven billion diagnostic examinations are performed each year in the United States, influencing 70% of health care decisions.<sup id=\"rdp-ebb-cite_ref-4\" class=\"reference\"><a href=\"#cite_note-4\">[4]<\/a><\/sup> Although <a href=\"https:\/\/www.limswiki.org\/index.php\/Medical_test\" title=\"Medical test\" class=\"wiki-link\" data-key=\"0e5a509a721423b5cae83265bbb80c85\">diagnostic tests<\/a> differ in personnel, infrastructure, and technology, they have a shared commonality: providing data for clinical diagnosis.<sup id=\"rdp-ebb-cite_ref-5\" class=\"reference\"><a href=\"#cite_note-5\">[5]<\/a><\/sup> ID has been proposed to better manage, organize, and present diagnostic data and bridge intellectual silos. ID represents a convergence of imaging, pathology, and clinical laboratory medicine, plus advanced levels of IT.<sup id=\"rdp-ebb-cite_ref-6\" class=\"reference\"><a href=\"#cite_note-6\">[6]<\/a><\/sup> In this framework, integrated (versus isolated) practices plus <a href=\"https:\/\/www.limswiki.org\/index.php\/Clinical_decision_support_system\" title=\"Clinical decision support system\" class=\"wiki-link\" data-key=\"095141425468d057aa977016869ca37d\">clinical decision support (CDS) tools<\/a> drive appropriate care. Data from the entire diagnostic arsenal are aggregated to enhance insights, and EHRs present information in a consumable way to facilitate collaborative decision making and accurate clinical diagnosis. ID uses <a href=\"https:\/\/www.limswiki.org\/index.php\/Medical_informatics\" class=\"mw-redirect wiki-link\" title=\"Medical informatics\" data-key=\"f89ecb3b26617b8c6e09bc5e050cfd5d\">medical informatics<\/a> (in which data are data, regardless of their nature or source) to organize and analyze vast, disparate diagnostic data sets to achieve timely and accurate diagnosis, precise therapeutics, accurate assessment of prognosis, and maintenance of population health.<sup id=\"rdp-ebb-cite_ref-:0_7-0\" class=\"reference\"><a href=\"#cite_note-:0-7\">[7]<\/a><\/sup>\n<\/p><p>Radiology, <a href=\"https:\/\/www.limswiki.org\/index.php\/Clinical_laboratory\" title=\"Clinical laboratory\" class=\"wiki-link\" data-key=\"307bcdf1bdbcd1bb167cee435b7a5463\">clinical laboratories<\/a>, and pathology departments, which perform the preponderance of diagnostic tests, currently play a central role in medical diagnostics. However, our disciplines have not worked as an integrated unit. Rather, we are islands of vast data and extraordinary intradisciplinary expertise separated from one another and from our clinical colleagues by <a href=\"https:\/\/www.limswiki.org\/index.php\/Informatics_(academic_field)\" title=\"Informatics (academic field)\" class=\"wiki-link\" data-key=\"0391318826a5d9f9a1a1bcc88394739f\">informatics<\/a>, physical, and specialty barriers. We have not integrated our data or communicated them in a coordinated fashion to our clinical colleagues, instead expecting clinicians to integrate and interpret these data themselves. Although of immense potential value, our petabytes of data are increasingly overwhelming providers and systems as we \u201cthrow our work over the fence\u201d and hope that someone figures out what it all means (Fig. 1A). It is no longer possible for individual health care providers to perform this complex task. ID offers a helping hand.\n<\/p><p><br \/>\n<a href=\"https:\/\/www.limswiki.org\/index.php\/File:FIG1_Beauchamp_InsightsImaging2022_14.png\" class=\"image wiki-link\" data-key=\"81178e770ebcd9d730fe95f99b6bdd39\"><img alt=\"FIG1 Beauchamp InsightsImaging2022 14.png\" src=\"https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/6\/6e\/FIG1_Beauchamp_InsightsImaging2022_14.png\" decoding=\"async\" style=\"width: 100%;max-width: 400px;height: auto;\" \/><\/a>\n<\/p>\n<div style=\"clear:both;\"><\/div>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table border=\"0\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><blockquote><p><b>Figure 1.<\/b> Diagram describing (A') segregated diagnostics versus (B) integrative diagnostics.<\/p><\/blockquote>\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<p>In ID, radiologists, pathologists, and other diagnosticians work as teams with shared access to continuously updated patient data, from which experts and CDS tools extract relevant clinical information and formulate dynamic differential diagnosis and management pathways (Fig. 1B). Given our in-depth knowledge of our test data, understanding of the pathobiochemical and physiological basis of our diagnostic findings, technological skills, and strong informatics resources and expertise, the practices of radiology and pathology should strive for leadership roles in the ID environment.\n<\/p><p>Predictive analytic tools based on aggregated clinical data can streamline care pathways so that appropriate diagnostic tests (including those performed by radiology, laboratory medicine, and pathology) are expedited on the basis of reason for referral, even in advance of a patient\u2019s visit with a provider. This requires real-time data entry from all sources, continual analytics, and timely interactive communication among <a href=\"https:\/\/www.limswiki.org\/index.php\/Laboratory\" title=\"Laboratory\" class=\"wiki-link\" data-key=\"c57fc5aac9e4abf31dccae81df664c33\">laboratories<\/a>, providers, and patients. Triaging patients in this manner could streamline and more appropriately prioritize health care access. For example, by identifying patients who need to be seen sooner, a decrease in wait times for specialists would provide reassurance to patients earlier in their care journey and prevent them from turning to high-cost settings such as the emergency department for care. ID could direct patients to the correct therapy sooner, modify treatment when appropriate, and terminate it when not effective, ultimately decreasing morbidity, improving outcomes, and avoiding unnecessary cost. Earlier access and more appropriate care are increasingly rewarded in value-based care payment arrangements. Additionally, ID could assess information that affects both individual patient well-being and population health, including identification of emerging infections, antibiotic resistance, exposure to toxic substances, and chemical or biologic threats.\n<\/p><p>Despite a clear need and sound theoretical reasons for expanding the role of radiologists and pathologists in ID, real-world efforts remain meager. Our purpose is to stimulate more ID activity in our specialties by presenting the rationale for such efforts, highlighting successful ID programs that might be emulated at other sites, and recommending specific endeavors that are feasible now and should be prioritized in our departments and institutions.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"The_ID_process\">The ID process<\/span><\/h3>\n<p>As outlined by the Institute of Medicine Committee on Diagnostic Error in Health Care, the diagnostic examination process is divided into three phases: pre-analytic, analytic, and post-analytic.<sup id=\"rdp-ebb-cite_ref-:0_7-1\" class=\"reference\"><a href=\"#cite_note-:0-7\">[7]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-8\" class=\"reference\"><a href=\"#cite_note-8\">[8]<\/a><\/sup> (Fig. 2)\n<\/p><p><br \/>\n<a href=\"https:\/\/www.limswiki.org\/index.php\/File:Fig2_Beauchamp_InsightsImaging2022_14.png\" class=\"image wiki-link\" data-key=\"d756286d27e4ca04565a2a6ca4042008\"><img alt=\"Fig2 Beauchamp InsightsImaging2022 14.png\" src=\"https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/7\/72\/Fig2_Beauchamp_InsightsImaging2022_14.png\" decoding=\"async\" style=\"width: 100%;max-width: 400px;height: auto;\" \/><\/a>\n<\/p>\n<div style=\"clear:both;\"><\/div>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table border=\"0\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><blockquote><p><b>Figure 2.<\/b> Integrative diagnostic workflow phases. CDS\u2009= clinical decision support; SPOC\u2009= single point of contact.<\/p><\/blockquote>\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<p>The analytic phase is the least susceptible to errors because of attention to technical performance and procedural standards, rigorous internal management and external quality assessment, and precise quantitative measurements. In contrast, our relative inattention to the pre- and post-analytic phases now warrants modification. In laboratory medicine, the analytic phase accounts for approximately 25% of total effort and <a href=\"https:\/\/www.limswiki.org\/index.php\/Workflow\" title=\"Workflow\" class=\"wiki-link\" data-key=\"92bd8748272e20d891008dcb8243e8a8\">workflow<\/a>, the pre-analytic phase for 57%, and the post-analytic phase for 17%.<sup id=\"rdp-ebb-cite_ref-9\" class=\"reference\"><a href=\"#cite_note-9\">[9]<\/a><\/sup> A disease process that requires inputs from multiple diagnostic disciplines is typically interrogated in a stepwise and discontinuous way. Although this is sometimes unavoidable (including subsequent testing whose utility only becomes apparent on the basis of preceding tests), the fragmented, sequential nature of the diagnostic process can cause treatment delays with negative impacts on outcomes.<sup id=\"rdp-ebb-cite_ref-10\" class=\"reference\"><a href=\"#cite_note-10\">[10]<\/a><\/sup> ID can accelerate medical diagnosis, transforming this discontinuous, slow, and fragmented approach into a highly coordinated process with faster information flow through these test phases.\n<\/p><p>In the pre-examination phase, the referring provider is responsible for performing and\/or requesting the most appropriate examinations. In an estimated 10 to 15% of cases, the referring provider needs, and would value, assistance with these decisions. Inappropriate laboratory testing involves both under- and overutilization and occurs in 20 to 30% of cases.<sup id=\"rdp-ebb-cite_ref-11\" class=\"reference\"><a href=\"#cite_note-11\">[11]<\/a><\/sup> Extra support may be needed for primary care providers, who see a wide variety of patients and diseases.<sup id=\"rdp-ebb-cite_ref-12\" class=\"reference\"><a href=\"#cite_note-12\">[12]<\/a><\/sup> Modern health care informatics can help providers request the most appropriate examinations by integrating CDS tools into clinical workflow.<sup id=\"rdp-ebb-cite_ref-13\" class=\"reference\"><a href=\"#cite_note-13\">[13]<\/a><\/sup> For example, use of a real-time radiology appropriateness CDS application decreased inappropriate utilization of brain and spine MRI and sinus CT<sup id=\"rdp-ebb-cite_ref-14\" class=\"reference\"><a href=\"#cite_note-14\">[14]<\/a><\/sup>, and computer-generated reminders to clinicians in Kenya improved CD4 laboratory monitoring of patients with HIV infection.<sup id=\"rdp-ebb-cite_ref-15\" class=\"reference\"><a href=\"#cite_note-15\">[15]<\/a><\/sup> CDS tools should be available on platforms that integrate seamlessly into providers\u2019 workflow without adding unnecessary steps, and the appropriate use criteria underpinning these tools must be evidence-based. Feedback to providers must be supportive and advance learning, rather than being punitive. Additionally, CDS systems should be adapted to local circumstances, including local patient demographics and resources (such as the availability of diagnostic test equipment and the competencies of diagnosticians). CDS systems must also be capable of incorporating all relevant patient data. Moreover, CDS should be \u201cintegrated,\u201d reflecting not only the appropriateness of a single diagnostic discipline but also the benefit of combinations of tests across disciplines.\n<\/p><p><br \/>\nAlthough referring physicians are responsible for maximizing the likelihood that patients will get needed examinations, approximately 20% of requested examinations in the United States are never performed.<sup id=\"rdp-ebb-cite_ref-16\" class=\"reference\"><a href=\"#cite_note-16\">[16]<\/a><\/sup> Well-designed health care systems using contemporary, web-connected logistic support tools can improve this by coordinating examination times across disciplines at sites that match patients\u2019 circumstances and preferences to local health care resources. <a href=\"https:\/\/www.limswiki.org\/index.php\/Point-of-care_testing\" title=\"Point-of-care testing\" class=\"wiki-link\" data-key=\"8aa9628a821f86a2090854afbf38248b\">Point-of-care (POC) testing<\/a> and service increases patient test completion, satisfaction, and clinical outcomes, although it presents efficiency and <a href=\"https:\/\/www.limswiki.org\/index.php\/Quality_control\" title=\"Quality control\" class=\"wiki-link\" data-key=\"1e0e0c2eb3e45aff02f5d61799821f0f\">quality control<\/a> (QC) challenges. POC laboratory testing has improved clinical outcomes in influenza and pneumonia, HIV infection, heart attack, and strep throat.<sup id=\"rdp-ebb-cite_ref-17\" class=\"reference\"><a href=\"#cite_note-17\">[17]<\/a><\/sup> In Berlin, the use of mobile stroke units with CT scans and POC laboratory tests resulted in decreased time to treatment and lower global disability at three-month follow-up.<sup id=\"rdp-ebb-cite_ref-18\" class=\"reference\"><a href=\"#cite_note-18\">[18]<\/a><\/sup>\n<\/p><p>The analytic phase of the diagnostic process centers on the performance of each specific examination, which are currently relatively independent events. Most <a href=\"https:\/\/www.limswiki.org\/index.php\/Picture_archiving_and_communication_system\" title=\"Picture archiving and communication system\" class=\"wiki-link\" data-key=\"523b73ff51fa83663dc0b1d59e6d0f05\">picture archiving and communication systems<\/a> (PACS) and <a href=\"https:\/\/www.limswiki.org\/index.php\/Radiology_information_system\" title=\"Radiology information system\" class=\"wiki-link\" data-key=\"62d0a667f8b27309ea38a46507cfb500\">radiology information systems<\/a> (RIS) are separate from <a href=\"https:\/\/www.limswiki.org\/index.php\/Laboratory_information_system\" title=\"Laboratory information system\" class=\"wiki-link\" data-key=\"37add65b4d1c678b382a7d4817a9cf64\">laboratory information systems<\/a> (LIS), resulting in each pathologist and radiologist interpreting their own studies without easy access to the others\u2019 results. Bridging this disconnect should be a radiology and pathology IT priority. Diagnostic accuracy and management recommendations are improved when examinations are tailored and interpreted using knowledge from previous tests. Modern informatics, through optimizing the EHR, should make the complete medical record available to every examiner at the time of an examination, along with appropriate management guidelines. Each study\u2019s unique information should be intelligently and intuitively encapsulated in each sequential result. For example, POC CDS for management of incidental lung nodules improved adherence to nationally recommended guidelines for follow-up.<sup id=\"rdp-ebb-cite_ref-19\" class=\"reference\"><a href=\"#cite_note-19\">[19]<\/a><\/sup>\n<\/p><p>The post-analytic phase of diagnostics initially focuses on the application of test results to the individual patient\u2019s diagnosis and care plan. The aggregation and diagnostic inferences from all of a patient\u2019s examinations leads to the most accurate and specific diagnosis. Examination results should be promptly and intuitively incorporated into the EHR and made easily available to health care providers and the patient. Until the past decade, these medical data were analyzed by a single or small number of providers, primarily using heuristics. Although an invaluable human thought process, heuristics takes shortcuts in reasoning, may not use all available data, and has well-known sources of error, including cognitive, selective, and availability biases.<sup id=\"rdp-ebb-cite_ref-20\" class=\"reference\"><a href=\"#cite_note-20\">[20]<\/a><\/sup> Furthermore, heuristics suffers reduced accuracy and efficiency with increasing volumes and diversity of data types and greater task complexity.\n<\/p><p>Deficiencies in current practice and EHRs extend from the most basic error\u2014missing data\u2014to data overload, as with radiopathogenomics. For example, in a Veterans Affairs setting, 30% of providers reported encountering at least one patient with a missed test result over the previous two weeks that caused a delay in diagnosis or treatment.<sup id=\"rdp-ebb-cite_ref-21\" class=\"reference\"><a href=\"#cite_note-21\">[21]<\/a><\/sup> Tumor boards, with their extensive clinical, imaging, laboratory, and <a href=\"https:\/\/www.limswiki.org\/index.php\/Anatomical_pathology\" title=\"Anatomical pathology\" class=\"wiki-link\" data-key=\"5668db6faf37e8c1432a1d7953f30cb7\">anatomic pathology<\/a> content, may represent the epitome of data overload. No single human can master all the information of even one patient in any reasonable period of time, which was the topic of an RSNA\/American Association of Physicists in Medicine symposium on ID in 2019.<sup id=\"rdp-ebb-cite_ref-22\" class=\"reference\"><a href=\"#cite_note-22\">[22]<\/a><\/sup> The current explosion of remote health monitoring tools and diagnostic tests with exponentially larger data units can easily overwhelm a single astute physician. It is estimated that every patient generates 80 MB of data each year, and the volume of health care data is predicted to increase faster than any other business sector.<sup id=\"rdp-ebb-cite_ref-23\" class=\"reference\"><a href=\"#cite_note-23\">[23]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-24\" class=\"reference\"><a href=\"#cite_note-24\">[24]<\/a><\/sup> ID can bring more human and computational resources to bear on these essentially raw data to yield useful information to diagnose and treat individual patient problems as well as address population disease and health management.<sup id=\"rdp-ebb-cite_ref-25\" class=\"reference\"><a href=\"#cite_note-25\">[25]<\/a><\/sup>\n<\/p><p>An intelligent informatics infrastructure leveraging all these individual and population data can greatly augment the traditional human analysis. Integrated structured reports with discrete data are critical for data aggregation, which, in conjunction with outcome data, allows the development and optimization of front-end CDS systems. CDS tools, incorporating <a href=\"https:\/\/www.limswiki.org\/index.php\/Artificial_intelligence\" title=\"Artificial intelligence\" class=\"wiki-link\" data-key=\"0c45a597361ca47e1cd8112af676276e\">artificial intelligence<\/a> (AI) and <a href=\"https:\/\/www.limswiki.org\/index.php\/Machine_learning\" title=\"Machine learning\" class=\"wiki-link\" data-key=\"79aab39cfa124c958cd1dbcab3dde122\">machine learning<\/a> (ML) methodology, can provide referring providers with real-time probabilistic differential diagnoses for individual patients and enable the development of management paradigms for specific diseases and large populations.<sup id=\"rdp-ebb-cite_ref-26\" class=\"reference\"><a href=\"#cite_note-26\">[26]<\/a><\/sup> Unfortunately, many CDS systems are monodisciplinary, prematurely obsolete, and incompatible with efficient clinical workflow. Modern health care informatics must develop fully integrated CDS tools that are multidisciplinary, continuously updated, and adapted to the local situation. These new management paradigms can close the loop from the post-analytic back to the pre-analytic phase by suggesting the most appropriate examinations for the referring physician\u2019s next patient with a similar problem set. Furthermore, this information can help health care systems identify their most burdensome and needy patients for proactive health care management.\n<\/p><p>In the United States, the 21st Century Cures Act emphasizes the patient\u2019s role in the post-analytic phase. The program rule on interoperability, information blocking, and Office of National Health Coordinator (ONHC) health IT certification, which implements this act, requires that health care providers give patients access without charge to all the health information in their EHR \u201cwithout delay.\u201d<sup id=\"rdp-ebb-cite_ref-27\" class=\"reference\"><a href=\"#cite_note-27\">[27]<\/a><\/sup> This legislative directive, predicated on evidence that optimal diagnosis and treatment are enhanced by the convenient availability of patients\u2019 medical records to their physicians, will further drive the aggregation of medical information, regardless of initial source or current repository. This initiative should better enable all physicians involved in a patient\u2019s care to have immediate access to all of that patient\u2019s health care information. Although providing invaluable information to providers, including radiologists and pathologists, the technical and legal demands of this act on provider practices, health systems, and IT vendors will be significant. The requirement that all components of the EHR be promptly provided to the patient, including all laboratory, anatomic pathology, and radiology reports, presents a communication challenge and an opportunity for ID. We will have to modify our reports for patients\u2019 consumption through health care portals, offering the opportunity to integrate and summarize test results for patients and referring physicians.\n<\/p>\n<h3><span id=\"rdp-ebb-ID_in_tandem_with_radiology_and_pathology:_\u201cIn_vivo\u201d_meets_\u201cIn_vitro\u201d\"><\/span><span class=\"mw-headline\" id=\"ID_in_tandem_with_radiology_and_pathology:_.E2.80.9CIn_vivo.E2.80.9D_meets_.E2.80.9CIn_vitro.E2.80.9D\">ID in tandem with radiology and pathology: \u201c<i>In vivo<\/i>\u201d meets \u201c<i>In vitro<\/i>\u201d<\/span><\/h3>\n<p>In 2020, the European Society of Radiology and the European Federation of Laboratory Medicine signed a memorandum of understanding confirming international support of ID between both disciplines.<sup id=\"rdp-ebb-cite_ref-28\" class=\"reference\"><a href=\"#cite_note-28\">[28]<\/a><\/sup> Underlying this alliance is the favorable complementarity of diagnostic scope and data generated by the two fields. Modern imaging technologies provide high-resolution morphologic information but limited information on tissue metabolism and potential function and no systems information. In contrast, clinical laboratory medicine measures thousands of biochemical and molecular markers with moderate to high tissue specificity in various bodily fluids, but it rarely gives the pinpoint morphologic information that radiology can provide. For example, molecular biomarkers can sensitively indicate the presence of minute brain lesions, but these markers cannot localize a defect within the organ, assess the size of a lesion, or even count the number of lesions, functions that are easily provided by high-resolution <i>in vivo<\/i> imaging.<sup id=\"rdp-ebb-cite_ref-29\" class=\"reference\"><a href=\"#cite_note-29\">[29]<\/a><\/sup>\n<\/p><p>Table 1 demonstrates the clinical potential of ID between imaging and laboratory medicine. Each diagnosis or medical condition requires the results of a specific set of clinical, laboratory, radiology, and pathology tests to achieve a precise diagnosis. To make efficient use of our siloed data for ID, we must define interdisciplinary biomarker sets for specific clinical indications. Currently, physicians order examinations or tests from different disciplines and integrate the data themselves. With ID, clinical questions can be addressed by <i>in vivo<\/i> and <i>in vitro<\/i> diagnostic medicine, with different disciplines integrating their respective data and reporting interpreted results to other providers and patients in a combined report. Now is the time for radiologists and pathologists to venture beyond our disciplines and engage the broader diagnostic challenges confronted by ID. In the \u201cRecommendations\u201d section, we provide concrete advice on integration of ID into current practices.\n<\/p>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table class=\"wikitable\" border=\"1\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td colspan=\"6\" style=\"background-color:white; padding-left:10px; padding-right:10px;\"><b>Table 1.<\/b> Examples of integrative diagnostics. ADH = antidiuretic hormone; BNP = B-type natriuretic peptide; CA = 15\u20133 cancer antigen; CA = 19\u20139 carbohydrate antigen; CEA = carcinoembryonic antigen; CKD = chronic kidney disease; CRH = corticotropin-releasing hormone; CRP = C-reactive protein; CSF = cerebrospinal fluid; CYFRA 21\u20131 = cytokeratin fragment; DRE = digital rectal examination; Dx = diagnosis; ECG = electrocardiography; ER = estrogen receptor; FT3 = free T3; FT4 = free T4; GADD45 = growth arrest and DNA damage; GFAP = glial fibrillary acidic protein; GFR = glomerular filtration rate; GGT = gamma-glutamyl transferase; HbA<sub>1c<\/sub> = glycated hemoglobin; HER2neu = human epidermal growth factor receptor 2; HR = heart rate; IA-2 = islet antigen; IEF = isoelectric focusing; Ig = immunoglobulin; IL = interleukin; MEN = multiple endocrine neoplasm; MSI = multisatellite instability; NSE = neuron-specific enolase; NT-proBNP = N-terminal pro\u2013B-type natriuretic peptide; OHase = hydroxyvitamin hydroxylase; PCT = procalcitonin; PR = progesterone receptor; PSA = prostate-specific antigen; Ret = rearranged during transfection; SCC = squamous cell carcinoma; Tg = thyroglobulin; TnI = troponin I; TnT = troponin T; TPO = thyroid peroxidase; TRAK = thyrotropin receptor antibodies; TSH = thyroid-stimulating hormone; VHL = Von Hippel Lindau.\n<\/td><\/tr>\n<tr>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Disease\n<\/th>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Clinical findings\n<\/th>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\"><i>In vivo<\/i> Dx (Imaging)\n<\/th>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\"><i>In vitro<\/i> Dx (Laboratory medicine)\n<\/th>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\"><i>In vitro<\/i> Dx (Pathology)\n<\/th>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">References\n<\/th><\/tr>\n<tr>\n<td colspan=\"6\" style=\"background-color:white; padding-left:10px; padding-right:10px;\"><i>Cancer<\/i>\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Prostate\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">DRE, osseous lesion\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Transrectal ultrasound, MRI, PET\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">PSA, acid phosphatase\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><sup id=\"rdp-ebb-cite_ref-30\" class=\"reference\"><a href=\"#cite_note-30\">[30]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-31\" class=\"reference\"><a href=\"#cite_note-31\">[31]<\/a><\/sup>\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Colorectal\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Occult blood, ileus\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">CT, MRI, PET\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">CEA, CA 19\u20139, blood count\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Histopathology, MSI assessment\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><sup id=\"rdp-ebb-cite_ref-32\" class=\"reference\"><a href=\"#cite_note-32\">[32]<\/a><\/sup>\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Pancreatic\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Jaundice\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">MRI\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">CA 19\u20139, bilirubin, GGT\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Histopathology\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><sup id=\"rdp-ebb-cite_ref-33\" class=\"reference\"><a href=\"#cite_note-33\">[33]<\/a><\/sup>\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Breast\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Clinical examination\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">CT\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">CA 15\u20133\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Histopathology, ER and PR status, HER2neu\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><sup id=\"rdp-ebb-cite_ref-34\" class=\"reference\"><a href=\"#cite_note-34\">[34]<\/a><\/sup>\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Brain\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Neurologic deficit\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">CT, MRI\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">S100\u03b2\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><sup id=\"rdp-ebb-cite_ref-35\" class=\"reference\"><a href=\"#cite_note-35\">[35]<\/a><\/sup>\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Lung\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">CEA, SCC, NSE, CYFRA 21\u20131\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><sup id=\"rdp-ebb-cite_ref-36\" class=\"reference\"><a href=\"#cite_note-36\">[36]<\/a><\/sup>\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Plasmocytoma\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Spontaneous fractures\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Whole-body MRI\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Blood count, serum electrophoresis, IEF\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><sup id=\"rdp-ebb-cite_ref-37\" class=\"reference\"><a href=\"#cite_note-37\">[37]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-38\" class=\"reference\"><a href=\"#cite_note-38\">[38]<\/a><\/sup>\n<\/td><\/tr>\n<tr>\n<td colspan=\"6\" style=\"background-color:white; padding-left:10px; padding-right:10px;\"><i>Cardiovascular<\/i>\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Chest pain\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Triple-rule-out ECG-gated CT\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">TnI\/TnT, NT-proBNP, BNP, D-dimer\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><sup id=\"rdp-ebb-cite_ref-39\" class=\"reference\"><a href=\"#cite_note-39\">[39]<\/a><\/sup>\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Dyspnea\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Thorax\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">NT-proBNP, BNP, differential blood count, creatinine, GFR, CRP, PCT\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><sup id=\"rdp-ebb-cite_ref-40\" class=\"reference\"><a href=\"#cite_note-40\">[40]<\/a><\/sup>\n<\/td><\/tr>\n<tr>\n<td colspan=\"6\" style=\"background-color:white; padding-left:10px; padding-right:10px;\"><i>Neurological<\/i>\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Stroke\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Hemiparesis\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">CT angiography, MRI\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">GFAP, S100\u03b2\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><sup id=\"rdp-ebb-cite_ref-41\" class=\"reference\"><a href=\"#cite_note-41\">[41]<\/a><\/sup>\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Meningitis\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Neurologic deficit, meningitis sign (eg, Kernig sign)\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">CSF cell count, albumin, IgG, IgA, IgM, glucose, lactate, bacteria, CRP, PCT, sepsis parameter, bacterial culture\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><sup id=\"rdp-ebb-cite_ref-42\" class=\"reference\"><a href=\"#cite_note-42\">[42]<\/a><\/sup>\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Multiple sclerosis\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Specific neurologic deficit\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">CSF cell count, albumin, IgG, IgA, IgM, glucose, CRP, oligoclonal bands\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><sup id=\"rdp-ebb-cite_ref-43\" class=\"reference\"><a href=\"#cite_note-43\">[43]<\/a><\/sup>\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Encephalitis\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\n<\/td><\/tr>\n<tr>\n<td colspan=\"6\" style=\"background-color:white; padding-left:10px; padding-right:10px;\"><i>Inflammation<\/i>\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Sepsis\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Focus search\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">CRP, PCT, cytokine profiles IL-6, IL-8, differential blood count, blood culture\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><sup id=\"rdp-ebb-cite_ref-44\" class=\"reference\"><a href=\"#cite_note-44\">[44]<\/a><\/sup>\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Rheumatoid arthritis\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Bone imaging\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">CRP, sedimentation rate\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><sup id=\"rdp-ebb-cite_ref-45\" class=\"reference\"><a href=\"#cite_note-45\">[45]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-46\" class=\"reference\"><a href=\"#cite_note-46\">[46]<\/a><\/sup>\n<\/td><\/tr>\n<tr>\n<td colspan=\"6\" style=\"background-color:white; padding-left:10px; padding-right:10px;\"><i>Endocrinology<\/i>\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Addison or Conn syndrome\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Hypertension\/hypotension, cardiovascular symptoms, stress\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">MRI, selective adrenal venous sampling\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Adrenal hormones, orthostasis test, salt exposure test\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><sup id=\"rdp-ebb-cite_ref-47\" class=\"reference\"><a href=\"#cite_note-47\">[47]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-48\" class=\"reference\"><a href=\"#cite_note-48\">[48]<\/a><\/sup>\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Hypophysitis\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Headache, altered vision, diabetes insipidus, signs of adrenal insufficiency\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">CT, MRI\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Adrenal hormones, TSH, CRH, CRP, drugs and therapeutic medications\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><sup id=\"rdp-ebb-cite_ref-49\" class=\"reference\"><a href=\"#cite_note-49\">[49]<\/a><\/sup>\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Multiple endocrine neoplasia syndromes\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Mutation status: MEN, Ret, VHL1\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Diabetes\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Polyuria, polydipsia, fatigue, weight change, CKD, retinopathy\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Glucose, HbA<sub>1c<\/sub>, C-peptide, urine-Stix, blood gases and blood pH, lactate, ADH, copeptin, GADD45 antibodies, islet cell antibodies, IA-2 antibodies, insulin\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><sup id=\"rdp-ebb-cite_ref-50\" class=\"reference\"><a href=\"#cite_note-50\">[50]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-51\" class=\"reference\"><a href=\"#cite_note-51\">[51]<\/a><\/sup>\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Hypothyroidism\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Fatigue, weight gain, low activity, depression, blood pressure, HR\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Thyroid ultrasound\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">TSH, FT4, FT3, Tg, TRAK and TPO antibodies\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><sup id=\"rdp-ebb-cite_ref-52\" class=\"reference\"><a href=\"#cite_note-52\">[52]<\/a><\/sup>\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Congenital adrenal hyperplasia\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Virilization, salt loss\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Ultrasound\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Cortisol, aldosterone, electrolytes\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Karyotyping, mutation status: 21-OHase, 17a-OHase\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><sup id=\"rdp-ebb-cite_ref-53\" class=\"reference\"><a href=\"#cite_note-53\">[53]<\/a><\/sup>\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<h3><span id=\"rdp-ebb-Why_ID?\"><\/span><span class=\"mw-headline\" id=\"Why_ID.3F\">Why ID?<\/span><\/h3>\n<h4><span class=\"mw-headline\" id=\"Added_clinical_value\">Added clinical value<\/span><\/h4>\n<p>Good medical practice demands that only clinically appropriate examinations be performed, with minimum achievable risk. Socioeconomics requires that medical examinations be performed in a cost-effective fashion, while minimizing discomfort or inconvenience. The search for value in health care spending often casts imaging and diagnostics as drivers of cost and wasteful overutilization. However, diagnostic examination results are directly or indirectly involved in approximately 70% of medical decision making, while requiring less than 3% of the money spent on health care expenditures. In an effort to ensure value, , payers, and <a href=\"https:\/\/www.limswiki.org\/index.php\/Regulatory_compliance\" title=\"Regulatory compliance\" class=\"wiki-link\" data-key=\"7dbc9be278a8efda25a4b592ee6ef0ca\">regulatory agencies<\/a> track cost and quality performance; ID has the potential to improve both. Predictive analytic tools based on aggregated clinical data can streamline care pathways so that appropriate imaging and diagnostics are prioritized and expedited, on the basis of continual asynchronous informatics tools operating outside of, but in parallel with, direct communications and visits with patient providers.\n<\/p><p>Our health care delivery system is rife with opportunity for streamlining care and reducing cost. We must find more cost-effective approaches to evaluating and bringing better health care not only to an individual patient but to our populations of patients, especially those who may have been historically disadvantaged. Since 2002, the American Medical Association (AMA) has emphasized the roles and responsibilities of physicians to promote the <a href=\"https:\/\/www.limswiki.org\/index.php\/Public_health\" title=\"Public health\" class=\"wiki-link\" data-key=\"81092e25c0bd359cedd1b9f9dc350c86\">public\u2019s health<\/a>.<sup id=\"rdp-ebb-cite_ref-54\" class=\"reference\"><a href=\"#cite_note-54\">[54]<\/a><\/sup> Patients in rural areas often experience barriers to health care, including radiology and laboratory services, that limit their ability to receive appropriate care. Not surprisingly, these deleterious effects are magnified for minority, underserved, and underdeveloped populations.<sup id=\"rdp-ebb-cite_ref-55\" class=\"reference\"><a href=\"#cite_note-55\">[55]<\/a><\/sup> ID offers unique and necessary tools to address these broader social demands on health care.\n<\/p><p>Local reimbursement systems present formidable barriers to change, including the implementation of ID. The prevailing fee-for-service reimbursement system in the United States offers little incentive to pool intellectual and informatics resources to develop an ID approach. Regulatory constraints around fee sharing have been reduced by the accountable care and bundled payment programs (i.e., the Affordable Care Act), but these programs still represent a minority of health care reimbursement. Even in single-payer systems such as the United Kingdom\u2019s National Health Service, cultural barriers may exist arising from the desire to maintain individual department resources. Importantly, the large capital investments in informatics infrastructure that will be required to manage a robust ID workflow could actually delay innovation when new, more integrated IT systems are needed in the future. The <a href=\"https:\/\/www.limswiki.org\/index.php\/Health_Information_Technology_for_Economic_and_Clinical_Health_Act\" title=\"Health Information Technology for Economic and Clinical Health Act\" class=\"wiki-link\" data-key=\"89c9e20984bbda2e628b6d1d28ec3ad5\">Health Information Technology for Economic and Clinical Health Act<\/a> of 2009 incentivizing the adoption of EHRs included $27 billion to help finance the endeavor.<sup id=\"rdp-ebb-cite_ref-56\" class=\"reference\"><a href=\"#cite_note-56\">[56]<\/a><\/sup> The current Cures Act does not have comparable governmental financial support. The lack of clarity on how the significant investment required of medical informatics companies will be rewarded represents another reimbursement-related barrier to innovation.\n<\/p>\n<h4><span class=\"mw-headline\" id=\"Discovery\">Discovery<\/span><\/h4>\n<p>Imaging and advanced molecular diagnostics have hastened the pace of discovery by providing quantitative outcome measures and decreasing subject variability in clinical trials, while lessening required sample size.<sup id=\"rdp-ebb-cite_ref-:1_57-0\" class=\"reference\"><a href=\"#cite_note-:1-57\">[57]<\/a><\/sup> ID can expand our ability to perform efficient clinical trials with diverse patient populations. Using \u201creal-world\u201d data allows pragmatic research based on \u201ccomputable phenotypes,\u201d resulting in clinical cohorts from multiple sources containing data gathered in clinical care, home, or community settings.<sup id=\"rdp-ebb-cite_ref-:1_57-1\" class=\"reference\"><a href=\"#cite_note-:1-57\">[57]<\/a><\/sup> It also enables more practical \u201cpseudorandomized\u201d clinical trials, which is important in a setting of decreased margins and demand for faster discovery. Furthermore, many diseases respond to multimodality therapy, and as such, evaluating single therapy interventions using traditional outcome measures and randomized clinical trials may miss therapies with important subclinical effects.\n<\/p>\n<h4><span class=\"mw-headline\" id=\"Medical_education\">Medical education<\/span><\/h4>\n<p>ID principles should be formally introduced in the first year of medical school, beginning with the concepts of team medicine and differential diagnosis on the basis of Bayesian inference, and pathologists and radiologists should be active participants. The current organization of undergraduate and graduate medical education fosters departmental silos, compounding fragmented informatics and information infrastructure. Traditional teaching must be changed to reflect the ID workflow, as in the problem-oriented curricula adopted in the Netherlands.<sup id=\"rdp-ebb-cite_ref-58\" class=\"reference\"><a href=\"#cite_note-58\">[58]<\/a><\/sup> Table 2 includes recommendations for ways to encourage ID in medical education.\n<\/p>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table class=\"wikitable\" border=\"1\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td colspan=\"4\" style=\"background-color:white; padding-left:10px; padding-right:10px;\"><b>Table 2.<\/b> Recommendations for ways to encourage ID in medical education. CDS = clinical decision support; CME = continuing medical education; dx = diagnosis; EHR = electronic health record; GME = graduate medical education; ID = integrative diagnostics; IS = information systems; POC = point-of-care; QC = quality control; rx = treatment; UME = undergraduate medical education.\n<\/td><\/tr>\n<tr>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Organizational\n<\/th>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Educational\n<\/th>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Operational\n<\/th>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Research\n<\/th><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\u25aa Expand multidisciplinary teams, e.g., \u201ctumor boards\u201d for all disciplines<br \/>\u25aa Develop national organizational support<br \/>\u25aa Incorporate ID sessions into annual professional meetings<br \/>\u25aa Hold joint leadership meetings<br \/>\u25aa Develop and implement cross-departmental professional and administrative structure<br \/>\u25aa Designate an associate dean for ID<br \/>\u25aa Form a joint committee of radiology\/pathology leadership\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\u25aa UME: Learn principles of diagnosis radiology, laboratory, and pathology from instructors<br \/>\u25aa GME: Attend joint radiology and pathology presentations and conferences<br \/>\u25aa CME: Participate in joint professional society courses\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\u25aa Integrate radiology and pathology IS (with EHR)<br \/>\u25aa Monitor and improve joint workflow<br \/>\u25aa Develop coordinated diagnostic test scheduling<br \/>\u25aa Increase POC testing<br \/>\u25aa Improve ID turnaround time: test 1 to 2 to 3 to dx to rx<br \/>\u25aa Document and QC diagnostic errors<br \/>\u25aa Apply a routine 360\u00b0 follow-up for all diagnostic tests: missed examinations, missing reports; missing referral physician follow-up\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\u25aa Implement integrated reporting mechanisms<br \/>\u25aa Implement advanced CDS functions<br \/>\u25aa Develop ID financial models<br \/>\u25aa Conduct real-world trials for diagnostic tests\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<h3><span id=\"rdp-ebb-ID_now?\"><\/span><span class=\"mw-headline\" id=\"ID_now.3F\">ID now?<\/span><\/h3>\n<p>Although separate radiology and pathology departments remain the norm at academic medical centers, early efforts at ID departments have been made. At Erasmus MC, University Medical Center Rotterdam, one of the largest academic hospitals in the Netherlands, clinical departments are organized in themes (G.P. Krestin, personal observation, 2022). The theme \"Diagnostics and Advice\" gathers all diagnostic departments (radiology and nuclear medicine, pathology, laboratory medicine, <a href=\"https:\/\/www.limswiki.org\/index.php\/Microbiology\" title=\"Microbiology\" class=\"wiki-link\" data-key=\"920bf32dc9c9cf492c58c4c5484df41f\">microbiology<\/a>, <a href=\"https:\/\/www.limswiki.org\/index.php\/Virology\" title=\"Virology\" class=\"wiki-link\" data-key=\"308e2be65af9eba5e59ea76a920dfd30\">virology<\/a>, <a href=\"https:\/\/www.limswiki.org\/index.php\/Immunology\" title=\"Immunology\" class=\"wiki-link\" data-key=\"da0f4b59081f92df2c16fcfb965ba7c8\">immunology<\/a>, and <a href=\"https:\/\/www.limswiki.org\/index.php\/Pharmacology\" title=\"Pharmacology\" class=\"wiki-link\" data-key=\"e2071e61af2af92a10a3c9036aff9c80\">pharmacy<\/a>). The leadership of the theme consists of the department chairs and is committed to implementing the concept of ID to deliver high-quality ID reports to the referring physicians of the hospital. However, in the initial phase there was resistance from both clinical and diagnostic staff: referring clinicians considered that decision for the choice of diagnostic tests needed to remain their domain, while the diagnostic staff was reluctant to take on board additional \u201cburdensome\u201d exchanges with their colleagues in other diagnostic specialties. To break the deadlock, leadership started with a number of pilot cases (lung cancer, adrenal incidentaloma, primary liver lesions) that all turned out to benefit from an ID approach.\n<\/p><p>In 2018, the new Dell Medical School of the University of Texas at Austin established the Department of Diagnostic Medicine, which incorporated radiology and pathology (R.N. Bryan, personal observation, 2022). The organization of this department features a tripartite leadership of the chair and co-chairs or chiefs of clinical radiology and pathology. The chair has primary responsibility for the research program, while the clinical chiefs have primary responsibility for their respective clinical services. Responsibility for the educational programs is shared by these three departmental leaders, who are supported by appropriate vice-chairs for education and research from radiology and pathology faculty members. Although still nascent, progress of the program is internally viewed as \u201cencouraging.\u201d Newly Accreditation Council for Graduate Medical Education (ACGME)-credentialed radiology and pathology residency programs will accentuate radiology and pathology teaching conferences and multidisciplinary clinical conferences.\n<\/p><p>A major limitation to these joint efforts is IT infrastructure. At Erasmus MC, the recent digitization of the pathology department and use of similar image management systems in pathology and radiology is expected to further facilitate integration between these specialties and the health system EHR. At the Dell Medical School, IT remains separate and fragmented, not only between radiology and pathology but also with the hospital EHR and other specialty information systems. Although technological integration of IT infrastructure (RIS, LIS, PACS, EHR, etc.) is necessary for the success of ID, it is not sufficient. Coordinated, multispecialty oversight of the ensemble is critical and must still address the specific needs of each specialty, while at the same time presenting a seamless overview to the clinical, research, and educational communities.\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Recommendations\">Recommendations<\/span><\/h2>\n<p>Progress toward a more integrated approach to medical diagnostics has been slow, even in organizations that have created structures to foster it. Silos of expertise and incentives are deeply ingrained. Some might argue that it will take regulation or significant payment innovation to break them down. The digitization of pathology, pathology\u2019s \u201cthird revolution,\u201d and the application of AI to medical data create a sense of both possibility and urgency around this effort. Key drivers of success will be organizational matrices that foster communication and collaboration, supported by robust informatics infrastructure. A general model of this concept is the integrated practice unit (IPU), which defines a multidisciplinary team of appropriate clinical and patient support personnel to address the full care cycle of a patient condition, supported by necessary physical, financial, and IT elements.<sup id=\"rdp-ebb-cite_ref-59\" class=\"reference\"><a href=\"#cite_note-59\">[59]<\/a><\/sup> A relatively unique view of the currently ill-defined roles of radiologists and pathologists in an IPU is that of an information specialist.<sup id=\"rdp-ebb-cite_ref-60\" class=\"reference\"><a href=\"#cite_note-60\">[60]<\/a><\/sup> Here, the radiologist\u2019s or pathologist\u2019s responsibility is not just the extraction of information from images or histology but management of that information (plus information extracted by AI) in the clinical context of the patient.\n<\/p><p>Change must begin with small, easy steps, such as preclinical ID presentations by radiologists and pathologists, more joint radiology and pathology teaching sessions in our graduate medical education programs, focused postgraduate training programs jointly sponsored by our professional organizations, and extension of the tumor board concept into other disciplines, such as heart failure and infectious disease. However, the initial smaller steps should culminate in an organization with the will to implement a strong ID program and a way to support it through robust informatics. Table 2 lists recommendations for changes, some more immediately \u201cdoable,\u201d others more demanding but achievable. The previous section described early ID efforts at Erasmus MC and the Dell Medical School. A third example, the Center for Integrated Diagnostics at the Massachusetts General Hospital, with the mission \u201cto foster development of clinical actionable diagnostics and accelerate the adoption of personalized medicine,\u201d also recognizes the need to extend the concept beyond oncology and expand its testing to other disciplines.<sup id=\"rdp-ebb-cite_ref-61\" class=\"reference\"><a href=\"#cite_note-61\">[61]<\/a><\/sup>\n<\/p><p>The failure of widespread adoption of the IPU concept of disease-focused care does not bode well for the health care system\u2019s ability to adapt.<sup id=\"rdp-ebb-cite_ref-62\" class=\"reference\"><a href=\"#cite_note-62\">[62]<\/a><\/sup> Creating financial models that demonstrate the economic value proposition of ID will be a necessary catalyst for change. We believe creating a clear vision of the value created by ID for patient outcomes and quality of care will be most effective. Berwick\u2019s \u201cdimensions of total quality\u201d are all served by ID: don\u2019t kill me (no needless deaths from improper diagnosis); do help me (with a quick diagnosis); don\u2019t hurt me (no needless pain or unnecessarily invasive tests); don\u2019t make me feel helpless (inform patients of the reason and results of diagnostic tests); don\u2019t keep me waiting (or running between multiple test sites); and don\u2019t waste resources, mine or anyone else\u2019s (perform the fewest, best, least expensive tests).<sup id=\"rdp-ebb-cite_ref-63\" class=\"reference\"><a href=\"#cite_note-63\">[63]<\/a><\/sup>\n<\/p>\n<h2><span id=\"rdp-ebb-Abbreviations,_acronyms,_and_initialisms\"><\/span><span class=\"mw-headline\" id=\"Abbreviations.2C_acronyms.2C_and_initialisms\">Abbreviations, acronyms, and initialisms<\/span><\/h2>\n<ul><li><b>ACGME<\/b>: Accreditation Council for Graduate Medical Education<\/li>\n<li><b>AI<\/b>: artificial intelligence<\/li>\n<li><b>AMA<\/b>: American Medical Association<\/li>\n<li><b>CDS<\/b>: clinical decision support<\/li>\n<li><b>EHR<\/b>: electronic health record<\/li>\n<li><b>ID<\/b>: integrative diagnostics<\/li>\n<li><b>IPU<\/b>: integrated practice unit<\/li>\n<li><b>IS<\/b>: information systems<\/li>\n<li><b>IT<\/b>: information technology<\/li>\n<li><b>IS3R<\/b>: International Society of Strategic Studies in Radiology<\/li>\n<li><b>LIS<\/b>: laboratory information system<\/li>\n<li><b>ML<\/b>: machine learning<\/li>\n<li><b>PACS<\/b>: picture archiving and communication system<\/li>\n<li><b>POC<\/b>: point-of-care<\/li>\n<li><b>RIS<\/b>: radiology information system<\/li>\n<li><b>SPOC<\/b>: single point of contact<\/li><\/ul>\n<h2><span class=\"mw-headline\" id=\"Acknowledgements\">Acknowledgements<\/span><\/h2>\n<p>This paper is published simultaneously in the <i>Journal of the American College of Radiology<\/i> (DOI: 10.1016\/j.jacr.2022.11.015) and <i>Insights into Imaging<\/i> (DOI: 10.1186\/s13244-023-01379-9).\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Funding\">Funding<\/span><\/h3>\n<p>This work has not received any funding.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Contributions\">Contributions<\/span><\/h3>\n<p>All authors read and approved the final manuscript.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Competing_interest\">Competing interest<\/span><\/h3>\n<p>The authors state that they have no conflict of interest related to the material discussed in this article.\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Notes\">Notes<\/span><\/h2>\n<p>This presentation is faithful to the original, with only a few minor changes to presentation, grammar, and punctuation. In some cases important information was missing from the references, and that information was added. Several URLs were dead in the original; substitute URLs were found for this version. The order of the references in this version differs from the original; the original continues from 40 at Table 2, but this version, by design, lists the references in order of appearance.\n<\/p>\n<div class=\"mw-references-wrap mw-references-columns\"><ol class=\"references\">\n<li id=\"cite_note-1\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-1\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Saber Tehrani, Ali S; Lee, HeeWon; Mathews, Simon C; Shore, Andrew; Makary, Martin A; Pronovost, Peter J; Newman-Toker, David E (1 August 2013). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/qualitysafety.bmj.com\/lookup\/doi\/10.1136\/bmjqs-2012-001550\" target=\"_blank\">\"25-Year summary of US malpractice claims for diagnostic errors 1986\u20132010: an analysis from the National Practitioner Data Bank\"<\/a> (in en). <i>BMJ Quality & Safety<\/i> <b>22<\/b> (8): 672\u2013680. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1136%2Fbmjqs-2012-001550\" target=\"_blank\">10.1136\/bmjqs-2012-001550<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2044-5415\" target=\"_blank\">2044-5415<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/qualitysafety.bmj.com\/lookup\/doi\/10.1136\/bmjqs-2012-001550\" target=\"_blank\">https:\/\/qualitysafety.bmj.com\/lookup\/doi\/10.1136\/bmjqs-2012-001550<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=25-Year+summary+of+US+malpractice+claims+for+diagnostic+errors+1986%E2%80%932010%3A+an+analysis+from+the+National+Practitioner+Data+Bank&rft.jtitle=BMJ+Quality+%26+Safety&rft.aulast=Saber+Tehrani&rft.aufirst=Ali+S&rft.au=Saber+Tehrani%2C%26%2332%3BAli+S&rft.au=Lee%2C%26%2332%3BHeeWon&rft.au=Mathews%2C%26%2332%3BSimon+C&rft.au=Shore%2C%26%2332%3BAndrew&rft.au=Makary%2C%26%2332%3BMartin+A&rft.au=Pronovost%2C%26%2332%3BPeter+J&rft.au=Newman-Toker%2C%26%2332%3BDavid+E&rft.date=1+August+2013&rft.volume=22&rft.issue=8&rft.pages=672%E2%80%93680&rft_id=info:doi\/10.1136%2Fbmjqs-2012-001550&rft.issn=2044-5415&rft_id=https%3A%2F%2Fqualitysafety.bmj.com%2Flookup%2Fdoi%2F10.1136%2Fbmjqs-2012-001550&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-2\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-2\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Graber, Mark L (1 October 2013). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/qualitysafety.bmj.com\/lookup\/doi\/10.1136\/bmjqs-2012-001615\" target=\"_blank\">\"The incidence of diagnostic error in medicine\"<\/a> (in en). <i>BMJ Quality & Safety<\/i> <b>22<\/b> (Suppl 2): ii21\u2013ii27. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1136%2Fbmjqs-2012-001615\" target=\"_blank\">10.1136\/bmjqs-2012-001615<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2044-5415\" target=\"_blank\">2044-5415<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC3786666\/\" target=\"_blank\">PMC3786666<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/23771902\" target=\"_blank\">23771902<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/qualitysafety.bmj.com\/lookup\/doi\/10.1136\/bmjqs-2012-001615\" target=\"_blank\">https:\/\/qualitysafety.bmj.com\/lookup\/doi\/10.1136\/bmjqs-2012-001615<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=The+incidence+of+diagnostic+error+in+medicine&rft.jtitle=BMJ+Quality+%26+Safety&rft.aulast=Graber&rft.aufirst=Mark+L&rft.au=Graber%2C%26%2332%3BMark+L&rft.date=1+October+2013&rft.volume=22&rft.issue=Suppl+2&rft.pages=ii21%E2%80%93ii27&rft_id=info:doi\/10.1136%2Fbmjqs-2012-001615&rft.issn=2044-5415&rft_id=info:pmc\/PMC3786666&rft_id=info:pmid\/23771902&rft_id=https%3A%2F%2Fqualitysafety.bmj.com%2Flookup%2Fdoi%2F10.1136%2Fbmjqs-2012-001615&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-3\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-3\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation book\">Schwartz, A.; Elstein, A.S. (2019). \"Clinical reasoning in medicine\". In Higgs, Joy; Jensen, Gail M.; Loftus, Stephen <i>et al.<\/i>. <i>Clinical reasoning in the health professions<\/i> (Fourth edition ed.). Edinburgh London New York: Elsevier. pp. 223\u2013234. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-0-7020-6224-7.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Clinical+reasoning+in+medicine&rft.atitle=Clinical+reasoning+in+the+health+professions&rft.aulast=Schwartz%2C+A.%3B+Elstein%2C+A.S.&rft.au=Schwartz%2C+A.%3B+Elstein%2C+A.S.&rft.date=2019&rft.pages=pp.%26nbsp%3B223%E2%80%93234&rft.edition=Fourth+edition&rft.place=Edinburgh+London+New+York&rft.pub=Elsevier&rft.isbn=978-0-7020-6224-7&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-4\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-4\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">AdvaMedDx (June 2011). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/web.archive.org\/web\/20201201141722\/https:\/\/dx.advamed.org\/resource-center?page=4\" target=\"_blank\">\"A Policy Primer on Diagnostics\"<\/a>. Archived from <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/web.archive.org\/web\/20201201141722\/https:\/\/dx.advamed.org\/research\/resource-center\/advameddx-policy-primer-diagnostics-june-2011-pdf\" target=\"_blank\">the original<\/a> on 01 December 2020<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/web.archive.org\/web\/20201201141722\/https:\/\/dx.advamed.org\/resource-center?page=4\" target=\"_blank\">https:\/\/web.archive.org\/web\/20201201141722\/https:\/\/dx.advamed.org\/resource-center?page=4<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=A+Policy+Primer+on+Diagnostics&rft.atitle=&rft.aulast=AdvaMedDx&rft.au=AdvaMedDx&rft.date=June+2011&rft_id=https%3A%2F%2Fweb.archive.org%2Fweb%2F20201201141722%2Fhttps%3A%2F%2Fdx.advamed.org%2Fresource-center%3Fpage%3D4&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-5\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-5\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation book\">Van Leeuwen, Anne M.; Bladh, Mickey Lynn (2021). <i>Davis's comprehensive manual of laboratory and diagnostic tests with nursing implications<\/i> (Ninth edition ed.). Philadelphia: F.A. Davis. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-1-7196-4058-9.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=book&rft.btitle=Davis%27s+comprehensive+manual+of+laboratory+and+diagnostic+tests+with+nursing+implications&rft.aulast=Van+Leeuwen&rft.aufirst=Anne+M.&rft.au=Van+Leeuwen%2C%26%2332%3BAnne+M.&rft.au=Bladh%2C%26%2332%3BMickey+Lynn&rft.date=2021&rft.edition=Ninth+edition&rft.place=Philadelphia&rft.pub=F.A.+Davis&rft.isbn=978-1-7196-4058-9&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-6\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-6\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Lippi, Giuseppe; Plebani, Mario (15 February 2020). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.biochemia-medica.com\/en\/journal\/30\/1\/10.11613\/BM.2020.010501\" target=\"_blank\">\"Integrated diagnostics: the future of laboratory medicine?\"<\/a>. <i>Biochemia medica<\/i> <b>30<\/b> (1): 18\u201330. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.11613%2FBM.2020.010501\" target=\"_blank\">10.11613\/BM.2020.010501<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC6904966\/\" target=\"_blank\">PMC6904966<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/31839719\" target=\"_blank\">31839719<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.biochemia-medica.com\/en\/journal\/30\/1\/10.11613\/BM.2020.010501\" target=\"_blank\">https:\/\/www.biochemia-medica.com\/en\/journal\/30\/1\/10.11613\/BM.2020.010501<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Integrated+diagnostics%3A+the+future+of+laboratory+medicine%3F&rft.jtitle=Biochemia+medica&rft.aulast=Lippi&rft.aufirst=Giuseppe&rft.au=Lippi%2C%26%2332%3BGiuseppe&rft.au=Plebani%2C%26%2332%3BMario&rft.date=15+February+2020&rft.volume=30&rft.issue=1&rft.pages=18%E2%80%9330&rft_id=info:doi\/10.11613%2FBM.2020.010501&rft_id=info:pmc\/PMC6904966&rft_id=info:pmid\/31839719&rft_id=https%3A%2F%2Fwww.biochemia-medica.com%2Fen%2Fjournal%2F30%2F1%2F10.11613%2FBM.2020.010501&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:0-7\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:0_7-0\">7.0<\/a><\/sup> <sup><a href=\"#cite_ref-:0_7-1\">7.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation book\">Committee on Diagnostic Error in Health Care; Board on Health Care Services; Institute of Medicine; The National Academies of Sciences, Engineering, and Medicine (29 December 2015). Balogh, Erin P.; Miller, Bryan T.; Ball, John R.. eds. <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.nap.edu\/catalog\/21794\" target=\"_blank\"><i>Improving Diagnosis in Health Care<\/i><\/a>. Washington, D.C.: National Academies Press. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.17226%2F21794.\" target=\"_blank\">10.17226\/21794.<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-0-309-37769-0<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/www.nap.edu\/catalog\/21794\" target=\"_blank\">http:\/\/www.nap.edu\/catalog\/21794<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=book&rft.btitle=Improving+Diagnosis+in+Health+Care&rft.aulast=Committee+on+Diagnostic+Error+in+Health+Care&rft.au=Committee+on+Diagnostic+Error+in+Health+Care&rft.au=Board+on+Health+Care+Services&rft.au=Institute+of+Medicine&rft.au=The+National+Academies+of+Sciences%2C+Engineering%2C+and+Medicine&rft.date=29+December+2015&rft.place=Washington%2C+D.C.&rft.pub=National+Academies+Press&rft_id=info:doi\/10.17226%2F21794.&rft.isbn=978-0-309-37769-0&rft_id=http%3A%2F%2Fwww.nap.edu%2Fcatalog%2F21794&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-8\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-8\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation book\">Stern, Scott D. C.; Cifu, Adam S.; Altkorn, Diane (2015). <i>Symptom to diagnosis: an evidence-based guide<\/i> (3rd edition ed.). New York Chicago San Francisco: McGraw-Hill Education Medical. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-1-259-25253-2.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=book&rft.btitle=Symptom+to+diagnosis%3A+an+evidence-based+guide&rft.aulast=Stern&rft.aufirst=Scott+D.+C.&rft.au=Stern%2C%26%2332%3BScott+D.+C.&rft.au=Cifu%2C%26%2332%3BAdam+S.&rft.au=Altkorn%2C%26%2332%3BDiane&rft.date=2015&rft.edition=3rd+edition&rft.place=New+York+Chicago+San+Francisco&rft.pub=McGraw-Hill+Education+Medical&rft.isbn=978-1-259-25253-2&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-9\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-9\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Lundberg, George D. (2 February 1990). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/jama.jamanetwork.com\/article.aspx?doi=10.1001\/jama.1990.03440050103044\" target=\"_blank\">\"Critical (Panic) Value Notification: An Established Laboratory Practice Policy (Parameter)\"<\/a> (in en). <i>JAMA: The Journal of the American Medical Association<\/i> <b>263<\/b> (5): 709. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1001%2Fjama.1990.03440050103044\" target=\"_blank\">10.1001\/jama.1990.03440050103044<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0098-7484\" target=\"_blank\">0098-7484<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/jama.jamanetwork.com\/article.aspx?doi=10.1001\/jama.1990.03440050103044\" target=\"_blank\">http:\/\/jama.jamanetwork.com\/article.aspx?doi=10.1001\/jama.1990.03440050103044<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Critical+%28Panic%29+Value+Notification%3A+An+Established+Laboratory+Practice+Policy+%28Parameter%29&rft.jtitle=JAMA%3A+The+Journal+of+the+American+Medical+Association&rft.aulast=Lundberg&rft.aufirst=George+D.&rft.au=Lundberg%2C%26%2332%3BGeorge+D.&rft.date=2+February+1990&rft.volume=263&rft.issue=5&rft.pages=709&rft_id=info:doi\/10.1001%2Fjama.1990.03440050103044&rft.issn=0098-7484&rft_id=http%3A%2F%2Fjama.jamanetwork.com%2Farticle.aspx%3Fdoi%3D10.1001%2Fjama.1990.03440050103044&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-10\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-10\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Bleicher, Richard J.; Ruth, Karen; Sigurdson, Elin R.; Beck, J. Robert; Ross, Eric; Wong, Yu-Ning; Patel, Sameer A.; Boraas, Marcia <i>et al.<\/i> (1 March 2016). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/oncology.jamanetwork.com\/article.aspx?doi=10.1001\/jamaoncol.2015.4508\" target=\"_blank\">\"Time to Surgery and Breast Cancer Survival in the United States\"<\/a> (in en). <i>JAMA Oncology<\/i> <b>2<\/b> (3): 330. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1001%2Fjamaoncol.2015.4508\" target=\"_blank\">10.1001\/jamaoncol.2015.4508<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2374-2437\" target=\"_blank\">2374-2437<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC4788555\/\" target=\"_blank\">PMC4788555<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/26659430\" target=\"_blank\">26659430<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/oncology.jamanetwork.com\/article.aspx?doi=10.1001\/jamaoncol.2015.4508\" target=\"_blank\">http:\/\/oncology.jamanetwork.com\/article.aspx?doi=10.1001\/jamaoncol.2015.4508<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Time+to+Surgery+and+Breast+Cancer+Survival+in+the+United+States&rft.jtitle=JAMA+Oncology&rft.aulast=Bleicher&rft.aufirst=Richard+J.&rft.au=Bleicher%2C%26%2332%3BRichard+J.&rft.au=Ruth%2C%26%2332%3BKaren&rft.au=Sigurdson%2C%26%2332%3BElin+R.&rft.au=Beck%2C%26%2332%3BJ.+Robert&rft.au=Ross%2C%26%2332%3BEric&rft.au=Wong%2C%26%2332%3BYu-Ning&rft.au=Patel%2C%26%2332%3BSameer+A.&rft.au=Boraas%2C%26%2332%3BMarcia&rft.au=Chang%2C%26%2332%3BEric+I.&rft.date=1+March+2016&rft.volume=2&rft.issue=3&rft.pages=330&rft_id=info:doi\/10.1001%2Fjamaoncol.2015.4508&rft.issn=2374-2437&rft_id=info:pmc\/PMC4788555&rft_id=info:pmid\/26659430&rft_id=http%3A%2F%2Foncology.jamanetwork.com%2Farticle.aspx%3Fdoi%3D10.1001%2Fjamaoncol.2015.4508&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-11\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-11\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Zhi, Ming; Ding, Eric L.; Theisen-Toupal, Jesse; Whelan, Julia; Arnaout, Ramy (15 November 2013). Szecsi, Pal Bela. ed. <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/dx.plos.org\/10.1371\/journal.pone.0078962\" target=\"_blank\">\"The Landscape of Inappropriate Laboratory Testing: A 15-Year Meta-Analysis\"<\/a> (in en). <i>PLoS ONE<\/i> <b>8<\/b> (11): e78962. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1371%2Fjournal.pone.0078962\" target=\"_blank\">10.1371\/journal.pone.0078962<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1932-6203\" target=\"_blank\">1932-6203<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC3829815\/\" target=\"_blank\">PMC3829815<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/24260139\" target=\"_blank\">24260139<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/dx.plos.org\/10.1371\/journal.pone.0078962\" target=\"_blank\">https:\/\/dx.plos.org\/10.1371\/journal.pone.0078962<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=The+Landscape+of+Inappropriate+Laboratory+Testing%3A+A+15-Year+Meta-Analysis&rft.jtitle=PLoS+ONE&rft.aulast=Zhi&rft.aufirst=Ming&rft.au=Zhi%2C%26%2332%3BMing&rft.au=Ding%2C%26%2332%3BEric+L.&rft.au=Theisen-Toupal%2C%26%2332%3BJesse&rft.au=Whelan%2C%26%2332%3BJulia&rft.au=Arnaout%2C%26%2332%3BRamy&rft.date=15+November+2013&rft.volume=8&rft.issue=11&rft.pages=e78962&rft_id=info:doi\/10.1371%2Fjournal.pone.0078962&rft.issn=1932-6203&rft_id=info:pmc\/PMC3829815&rft_id=info:pmid\/24260139&rft_id=https%3A%2F%2Fdx.plos.org%2F10.1371%2Fjournal.pone.0078962&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-12\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-12\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Hughes, Danny R.; Jiang, Miao; Duszak, Richard (1 January 2015). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/archinte.jamanetwork.com\/article.aspx?doi=10.1001\/jamainternmed.2014.6349\" target=\"_blank\">\"A Comparison of Diagnostic Imaging Ordering Patterns Between Advanced Practice Clinicians and Primary Care Physicians Following Office-Based Evaluation and Management Visits\"<\/a> (in en). <i>JAMA Internal Medicine<\/i> <b>175<\/b> (1): 101. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1001%2Fjamainternmed.2014.6349\" target=\"_blank\">10.1001\/jamainternmed.2014.6349<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2168-6106\" target=\"_blank\">2168-6106<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/archinte.jamanetwork.com\/article.aspx?doi=10.1001\/jamainternmed.2014.6349\" target=\"_blank\">http:\/\/archinte.jamanetwork.com\/article.aspx?doi=10.1001\/jamainternmed.2014.6349<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=A+Comparison+of+Diagnostic+Imaging+Ordering+Patterns+Between+Advanced+Practice+Clinicians+and+Primary+Care+Physicians+Following+Office-Based+Evaluation+and+Management+Visits&rft.jtitle=JAMA+Internal+Medicine&rft.aulast=Hughes&rft.aufirst=Danny+R.&rft.au=Hughes%2C%26%2332%3BDanny+R.&rft.au=Jiang%2C%26%2332%3BMiao&rft.au=Duszak%2C%26%2332%3BRichard&rft.date=1+January+2015&rft.volume=175&rft.issue=1&rft.pages=101&rft_id=info:doi\/10.1001%2Fjamainternmed.2014.6349&rft.issn=2168-6106&rft_id=http%3A%2F%2Farchinte.jamanetwork.com%2Farticle.aspx%3Fdoi%3D10.1001%2Fjamainternmed.2014.6349&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-13\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-13\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Berner, E.S. (June 2009). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/digital.ahrq.gov\/sites\/default\/files\/docs\/page\/09-0069-EF_1.pdf\" target=\"_blank\">\"Clinical decision support systems: State of the Art\"<\/a> (PDF). Agency for Healthcare Research and Quality<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/digital.ahrq.gov\/sites\/default\/files\/docs\/page\/09-0069-EF_1.pdf\" target=\"_blank\">https:\/\/digital.ahrq.gov\/sites\/default\/files\/docs\/page\/09-0069-EF_1.pdf<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Clinical+decision+support+systems%3A+State+of+the+Art&rft.atitle=&rft.aulast=Berner%2C+E.S.&rft.au=Berner%2C+E.S.&rft.date=June+2009&rft.pub=Agency+for+Healthcare+Research+and+Quality&rft_id=https%3A%2F%2Fdigital.ahrq.gov%2Fsites%2Fdefault%2Ffiles%2Fdocs%2Fpage%2F09-0069-EF_1.pdf&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-14\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-14\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Blackmore, C. Craig; Mecklenburg, Robert S.; Kaplan, Gary S. (1 January 2011). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1546144010003893\" target=\"_blank\">\"Effectiveness of Clinical Decision Support in Controlling Inappropriate Imaging\"<\/a> (in en). <i>Journal of the American College of Radiology<\/i> <b>8<\/b> (1): 19\u201325. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.jacr.2010.07.009\" target=\"_blank\">10.1016\/j.jacr.2010.07.009<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1546144010003893\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1546144010003893<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Effectiveness+of+Clinical+Decision+Support+in+Controlling+Inappropriate+Imaging&rft.jtitle=Journal+of+the+American+College+of+Radiology&rft.aulast=Blackmore&rft.aufirst=C.+Craig&rft.au=Blackmore%2C%26%2332%3BC.+Craig&rft.au=Mecklenburg%2C%26%2332%3BRobert+S.&rft.au=Kaplan%2C%26%2332%3BGary+S.&rft.date=1+January+2011&rft.volume=8&rft.issue=1&rft.pages=19%E2%80%9325&rft_id=info:doi\/10.1016%2Fj.jacr.2010.07.009&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS1546144010003893&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-15\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-15\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Were, M. C.; Shen, C.; Tierney, W. M.; Mamlin, J. J.; Biondich, P. G.; Li, X.; Kimaiyo, S.; Mamlin, B. W. (1 March 2011). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/academic.oup.com\/jamia\/article-lookup\/doi\/10.1136\/jamia.2010.005520\" target=\"_blank\">\"Evaluation of computer-generated reminders to improve CD4 laboratory monitoring in sub-Saharan Africa: a prospective comparative study\"<\/a> (in en). <i>Journal of the American Medical Informatics Association<\/i> <b>18<\/b> (2): 150\u2013155. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1136%2Fjamia.2010.005520\" target=\"_blank\">10.1136\/jamia.2010.005520<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1067-5027\" target=\"_blank\">1067-5027<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC3116261\/\" target=\"_blank\">PMC3116261<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/21252053\" target=\"_blank\">21252053<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/academic.oup.com\/jamia\/article-lookup\/doi\/10.1136\/jamia.2010.005520\" target=\"_blank\">https:\/\/academic.oup.com\/jamia\/article-lookup\/doi\/10.1136\/jamia.2010.005520<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Evaluation+of+computer-generated+reminders+to+improve+CD4+laboratory+monitoring+in+sub-Saharan+Africa%3A+a+prospective+comparative+study&rft.jtitle=Journal+of+the+American+Medical+Informatics+Association&rft.aulast=Were&rft.aufirst=M.+C.&rft.au=Were%2C%26%2332%3BM.+C.&rft.au=Shen%2C%26%2332%3BC.&rft.au=Tierney%2C%26%2332%3BW.+M.&rft.au=Mamlin%2C%26%2332%3BJ.+J.&rft.au=Biondich%2C%26%2332%3BP.+G.&rft.au=Li%2C%26%2332%3BX.&rft.au=Kimaiyo%2C%26%2332%3BS.&rft.au=Mamlin%2C%26%2332%3BB.+W.&rft.date=1+March+2011&rft.volume=18&rft.issue=2&rft.pages=150%E2%80%93155&rft_id=info:doi\/10.1136%2Fjamia.2010.005520&rft.issn=1067-5027&rft_id=info:pmc\/PMC3116261&rft_id=info:pmid\/21252053&rft_id=https%3A%2F%2Facademic.oup.com%2Fjamia%2Farticle-lookup%2Fdoi%2F10.1136%2Fjamia.2010.005520&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-16\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-16\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Lacy, N. L. (1 November 2004). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.annfammed.org\/cgi\/doi\/10.1370\/afm.123\" target=\"_blank\">\"Why We Don't Come: Patient Perceptions on No-Shows\"<\/a> (in en). <i>The Annals of Family Medicine<\/i> <b>2<\/b> (6): 541\u2013545. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1370%2Fafm.123\" target=\"_blank\">10.1370\/afm.123<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1544-1709\" target=\"_blank\">1544-1709<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC1466756\/\" target=\"_blank\">PMC1466756<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/15576538\" target=\"_blank\">15576538<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/www.annfammed.org\/cgi\/doi\/10.1370\/afm.123\" target=\"_blank\">http:\/\/www.annfammed.org\/cgi\/doi\/10.1370\/afm.123<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Why+We+Don%27t+Come%3A+Patient+Perceptions+on+No-Shows&rft.jtitle=The+Annals+of+Family+Medicine&rft.aulast=Lacy&rft.aufirst=N.+L.&rft.au=Lacy%2C%26%2332%3BN.+L.&rft.date=1+November+2004&rft.volume=2&rft.issue=6&rft.pages=541%E2%80%93545&rft_id=info:doi\/10.1370%2Fafm.123&rft.issn=1544-1709&rft_id=info:pmc\/PMC1466756&rft_id=info:pmid\/15576538&rft_id=http%3A%2F%2Fwww.annfammed.org%2Fcgi%2Fdoi%2F10.1370%2Fafm.123&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-17\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-17\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">AdvaMedDx (14 November 2019). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/dx.advamed.org\/member-center\/resource-library\/from-test-to-treatment-the-value-of-diagnostics\/\" target=\"_blank\">\"From Test To Treatment: The Value Of Diagnostics\"<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/dx.advamed.org\/member-center\/resource-library\/from-test-to-treatment-the-value-of-diagnostics\/\" target=\"_blank\">https:\/\/dx.advamed.org\/member-center\/resource-library\/from-test-to-treatment-the-value-of-diagnostics\/<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 25 February 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=From+Test+To+Treatment%3A+The+Value+Of+Diagnostics&rft.atitle=&rft.aulast=AdvaMedDx&rft.au=AdvaMedDx&rft.date=14+November+2019&rft_id=https%3A%2F%2Fdx.advamed.org%2Fmember-center%2Fresource-library%2Ffrom-test-to-treatment-the-value-of-diagnostics%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-18\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-18\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Ebinger, Martin; Siegerink, Bob; Kunz, Alexander; Wendt, Matthias; Weber, Joachim E.; Schwabauer, Eugen; Geisler, Frederik; Freitag, Erik <i>et al.<\/i> (2 February 2021). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/jamanetwork.com\/journals\/jama\/fullarticle\/2775714\" target=\"_blank\">\"Association Between Dispatch of Mobile Stroke Units and Functional Outcomes Among Patients With Acute Ischemic Stroke in Berlin\"<\/a> (in en). <i>JAMA<\/i> <b>325<\/b> (5): 454. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1001%2Fjama.2020.26345\" target=\"_blank\">10.1001\/jama.2020.26345<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0098-7484\" target=\"_blank\">0098-7484<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC7856548\/\" target=\"_blank\">PMC7856548<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/33528537\" target=\"_blank\">33528537<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/jamanetwork.com\/journals\/jama\/fullarticle\/2775714\" target=\"_blank\">https:\/\/jamanetwork.com\/journals\/jama\/fullarticle\/2775714<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Association+Between+Dispatch+of+Mobile+Stroke+Units+and+Functional+Outcomes+Among+Patients+With+Acute+Ischemic+Stroke+in+Berlin&rft.jtitle=JAMA&rft.aulast=Ebinger&rft.aufirst=Martin&rft.au=Ebinger%2C%26%2332%3BMartin&rft.au=Siegerink%2C%26%2332%3BBob&rft.au=Kunz%2C%26%2332%3BAlexander&rft.au=Wendt%2C%26%2332%3BMatthias&rft.au=Weber%2C%26%2332%3BJoachim+E.&rft.au=Schwabauer%2C%26%2332%3BEugen&rft.au=Geisler%2C%26%2332%3BFrederik&rft.au=Freitag%2C%26%2332%3BErik&rft.au=Lange%2C%26%2332%3BJulia&rft.date=2+February+2021&rft.volume=325&rft.issue=5&rft.pages=454&rft_id=info:doi\/10.1001%2Fjama.2020.26345&rft.issn=0098-7484&rft_id=info:pmc\/PMC7856548&rft_id=info:pmid\/33528537&rft_id=https%3A%2F%2Fjamanetwork.com%2Fjournals%2Fjama%2Ffullarticle%2F2775714&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-19\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-19\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Lu, Michael T.; Rosman, David A.; Wu, Carol C.; Gilman, Matthew D.; Harvey, H. Benjamin; Gervais, Debra A.; Alkasab, Tarik K.; Shepard, Jo-Anne O. <i>et al.<\/i> (1 February 2016). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1546144015009667\" target=\"_blank\">\"Radiologist Point-of-Care Clinical Decision Support and Adherence to Guidelines for Incidental Lung Nodules\"<\/a> (in en). <i>Journal of the American College of Radiology<\/i> <b>13<\/b> (2): 156\u2013162. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.jacr.2015.09.029\" target=\"_blank\">10.1016\/j.jacr.2015.09.029<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1546144015009667\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1546144015009667<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Radiologist+Point-of-Care+Clinical+Decision+Support+and+Adherence+to+Guidelines+for+Incidental+Lung+Nodules&rft.jtitle=Journal+of+the+American+College+of+Radiology&rft.aulast=Lu&rft.aufirst=Michael+T.&rft.au=Lu%2C%26%2332%3BMichael+T.&rft.au=Rosman%2C%26%2332%3BDavid+A.&rft.au=Wu%2C%26%2332%3BCarol+C.&rft.au=Gilman%2C%26%2332%3BMatthew+D.&rft.au=Harvey%2C%26%2332%3BH.+Benjamin&rft.au=Gervais%2C%26%2332%3BDebra+A.&rft.au=Alkasab%2C%26%2332%3BTarik+K.&rft.au=Shepard%2C%26%2332%3BJo-Anne+O.&rft.au=Boland%2C%26%2332%3BGiles+W.&rft.date=1+February+2016&rft.volume=13&rft.issue=2&rft.pages=156%E2%80%93162&rft_id=info:doi\/10.1016%2Fj.jacr.2015.09.029&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS1546144015009667&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-20\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-20\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Zwaan, Laura; Thijs, Abel; Wagner, Cordula; Timmermans, Dani\u00eblle R.M. (1 August 2013). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0277953613002682\" target=\"_blank\">\"Does inappropriate selectivity in information use relate to diagnostic errors and patient harm? The diagnosis of patients with dyspnea\"<\/a> (in en). <i>Social Science & Medicine<\/i> <b>91<\/b>: 32\u201338. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.socscimed.2013.05.001\" target=\"_blank\">10.1016\/j.socscimed.2013.05.001<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0277953613002682\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0277953613002682<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Does+inappropriate+selectivity+in+information+use+relate+to+diagnostic+errors+and+patient+harm%3F+The+diagnosis+of+patients+with+dyspnea&rft.jtitle=Social+Science+%26+Medicine&rft.aulast=Zwaan&rft.aufirst=Laura&rft.au=Zwaan%2C%26%2332%3BLaura&rft.au=Thijs%2C%26%2332%3BAbel&rft.au=Wagner%2C%26%2332%3BCordula&rft.au=Timmermans%2C%26%2332%3BDani%C3%ABlle+R.M.&rft.date=1+August+2013&rft.volume=91&rft.pages=32%E2%80%9338&rft_id=info:doi\/10.1016%2Fj.socscimed.2013.05.001&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS0277953613002682&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-21\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-21\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Wahls, Terry L; Cram, Peter M (1 December 2007). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/bmcfampract.biomedcentral.com\/articles\/10.1186\/1471-2296-8-32\" target=\"_blank\">\"The frequency of missed test results and associated treatment delays in a highly computerized health system\"<\/a> (in en). <i>BMC Family Practice<\/i> <b>8<\/b> (1): 32. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1186%2F1471-2296-8-32\" target=\"_blank\">10.1186\/1471-2296-8-32<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1471-2296\" target=\"_blank\">1471-2296<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC1891295\/\" target=\"_blank\">PMC1891295<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/17519017\" target=\"_blank\">17519017<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/bmcfampract.biomedcentral.com\/articles\/10.1186\/1471-2296-8-32\" target=\"_blank\">https:\/\/bmcfampract.biomedcentral.com\/articles\/10.1186\/1471-2296-8-32<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=The+frequency+of+missed+test+results+and+associated+treatment+delays+in+a+highly+computerized+health+system&rft.jtitle=BMC+Family+Practice&rft.aulast=Wahls&rft.aufirst=Terry+L&rft.au=Wahls%2C%26%2332%3BTerry+L&rft.au=Cram%2C%26%2332%3BPeter+M&rft.date=1+December+2007&rft.volume=8&rft.issue=1&rft.pages=32&rft_id=info:doi\/10.1186%2F1471-2296-8-32&rft.issn=1471-2296&rft_id=info:pmc\/PMC1891295&rft_id=info:pmid\/17519017&rft_id=https%3A%2F%2Fbmcfampract.biomedcentral.com%2Farticles%2F10.1186%2F1471-2296-8-32&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-22\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-22\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Allyn, J. (29 August 2019). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.rsna.org\/news\/2019\/August\/Integrated-Diagnostics\" target=\"_blank\">\"RSNA\/AAPM Symposium Addresses Integrated Diagnostics at RSNA 2019\"<\/a>. Radiological Society of North America<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.rsna.org\/news\/2019\/August\/Integrated-Diagnostics\" target=\"_blank\">https:\/\/www.rsna.org\/news\/2019\/August\/Integrated-Diagnostics<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=RSNA%2FAAPM+Symposium+Addresses+Integrated+Diagnostics+at+RSNA+2019&rft.atitle=&rft.aulast=Allyn%2C+J.&rft.au=Allyn%2C+J.&rft.date=29+August+2019&rft.pub=Radiological+Society+of+North+America&rft_id=https%3A%2F%2Fwww.rsna.org%2Fnews%2F2019%2FAugust%2FIntegrated-Diagnostics&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-23\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-23\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Harmony Healthcare IT (4 August 2020). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.harmonyhit.com\/health-data-volumes-skyrocket-legacy-data-archives-rise-hie\/\" target=\"_blank\">\"Health Data Volumes Skyrocket, Legacy Data Archives On the Rise\"<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.harmonyhit.com\/health-data-volumes-skyrocket-legacy-data-archives-rise-hie\/\" target=\"_blank\">https:\/\/www.harmonyhit.com\/health-data-volumes-skyrocket-legacy-data-archives-rise-hie\/<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 15 November 2021<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Health+Data+Volumes+Skyrocket%2C+Legacy+Data+Archives+On+the+Rise&rft.atitle=&rft.aulast=Harmony+Healthcare+IT&rft.au=Harmony+Healthcare+IT&rft.date=4+August+2020&rft_id=https%3A%2F%2Fwww.harmonyhit.com%2Fhealth-data-volumes-skyrocket-legacy-data-archives-rise-hie%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-24\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-24\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">RBC Capital Markets (2021). <a rel=\"nofollow\" class=\"external text\" href=\"#content-panel\">\"The Healthcare Data Explosion\"<\/a>. RBC Dominion Securities Inc<span class=\"printonly\">. <a rel=\"nofollow\" class=\"external free\" href=\"#content-panel\">https:\/\/www.rbccm.com\/en\/gib\/healthcare\/episode\/the_healthcare_data_explosion#content-panel<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 15 November 2021<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=The+Healthcare+Data+Explosion&rft.atitle=&rft.aulast=RBC+Capital+Markets&rft.au=RBC+Capital+Markets&rft.date=2021&rft.pub=RBC+Dominion+Securities+Inc&rft_id=https%3A%2F%2Fwww.rbccm.com%2Fen%2Fgib%2Fhealthcare%2Fepisode%2Fthe_healthcare_data_explosion%23content-panel&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-25\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-25\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Association of State and Territorial Health Officials (2016). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/web.archive.org\/web\/20191108083841\/http:\/\/www.astho.org\/Health-Systems-Transformation\/Medicaid-and-Public-Health-Partnerships\/Learning-Series\/Public-Health-Informatics\/\" target=\"_blank\">\"Public Health Informatics\"<\/a>. <i>Medicaid and Public Health Integration Learning Series<\/i>. Archived from <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.astho.org\/Health-Systems-Transformation\/Medicaid-and-Public-Health-Partnerships\/Learning-Series\/Public-Health-Informatics\/\" target=\"_blank\">the original<\/a> on 08 November 2019<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/web.archive.org\/web\/20191108083841\/http:\/\/www.astho.org\/Health-Systems-Transformation\/Medicaid-and-Public-Health-Partnerships\/Learning-Series\/Public-Health-Informatics\/\" target=\"_blank\">https:\/\/web.archive.org\/web\/20191108083841\/http:\/\/www.astho.org\/Health-Systems-Transformation\/Medicaid-and-Public-Health-Partnerships\/Learning-Series\/Public-Health-Informatics\/<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Public+Health+Informatics&rft.atitle=Medicaid+and+Public+Health+Integration+Learning+Series&rft.aulast=Association+of+State+and+Territorial+Health+Officials&rft.au=Association+of+State+and+Territorial+Health+Officials&rft.date=2016&rft_id=https%3A%2F%2Fweb.archive.org%2Fweb%2F20191108083841%2Fhttp%3A%2F%2Fwww.astho.org%2FHealth-Systems-Transformation%2FMedicaid-and-Public-Health-Partnerships%2FLearning-Series%2FPublic-Health-Informatics%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-26\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-26\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Riches, Nicholas; Panagioti, Maria; Alam, Rahul; Cheraghi-Sohi, Sudeh; Campbell, Stephen; Esmail, Aneez; Bower, Peter (8 March 2016). Schmidt, Robert L. ed. <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/dx.plos.org\/10.1371\/journal.pone.0148991\" target=\"_blank\">\"The Effectiveness of Electronic Differential Diagnoses (DDX) Generators: A Systematic Review and Meta-Analysis\"<\/a> (in en). <i>PLOS ONE<\/i> <b>11<\/b> (3): e0148991. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1371%2Fjournal.pone.0148991\" target=\"_blank\">10.1371\/journal.pone.0148991<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1932-6203\" target=\"_blank\">1932-6203<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC4782994\/\" target=\"_blank\">PMC4782994<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/26954234\" target=\"_blank\">26954234<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/dx.plos.org\/10.1371\/journal.pone.0148991\" target=\"_blank\">https:\/\/dx.plos.org\/10.1371\/journal.pone.0148991<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=The+Effectiveness+of+Electronic+Differential+Diagnoses+%28DDX%29+Generators%3A+A+Systematic+Review+and+Meta-Analysis&rft.jtitle=PLOS+ONE&rft.aulast=Riches&rft.aufirst=Nicholas&rft.au=Riches%2C%26%2332%3BNicholas&rft.au=Panagioti%2C%26%2332%3BMaria&rft.au=Alam%2C%26%2332%3BRahul&rft.au=Cheraghi-Sohi%2C%26%2332%3BSudeh&rft.au=Campbell%2C%26%2332%3BStephen&rft.au=Esmail%2C%26%2332%3BAneez&rft.au=Bower%2C%26%2332%3BPeter&rft.date=8+March+2016&rft.volume=11&rft.issue=3&rft.pages=e0148991&rft_id=info:doi\/10.1371%2Fjournal.pone.0148991&rft.issn=1932-6203&rft_id=info:pmc\/PMC4782994&rft_id=info:pmid\/26954234&rft_id=https%3A%2F%2Fdx.plos.org%2F10.1371%2Fjournal.pone.0148991&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-27\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-27\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.federalregister.gov\/documents\/2020\/05\/01\/2020-07419\/21st-century-cures-act-interoperability-information-blocking-and-the-onc-health-it-certification\" target=\"_blank\">\"21st Century Cures Act: Interoperability, Information Blocking, and the ONC Health IT Certification Program - 85 FR 25642\"<\/a>. <i>Federal Register<\/i>. U.S. Government Publishing Office. 1 May 2020<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.federalregister.gov\/documents\/2020\/05\/01\/2020-07419\/21st-century-cures-act-interoperability-information-blocking-and-the-onc-health-it-certification\" target=\"_blank\">https:\/\/www.federalregister.gov\/documents\/2020\/05\/01\/2020-07419\/21st-century-cures-act-interoperability-information-blocking-and-the-onc-health-it-certification<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=21st+Century+Cures+Act%3A+Interoperability%2C+Information+Blocking%2C+and+the+ONC+Health+IT+Certification+Program+-+85+FR+25642&rft.atitle=Federal+Register&rft.date=1+May+2020&rft.pub=U.S.+Government+Publishing+Office&rft_id=https%3A%2F%2Fwww.federalregister.gov%2Fdocuments%2F2020%2F05%2F01%2F2020-07419%2F21st-century-cures-act-interoperability-information-blocking-and-the-onc-health-it-certification&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-28\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-28\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.myesr.link\/Mailings\/esr@work-september-2019\/\" target=\"_blank\">\"ESR reaches out to Clinical Chemistry and Laboratory Medicine\"<\/a>. European Society of Radiology. September 2019<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/www.myesr.link\/Mailings\/esr@work-september-2019\/\" target=\"_blank\">http:\/\/www.myesr.link\/Mailings\/esr@work-september-2019\/<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 26 May 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=ESR+reaches+out+to+Clinical+Chemistry+and+Laboratory+Medicine&rft.atitle=&rft.date=September+2019&rft.pub=European+Society+of+Radiology&rft_id=http%3A%2F%2Fwww.myesr.link%2FMailings%2Fesr%40work-september-2019%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-29\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-29\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Pelsers, Maurice M A L; Hanhoff, Thorsten; Van der Voort, Dani\u00eblle; Arts, Baer; Peters, Maarten; Ponds, Rudolf; Honig, Adriaan; Rudzinski, Wojtek <i>et al.<\/i> (1 September 2004). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/academic.oup.com\/clinchem\/article\/50\/9\/1568\/5640128\" target=\"_blank\">\"Brain- and Heart-Type Fatty Acid-Binding Proteins in the Brain: Tissue Distribution and Clinical Utility\"<\/a> (in en). <i>Clinical Chemistry<\/i> <b>50<\/b> (9): 1568\u20131575. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1373%2Fclinchem.2003.030361\" target=\"_blank\">10.1373\/clinchem.2003.030361<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0009-9147\" target=\"_blank\">0009-9147<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/academic.oup.com\/clinchem\/article\/50\/9\/1568\/5640128\" target=\"_blank\">https:\/\/academic.oup.com\/clinchem\/article\/50\/9\/1568\/5640128<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Brain-+and+Heart-Type+Fatty+Acid-Binding+Proteins+in+the+Brain%3A+Tissue+Distribution+and+Clinical+Utility&rft.jtitle=Clinical+Chemistry&rft.aulast=Pelsers&rft.aufirst=Maurice+M+A+L&rft.au=Pelsers%2C%26%2332%3BMaurice+M+A+L&rft.au=Hanhoff%2C%26%2332%3BThorsten&rft.au=Van+der+Voort%2C%26%2332%3BDani%C3%ABlle&rft.au=Arts%2C%26%2332%3BBaer&rft.au=Peters%2C%26%2332%3BMaarten&rft.au=Ponds%2C%26%2332%3BRudolf&rft.au=Honig%2C%26%2332%3BAdriaan&rft.au=Rudzinski%2C%26%2332%3BWojtek&rft.au=Spener%2C%26%2332%3BFriedrich&rft.date=1+September+2004&rft.volume=50&rft.issue=9&rft.pages=1568%E2%80%931575&rft_id=info:doi\/10.1373%2Fclinchem.2003.030361&rft.issn=0009-9147&rft_id=https%3A%2F%2Facademic.oup.com%2Fclinchem%2Farticle%2F50%2F9%2F1568%2F5640128&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-30\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-30\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Ponti, Giovanni; Maccaferri, Monia; Percesepe, Antonio; Tomasi, Aldo; Ozben, Tomris (2 January 2021). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.tandfonline.com\/doi\/full\/10.1080\/10408363.2020.1803789\" target=\"_blank\">\"Liquid biopsy with cell free DNA: new horizons for prostate cancer\"<\/a> (in en). <i>Critical Reviews in Clinical Laboratory Sciences<\/i> <b>58<\/b> (1): 60\u201376. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1080%2F10408363.2020.1803789\" target=\"_blank\">10.1080\/10408363.2020.1803789<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1040-8363\" target=\"_blank\">1040-8363<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.tandfonline.com\/doi\/full\/10.1080\/10408363.2020.1803789\" target=\"_blank\">https:\/\/www.tandfonline.com\/doi\/full\/10.1080\/10408363.2020.1803789<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Liquid+biopsy+with+cell+free+DNA%3A+new+horizons+for+prostate+cancer&rft.jtitle=Critical+Reviews+in+Clinical+Laboratory+Sciences&rft.aulast=Ponti&rft.aufirst=Giovanni&rft.au=Ponti%2C%26%2332%3BGiovanni&rft.au=Maccaferri%2C%26%2332%3BMonia&rft.au=Percesepe%2C%26%2332%3BAntonio&rft.au=Tomasi%2C%26%2332%3BAldo&rft.au=Ozben%2C%26%2332%3BTomris&rft.date=2+January+2021&rft.volume=58&rft.issue=1&rft.pages=60%E2%80%9376&rft_id=info:doi\/10.1080%2F10408363.2020.1803789&rft.issn=1040-8363&rft_id=https%3A%2F%2Fwww.tandfonline.com%2Fdoi%2Ffull%2F10.1080%2F10408363.2020.1803789&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-31\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-31\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation\" id=\"rdp-ebb-CITEREFGaoZhangLiZeng2019\">Gao, Yanyun; Zhang, Meng; Li, Xiulian; Zeng, Pengjiao; Wang, Peitao; Zhang, Lijuan (2019), <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1877117318301613\" target=\"_blank\">\"Serum PSA levels in patients with prostate cancer and other 33 different types of diseases\"<\/a> (in en), <i>Progress in Molecular Biology and Translational Science<\/i> (Elsevier) <b>162<\/b>: 377\u2013390, <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fbs.pmbts.2018.12.013\" target=\"_blank\">10.1016\/bs.pmbts.2018.12.013<\/a>, <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-0-12-817738-9<span class=\"printonly\">, <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1877117318301613\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1877117318301613<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 2023-04-04<\/span><\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Serum+PSA+levels+in+patients+with+prostate+cancer+and+other+33+different+types+of+diseases&rft.jtitle=Progress+in+Molecular+Biology+and+Translational+Science&rft.aulast=Gao&rft.aufirst=Yanyun&rft.au=Gao%2C%26%2332%3BYanyun&rft.au=Zhang%2C%26%2332%3BMeng&rft.au=Li%2C%26%2332%3BXiulian&rft.au=Zeng%2C%26%2332%3BPengjiao&rft.au=Wang%2C%26%2332%3BPeitao&rft.au=Zhang%2C%26%2332%3BLijuan&rft.date=2019&rft.volume=162&rft.pages=377%E2%80%93390&rft.pub=Elsevier&rft_id=info:doi\/10.1016%2Fbs.pmbts.2018.12.013&rft.isbn=978-0-12-817738-9&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS1877117318301613&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-32\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-32\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Bhalla, Amarpreet; Zulfiqar, Muhammad; Bluth, Martin H. (1 June 2018). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0272271218300088\" target=\"_blank\">\"Molecular Diagnostics in Colorectal Carcinoma\"<\/a> (in en). <i>Clinics in Laboratory Medicine<\/i> <b>38<\/b> (2): 311\u2013342. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.cll.2018.02.008\" target=\"_blank\">10.1016\/j.cll.2018.02.008<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0272271218300088\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0272271218300088<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Molecular+Diagnostics+in+Colorectal+Carcinoma&rft.jtitle=Clinics+in+Laboratory+Medicine&rft.aulast=Bhalla&rft.aufirst=Amarpreet&rft.au=Bhalla%2C%26%2332%3BAmarpreet&rft.au=Zulfiqar%2C%26%2332%3BMuhammad&rft.au=Bluth%2C%26%2332%3BMartin+H.&rft.date=1+June+2018&rft.volume=38&rft.issue=2&rft.pages=311%E2%80%93342&rft_id=info:doi\/10.1016%2Fj.cll.2018.02.008&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS0272271218300088&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-33\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-33\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Delgado, Jose Antonio; Ballesteros, Maria Antonieta; Parera, Mar\u00eda Magdalena; Bau\u00e7a, Josep Miquel (2 November 2021). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/academic.oup.com\/labmed\/article\/52\/6\/550\/6253743\" target=\"_blank\">\"Pancreatic Cancer Insights: Optimization of the Diagnostic Capacity of Tumor Biomarkers\"<\/a> (in en). <i>Laboratory Medicine<\/i> <b>52<\/b> (6): 550\u2013557. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1093%2Flabmed%2Flmab016\" target=\"_blank\">10.1093\/labmed\/lmab016<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0007-5027\" target=\"_blank\">0007-5027<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/academic.oup.com\/labmed\/article\/52\/6\/550\/6253743\" target=\"_blank\">https:\/\/academic.oup.com\/labmed\/article\/52\/6\/550\/6253743<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Pancreatic+Cancer+Insights%3A+Optimization+of+the+Diagnostic+Capacity+of+Tumor+Biomarkers&rft.jtitle=Laboratory+Medicine&rft.aulast=Delgado&rft.aufirst=Jose+Antonio&rft.au=Delgado%2C%26%2332%3BJose+Antonio&rft.au=Ballesteros%2C%26%2332%3BMaria+Antonieta&rft.au=Parera%2C%26%2332%3BMar%C3%ADa+Magdalena&rft.au=Bau%C3%A7a%2C%26%2332%3BJosep+Miquel&rft.date=2+November+2021&rft.volume=52&rft.issue=6&rft.pages=550%E2%80%93557&rft_id=info:doi\/10.1093%2Flabmed%2Flmab016&rft.issn=0007-5027&rft_id=https%3A%2F%2Facademic.oup.com%2Flabmed%2Farticle%2F52%2F6%2F550%2F6253743&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-34\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-34\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation\" id=\"rdp-ebb-CITEREFLiXuZhang2019\">Li, Xiulian; Xu, Yan; Zhang, Lijuan (2019), <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S187711731930016X\" target=\"_blank\">\"Serum CA153 as biomarker for cancer and noncancer diseases\"<\/a> (in en), <i>Progress in Molecular Biology and Translational Science<\/i> (Elsevier) <b>162<\/b>: 265\u2013276, <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fbs.pmbts.2019.01.005\" target=\"_blank\">10.1016\/bs.pmbts.2019.01.005<\/a>, <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-0-12-817738-9<span class=\"printonly\">, <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S187711731930016X\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S187711731930016X<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 2023-04-04<\/span><\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Serum+CA153+as+biomarker+for+cancer+and+noncancer+diseases&rft.jtitle=Progress+in+Molecular+Biology+and+Translational+Science&rft.aulast=Li&rft.aufirst=Xiulian&rft.au=Li%2C%26%2332%3BXiulian&rft.au=Xu%2C%26%2332%3BYan&rft.au=Zhang%2C%26%2332%3BLijuan&rft.date=2019&rft.volume=162&rft.pages=265%E2%80%93276&rft.pub=Elsevier&rft_id=info:doi\/10.1016%2Fbs.pmbts.2019.01.005&rft.isbn=978-0-12-817738-9&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS187711731930016X&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-35\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-35\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Heizmann, Claus W. (1 July 2019). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0167488918304786\" target=\"_blank\">\"S100 proteins: Diagnostic and prognostic biomarkers in laboratory medicine\"<\/a> (in en). <i>Biochimica et Biophysica Acta (BBA) - Molecular Cell Research<\/i> <b>1866<\/b> (7): 1197\u20131206. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.bbamcr.2018.10.015\" target=\"_blank\">10.1016\/j.bbamcr.2018.10.015<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0167488918304786\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0167488918304786<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=S100+proteins%3A+Diagnostic+and+prognostic+biomarkers+in+laboratory+medicine&rft.jtitle=Biochimica+et+Biophysica+Acta+%28BBA%29+-+Molecular+Cell+Research&rft.aulast=Heizmann&rft.aufirst=Claus+W.&rft.au=Heizmann%2C%26%2332%3BClaus+W.&rft.date=1+July+2019&rft.volume=1866&rft.issue=7&rft.pages=1197%E2%80%931206&rft_id=info:doi\/10.1016%2Fj.bbamcr.2018.10.015&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS0167488918304786&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-36\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-36\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Wang, Hongchun; Zhang, Jian; Li, Xiaoli; Zhang, Cheng; Zheng, Shuli; Chi, Yihong; Sheng, Xia; Zhang, Yi (1 November 2020). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/jcla.23465\" target=\"_blank\">\"The utilization pattern of serum tumor markers in lung cancer patients: A population\u2010based retrospective descriptive study\"<\/a> (in en). <i>Journal of Clinical Laboratory Analysis<\/i> <b>34<\/b> (11). <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1002%2Fjcla.23465\" target=\"_blank\">10.1002\/jcla.23465<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0887-8013\" target=\"_blank\">0887-8013<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC7676212\/\" target=\"_blank\">PMC7676212<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/32638440\" target=\"_blank\">32638440<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/jcla.23465\" target=\"_blank\">https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/jcla.23465<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=The+utilization+pattern+of+serum+tumor+markers+in+lung+cancer+patients%3A+A+population%E2%80%90based+retrospective+descriptive+study&rft.jtitle=Journal+of+Clinical+Laboratory+Analysis&rft.aulast=Wang&rft.aufirst=Hongchun&rft.au=Wang%2C%26%2332%3BHongchun&rft.au=Zhang%2C%26%2332%3BJian&rft.au=Li%2C%26%2332%3BXiaoli&rft.au=Zhang%2C%26%2332%3BCheng&rft.au=Zheng%2C%26%2332%3BShuli&rft.au=Chi%2C%26%2332%3BYihong&rft.au=Sheng%2C%26%2332%3BXia&rft.au=Zhang%2C%26%2332%3BYi&rft.date=1+November+2020&rft.volume=34&rft.issue=11&rft_id=info:doi\/10.1002%2Fjcla.23465&rft.issn=0887-8013&rft_id=info:pmc\/PMC7676212&rft_id=info:pmid\/32638440&rft_id=https%3A%2F%2Fonlinelibrary.wiley.com%2Fdoi%2F10.1002%2Fjcla.23465&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-37\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-37\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Milani, Paolo; Palladini, Giovanni; Merlini, Giampaolo (13 July 2016). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.tandfonline.com\/doi\/full\/10.1080\/00365513.2016.1210337\" target=\"_blank\">\"Serum-free light-chain analysis in diagnosis and management of multiple myeloma and related conditions\"<\/a> (in en). <i>Scandinavian Journal of Clinical and Laboratory Investigation<\/i> <b>76<\/b> (sup245): S113\u2013S118. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1080%2F00365513.2016.1210337\" target=\"_blank\">10.1080\/00365513.2016.1210337<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0036-5513\" target=\"_blank\">0036-5513<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.tandfonline.com\/doi\/full\/10.1080\/00365513.2016.1210337\" target=\"_blank\">https:\/\/www.tandfonline.com\/doi\/full\/10.1080\/00365513.2016.1210337<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Serum-free+light-chain+analysis+in+diagnosis+and+management+of+multiple+myeloma+and+related+conditions&rft.jtitle=Scandinavian+Journal+of+Clinical+and+Laboratory+Investigation&rft.aulast=Milani&rft.aufirst=Paolo&rft.au=Milani%2C%26%2332%3BPaolo&rft.au=Palladini%2C%26%2332%3BGiovanni&rft.au=Merlini%2C%26%2332%3BGiampaolo&rft.date=13+July+2016&rft.volume=76&rft.issue=sup245&rft.pages=S113%E2%80%93S118&rft_id=info:doi\/10.1080%2F00365513.2016.1210337&rft.issn=0036-5513&rft_id=https%3A%2F%2Fwww.tandfonline.com%2Fdoi%2Ffull%2F10.1080%2F00365513.2016.1210337&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-38\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-38\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Shi, Min; Xiao, Ruobing; Woda, Bruce A.; Yu, Hongbo (1 March 2014). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/meridian.allenpress.com\/aplm\/article\/138\/3\/410\/132807\/Five-Important-Advances-in-Hematopathology\" target=\"_blank\">\"Five Important Advances in Hematopathology\"<\/a> (in en). <i>Archives of Pathology & Laboratory Medicine<\/i> <b>138<\/b> (3): 410\u2013419. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.5858%2FARPA.2012-0645-RA\" target=\"_blank\">10.5858\/ARPA.2012-0645-RA<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1543-2165\" target=\"_blank\">1543-2165<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/meridian.allenpress.com\/aplm\/article\/138\/3\/410\/132807\/Five-Important-Advances-in-Hematopathology\" target=\"_blank\">http:\/\/meridian.allenpress.com\/aplm\/article\/138\/3\/410\/132807\/Five-Important-Advances-in-Hematopathology<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Five+Important+Advances+in+Hematopathology&rft.jtitle=Archives+of+Pathology+%26+Laboratory+Medicine&rft.aulast=Shi&rft.aufirst=Min&rft.au=Shi%2C%26%2332%3BMin&rft.au=Xiao%2C%26%2332%3BRuobing&rft.au=Woda%2C%26%2332%3BBruce+A.&rft.au=Yu%2C%26%2332%3BHongbo&rft.date=1+March+2014&rft.volume=138&rft.issue=3&rft.pages=410%E2%80%93419&rft_id=info:doi\/10.5858%2FARPA.2012-0645-RA&rft.issn=1543-2165&rft_id=http%3A%2F%2Fmeridian.allenpress.com%2Faplm%2Farticle%2F138%2F3%2F410%2F132807%2FFive-Important-Advances-in-Hematopathology&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-39\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-39\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Jacob, Rachel; Khan, Mahmood (1 December 2018). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.thieme-connect.de\/DOI\/DOI?10.1055\/s-0039-1679104\" target=\"_blank\">\"Cardiac Biomarkers: What Is and What Can Be\"<\/a> (in en). <i>Indian Journal of Cardiovascular Disease in Women WINCARS<\/i> <b>03<\/b> (04): 240\u2013244. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1055%2Fs-0039-1679104\" target=\"_blank\">10.1055\/s-0039-1679104<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2455-7854\" target=\"_blank\">2455-7854<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC6957084\/\" target=\"_blank\">PMC6957084<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/31934672\" target=\"_blank\">31934672<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/www.thieme-connect.de\/DOI\/DOI?10.1055\/s-0039-1679104\" target=\"_blank\">http:\/\/www.thieme-connect.de\/DOI\/DOI?10.1055\/s-0039-1679104<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Cardiac+Biomarkers%3A+What+Is+and+What+Can+Be&rft.jtitle=Indian+Journal+of+Cardiovascular+Disease+in+Women+WINCARS&rft.aulast=Jacob&rft.aufirst=Rachel&rft.au=Jacob%2C%26%2332%3BRachel&rft.au=Khan%2C%26%2332%3BMahmood&rft.date=1+December+2018&rft.volume=03&rft.issue=04&rft.pages=240%E2%80%93244&rft_id=info:doi\/10.1055%2Fs-0039-1679104&rft.issn=2455-7854&rft_id=info:pmc\/PMC6957084&rft_id=info:pmid\/31934672&rft_id=http%3A%2F%2Fwww.thieme-connect.de%2FDOI%2FDOI%3F10.1055%2Fs-0039-1679104&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-40\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-40\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Ferry, Olivia R.; Huang, Yao C.; Masel, Philip J.; Hamilton, Michael; Fong, Kwun M.; Bowman, Rayleen V.; McKenzie, Scott C.; Yang, Ian A. (1 October 2019). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/jtd.amegroups.com\/article\/view\/32611\/22932\" target=\"_blank\">\"Diagnostic approach to chronic dyspnoea in adults\"<\/a>. <i>Journal of Thoracic Disease<\/i> <b>11<\/b> (S17): S2117\u2013S2128. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.21037%2Fjtd.2019.10.53\" target=\"_blank\">10.21037\/jtd.2019.10.53<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC6831921\/\" target=\"_blank\">PMC6831921<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/31737340\" target=\"_blank\">31737340<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/jtd.amegroups.com\/article\/view\/32611\/22932\" target=\"_blank\">http:\/\/jtd.amegroups.com\/article\/view\/32611\/22932<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Diagnostic+approach+to+chronic+dyspnoea+in+adults&rft.jtitle=Journal+of+Thoracic+Disease&rft.aulast=Ferry&rft.aufirst=Olivia+R.&rft.au=Ferry%2C%26%2332%3BOlivia+R.&rft.au=Huang%2C%26%2332%3BYao+C.&rft.au=Masel%2C%26%2332%3BPhilip+J.&rft.au=Hamilton%2C%26%2332%3BMichael&rft.au=Fong%2C%26%2332%3BKwun+M.&rft.au=Bowman%2C%26%2332%3BRayleen+V.&rft.au=McKenzie%2C%26%2332%3BScott+C.&rft.au=Yang%2C%26%2332%3BIan+A.&rft.date=1+October+2019&rft.volume=11&rft.issue=S17&rft.pages=S2117%E2%80%93S2128&rft_id=info:doi\/10.21037%2Fjtd.2019.10.53&rft_id=info:pmc\/PMC6831921&rft_id=info:pmid\/31737340&rft_id=http%3A%2F%2Fjtd.amegroups.com%2Farticle%2Fview%2F32611%2F22932&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-41\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-41\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Dagonnier, Marie; Donnan, Geoffrey A.; Davis, Stephen M.; Dewey, Helen M.; Howells, David W. (5 February 2021). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.frontiersin.org\/articles\/10.3389\/fneur.2021.619721\/full\" target=\"_blank\">\"Acute Stroke Biomarkers: Are We There Yet?\"<\/a>. <i>Frontiers in Neurology<\/i> <b>12<\/b>: 619721. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.3389%2Ffneur.2021.619721\" target=\"_blank\">10.3389\/fneur.2021.619721<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1664-2295\" target=\"_blank\">1664-2295<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC7902038\/\" target=\"_blank\">PMC7902038<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/33633673\" target=\"_blank\">33633673<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.frontiersin.org\/articles\/10.3389\/fneur.2021.619721\/full\" target=\"_blank\">https:\/\/www.frontiersin.org\/articles\/10.3389\/fneur.2021.619721\/full<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Acute+Stroke+Biomarkers%3A+Are+We+There+Yet%3F&rft.jtitle=Frontiers+in+Neurology&rft.aulast=Dagonnier&rft.aufirst=Marie&rft.au=Dagonnier%2C%26%2332%3BMarie&rft.au=Donnan%2C%26%2332%3BGeoffrey+A.&rft.au=Davis%2C%26%2332%3BStephen+M.&rft.au=Dewey%2C%26%2332%3BHelen+M.&rft.au=Howells%2C%26%2332%3BDavid+W.&rft.date=5+February+2021&rft.volume=12&rft.pages=619721&rft_id=info:doi\/10.3389%2Ffneur.2021.619721&rft.issn=1664-2295&rft_id=info:pmc\/PMC7902038&rft_id=info:pmid\/33633673&rft_id=https%3A%2F%2Fwww.frontiersin.org%2Farticles%2F10.3389%2Ffneur.2021.619721%2Ffull&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-42\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-42\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Wall, Emma C.; Chan, Jia Mun; Gil, Eliza; Heyderman, Robert S. (1 June 2021). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/journals.lww.com\/10.1097\/WCO.0000000000000934\" target=\"_blank\">\"Acute bacterial meningitis\"<\/a> (in en). <i>Current Opinion in Neurology<\/i> <b>34<\/b> (3): 386\u2013395. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1097%2FWCO.0000000000000934\" target=\"_blank\">10.1097\/WCO.0000000000000934<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1350-7540\" target=\"_blank\">1350-7540<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC7610733\/\" target=\"_blank\">PMC7610733<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/33767093\" target=\"_blank\">33767093<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/journals.lww.com\/10.1097\/WCO.0000000000000934\" target=\"_blank\">https:\/\/journals.lww.com\/10.1097\/WCO.0000000000000934<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Acute+bacterial+meningitis&rft.jtitle=Current+Opinion+in+Neurology&rft.aulast=Wall&rft.aufirst=Emma+C.&rft.au=Wall%2C%26%2332%3BEmma+C.&rft.au=Chan%2C%26%2332%3BJia+Mun&rft.au=Gil%2C%26%2332%3BEliza&rft.au=Heyderman%2C%26%2332%3BRobert+S.&rft.date=1+June+2021&rft.volume=34&rft.issue=3&rft.pages=386%E2%80%93395&rft_id=info:doi\/10.1097%2FWCO.0000000000000934&rft.issn=1350-7540&rft_id=info:pmc\/PMC7610733&rft_id=info:pmid\/33767093&rft_id=https%3A%2F%2Fjournals.lww.com%2F10.1097%2FWCO.0000000000000934&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-43\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-43\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Goldsmith, Joshua F.; Herskovits, A. Zara (1 September 2020). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S027227122030041X\" target=\"_blank\">\"Cerebrospinal Fluid Testing for Multiple Sclerosis\"<\/a> (in en). <i>Clinics in Laboratory Medicine<\/i> <b>40<\/b> (3): 369\u2013377. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.cll.2020.06.002\" target=\"_blank\">10.1016\/j.cll.2020.06.002<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S027227122030041X\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S027227122030041X<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Cerebrospinal+Fluid+Testing+for+Multiple+Sclerosis&rft.jtitle=Clinics+in+Laboratory+Medicine&rft.aulast=Goldsmith&rft.aufirst=Joshua+F.&rft.au=Goldsmith%2C%26%2332%3BJoshua+F.&rft.au=Herskovits%2C%26%2332%3BA.+Zara&rft.date=1+September+2020&rft.volume=40&rft.issue=3&rft.pages=369%E2%80%93377&rft_id=info:doi\/10.1016%2Fj.cll.2020.06.002&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS027227122030041X&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-44\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-44\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Schuurman, Alex R.; Reijnders, Tom D. Y.; Kullberg, Robert F. J.; Butler, Joe M.; van der Poll, Tom; Wiersinga, W. Joost (1 December 2021). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/icm-experimental.springeropen.com\/articles\/10.1186\/s40635-021-00383-x\" target=\"_blank\">\"Sepsis: deriving biological meaning and clinical applications from high-dimensional data\"<\/a> (in en). <i>Intensive Care Medicine Experimental<\/i> <b>9<\/b> (1): 27. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1186%2Fs40635-021-00383-x\" target=\"_blank\">10.1186\/s40635-021-00383-x<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2197-425X\" target=\"_blank\">2197-425X<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC8105470\/\" target=\"_blank\">PMC8105470<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/33961170\" target=\"_blank\">33961170<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/icm-experimental.springeropen.com\/articles\/10.1186\/s40635-021-00383-x\" target=\"_blank\">https:\/\/icm-experimental.springeropen.com\/articles\/10.1186\/s40635-021-00383-x<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Sepsis%3A+deriving+biological+meaning+and+clinical+applications+from+high-dimensional+data&rft.jtitle=Intensive+Care+Medicine+Experimental&rft.aulast=Schuurman&rft.aufirst=Alex+R.&rft.au=Schuurman%2C%26%2332%3BAlex+R.&rft.au=Reijnders%2C%26%2332%3BTom+D.+Y.&rft.au=Kullberg%2C%26%2332%3BRobert+F.+J.&rft.au=Butler%2C%26%2332%3BJoe+M.&rft.au=van+der+Poll%2C%26%2332%3BTom&rft.au=Wiersinga%2C%26%2332%3BW.+Joost&rft.date=1+December+2021&rft.volume=9&rft.issue=1&rft.pages=27&rft_id=info:doi\/10.1186%2Fs40635-021-00383-x&rft.issn=2197-425X&rft_id=info:pmc\/PMC8105470&rft_id=info:pmid\/33961170&rft_id=https%3A%2F%2Ficm-experimental.springeropen.com%2Farticles%2F10.1186%2Fs40635-021-00383-x&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-45\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-45\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Espinoza, Gianna; Maldonado, Genessis; Narvaez, Jemina; Guerrero, Roberto; Citera, Gustavo; Rios, Carlos (1 March 2021). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.dovepress.com\/beyond-rheumatoid-arthritis-evaluation-what-are-we-missing-peer-reviewed-article-OARRR\" target=\"_blank\">\"Beyond Rheumatoid Arthritis Evaluation: What are We Missing?\"<\/a> (in en). <i>Open Access Rheumatology: Research and Reviews<\/i> <b>Volume 13<\/b>: 45\u201355. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.2147%2FOARRR.S298393\" target=\"_blank\">10.2147\/OARRR.S298393<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1179-156X\" target=\"_blank\">1179-156X<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC8007602\/\" target=\"_blank\">PMC8007602<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/33790666\" target=\"_blank\">33790666<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.dovepress.com\/beyond-rheumatoid-arthritis-evaluation-what-are-we-missing-peer-reviewed-article-OARRR\" target=\"_blank\">https:\/\/www.dovepress.com\/beyond-rheumatoid-arthritis-evaluation-what-are-we-missing-peer-reviewed-article-OARRR<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Beyond+Rheumatoid+Arthritis+Evaluation%3A+What+are+We+Missing%3F&rft.jtitle=Open+Access+Rheumatology%3A+Research+and+Reviews&rft.aulast=Espinoza&rft.aufirst=Gianna&rft.au=Espinoza%2C%26%2332%3BGianna&rft.au=Maldonado%2C%26%2332%3BGenessis&rft.au=Narvaez%2C%26%2332%3BJemina&rft.au=Guerrero%2C%26%2332%3BRoberto&rft.au=Citera%2C%26%2332%3BGustavo&rft.au=Rios%2C%26%2332%3BCarlos&rft.date=1+March+2021&rft.volume=Volume+13&rft.pages=45%E2%80%9355&rft_id=info:doi\/10.2147%2FOARRR.S298393&rft.issn=1179-156X&rft_id=info:pmc\/PMC8007602&rft_id=info:pmid\/33790666&rft_id=https%3A%2F%2Fwww.dovepress.com%2Fbeyond-rheumatoid-arthritis-evaluation-what-are-we-missing-peer-reviewed-article-OARRR&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-46\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-46\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Petrovsk\u00e1, Nora; Prajzlerov\u00e1, Kl\u00e1ra; Vencovsk\u00fd, Ji\u0159\u00ed; \u0160enolt, Ladislav; Filkov\u00e1, M\u00e1ria (1 May 2021). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1568997221000616\" target=\"_blank\">\"The pre-clinical phase of rheumatoid arthritis: From risk factors to prevention of arthritis\"<\/a> (in en). <i>Autoimmunity Reviews<\/i> <b>20<\/b> (5): 102797. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.autrev.2021.102797\" target=\"_blank\">10.1016\/j.autrev.2021.102797<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1568997221000616\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1568997221000616<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=The+pre-clinical+phase+of+rheumatoid+arthritis%3A+From+risk+factors+to+prevention+of+arthritis&rft.jtitle=Autoimmunity+Reviews&rft.aulast=Petrovsk%C3%A1&rft.aufirst=Nora&rft.au=Petrovsk%C3%A1%2C%26%2332%3BNora&rft.au=Prajzlerov%C3%A1%2C%26%2332%3BKl%C3%A1ra&rft.au=Vencovsk%C3%BD%2C%26%2332%3BJi%C5%99%C3%AD&rft.au=%C5%A0enolt%2C%26%2332%3BLadislav&rft.au=Filkov%C3%A1%2C%26%2332%3BM%C3%A1ria&rft.date=1+May+2021&rft.volume=20&rft.issue=5&rft.pages=102797&rft_id=info:doi\/10.1016%2Fj.autrev.2021.102797&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS1568997221000616&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-47\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-47\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Betterle, C.; Presotto, F.; Furmaniak, J. (1 December 2019). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/link.springer.com\/10.1007\/s40618-019-01079-6\" target=\"_blank\">\"Epidemiology, pathogenesis, and diagnosis of Addison\u2019s disease in adults\"<\/a> (in en). <i>Journal of Endocrinological Investigation<\/i> <b>42<\/b> (12): 1407\u20131433. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1007%2Fs40618-019-01079-6\" target=\"_blank\">10.1007\/s40618-019-01079-6<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1720-8386\" target=\"_blank\">1720-8386<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/link.springer.com\/10.1007\/s40618-019-01079-6\" target=\"_blank\">https:\/\/link.springer.com\/10.1007\/s40618-019-01079-6<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Epidemiology%2C+pathogenesis%2C+and+diagnosis+of+Addison%E2%80%99s+disease+in+adults&rft.jtitle=Journal+of+Endocrinological+Investigation&rft.aulast=Betterle&rft.aufirst=C.&rft.au=Betterle%2C%26%2332%3BC.&rft.au=Presotto%2C%26%2332%3BF.&rft.au=Furmaniak%2C%26%2332%3BJ.&rft.date=1+December+2019&rft.volume=42&rft.issue=12&rft.pages=1407%E2%80%931433&rft_id=info:doi\/10.1007%2Fs40618-019-01079-6&rft.issn=1720-8386&rft_id=https%3A%2F%2Flink.springer.com%2F10.1007%2Fs40618-019-01079-6&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-48\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-48\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Stavropoulos, Konstantinos; Imprialos, Konstantinos; Papademetriou, Vasilios; Faselis, Charles; Tsioufis, Kostas; Dimitriadis, Kyriakos; Doumas, Michael (2020). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/pubmed.ncbi.nlm.nih.gov\/30987572\" target=\"_blank\">\"Primary Aldosteronism: Novel Insights\"<\/a>. <i>Current Hypertension Reviews<\/i> <b>16<\/b> (1): 19\u201323. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.2174%2F1573402115666190415155512\" target=\"_blank\">10.2174\/1573402115666190415155512<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1875-6506\" target=\"_blank\">1875-6506<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/30987572\" target=\"_blank\">30987572<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/pubmed.ncbi.nlm.nih.gov\/30987572\" target=\"_blank\">https:\/\/pubmed.ncbi.nlm.nih.gov\/30987572<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Primary+Aldosteronism%3A+Novel+Insights&rft.jtitle=Current+Hypertension+Reviews&rft.aulast=Stavropoulos&rft.aufirst=Konstantinos&rft.au=Stavropoulos%2C%26%2332%3BKonstantinos&rft.au=Imprialos%2C%26%2332%3BKonstantinos&rft.au=Papademetriou%2C%26%2332%3BVasilios&rft.au=Faselis%2C%26%2332%3BCharles&rft.au=Tsioufis%2C%26%2332%3BKostas&rft.au=Dimitriadis%2C%26%2332%3BKyriakos&rft.au=Doumas%2C%26%2332%3BMichael&rft.date=2020&rft.volume=16&rft.issue=1&rft.pages=19%E2%80%9323&rft_id=info:doi\/10.2174%2F1573402115666190415155512&rft.issn=1875-6506&rft_id=info:pmid\/30987572&rft_id=https%3A%2F%2Fpubmed.ncbi.nlm.nih.gov%2F30987572&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-49\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-49\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Honegger, J\u00fcrgen; Buchfelder, Michael; Schlaffer, Sven; Droste, Michael; Werner, Sandy; Strasburger, Christian; St\u00f6rmann, Sylv\u00e8re; Schopohl, Jochen <i>et al.<\/i> (1 September 2015). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/academic.oup.com\/jcem\/article-lookup\/doi\/10.1210\/jc.2015-2146\" target=\"_blank\">\"Treatment of Primary Hypophysitis in Germany\"<\/a> (in en). <i>The Journal of Clinical Endocrinology & Metabolism<\/i> <b>100<\/b> (9): 3460\u20133469. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1210%2Fjc.2015-2146\" target=\"_blank\">10.1210\/jc.2015-2146<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0021-972X\" target=\"_blank\">0021-972X<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/academic.oup.com\/jcem\/article-lookup\/doi\/10.1210\/jc.2015-2146\" target=\"_blank\">https:\/\/academic.oup.com\/jcem\/article-lookup\/doi\/10.1210\/jc.2015-2146<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Treatment+of+Primary+Hypophysitis+in+Germany&rft.jtitle=The+Journal+of+Clinical+Endocrinology+%26+Metabolism&rft.aulast=Honegger&rft.aufirst=J%C3%BCrgen&rft.au=Honegger%2C%26%2332%3BJ%C3%BCrgen&rft.au=Buchfelder%2C%26%2332%3BMichael&rft.au=Schlaffer%2C%26%2332%3BSven&rft.au=Droste%2C%26%2332%3BMichael&rft.au=Werner%2C%26%2332%3BSandy&rft.au=Strasburger%2C%26%2332%3BChristian&rft.au=St%C3%B6rmann%2C%26%2332%3BSylv%C3%A8re&rft.au=Schopohl%2C%26%2332%3BJochen&rft.au=Kacheva%2C%26%2332%3BStella&rft.date=1+September+2015&rft.volume=100&rft.issue=9&rft.pages=3460%E2%80%933469&rft_id=info:doi\/10.1210%2Fjc.2015-2146&rft.issn=0021-972X&rft_id=https%3A%2F%2Facademic.oup.com%2Fjcem%2Farticle-lookup%2Fdoi%2F10.1210%2Fjc.2015-2146&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-50\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-50\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Serbis, Anastasios; Giapros, Vasileios; Kotanidou, Eleni P; Galli-Tsinopoulou, Assimina; Siomou, Ekaterini (15 April 2021). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.wjgnet.com\/1948-9358\/full\/v12\/i4\/344.htm\" target=\"_blank\">\"Diagnosis, treatment and prevention of type 2 diabetes mellitus in children and adolescents\"<\/a>. <i>World Journal of Diabetes<\/i> <b>12<\/b> (4): 344\u2013365. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.4239%2Fwjd.v12.i4.344\" target=\"_blank\">10.4239\/wjd.v12.i4.344<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1948-9358\" target=\"_blank\">1948-9358<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC8040084\/\" target=\"_blank\">PMC8040084<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/33889284\" target=\"_blank\">33889284<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.wjgnet.com\/1948-9358\/full\/v12\/i4\/344.htm\" target=\"_blank\">https:\/\/www.wjgnet.com\/1948-9358\/full\/v12\/i4\/344.htm<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Diagnosis%2C+treatment+and+prevention+of+type+2+diabetes+mellitus+in+children+and+adolescents&rft.jtitle=World+Journal+of+Diabetes&rft.aulast=Serbis&rft.aufirst=Anastasios&rft.au=Serbis%2C%26%2332%3BAnastasios&rft.au=Giapros%2C%26%2332%3BVasileios&rft.au=Kotanidou%2C%26%2332%3BEleni+P&rft.au=Galli-Tsinopoulou%2C%26%2332%3BAssimina&rft.au=Siomou%2C%26%2332%3BEkaterini&rft.date=15+April+2021&rft.volume=12&rft.issue=4&rft.pages=344%E2%80%93365&rft_id=info:doi\/10.4239%2Fwjd.v12.i4.344&rft.issn=1948-9358&rft_id=info:pmc\/PMC8040084&rft_id=info:pmid\/33889284&rft_id=https%3A%2F%2Fwww.wjgnet.com%2F1948-9358%2Ffull%2Fv12%2Fi4%2F344.htm&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-51\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-51\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Supabphol, Suangson; Seubwai, Wunchana; Wongkham, Sopit; Saengboonmee, Charupong (1 September 2021). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/link.springer.com\/10.1007\/s00109-021-02096-w\" target=\"_blank\">\"High glucose: an emerging association between diabetes mellitus and cancer progression\"<\/a> (in en). <i>Journal of Molecular Medicine<\/i> <b>99<\/b> (9): 1175\u20131193. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1007%2Fs00109-021-02096-w\" target=\"_blank\">10.1007\/s00109-021-02096-w<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0946-2716\" target=\"_blank\">0946-2716<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/link.springer.com\/10.1007\/s00109-021-02096-w\" target=\"_blank\">https:\/\/link.springer.com\/10.1007\/s00109-021-02096-w<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=High+glucose%3A+an+emerging+association+between+diabetes+mellitus+and+cancer+progression&rft.jtitle=Journal+of+Molecular+Medicine&rft.aulast=Supabphol&rft.aufirst=Suangson&rft.au=Supabphol%2C%26%2332%3BSuangson&rft.au=Seubwai%2C%26%2332%3BWunchana&rft.au=Wongkham%2C%26%2332%3BSopit&rft.au=Saengboonmee%2C%26%2332%3BCharupong&rft.date=1+September+2021&rft.volume=99&rft.issue=9&rft.pages=1175%E2%80%931193&rft_id=info:doi\/10.1007%2Fs00109-021-02096-w&rft.issn=0946-2716&rft_id=https%3A%2F%2Flink.springer.com%2F10.1007%2Fs00109-021-02096-w&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-52\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-52\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">LeGrys, Vicky A.; Hartmann, Katherine; Walsh, Joan F. (2004). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/pubmed.ncbi.nlm.nih.gov\/15559725\" target=\"_blank\">\"The clinical consequences and diagnosis of hypothyroidism\"<\/a>. <i>Clinical Laboratory Science: Journal of the American Society for Medical Technology<\/i> <b>17<\/b> (4): 203\u2013208. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0894-959X\" target=\"_blank\">0894-959X<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/15559725\" target=\"_blank\">15559725<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/pubmed.ncbi.nlm.nih.gov\/15559725\" target=\"_blank\">https:\/\/pubmed.ncbi.nlm.nih.gov\/15559725<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=The+clinical+consequences+and+diagnosis+of+hypothyroidism&rft.jtitle=Clinical+Laboratory+Science%3A+Journal+of+the+American+Society+for+Medical+Technology&rft.aulast=LeGrys&rft.aufirst=Vicky+A.&rft.au=LeGrys%2C%26%2332%3BVicky+A.&rft.au=Hartmann%2C%26%2332%3BKatherine&rft.au=Walsh%2C%26%2332%3BJoan+F.&rft.date=2004&rft.volume=17&rft.issue=4&rft.pages=203%E2%80%93208&rft.issn=0894-959X&rft_id=info:pmid\/15559725&rft_id=https%3A%2F%2Fpubmed.ncbi.nlm.nih.gov%2F15559725&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-53\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-53\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Pignatelli, Duarte; Carvalho, Berta L.; Palmeiro, Aida; Barros, Alberto; Guerreiro, Susana G.; Macut, Djuro (4 July 2019). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.frontiersin.org\/article\/10.3389\/fendo.2019.00432\/full\" target=\"_blank\">\"The Complexities in Genotyping of Congenital Adrenal Hyperplasia: 21-Hydroxylase Deficiency\"<\/a>. <i>Frontiers in Endocrinology<\/i> <b>10<\/b>: 432. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.3389%2Ffendo.2019.00432\" target=\"_blank\">10.3389\/fendo.2019.00432<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1664-2392\" target=\"_blank\">1664-2392<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC6620563\/\" target=\"_blank\">PMC6620563<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/31333583\" target=\"_blank\">31333583<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.frontiersin.org\/article\/10.3389\/fendo.2019.00432\/full\" target=\"_blank\">https:\/\/www.frontiersin.org\/article\/10.3389\/fendo.2019.00432\/full<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=The+Complexities+in+Genotyping+of+Congenital+Adrenal+Hyperplasia%3A+21-Hydroxylase+Deficiency&rft.jtitle=Frontiers+in+Endocrinology&rft.aulast=Pignatelli&rft.aufirst=Duarte&rft.au=Pignatelli%2C%26%2332%3BDuarte&rft.au=Carvalho%2C%26%2332%3BBerta+L.&rft.au=Palmeiro%2C%26%2332%3BAida&rft.au=Barros%2C%26%2332%3BAlberto&rft.au=Guerreiro%2C%26%2332%3BSusana+G.&rft.au=Macut%2C%26%2332%3BDjuro&rft.date=4+July+2019&rft.volume=10&rft.pages=432&rft_id=info:doi\/10.3389%2Ffendo.2019.00432&rft.issn=1664-2392&rft_id=info:pmc\/PMC6620563&rft_id=info:pmid\/31333583&rft_id=https%3A%2F%2Fwww.frontiersin.org%2Farticle%2F10.3389%2Ffendo.2019.00432%2Ffull&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-54\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-54\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Elster, A (1 April 2002). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0749379701004226\" target=\"_blank\">\"Physician roles in medicine-public health collaboration future directions of the American Medical Association\"<\/a>. <i>American Journal of Preventive Medicine<\/i> <b>22<\/b> (3): 211\u2013213. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2FS0749-3797%2801%2900422-6\" target=\"_blank\">10.1016\/S0749-3797(01)00422-6<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0749379701004226\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0749379701004226<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Physician+roles+in+medicine-public+health+collaboration+future+directions+of+the+American+Medical+Association&rft.jtitle=American+Journal+of+Preventive+Medicine&rft.aulast=Elster&rft.aufirst=A&rft.au=Elster%2C%26%2332%3BA&rft.date=1+April+2002&rft.volume=22&rft.issue=3&rft.pages=211%E2%80%93213&rft_id=info:doi\/10.1016%2FS0749-3797%2801%2900422-6&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS0749379701004226&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-55\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-55\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Emerson, Marc A.; Golightly, Yvonne M.; Aiello, Allison E.; Reeder\u2010Hayes, Katherine E.; Tan, Xianming; Maduekwe, Ugwuji; Johnson\u2010Thompson, Marian; Olshan, Andrew F. <i>et al.<\/i> (15 November 2020). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/cncr.33121\" target=\"_blank\">\"Breast cancer treatment delays by socioeconomic and health care access latent classes in Black and White women\"<\/a> (in en). <i>Cancer<\/i> <b>126<\/b> (22): 4957\u20134966. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1002%2Fcncr.33121\" target=\"_blank\">10.1002\/cncr.33121<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0008-543X\" target=\"_blank\">0008-543X<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC7789230\/\" target=\"_blank\">PMC7789230<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/32954493\" target=\"_blank\">32954493<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/cncr.33121\" target=\"_blank\">https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/cncr.33121<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Breast+cancer+treatment+delays+by+socioeconomic+and+health+care+access+latent+classes+in+Black+and+White+women&rft.jtitle=Cancer&rft.aulast=Emerson&rft.aufirst=Marc+A.&rft.au=Emerson%2C%26%2332%3BMarc+A.&rft.au=Golightly%2C%26%2332%3BYvonne+M.&rft.au=Aiello%2C%26%2332%3BAllison+E.&rft.au=Reeder%E2%80%90Hayes%2C%26%2332%3BKatherine+E.&rft.au=Tan%2C%26%2332%3BXianming&rft.au=Maduekwe%2C%26%2332%3BUgwuji&rft.au=Johnson%E2%80%90Thompson%2C%26%2332%3BMarian&rft.au=Olshan%2C%26%2332%3BAndrew+F.&rft.au=Troester%2C%26%2332%3BMelissa+A.&rft.date=15+November+2020&rft.volume=126&rft.issue=22&rft.pages=4957%E2%80%934966&rft_id=info:doi\/10.1002%2Fcncr.33121&rft.issn=0008-543X&rft_id=info:pmc\/PMC7789230&rft_id=info:pmid\/32954493&rft_id=https%3A%2F%2Fonlinelibrary.wiley.com%2Fdoi%2F10.1002%2Fcncr.33121&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-56\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-56\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Schilling, B. (2011). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.commonwealthfund.org\/publications\/newsletter-article\/federal-government-has-put-billions-promoting-electronic-health\" target=\"_blank\">\"The Federal Government Has Put Billions into Promoting Electronic Health Record Use: How Is It Going?\"<\/a>. <i>The Commonwealth Fund<\/i><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.commonwealthfund.org\/publications\/newsletter-article\/federal-government-has-put-billions-promoting-electronic-health\" target=\"_blank\">https:\/\/www.commonwealthfund.org\/publications\/newsletter-article\/federal-government-has-put-billions-promoting-electronic-health<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 26 August 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=The+Federal+Government+Has+Put+Billions+into+Promoting+Electronic+Health+Record+Use%3A+How+Is+It+Going%3F&rft.atitle=The+Commonwealth+Fund&rft.aulast=Schilling%2C+B.&rft.au=Schilling%2C+B.&rft.date=2011&rft_id=https%3A%2F%2Fwww.commonwealthfund.org%2Fpublications%2Fnewsletter-article%2Ffederal-government-has-put-billions-promoting-electronic-health&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:1-57\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:1_57-0\">57.0<\/a><\/sup> <sup><a href=\"#cite_ref-:1_57-1\">57.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Sherman, Rachel E.; Anderson, Steven A.; Dal Pan, Gerald J.; Gray, Gerry W.; Gross, Thomas; Hunter, Nina L.; LaVange, Lisa; Marinac-Dabic, Danica <i>et al.<\/i> (8 December 2016). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.nejm.org\/doi\/10.1056\/NEJMsb1609216\" target=\"_blank\">\"Real-World Evidence \u2014 What Is It and What Can It Tell Us?\"<\/a> (in en). <i>New England Journal of Medicine<\/i> <b>375<\/b> (23): 2293\u20132297. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1056%2FNEJMsb1609216\" target=\"_blank\">10.1056\/NEJMsb1609216<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0028-4793\" target=\"_blank\">0028-4793<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/www.nejm.org\/doi\/10.1056\/NEJMsb1609216\" target=\"_blank\">http:\/\/www.nejm.org\/doi\/10.1056\/NEJMsb1609216<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Real-World+Evidence+%E2%80%94+What+Is+It+and+What+Can+It+Tell+Us%3F&rft.jtitle=New+England+Journal+of+Medicine&rft.aulast=Sherman&rft.aufirst=Rachel+E.&rft.au=Sherman%2C%26%2332%3BRachel+E.&rft.au=Anderson%2C%26%2332%3BSteven+A.&rft.au=Dal+Pan%2C%26%2332%3BGerald+J.&rft.au=Gray%2C%26%2332%3BGerry+W.&rft.au=Gross%2C%26%2332%3BThomas&rft.au=Hunter%2C%26%2332%3BNina+L.&rft.au=LaVange%2C%26%2332%3BLisa&rft.au=Marinac-Dabic%2C%26%2332%3BDanica&rft.au=Marks%2C%26%2332%3BPeter+W.&rft.date=8+December+2016&rft.volume=375&rft.issue=23&rft.pages=2293%E2%80%932297&rft_id=info:doi\/10.1056%2FNEJMsb1609216&rft.issn=0028-4793&rft_id=http%3A%2F%2Fwww.nejm.org%2Fdoi%2F10.1056%2FNEJMsb1609216&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-58\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-58\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Bate, Emily; Hommes, Juliette; Duvivier, Robbert; Taylor, David C. M. (1 January 2014). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.tandfonline.com\/doi\/full\/10.3109\/0142159X.2014.848269\" target=\"_blank\">\"Problem-based learning (PBL): Getting the most out of your students \u2013 Their roles and responsibilities: AMEE Guide No. 84\"<\/a> (in en). <i>Medical Teacher<\/i> <b>36<\/b> (1): 1\u201312. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.3109%2F0142159X.2014.848269\" target=\"_blank\">10.3109\/0142159X.2014.848269<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0142-159X\" target=\"_blank\">0142-159X<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/www.tandfonline.com\/doi\/full\/10.3109\/0142159X.2014.848269\" target=\"_blank\">http:\/\/www.tandfonline.com\/doi\/full\/10.3109\/0142159X.2014.848269<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Problem-based+learning+%28PBL%29%3A+Getting+the+most+out+of+your+students+%E2%80%93+Their+roles+and+responsibilities%3A+AMEE+Guide+No.+84&rft.jtitle=Medical+Teacher&rft.aulast=Bate&rft.aufirst=Emily&rft.au=Bate%2C%26%2332%3BEmily&rft.au=Hommes%2C%26%2332%3BJuliette&rft.au=Duvivier%2C%26%2332%3BRobbert&rft.au=Taylor%2C%26%2332%3BDavid+C.+M.&rft.date=1+January+2014&rft.volume=36&rft.issue=1&rft.pages=1%E2%80%9312&rft_id=info:doi\/10.3109%2F0142159X.2014.848269&rft.issn=0142-159X&rft_id=http%3A%2F%2Fwww.tandfonline.com%2Fdoi%2Ffull%2F10.3109%2F0142159X.2014.848269&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-59\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-59\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Porter, Michael E.; Lee, Thomas H. (1 January 2021). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/catalyst.nejm.org\/doi\/10.1056\/CAT.20.0237\" target=\"_blank\">\"Integrated Practice Units: A Playbook for Health Care Leaders\"<\/a> (in en). <i>NEJM Catalyst<\/i> <b>2<\/b> (1): CAT.20.0237. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1056%2FCAT.20.0237\" target=\"_blank\">10.1056\/CAT.20.0237<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2642-0007\" target=\"_blank\">2642-0007<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/catalyst.nejm.org\/doi\/10.1056\/CAT.20.0237\" target=\"_blank\">http:\/\/catalyst.nejm.org\/doi\/10.1056\/CAT.20.0237<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Integrated+Practice+Units%3A+A+Playbook+for+Health+Care+Leaders&rft.jtitle=NEJM+Catalyst&rft.aulast=Porter&rft.aufirst=Michael+E.&rft.au=Porter%2C%26%2332%3BMichael+E.&rft.au=Lee%2C%26%2332%3BThomas+H.&rft.date=1+January+2021&rft.volume=2&rft.issue=1&rft.pages=CAT.20.0237&rft_id=info:doi\/10.1056%2FCAT.20.0237&rft.issn=2642-0007&rft_id=http%3A%2F%2Fcatalyst.nejm.org%2Fdoi%2F10.1056%2FCAT.20.0237&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-60\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-60\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Jha, Saurabh; Topol, Eric J. (13 December 2016). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/jama.jamanetwork.com\/article.aspx?doi=10.1001\/jama.2016.17438\" target=\"_blank\">\"Adapting to Artificial Intelligence: Radiologists and Pathologists as Information Specialists\"<\/a> (in en). <i>JAMA<\/i> <b>316<\/b> (22): 2353. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1001%2Fjama.2016.17438\" target=\"_blank\">10.1001\/jama.2016.17438<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0098-7484\" target=\"_blank\">0098-7484<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/jama.jamanetwork.com\/article.aspx?doi=10.1001\/jama.2016.17438\" target=\"_blank\">http:\/\/jama.jamanetwork.com\/article.aspx?doi=10.1001\/jama.2016.17438<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Adapting+to+Artificial+Intelligence%3A+Radiologists+and+Pathologists+as+Information+Specialists&rft.jtitle=JAMA&rft.aulast=Jha&rft.aufirst=Saurabh&rft.au=Jha%2C%26%2332%3BSaurabh&rft.au=Topol%2C%26%2332%3BEric+J.&rft.date=13+December+2016&rft.volume=316&rft.issue=22&rft.pages=2353&rft_id=info:doi\/10.1001%2Fjama.2016.17438&rft.issn=0098-7484&rft_id=http%3A%2F%2Fjama.jamanetwork.com%2Farticle.aspx%3Fdoi%3D10.1001%2Fjama.2016.17438&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-61\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-61\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.massgeneral.org\/pathology\/services\/center-for-integrated-diagnostics\" target=\"_blank\">\"Department of Pathology, Center for Integrated Diagnostics\"<\/a>. Massachusetts General Hospital<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.massgeneral.org\/pathology\/services\/center-for-integrated-diagnostics\" target=\"_blank\">https:\/\/www.massgeneral.org\/pathology\/services\/center-for-integrated-diagnostics<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 15 November 2021<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Department+of+Pathology%2C+Center+for+Integrated+Diagnostics&rft.atitle=&rft.pub=Massachusetts+General+Hospital&rft_id=https%3A%2F%2Fwww.massgeneral.org%2Fpathology%2Fservices%2Fcenter-for-integrated-diagnostics&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-62\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-62\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Eickholt, Lynne (1 January 2020). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/catalyst.nejm.org\/doi\/10.1056\/CAT.19.1086\" target=\"_blank\">\"Why Many Integrated Delivery Systems Have Not Enhanced Consumer Value, and What\u2019s Next\"<\/a> (in en). <i>NEJM Catalyst<\/i> <b>1<\/b> (1): CAT.19.1086. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1056%2FCAT.19.1086\" target=\"_blank\">10.1056\/CAT.19.1086<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2642-0007\" target=\"_blank\">2642-0007<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/catalyst.nejm.org\/doi\/10.1056\/CAT.19.1086\" target=\"_blank\">http:\/\/catalyst.nejm.org\/doi\/10.1056\/CAT.19.1086<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Why+Many+Integrated+Delivery+Systems+Have+Not+Enhanced+Consumer+Value%2C+and+What%E2%80%99s+Next&rft.jtitle=NEJM+Catalyst&rft.aulast=Eickholt&rft.aufirst=Lynne&rft.au=Eickholt%2C%26%2332%3BLynne&rft.date=1+January+2020&rft.volume=1&rft.issue=1&rft.pages=CAT.19.1086&rft_id=info:doi\/10.1056%2FCAT.19.1086&rft.issn=2642-0007&rft_id=http%3A%2F%2Fcatalyst.nejm.org%2Fdoi%2F10.1056%2FCAT.19.1086&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-63\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-63\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Berwick, Donald M. (18 January 2005). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/annals.org\/article.aspx?doi=10.7326\/0003-4819-142-2-200501180-00011\" target=\"_blank\">\"My Right Knee\"<\/a> (in en). <i>Annals of Internal Medicine<\/i> <b>142<\/b> (2): 121-5. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.7326%2F0003-4819-142-2-200501180-00011\" target=\"_blank\">10.7326\/0003-4819-142-2-200501180-00011<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0003-4819\" target=\"_blank\">0003-4819<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/annals.org\/article.aspx?doi=10.7326\/0003-4819-142-2-200501180-00011\" target=\"_blank\">http:\/\/annals.org\/article.aspx?doi=10.7326\/0003-4819-142-2-200501180-00011<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=My+Right+Knee&rft.jtitle=Annals+of+Internal+Medicine&rft.aulast=Berwick&rft.aufirst=Donald+M.&rft.au=Berwick%2C%26%2332%3BDonald+M.&rft.date=18+January+2005&rft.volume=142&rft.issue=2&rft.pages=121-5&rft_id=info:doi\/10.7326%2F0003-4819-142-2-200501180-00011&rft.issn=0003-4819&rft_id=http%3A%2F%2Fannals.org%2Farticle.aspx%3Fdoi%3D10.7326%2F0003-4819-142-2-200501180-00011&rfr_id=info:sid\/en.wikipedia.org:Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<\/ol><\/div>\n<!-- \nNewPP limit report\nCached time: 20230630145828\nCache expiry: 86400\nDynamic content: false\nComplications: []\nCPU time usage: 0.916 seconds\nReal time usage: 1.057 seconds\nPreprocessor visited node count: 63543\/1000000\nPost\u2010expand include size: 577739\/2097152 bytes\nTemplate argument size: 178508\/2097152 bytes\nHighest expansion depth: 23\/40\nExpensive parser function count: 0\/100\nUnstrip recursion depth: 0\/20\nUnstrip post\u2010expand size: 7579\/5000000 bytes\n-->\n<!--\nTransclusion expansion time report (%,ms,calls,template)\n100.00% 925.413 1 -total\n 58.39% 540.383 63 Template:Citation\/core\n 49.32% 456.450 46 Template:Cite_journal\n 10.72% 99.173 62 Template:Date\n 7.58% 70.144 11 Template:Cite_web\n 6.89% 63.766 130 Template:Citation\/identifier\n 4.62% 42.727 1 Template:Infobox_journal_article\n 4.08% 37.748 1 Template:Infobox\n 3.56% 32.964 4 Template:Cite_book\n 3.01% 27.889 2 Template:Citation\n-->\n\n<!-- Saved in parser cache with key limswiki:pcache:idhash:14103-0!canonical and timestamp 20230630145827 and revision id 51770. Serialized with JSON.\n -->\n<\/div><\/div><div class=\"printfooter\">Source: <a rel=\"external_link\" class=\"external\" href=\"https:\/\/www.limswiki.org\/index.php\/Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology\">https:\/\/www.limswiki.org\/index.php\/Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology<\/a><\/div>\n<!-- end content --><div class=\"visualClear\"><\/div><\/div><\/div><div class=\"visualClear\"><\/div><\/div><!-- end of the left (by default at least) column --><div class=\"visualClear\"><\/div><\/div>\n\n\n\n<\/body>","c85ecad158b719016ec41928421b862e_images":["https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/8\/83\/GA_Beauchamp_InsightsImaging2022_14.png","https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/6\/6e\/FIG1_Beauchamp_InsightsImaging2022_14.png","https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/7\/72\/Fig2_Beauchamp_InsightsImaging2022_14.png"],"c85ecad158b719016ec41928421b862e_timestamp":1688138449,"99089d094ae9eb5f9ae5bdabb8d706dc_type":"article","99089d094ae9eb5f9ae5bdabb8d706dc_title":"An overview of data warehouse and data lake in modern enterprise data management (Nambiar and Mundra 2022)","99089d094ae9eb5f9ae5bdabb8d706dc_url":"https:\/\/www.limswiki.org\/index.php\/Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management","99089d094ae9eb5f9ae5bdabb8d706dc_plaintext":"\n\nJournal:An overview of data warehouse and data lake in modern enterprise data managementFrom LIMSWikiJump to navigationJump to searchFull article title\n \nAn overview of data warehouse and data lake in modern enterprise data managementJournal\n \nBig Data and Cognitive ComputingAuthor(s)\n \nNambiar, Athira; Mundra, DivyanshAuthor affiliation(s)\n \nSRM Institute of Science and TechnologyPrimary contact\n \nEmail: athiram at srmist dot edu dot inYear published\n \n2022Volume and issue\n \n6(4)Article #\n \n132DOI\n \n10.3390\/bdcc6040132ISSN\n \n2504-2289Distribution license\n \nCreative Commons Attribution 4.0 InternationalWebsite\n \nhttps:\/\/www.mdpi.com\/2504-2289\/6\/4\/132Download\n \nhttps:\/\/www.mdpi.com\/2504-2289\/6\/4\/132\/pdf (PDF)\n\nContents \n\n1 Abstract \n2 Introduction \n3 Definitions of big data analytics, data warehouse, and data lake \n\n3.1 Big data analytics \n3.2 Data warehouse \n3.3 Data lake \n3.4 The differences between data warehouses and data lakes \n\n3.4.1 A literature review of data warehouses and data lakes \n\n\n\n\n4 Architecture \n\n4.1 Data warehouse architecture \n4.2 Data lake architecture \n\n\n5 Design aspects \n\n5.1 Data warehouse design considerations for business needs \n5.2 Data lake design aspects for enterprise data management \n\n\n6 Tools and utilities \n\n6.1 Popular data warehouse tools and services \n6.2 Popular data lake tools and services \n\n\n7 Challenges \n\n7.1 Challenges in big data analytics \n7.2 Data warehouse implementation challenges \n7.3 Data lake implementation challenges \n\n\n8 Opportunities and future directions \n\n8.1 Data warehouses: Opportunities and future directions \n8.2 Data lakes: Opportunities and future directions \n\n\n9 Conclusions \n10 Abbreviations, acronyms, and initialisms \n11 Acknowledgements \n\n11.1 Author contributions \n11.2 Funding \n11.3 Conflicts of interest \n\n\n12 References \n13 Notes \n\n\n\nAbstract \nData is the lifeblood of any organization. In today\u2019s world, organizations recognize the vital role of data in modern business intelligence systems for making meaningful decisions and staying competitive in the field. Efficient and optimal data analytics provides a competitive edge to its performance and services. Major organizations generate, collect, and process vast amounts of data, falling under the category of \"big data.\" Managing and analyzing the sheer volume and variety of big data is a cumbersome process. At the same time, proper utilization of the vast collection of an organization\u2019s information can generate meaningful insights into business tactics. In this regard, two of the more popular data management systems in the area of big data analytics\u2014the data warehouse and data lake\u2014act as platforms to accumulate the big data generated and used by organizations. Although seemingly similar, both of them differ in terms of their characteristics and applications. \nThis article presents a detailed overview of the roles of data warehouses and data lakes in modern enterprise data management. We detail the definitions, characteristics, and related works for the respective data management frameworks. Furthermore, we explain the architecture and design considerations of the current state of the art. Finally, we provide a perspective on the challenges and promising research directions for the future.\nKeywords: big data, data warehousing, data lake, enterprise data management, OLAP, ETL tools, metadata, cloud computing, internet of things\n\nIntroduction \n\"Big data analytics\" is one of the buzzwords in today\u2019s digital world. It entails examining big data and uncovering any hidden patterns, correlations, etc. available in the data.[1] Big data analytics extracts and analyzes random data sets, forming them into meaningful information. According to statistics, the overall amount of data generated in the world in 2021 was approximately 79 zettabytes, and this is expected to double by 2025.[2] This unprecedented amount of data was the result of a data explosion that occurred, wherein data interactions increased by 5,000 percent since 2010.[3]\nBig data deals with the volume, variety, and velocity of data, while seeking the veracity (insightfulness) and value to data. These are known, in part, as the \"Vs\" of big data.[4] An unprecedented amount of diverse data is acquired, stored, and processed with high data quality for various application domains. These data originate from business transactions, real-time streaming, social media, video analytics, and text mining, creating a huge amount of semi- or unstructured data to be stored in different information silos.[5] The efficient integration and analysis of these multiple data across silos are required to divulge complete insight into the database. This is an open research topic of interest.\nBig data and its related emerging technologies have been changing the way e-commerce and e-services operate and have been opening new frontiers in business analytics and related research.[6] Big data analytics systems play a big role in the modern enterprise management domain, from product distribution to sales and marketing, as well as the analysis of hidden trends, similarities, and other insights, giving companies opportunities to optimize their data to find new opportunities within it.[7] Since organizations with better and more accurate data can make more informed business decisions by looking at market trends and customer preferences, they can gain competitive advantages over others. Hence, organizations invest tremendously in artificial intelligence (AI) and big data technologies to strive toward digital transformation and data-driven decision making, which ultimately leads to advanced business intelligence (BI).[6] As per reports, the worldwide big data analytics and BI software applications markets seem as though they will increase by USD 68 billion and 17.6 billion by 2024\u20132025, respectively.[8]\nBig data repositories exist in many forms, as per the requirements of corporations.[9] An effective data repository needs to unify, regulate, evaluate, and deploy a huge amount of data resources to enhance analytics and query performance. Based on the nature and the application scenario, there are many different types of data repositories outside of traditional relational databases. Two of the more popular data repositories among them are enterprise data warehouses and data lakes.[10][11][12]\nA data warehouse (DW) is a data repository which stores structured, filtered, and processed data that has been treated for a specific purpose, whereas a data lake (DL) is a vast pool of data for which the purpose is not or has not yet been defined.[9] In detail, DWs store large amounts of data collected by different sources, typically using predefined schemas. Typically, a DW is a purpose-built relational database running on specialized hardware either on the premises of an organization or in the cloud.[13] DWs have been used widely for storing enterprise data and fueling BI and analytics applications.[14][15][16]\nData lakes (DLs) have emerged as big data repositories that store raw data and provide a rich list of functionalities with the help of metadata descriptions.[10] Although the DL is also a form of enterprise data storage, it does not inherently include the same analytics features commonly associated with DWs. Instead, they are repositories storing raw data in their original formats and providing a common access interface. From the lake, data may flow downstream to a DW to get processed, packaged, and become ready for consumption. As a relatively new concept, there has been very limited research discussing various aspects of DLs, especially in internet articles or blogs.\nAlthough DWs and DLs share some overlapping features and use cases, there are fundamental differences in the data management philosophies, design characteristics, and ideal use conditions for each of these technologies. In this context, we provide a detailed overview and differences between both the DW and DL data management schemes in this survey paper. Furthermore, we consolidate the concepts and give a detailed analysis of different design aspects, various tools and utilities, etc., along with recent developments that have come into existence.\nThe remainder of this paper is organized as follows. In the next section, the terminology and basic definitions of big data analytics and the data management schemes are analyzed. Furthermore, the related works in the field are also summarized. After this summation, the architectures of both the DW and DL are presented, followed by their key design and practical aspects, presented at length. Afterwards, the various popular tools and services available for enterprise data management are summarized, followed by explanations of the open challenges and promising directions for these technologies. In particular, the pros and cons of various methods are critically discussed, and the observations are presented. Finally, conclusions are drawn from this research effort.\n\n Definitions of big data analytics, data warehouse, and data lake \nThe definitions and fundamental notions of various data management schemes are provided in this section. Furthermore, related works and review papers on this topic are also summarized.\n\nBig data analytics \nWith significant advancements in technology has come the unprecedented usage of computer networks, multimedia, the internet of things (IoT), social media, and cloud computing.[17] As a result, a huge amount of data, known as \u201cbig data,\u201d has been generated. Effective data processing is required to collect, manage, and analyze these data efficiently. The process of big data processing is aimed at data mining (i.e., extracting knowledge from large amounts of data), leveraging data management, machine learning (ML), high-performance computing, statistical charting, pattern recognition, etc. The important characteristics of big data (known as the seven \"Vs\" of big data) are as follows[18]:\n\nVolume, or the available amount of data;\nVelocity, or the speed of data processing;\nVariety, or the different types of big data;\nVolatility, or the variability of the data;\nVeracity, or the accuracy of the data;\nVisualization, or the depiction of big data-generated insights through visual representation; and\nValue, or the benefits organizations derive from the data.\nTypically, there are mainly three kinds of big data processing possible: batch processing, stream processing, and hybrid processing.[19] In batch processing, data stored in the non-volatile memory will be processed, and the probability and temporal characteristics of data conversion processes will be decided by the requirements of the problems. In stream processing, the collected data will be processed without storing them in non-volatile media, and the temporal characteristics of data conversion processes will mainly be determined by the incoming data rate. This is suitable for domains that require low response times. Another kind of big data processing, known as hybrid processing, combines both the batch and stream processing techniques to achieve high accuracy and a low processing time.[20] Some examples of hybrid big data processing are Lambda and Kappa Architecture.[21] Lambda Architecture processes huge quantities of data, enabling batch processing and stream processing methods with a hybrid approach. Kappa Architecture is a simpler alternative to Lambda Architecture, since it leverages the same technology stack to handle both real-time stream processing and historical batch processing. However, it avoids maintaining two different code bases for the batch and speed layers. The major notion is to facilitate real-time data processing using a single stream-processing engine, thus bypassing the multi-layered Lambda Architecture without compromising the standard quality of service.\n\nData warehouse \nThe concept of DWs was introduced in the late 1980s by IBM researchers Barry Devlin and Paul Murphy, with the aim to deliver an architectural model to solve the flow of data to decision support environments.[22] According to the definition by Inmon, \u201ca data warehouse is a subject-oriented, nonvolatile, integrated, time-variant collection of data in support of management decisions.\u201d[23] Formally, a DW is a large data repository wherein data can be stored and integrated from various sources in a well-structured manner and help in the decision-making process via proper data analytics.[24] The process of compiling information into a DW is known as data warehousing.\nIn enterprise data management, data warehousing is referred to as a set of decision-making systems targeted toward empowering the information specialist (leader, administrator, or analyst) to improve decision making and make decisions quicker. Hence, DW systems act as an important tool of BI, being used in enterprise data management by most medium and large organizations.[25][26] The past decade has seen unprecedented development both in the number of products and services offered and in the wide-scale adoption of these advancements by the industry. According to a comprehensive research report by Market Research Future (MRFR) titled \u201cData Warehouse as a Service Market information by Usage, by Deployment, by Application and Organization Size\u2014forecast to 2028,\u201d the market size will reach USD 7.69 billion, growing at a compound annual growth rate of 24.5%, by 2028.[27]\nIn the DW framework, data are periodically extracted from programs that aid in business operations and duplicated onto specialized processing units. They may then be approved, converted, reconstructed, and augmented with input from various options. The developed DW then becomes a primary origin of data for the production, analysis, and presentation of reports via instantaneous reports, e-portals, and digital readouts. It employs \u201conline analytical processing\u201d (OLAP), whose utility and execution needs differ from those of the \u201conline transaction processing\u201d (OLTP) implementations typically backed up by functional databases.[28][29] OLTP programs often computerize the handling of administrative data processes, such as order entry and banking transactions, which are an organization\u2019s necessary activities. DWs, on the other hand, are primarily concerned with decision assistance. As shown in Figure 1a, a DW integrates data from various sources and helps with analysis, data mining, and reporting. A detailed description of a DW\u2019s architecture is presented in the next major section.\n\r\n\n\n\n\n\n\n\n\n\n\nFigure 1. (a) Data warehouse architecture vs. (b) data lake architecture.\n\n\n\nDW advancements have benefited various sectors, including production (for supply shipment and client assistance), business (for profiling of clients and stock governance), monetary administration (for claims investigation, risk assessment, billing examination, and detecting fraud), logistics (for vehicle administration), broadcast communications (in order to analyze calls), utility companies (in order to analyze power use), and medical services.[30] The field of data warehousing has seen immense research and development over the last two decades in various research categories such as DW architecture, design, and evolution.\n\nData lake \nBy the beginning of the twenty-first century, new types of diverse data were emerging in ever-increasing volumes on the internet and at its interface to the enterprise (e.g., web-based business transactions, real-time streaming, sensor data, and social media). With the huge amount of data around, the need to have better solutions for storing and analyzing large amounts of semi-structured and unstructured data to gain relevant information and valuable insight became apparent. Traditional schema-on-write approaches such as the extract, transform, and load (ETL) process are too inefficient for such data management requirements. This gave rise to another popular modern enterprise data management scheme, the DL.[31][32][33]\nDLs are centralized storage repositories that enable users to store raw, unprocessed data in their original format, including unstructured, semi-structured, or structured data, at scale. These help enterprises to make better business decisions via visualizations or dashboards from big data analysis, ML, and real-time analytics. A pictorial representation of a DL is given in Figure 1b, above.\nAccording to Dixon, \u201cwhilst a data warehouse seems to be a bottle of water cleaned and ready for consumption, then 'Data Lake' is considered as a whole lake of data in a more natural state.\u201d[34] Another definition for the DL is provided by King[35], as a mechanism that \u201cstores disparate information while ignoring almost everything.\u201d An explanation of DLs from an architectural viewpoint is given by Alrehamy and Walker[36]: \u201cA data lake uses a flat architecture to store data in its raw format. Each data entity in the lake is associated with a unique identifier and a set of extended metadata, and consumers can use purpose-built schemas to query relevant data, which will result in a smaller set of data that can be analyzed to help answer a consumer\u2019s question.\u201d A DL houses data in its original raw form. The data in DLs can vary drastically in size and structure, and they lack any specific organizational structure. A DL can accommodate either very small or huge amounts of data as required. All of these features provide flexibility and scalability to DLs. At the same time, challenges related to the implementation and data analytics associated with DLs also arise.\nDLs are becoming increasingly popular for organizations to store their data in a centralized manner. A DL may contain unstructured or multi-structured data, where most of them may have unrealized value for the enterprise. This allows organizations to store their data from different sources without any overhead related to the transformation of the data.[31] This also allows ad hoc data analyses to be performed on this data, which can then be used by organizations to drive key insights and data-driven decision making. DLs replace the previous way of organizing and processing data from various sources with a centralized, efficient, and flexible repository that allows organizations to maximize their gains from a data-driven ecosystem. DLs also allow organizations to scale them to their needs. This is achieved by separating storage from the computational part. Complex transformation and preprocessing of data in the case of DWs is eliminated. The upfront financial overhead of data ingestion is also reduced. Once data are collated in the lake or hub, it is available for analysis for the organization.\n\nThe differences between data warehouses and data lakes \nAlthough DWs and DLs are used as two interchangeable terms, they are not the same.[22] One of the major differences between them is the different structures (i.e., processed vs. raw data). A DW stores data in processed and filtered form, whereas a DL stores raw or unprocessed data. Specifically, data are processed and organized into a single schema before being put into the warehouse, whereas raw and unstructured data are fed into a DL. Analysis is performed on the cleansed data in the warehouse. On the contrary, in a DL, data are selected and organized as and when needed.\nAs for storing processed data, a DW is economical. On the contrary, DLs have a comparatively larger capacity than the DW and are ideal for raw and unprocessed data analysis and employing ML. Another key difference is the objective or purpose of use. Typically, processed data that flow into DWs are used for specific purposes, and hence the storage space will not be wasted, whereas the purpose of usage for the DL is not defined and can ideally be used for any purpose. To use processed or filtered data, no specialized expertise is required, as merely familiarization with the presentation of data (e.g., charts, sheets, tables, and presentations) will do. Hence, DWs can be used by any business or individual. On the contrary, it is comparatively difficult to analyze DLs without familiarity with unprocessed data, hence requiring data scientists with appropriate skills or tools to comprehend them for specific business use. Accessibility or ease of use of data repositories is yet another aspect that differentiates DWs and DLs. Since the architecture of a DL has no proper structure, it has flexibility of use. Instead, the structure of a DW makes sure that no foreign particles invade it, and it is very costly to manipulate. This feature makes it very secure, too. A detailed analysis of the differences between DWs and DLs is given in Table 1.\n\n\n\n\n\n\n\nTable 1. Differences between data warehouses and data lakes.\n\n\nParameters\n\nData warehouse\n\nData lake\n\n\nData\n\nDWs focuse only on business processes.\n\nDLs store everything.\n\n\nProcessing\n\nData are highly processed.\n\nData are mainly unprocessed.\n\n\nType of data\n\nThey are mostly in the tabular form and structure.\n\nThey can be unstructured, semi-structured, or structured.\n\n\nTask\n\nDWs are optimized for data retrieval.\n\nDLs share data stewardship\n\n\nAgility\n\nDWs are less agile and have fixed configurations compared with DLs.\n\nDLs are highly agile and can be configured and reconfigured as needed.\n\n\nUsers\n\nDWs are widely used by business professionals and business analysts.\n\nDLs are used by data scientists, data developers, and business analysts.\n\n\nStorage\n\nDW has expensive storage that gives fast response time.\n\nDL has a design that features lower overall costs.\n\n\nSecurity\n\nDW allows better control of the data.\n\nDL allows less control of the data.\n\n\nSchema\n\nDW feartures schema on writing (predefined schemas).\n\nDL features schema on reading (no predefined schemas).\n\n\nData processing\n\nIt's time-consuming to introduce new content.\n\nIt helps with fast ingestion of new data.\n\n\nData granularity\n\nData tends to be at the summary or aggregated level of detail.\n\nData tends to be at a low level of detail or granularity.\n\n\nTools\n\nDWs feature mostly commercial tools.\n\nDLs can use open-source tools such as Hadoop or Map Reduce.\n\n\n\nA literature review of data warehouses and data lakes \nA summary of various research works in the field of DWs and DLs is presented here. Table 2 presents a list of various survey articles on DWs and DLs. Mainly, DW review works address architecture modeling and its comparisons[37][38], the evolution of the DW concept[39], real-time data warehousing and ETL[40], etc. Compared with the DW literature reviews, DL papers are relatively fewer in number. DL review works summarize recent approaches and the architecture of DLs[33][34] as well as the design and implementation aspects.[31] To the best of our knowledge, only one work on comparing DWs and DLs was found in the literature.[12] In contrast to that article, our work provides a comprehensive analysis of both data management schemes by addressing various aspects, such as definitions, architecture, practical design considerations, tools and services, challenges, and opportunities in detail. In addition to the survey papers, we also consolidate various works on DWs and DLs in the reported literature and classify them in Table 3 based on their functions and utility.\n\n\n\n\n\n\n\nTable 2. Summary of existing survey articles on data warehouses and data lakes.\n\n\nTopic\n\nSurvey article\n\nContributions\n\n\nData warehouse\n\nArif and Mujtaba[11]\n\nData warehouse survey\n\n\nData lake vs. data warehouse\n\nEl Aissi et al.[12]\n\nExplores the two architectures of data warehouses and data lakes\n\n\nData warehouse\n\nCodd et al.[29]\n\nData warehouse concepts, multilingualism issues in data warehouse design and solutions\n\n\nData lake\n\nHai et al.[31]\n\nA survey on designing, implementing, and applying data lakes\n\n\nData lake\n\nZagan and Danubianu[32]\n\nRecent approaches and architectures using data lakes\n\n\nData lake\n\nCherradi and El Haddadi[33]\n\nOverview of data lake definitions, architectures, and technologies\n\n\nData warehouse\n\nYang et al.[37]\n\nData warehouse architecture modeling and classifications\n\n\nData warehouse\n\nYessad and Labiod[38]\n\nComparative study on data warehouse architectures\n\n\nData warehouse\n\nOueslati and Akaichi[39]\n\nData warehouse evolution\n\n\nData warehouse\n\nEsmail Ali[40]\n\nReal-time data warehouse and ETL\n\n\nData warehouse and big data\n\nAftab and Siddiqui[41]\n\nA comprehensive survey on big data, big data analytics, augmentation, and big data warehouses\n\n\nData warehouse\n\nAlsqour et al.[42]\n\nArchitectures of data warehouses and their selection\n\n\nData warehouse\n\nRizzi et al.[43]\n\nData warehouse modeling and design\n\n\n\n\n\n\n\n\n\nTable 3. Related works: classification of data warehouse and data lake solutions.\n\n\nSystems or topic\n\nData warehouse\n\nData lake\n\nFunction or work performed\n\nReference\n\n\nOLAP\n\n\u2713\n\n\n\nOnline analytical processing (OLAP)\n\nCodd et al.[29]\n\n\nDWHA\n\n\u2713\n\n\n\nModeling and classification of data warehouses\n\nYang et al.[37]\n\n\nGEMMS\n\n\n\n\u2713\n\nMetadata extraction, metadata modeling\n\nQuix et al.[44]\n\n\nKAYAK\n\n\n\n\u2713\n\nDataset preparation and organization\n\nMaccioni and Torlone[45]\n\n\nDATAMARAN\n\n\n\n\u2713\n\nMetadata extraction\n\nGao et al.[46]\n\n\nGeokettle\n\n\u2713\n\n\n\nData warehouse architecture, design, and testing\n\nAstriani and Trisminingsih[47]\n\n\nGOODS\n\n\n\n\u2713\n\nDataset preparation and organization, metadata enrichment\n\nHalevy et al.[48]\n\n\nVOLAP\n\n\u2713\n\n\n\nOLAP, query processing, and optimization\n\nDehne et al.[49]\n\n\nDimension constraints\n\n\u2713\n\n\n\nMultidimensional data modeling, OLAP, query processing, and optimization\n\nHurtado et al.[50]\n\n\nCLAMS\n\n\n\n\u2713\n\nData quality improvement\n\nFarid et al.[51]\n\n\nJuneau\n\n\n\n\u2713\n\nDataset preparation and organization, discover related data sets, and query-driven data discovery\n\nZhang and Ives[52]\n\n\nJOSIE\n\n\n\n\u2713\n\nDiscover related data sets and query-driven data discovery\n\nZhu et al.[53]\n\n\nCoreDB\n\n\n\n\u2713\n\nMetadata enrichment and query heterogeneous data\n\nBeheshti et al.[54]\n\n\nConstance\n\n\n\n\u2713\n\nUnified interface for query processing and data exploration\n\nHai et al.[55]\n\n\nODS\n\n\u2713\n\n\n\nOperational data store\n\nAhmed et al.[56]\n\n\n\nArchitecture \nIn this section, the architectures of the DW and DL schemes are described in detail. Furthermore, the classification of DW and DL solutions based on function is carried out and summarized as a table.\n\nData warehouse architecture \nThe DW architecture contains historical and commutative data from multiple sources. Basically, there are three kinds of architectures[57]:\n\nSingle-tier architecture: This kind of single-layer model minimizes the amount of data stored. It helps remove data redundancy. However, its disadvantage is the lack of a component that separates analytical and transactional processing. This kind of architecture is not frequently used in practice.\nTwo-tier architecture: This model separates physically available sources and the DW by means of a staging area. Such an architecture makes sure that all data loaded into the warehouse are in an appropriate cleansed format. Nevertheless, this architecture is not expandable nor can it support many end users. Additionally, it has connectivity problems due to network limitations.\nThree-tier architecture: This is the most widely used architecture for DWs.[58][59] It consists of a top, middle, and bottom tier. In the bottom tier, data are cleansed, transformed, and loaded via backend tools. This tier serves as the database of the DW. The middle tier is an OLAP server that presents an abstract view of the database by acting as a mediator between the end user and the database. The top tier, the front-end client layer, consists of the tools and an application programming interface (API) that are used to connect and get data out from the DW (e.g., query tools, reporting tools, managed query tools, analysis tools, and data mining tools).\nThe architecture of a DW is shown in Figure 2. It consists of a central information repository that is surrounded by some key DW components, making the entire environment functional, manageable, and accessible.\n\r\n\n\n\n\n\n\n\n\n\n\nFigure 2. Data warehouse architecture.\n\n\n\nVarious components of the DW (from Figure 2) are now described.\nData warehouse database: The core foundation of the DW environment is its central database. This is implemented using relational database management system (RDBMS) technology.[60] However, there is a limitation to such implementations, since the traditional RDBMS system is optimized for transactional database processing and not for data warehousing. In this regard, the alternative means are (1) the usage of relational databases in parallel, which enables shared memory on various multiprocessor configurations or parallel processors, (2) new index structures to get rid of relational table scanning and improve the speed, and (3) multidimensional databases (MDDBs) used to circumvent the limitations caused by the relational DW models.\nExtract, transform, and load (ETL) tools: All the conversions, summarizations, and changes required to transform data into a unified format in the DW are carried out via ETL tools.[61] This ETL process helps the DW achieve enhanced system performance and BI, timely access to data, and a high return on investment:\n\nExtraction: This involves connecting systems and collecting the data needed for analytical processing.\nTransformation: The extracted data are converted into a standard format.\nLoading: The transformed data are imported into a large DW.\nETL anonymizes data as per regulatory stipulations, thereby anonymizing confidential and sensitive information before loading it into the target data store.[62] ETL eliminates unwanted data in operational databases from loading into DWs. ETL tools carry out amendments to the data arriving from different sources and calculate summaries and derived data. Such ETL tools generate background jobs, Cobol programs, shell scripts, etc. that regularly update the data in the DW. ETL tools also help with maintaining the metadata.\nMetadata: Metadata is the data about the data that define the DW.[63] It deals with some high-level technological concepts and helps with building, maintaining, and managing the DW. Metadata plays an important role in transforming data into knowledge, since it defines the source, usage, values, and features of the DW and how to update and process the data in a DW. This is the most difficult tool to choose due to the lack of a clear standard. Efforts are being made among data warehousing tool vendors to unify a metadata model. One category of metadata known as technical metadata contains information about the warehouse that is used by its designers and administrators, whereas another category called business metadata contains details that enable end users to understand the information stored in the DW.\nQuery tools: Query tools allow users to interact with the DW system and collect information relevant to businesses to make strategic decisions. Such tools can be of different types:\n\nQuery and reporting tools: Such tools help organizations generate regular operational reports and support high-volume batch jobs such as printing and calculating. Some popular reporting tools are Brio, Oracle, Powersoft, and SAS Institute. Similarly, query tools help end users to resolve pitfalls in SQL and database structure by inserting a meta-layer between the users and the database.\nApplication development tools: In addition to the built-in graphical and analytical tools, application development tools are leveraged to satisfy the analytical needs of an organization.\nData mining tools: This tool helps in automating the process of discovering meaningful new correlations and structures by mining large amounts of data.\nOLAP tools: OLAP tools exploit the concepts of a multidimensional database and help analyze the data using complex multidimensional views.[29][64] There are two types of OLAP tools: multidimensional OLAP (MOLAP) and relational OLAP (ROLAP).[65] With MOLAP, a cube is aggregated from the relational data source. Based on the user report request, the MOLAP tool generates a prompt result, since all the data are already pre-aggregated within the cube.[66] In the case of ROLAP, the ROLAP engine acts as a smart SQL generator. It comes with a \u201cdesigner\u201d piece, wherein the administrator specifies the association between the relational tables, attributes, and hierarchy map and the underlying database tables.[67]\nData lake architecture \nThe architecture of a business DL is depicted in Figure 3. Although it is treated as a single repository, it can be distinguished as separate layers in most cases.\n\r\n\n\n\n\n\n\n\n\n\n\nFigure 3. Data lake building blocks.\n\n\n\nVarious components of the DL (from Figure 3) are now described.\nRaw data layer: This layer is also known as the ingestion layer or landing area because it acts as the sink of the DL. The prime goal is to ingest raw data as quickly and as efficiently as possible. No transformations are allowed at this stage. With the help of the archive, it is possible to get back to a point in time with raw data. Overriding (i.e., handling duplicate versions of the same data) is not permitted. End users are not granted access to this layer. These are not ready-to-use data, and they need a lot of knowledge in terms of relevant consumption.\nStandardized data layer: This is optional in most implementations. If one expects fast growth for his or her DL architecture, then this is a good option. The prime objective of the standardized layer is to boost the performance of the data transfer from the raw layer to the curated layer. In the raw layer, data are stored in their native format, whereas in the standardized layer, the appropriate format that fits best for cleansing is selected.\nCleansed layer or curated layer: In this layer, data are transformed into consumable data sets and stored in files or tables. This is one of the most complex parts of the whole DL solution since it requires cleansing, transformation, denormalization, and consolidation of different objects. Furthermore, the data are organized by purpose, type, and file structure. Usually, end users are granted access only to this layer.\nApplication layer: This is also known as the trusted layer, secure layer, or production layer. This is sourced from the cleansed layer and enforced with requisite business logic. In case the applications use ML models on the DL, they are obtained from here. The structure of the data is the same as in the cleansed layer.\nSandbox data layer: This is also another optional layer that is meant for analysts\u2019 and data scientists\u2019 work to carry out experiments and search for patterns or correlations. The sandbox data layer is the proper place to enrich the data with any source from the internet.\nSecurity: While DLs are not exposed to a broad audience, the security aspects are of great importance, especially during the initial phase and architecture. These are not like relational databases, which have an artillery of security mechanisms.\nGovernance: Monitoring and logging operations become crucial at some point while performing analysis.\nMetadata: This is the data about data. Most of the schemas reload additional details of the purpose of data, with descriptions on how they are meant to be exploited.\nStewardship: Based on the scale that is required, either the creation of a separate role or delegation of this responsibility to the users will be carried out, possibly through some metadata solutions.\nMaster data: This is an essential part of serving ready-to-use data. It can be either stored on the DL or referenced while executing ETL processes.\nArchive: DLs keep some archive data that come from data warehousing. Otherwise, performance and storage-related problems may occur.\nOffload: This area helps to offload some time- and resource-consuming ETL processes to a DL in case of relational data warehousing solutions.\nOrchestration and ETL processes: Once the data are pushed from the raw layer through the cleansed layer and to the sandbox and application layers, a tool is required to orchestrate the flow. Either an orchestration tool or some additional resources to execute them are leveraged in this regard.\nMany implementations of a DL are originally based on Apache Hadoop. The Highly Available Object Oriented Data Platform (Hadoop) is a widely popular big data tool especially suitable for batch processing workloads of big data.[68] It uses the Hadoop Distributed File System (HDFS) as its core storage and MapReduce (MR) as the basic computing model. Novel computing models are constantly proposed to cope with the increasing needs for batch processing performance (e.g., Tez, Spark, and Presto).[69][70] The MR model has also been replaced with the directed acyclic graph (DAG) model, which improves computing models\u2019 abstract concurrency. \nThe second phase of DL evolution has happened with the arrival of Lambda Architecture[71][72], owing to the constant changes in data processing capabilities and processing demand. It presents stream computing engines, such as Storm, Spark Streaming, and Flink.[73] In such a framework, batch processing is combined with stream computing to meet the needs of many emerging applications. Yet another advanced phase is seen with Kappa Architecture.[74] The two models of batch processing and stream computing are unified by improving the stream computing concurrency and increasing the time window of streaming data. In this regard, stream computing is used that features an inherent and scalable distributed architecture.\n\nDesign aspects \nThe design aspects and practical implementation constraints are to be studied in detail to develop a suitable data management solution. This section presents the design aspects to be considered in DW- and DL-based enterprise data management.\n\nData warehouse design considerations for business needs \nTo design a successful DW, one should also realize the requirements of an organization and develop a framework for them. There are some key criteria to keep in mind when choosing a DW. The very first design consideration in a DW is the business and user needs. Hence, during the designing phase, the integration of the DW with existing business processes and compatibility checks with long-term strategies have to be ensured. Enterprises have to clearly comprehend the purpose of their DW, any technical requirements, benefits of end users from the system, improved means of reporting for BI, and analytics. In this regard, finding the notion of what information is important to the business is quintessential to the success of the DW. To facilitate this, creating an appropriate data model of the business is a key aspect when designing DWs (e.g., SQL Developer Data Modeler [SDDM]). Furthermore, a data flow diagram can also help in depicting the data flow within the company in diagram format.\nWhile designing a DW, yet another important practical consideration is to leverage a recognized DW modeling standard (e.g., 3NF, star schema (dimensional), and Data Vault).[75] Selecting such a standard architecture and sticking to the same one can augment the efficiency within a DW development approach. Similarly, an agile DW methodology is also an important practical aspect. With proper planning, DW projects can be compartmentalized to smaller pieces capable of delivering faster. This design trick helps to prioritize the DW as a business\u2019s needs change.\nThe choice of storage is also an important consideration. Enterprises can opt for either on-premises architecture or a cloud DW.[13] On-premises architectures require setting up the physical environment, including all the servers necessary to power ETL processes, storage, and analytic operations, whereas third-party cloud implementations can skip this step. However, a few circumstances exist where it still makes sense to consider an on-premises approach. For example, if most of the critical databases are on-premises and are old enough, they will not work well with cloud-based DWs. Furthermore, if the organization has to deal with strict regulatory requirements, which might include no offshore data storage, an on-premises setting might be the better choice. Nevertheless, cloud-based services provide the most flexible data warehousing service in the market in terms of storage and cloud's pay-as-you-go nature.\nThe organization\u2019s ecosystem also plays a key role. Adopting a DW automation tool ensures the efficient usage of IT resources, faster implementation through projects, and better support by enforcing coding standards (e.g., Wherescape, AnalytixDS, Ajilius). The data modeling planning step imparts detailed, reusable documentation of a DW\u2019s implementation. Specifically, it assesses the data structures, investigates how to efficiently represent these sources in the DW, specifies OLAP requirements, etc.\nSelection of the appropriate ETL or extract, load, and transform (ELT) solution is yet another design concern.[40] When businesses use expensive in-house analytics systems, much prep work including transformations can be conducted, as in the ETL scheme. However, ELT is a better approach when the destination is a cloud-based DW. Once data are collocated, the power of a single cloud engine can be leveraged to perform integrations and transformations efficiently. Organizations can transform their raw data at any time according to their use case, rather than a step in the data pipeline.\nSemantic and reporting layers represent another consideration. Based on previously documented data models, an OLAP server is implemented to facilitate the analytical queries of the users and to empower BI systems. In this regard, data engineers should carefully consider time-to-analysis and latency requirements to assess the analytical processing capabilities of the DW. Similarly, while designing the reporting layer, the implementation of reporting interfaces or delivery methods as well as permissible access have to be set by the administrator.\nFinally, ease of scalability should be considered. Understanding current business needs is critical to BI and decision making. This includes how much data the organization currently has and how quickly its needs are likely to grow. Staffing and vendor costs need to be taken into consideration while deciding the scale of growth.\n\nData lake design aspects for enterprise data management \nAt a high level, the concept of a DL seems to be simple. Irrespective of the format, it stores data from multiple sources in one place, leverages big data technologies, and deploys on a commodity infrastructure. However, many a time, reality may fail due to various practical constraints. Hence, it is quite important to consider several key criteria while designing an enterprise DL. Of primary concern is focusing on business objectives rather than technology. By anchoring the business objectives, a DL can prioritize the efforts and outcomes accordingly. For instance, for a particular business objective, there may be some data that are more valuable than others. This kind of comprehension and analysis is the key to an enterprise\u2019s DL success. With such an oriented goal, DLs can start small and then accordingly learn, adapt, and produce accelerated outcomes for a business. In particular, some key factors in this regard are (1) whether it solves an actual business problem, (2) if it imparts new capabilities, and (3) the access or ownership of data, among others.\nScalability and durability are two more major criteria to consider.[76] Scalability enables scaling to any size of data while importing them in real time. This is an essential criterion for a DL since it is a centralized data repository for an entire organization. Durability deals with providing consistent uptime while ensuring no loss or corruption of data.\nAnother key design aspect in a DL is its capability to store unstructured, semi-structured, and structured data, which helps organizations to transfer anything from raw, unprocessed data to fully aggregated analytical outcomes.[77] In particular, the DL has to deliver business-ready data. Practically speaking, data by themselves have no meaning. Although file formats and schemas can parse the data (e.g., JSON and XML), they fail at delivering insight into their meaning. To circumvent such a limitation, a critical component of any DL technical design is the incorporation of a knowledge catalog. Such a catalog helps in finding and understanding information assets. The knowledge catalog\u2019s contents include the semantic meaning of the data, format and ownership of data, and data policies, among other elements.\nSecurity considerations are also of prime importance in a DL in the cloud. The three domains of security are encryption, network-level security, and access control. Network-level security imparts a robust defense strategy by denying inappropriate access at the network level, whereas encryption ensures security at least for those types of data that are not publicly available. Security should be part of DL design from the beginning. Compliance standards that regulate data protection and privacy are incorporated in many industries, such as the Payment Card Industry Data Security Standard (PCI DSS) for financial services and Health Insurance Portability and Accountability Act (HIPAA) for healthcare.[78] Furthermore, two of the biggest regulations regarding consumer privacy\u2014California\u2019s Consumer Privacy Act (CCPA) and the European Union\u2019s General Data Protection Regulation (GDPR)\u2014restrict the ownership, use, and management of personal and private data.\nA DL design must also include metadata storage functionality to help users to search and learn about the data sets in the lake.[79] A DL allows the storage of all data that are independent of the fixed schema. Instead, data are read at the time of processing, should they be parsed and adapted into a schema, only as necessary. This feature saves plenty of time for enterprises.\nArchitecture in motion is another interesting concept (i.e., the architecture will likely include more than one DL and must be adaptable to address changing requirements). For instance, on-premises work with Hadoop could be moved to the cloud or a hybrid platform in the future. By facilitating the innovation of multi-cloud storage, a DL can be easily upgraded to be used across data centers, on premises, and in private clouds. In addition, ML and automation can augment the data flow capabilities of an enterprise\u2019s DL design.\n\nTools and utilities \nIn this section, we categorize and detail the popular DW and DL tools and services.\n\nPopular data warehouse tools and services \nAn enterprise DW is one of the primary components of BI.[14][16] It stores data from one or more heterogeneous sources and then analyzes and extracts insights from them to support decision making. Some of the popular top data warehousing tools are explained.\nAmazon Web Services (AWS) data warehouse tools: AWS is one of the major leaders in data warehousing solutions.[80] AWS has many services, such as AWS Redshift, AWS S3, and Amazon Relational Database Service (ARDS), making it a very cost-effective and highly scalable platform. AWS Redshift is a suitable platform for businesses that require advanced capabilities that exploit high-end tools.[81] It consists of an in-house team that organizes AWS\u2019s extensive menu of services. Amazon Simple Storage Service (AWS S3) is a low-cost storage solution with industry-leading scalability, performance, and security features. ARDS is an AWS cloud data storage service that runs and scales a relational database. It has resizable and cost-effective technology that facilitates an industry-standard relational database and manages all database management activities.\nGoogle data warehouse tools: Google is highly acclaimed for its data management skills along with its dominance as a search engine. Google\u2019s DW tools excel in cutting-edge structured data management and analytics by incorporating machine intelligence.[82] Google BigQuery is a business-level cloud-based data warehousing solution platform specially designed to save time by storing and querying large data sets through using super-fast SQL searches against multi-terabyte data sets in seconds, offering customers real-time data insights. Google Cloud Data Fusion is a cloud ETL solution which is entirely managed and allows data integration at any size with a visual point-and-click interface. Dataflow is another cloud-based data-processing service that can be used to stream data in batches or in real time. Google Data Studio enables turning the data into entirely customizable, easy-to-read reports and dashboards.\nMicrosoft Azure Data Warehouse tools: Microsoft Azure is a recent cloud computing platform that provides infrastructure as a service (IaaS), platform as a service (PaaS), and software as a service (SaaS) as well as 200+ products and cloud services.[83] Azure SQL Database is suitable for data warehousing applications with up to 8 TB of data volume and a large number of active users, facilitating advanced query processing. Azure Synapse Analytics consists of data integration, big data analytics, and enterprise data warehousing capabilities by also integrating ML technologies.\nOracle Autonomous Data Warehouse: Oracle Autonomous Data Warehouse[84] is a cloud-based DW service that manages the complexities associated with DW development, data protection, data application development, etc. The setting, safeguarding, regulating, and backing up of data are all automated using this technology. This cloud computing solution is easy to use, secure, quick to respond, and scalable.\nSnowflake: Snowflake[85] is a cloud-based DW tool offering a quick, easy-to-use, and adaptable DW platform. It has a comprehensive SaaS architecture since it runs entirely in the cloud. This makes data processing easier by permitting users to work with a single language\u2014SQL\u2014for data blending, analysis, and transformations on a variety of data types. Snowflake\u2019s multi-tenant design enables real-time data exchange throughout the enterprise without relocating data.\nIBM Data Warehouse tools: IBM is a preferred choice for large business clients due to its huge install base, vertical data models, various data management solutions, and real-time analytics.[86] IBM DB2 Warehouse is a cloud DW that enables self-scaling data storage and processing and deployment flexibility. Another tool is IBM Datastage, which can take data from a source system, transform it, and feed it into a target system. This enables the users to merge data from several corporate systems using either an on-premises or cloud-based parallel architecture.\n\nPopular data lake tools and services \nA DL stores structured data from relational databases, where semi-structured data, unstructured data, and binary data and can be set up on-premises or in the cloud.[87][88] Some of the most popular DL tools and services are analyzed.\nAzure Data Lake: Azure Data Lake makes it easy for developers and data scientists to store data of any size, shape, and speed and conduct all types of processing and analytics across platforms and languages.[89] It removes the complexities associated with ingesting and storing the data and makes it faster to bring up and execute with batch, streaming, and interactive analytics.[90] Some of the key features of Azure Data Lake include unlimited scale and data durability, on-par performance even with demanding workloads, high security with flexible mechanisms, and cost optimization through independent scaling of storage.\nAWS: AWS claims to provide \u201cthe most secure, scalable, comprehensive, and cost-effective portfolio of services for customers to build their data lake in the cloud.\u201d[91] AWS Lake Formation helps to set up a secure DL that can collect and catalog data from databases and object storage, move the data into the new Amazon Simple Storage Service (S3) DL, and clean and classify the data using ML algorithms. It offers various aspects of scalability, agility, and flexibility that are required by the companies to fuse data and analytics approaches. AWS customers include NETFLIX, Zillow, NASDAQ, Yelp, and iRobot.[92]\nGoogle BigLake: BigLake is a storage engine that unifies DWs and DLs. It removes the need to duplicate or move data, thus making the system efficient and cost-effective. BigLake provides detailed access controls and performance acceleration across BigQuery and multi-cloud DLs, with open formats to ensure a unified, flexible, and cost-effective lakehouse architecture. The top features of BigLake include (1) users being able to enforce consistent access controls across most analytics engines with a single copy of data and (2) unified governance and management at scale. Users can extend BigQuery to multi-cloud DLs and open formats with fine-grained security controls without setting up a new infrastructure.[93]\nCloudera: Cloudera SDX is a DL service for creating safe, secure, and governed DLs with protective rings around the data wherever they stored, from object stores to the HDFS. It provides the capabilities needed for (1) data schema and metadata information, (2) metadata governance and management, (3) data access authorization and authentication, and (4) compliance-ready access auditing.[94]\nSnowflake: Snowflake\u2019s cross-cloud platform breaks down silos and enables a DL strategy. Data scientists, analysts, and developers can seamlessly leverage governed data self-service for a variety of workloads. The key features of Snowflake include (1) all data on one platform that combines structured, semi-structured, and unstructured data of any format across clouds and regions; (2) fast, reliable processing and querying, simplifying the architecture with an elastic engine to power many workloads; and (3) secure collaboration via easy integration of external data without ETL.[95]\n\nChallenges \nThis section addresses some of the key challenges in big data analytics problems. In addition, the implementation challenges encountered in DW and DL paradigms are also critically analyzed.\n\nChallenges in big data analytics \nIn the past few years, big data have been accumulated in every walk of human life, including healthcare, retail, public administration, and research. Web-based applications have to deal with big data frequently, such as internet text and documents (corpus, etc.), social network analysis, prediction markets, and internet search indexing.[96] Although we can clearly observe the potential and current advantages of big data, there are some inherent challenges also present that have to be tackled to achieve the full potential of big data analytics.[97]\nThe first hurdle for big data analytics is the storage mediums and higher I\/O speed.[98] Storage of big data causes a financial overhead which is not affordable or profitable for many enterprises. Furthermore, this also results in slower processes.[99] In decades gone by, analysts made use of hard disk drives for data storage purposes, but this is slower in terms of random I\/O performance compared with sequential I\/O. To overcome this limitation, the concept of solid-state drives (SSDs) and phase change memory were introduced. However, the currently available storage tech simply does not possess the required performance for processing big data and delivering insights in a timely fashion. Companies opt for various modern techniques to handle large data sets, such as compression (reducing the number of bits within the data), data tiering (storing data in several storage tiers), and deduplication (the process of removing duplicates and unwanted data).\nAnther challenge is the lack of proper understanding of big data and the lack of knowledge professionals. Due to insufficient understanding, organizations may fail in big data initiatives. This may be due to the absence of skilled data professionals, the lack of a transparent picture for employees, or improper usage of data repositories, among other reasons. It is highly encouraged to conduct big data workshops and seminars at companies to enable every level of the organization to inculcate a basic understanding of knowledge concepts. Furthermore, companies should invest in recruiting skilled professionals, supplying training programs to the staff, as well as purchasing knowledge analytics solutions powered by advanced AI or ML tools.\nYet another challenge in big data analytics is the confusion with suitable tool selection. For instance, many a time, it is not so clear whether Hadoop or Spark is a better option for data analytics and storage. Sometimes, the wrong selection may result in poor decisions and the selection of inappropriate technology. Hence, money, time, effort, and work hours are wasted. The best solution would be to make use of experienced professionals or data consulting to obtain a recommendation for the tools that can support a company based on its scenario.\nData in a corporation come from various sources, such as customer logs, financial reports, social media platforms, e-mails, and reports created by employees. Integrating data from such a huge spread of sources is another challenging task.[100] This consolidation task, known as data integration, is crucial for BI. Hence, enterprises purchase proper tools for data integration purposes. Talend Data Integration, IBM InfoSphere Xplenty, Informatica PowerCenter, and Microsoft SQL QlikView are some of the popular data integration tools.[101]\nSecurity of huge sets of knowledge, especially ones that involve many confidential details of customers, is one of the inevitable challenges in big data analytics.[102][103] The careless treatment of data repositories may invite malicious hackers, which can cost millions for a stolen record or a knowledge breach. The remedy would be to foster a cybersecurity division of a company to guard their data and to implement various security actions such as data encryption, data segregation, identity and access control, implementation of endpoint security, real-time security monitoring, and using big data security tools (e.g., IBM Guardian).\n\nData warehouse implementation challenges \nImplementation of a DW requires proper planning and execution based on proper methods. Some of the major challenging considerations that arise with data warehousing are design, construction, and implementation.[104][105]\nThe efficiency and working of a DW are dependent on the data that support its operations. With incorrect or redundant data, DW managers cannot accurately measure the exact costs. A key solution is to automate the system to improve the lead data quality and make sure that the sales team receives complete, correct, and consistent lead information. Another major concern in a DW is the quality control of data (i.e., quality and consistency of data).[106] The BI process can be fine-tuned by incorporating flexibility to accept and integrate analytics as well as update the warehouse\u2019s schema to handle evolutions.\nAnother major challenge is differences in naming, domain definitions, and identification numbers from heterogeneous sources. The DW has to be designed in such a way that it can accommodate the addition and attrition of data sources and the evolution of the sources and source data, thus avoiding major redesign. Yet another challenge is customizing the available source data into the data model of the DW because the capabilities of a DW may change over time based on the change in technology.[107] Further, broader skills are required for the administration of DWs in traditional database administration. Hence, managing the DW in a large organization, the design of the management function, and selecting the management team for a database warehouse are some of the important aspects of a DW.\nData security is another critical requirement in DWs, given that business data are extremely sensitive and can be easily obtained.[108] Unfortunately, the typical security paradigm\u2014based on tables, lines, and characteristics\u2014is incompatible with DWs. Following that, the model should be changed to one that is firmly integrated with the applicable model and is focused on the key notions of multidimensional display, such as facts, aspects, and measures. Furthermore, as is frequently advised in computer programming, information security should be considered at all stages of the improvement process, from prerequisite analysis to execution and upkeep. In addition, DW governance is yet another important consideration, which includes approval of the data modeling standards and metadata standards, the design of a data access policy, and a data backup strategy.[109]\n\nData lake implementation challenges \nThe DL is relatively novel technology and has not matured yet. Hence, there are many challenges in its implementation, including many of the same challenges that early DWs confronted.[77][110] The first challenge is the high cost of DLs. They are expensive to implement and maintain. DL platforms that exploit the cloud may be easier to deploy, but they may also come with high fees. Some of the platforms such as Hadoop are open-source and hence free of cost. Nevertheless, the implementation and management may take more time and more expert staff. Management difficulty is another issue.[77] The management of the DL involves various complex tasks, such as ensuring the capacity of the host infrastructure to cope with the growth of the DL and dealing with data redundancy and data security. This puts forth challenges even to skilled engineers. Furthermore, it is required to have more domain experts and engineers with real expertise in setting up and managing DLs. In the current scenario, there is a shortage of both data scientists and data engineers in the field. This lack of skills is yet another challenge.\nAnother aspect for consideration is the long time to value (i.e., it takes years to become full-fledged and to be integrated well with the workflow and analytics tools to impart real value to the enterprise).[111] As mentioned in the case of DWs, in the case of DLs, data security is also a major concern. It requires special security measures to be considered to enforce data governance rules and to secure the data in the DL with the help of cybersecurity specialists and security tools. Another critical challenge is the computation resources and increase in computing power. This is due to the fact that data are growing unprecedentedly faster than computing power. At the same rate, the existing computers are not well equipped to host and manage them at the same rate due to a lack of power. Similarly, open-source data platforms also find many core problems surrounding DLs which are too costly to manage. This also requires massive computing power to overcome such serious skill gaps.\nTo build a better DL, modernization of the way businesses build and manage DLs is required. One key takeaway is to take full advantage of the cloud, as opposed to building cumbersome DLs on a tailor-made infrastructure.[112] It helps to get rid of data silos and to build DLs that are applicable to various use cases, rather than only fitting them to a certain range of needs.\n\nOpportunities and future directions \nBased on our survey, we discuss novel trends in modern enterprise data management and point out some promising directions for future research in this section.\n\nData warehouses: Opportunities and future directions \nThe business management landscape has witnessed a massive change with the emergence of the DW. The advancements in cloud technology, the IoT, and big data analytics have brought effective data solutions to modern DWs.[79][113] With the rapid evolution of technology, many enterprises have migrated their data to the cloud to expand their networks and markets. Cloud DWs help to overcome the huge costs of purchasing, infrastructure, installation, etc.[114] Hence, in the coming years, more sophisticated technology in cloud DWs is envisaged to enhance intense, easy-to-use, and economical data clouds as well. The long-term gains for the adoption of cloud warehousing are mainly data availability and scalability. The flexibility to store a variety of data formats\u2014not just relational\u2014combined with the intrinsic flexibility of cloud-based services enables a very broad distribution of cloud services.\nAnother massive change is in the means of data analytics. In contrast to the older times, wherein data analytics and BI occurred in two different divisions, which delayed the overall efficiency of the system, the modern DW provides an advanced structure for storage and faster data flow, thus making them easily accessible for business users. Such an agility model is powered by data fragmentation, allowing access to and the analysis of data across the enterprise in real time.\nAnother big advancement is found in IoT platforms used for sharing and storing data. This has changed the face of data streaming by enabling users to store and access data across multiple devices. The concept of the IoT is more pertinent to the real world due to the increasing popularity of mobile devices, embedded and ubiquitous communication technologies, cloud computing, and data analytics. In a broader sense, as with the internet, the IoT enables devices to exist in many places and facilitates applications from trivial to the most crucial. Several technologies such as computational intelligence and big data can be incorporated together with the IoT to improve data management and knowledge discovery on a large scale. Much research in this sense has been carried out by Mishra et al.[115]\nIn summary, the future of DWs comprises features that enable the following:\n\nAll data are accessible from a single location;\nThe capability to outsource the task of maintaining that service\u2019s high availability to all customers;\nGovernance based on policies;\nPlatforms with high user experience (UX) discoverability; and\nPlatforms that cater to all customers.\nData lakes: Opportunities and future directions \nOne of the core capabilities of a DL architecture is its ability to quickly and easily ingest multiple types of data (e.g., real-time streaming data from on-premises storage platforms, structured data generated and processed by mainframes and DWs, and unstructured or semi-structured data). The ingestion process makes use of a high degree of parallelism and low latency since it requires interfacing with external data sources with limited bandwidth. Hence, ingestion will not carry out any deep analysis of the downloaded data. However, there are possibilities for applying shallow data sketches on the downloaded contents and their metadata to maintain a basic organization of the ingested data sets.\nIn another phase of DL management (i.e., the data extraction stage), the raw data are transformed into a predetermined data model. Although various studies have been conducted on this topic, there still remains room for improvement. Rather than conducting extraction on one file at a time, one can take advantage of the knowledge from the history of extractions. Similarly, in the cleaning phase of the DL, not much work has not been performed in the literature other than some approaches such as CLAMS.[51] One opportunity in this regard will be to make use of the lake\u2019s wisdom and perform collective data cleaning. In addition, it is important to investigate the possible means of errors in the lake and to get rid of them efficiently to obtain a clean DL.\nThe common methods to retrieve the data from the DL are query-based retrieval (i.e., a user starts a search with a query for data retrieval) and data-based retrieval (i.e., a user navigates a DL as a linkage graph or a hierarchical structure to find data of interest).[77] A new direction may be to incorporate analysis-driven or context-driven approaches (i.e., augmenting a data set with relevant data and some contextual information to facilitate learning tasks).\nAnother direction of research is related to the exploration of ML in DLs. Specifically, many studies are underway focusing on ML application toward data set organization and discovery. The data set discovery task is often associated with finding \u201csimilar\u201d attributes extracted from the data, metadata, etc. which could be further coupled with classification or clustering tasks. Some recent works have leveraged ML techniques, such as the KNN classifier[116] and a logistic regression model for optimizing feature coefficients.[117] More advanced deep learning and similar sophisticated ML techniques are envisaged to augment the data set discovery process in the coming years.\nMetadata management is an important task in a DL, since a DL does not come with descriptive data catalogs.[77][79] Due to the lack of such explicit metadata of data sets, especially during the discovery and cleaning of data, there is a chance for a DL to become a data swamp. Hence, it is quite necessary to extract meaningful metadata from data sources and to support efficient storage and query answering of metadata. In this field of metadata management, there remain more topics to explore further in extracting knowledge from lake data and incorporating them into existing knowledge bases. Yet another key aspect is data versioning, wherein new versions of the already existing files enter into a dynamic DL.[79] Since versioning-related operations can affect all stages of a DL, it is a crucial aspect to address. There are some large-scale data set version control tools, such as DataHub, that provide a Git-like interface to handle version creation, branching, and merging operations. Nevertheless, more research and development may be carried out further to deal with schema evolution.\nAs a final note, there is an emerging data management architecture trend called the \"data lakehouse\" that couples the flexibility of a DL with the data management capabilities of a DW. Specifically, it is considered a unique data storage solution for all data\u2014unstructured, semi-structured, and structured\u2014while providing the data quality and data governance standards of a DW.[118] Such a data lakehouse would be capable of imparting better data governance, reduced data movement and redundancy, efficient use time, etc., even with a simplified schema. This topic of the data lakehouse is envisaged to be an excellent research area of data management in the future.\n\nConclusions \nEnterprises and business organizations exploit a huge volume of data to understand their customers and to make informed business decisions to stay competitive in the field. However, big data come in a variety of formats and types (e.g., structured, semi-structured and unstructured data), making it difficult for businesses to manage and use them effectively. Based on the structure of the data, typically, two types of data storage are utilized in enterprise data management: the DW and DL. Despite being used interchangeably, they are two distinct storage forms with unique characteristics that serve different purposes.\nIn this review, a comparative analysis of DWs and DLs was undertaken by highlighting the key differences between the two data management approaches. In particular, the definitions of the DW and DL, highlighting their characteristics and key differences, were detailed. Furthermore, the architecture and design aspects of both DWs and DLs are clearly discussed. In addition, a detailed overview of the popular DW and DL tools and services was also provided. The key challenges of big data analytics in general, as well as the challenges of implementation of DWs and DLs, were also critically analyzed in this survey. Finally, the opportunities and future research directions were contemplated. We hope that the thorough comparison of existing DWs vs. DLs and the discussion of open research challenges in this survey will motivate the future development of enterprise data management and benefit the research community significantly.\n\n Abbreviations, acronyms, and initialisms \nAI: artificial intelligence\nAPI: application programming interface\nARDS: Amazon Relational Database Service\nAWS: Amazon Web Services\nAWS S3: AWS Simple Storage Service\nBI: business intelligence\nCCPA: California Consumer Privacy Act\nDAG: directed acyclic graph\nDL: data lake\nDW: data warehouse\nELT: extract, load, and transform\nETL: extract, transform, and load\nGDPR: General Data Protection Regulation\nHDFS: Hadoop Distributed File System\nHIPAA: Health Insurance Portability and Accountability Act\nIaaS: infrastructure as a service\nIoT: internet of things\nMDDB: multidimensional databases\nML: machine learning\nMOLAP: multidimensional OLAP\nMR: MapReduce\nMRFR: Market Research Future\nOLAP: online analytical processing\nOLTP: online transaction processing\nPaaS: platform as a service\nPCI DSS: Payment Card Industry Data Security Standard\nRDBMS: relational database management system\nROLAP: relational OLAP\nSaaS: software as a service\nSDDM: SQL Developer Data Modeler\nSSD: solid-state drive\nAcknowledgements \nAuthor contributions \nConceptualization, A.N. and D.M.; methodology, A.N. and D.M.; validation, A.N.; formal analysis, D.M.; investigation, A.N.; data curation, A.N. and D.M.; writing\u2014original draft preparation, A.N. and D.M.; writing\u2014review and editing, A.N. and D.M.; visualization, A.N.; supervision, A.N.; project administration, A.N. All authors have read and agreed to the published version of the manuscript.\n\nFunding \nThis research received no external funding.\n\nConflicts of interest \nThe authors declare no conflict of interest.\n\nReferences \n\n\n\u2191 Tsai, Chun-Wei; Lai, Chin-Feng; Chao, Han-Chieh; Vasilakos, Athanasios V. (1 December 2015). \"Big data analytics: a survey\" (in en). Journal of Big Data 2 (1): 21. doi:10.1186\/s40537-015-0030-3. ISSN 2196-1115. http:\/\/www.journalofbigdata.com\/content\/2\/1\/21 .   \n \n\n\u2191 Statista Research Department (13 June 2022). \"Big data - Statistics & Facts\". Statista. Archived from the original on 03 October 2022. https:\/\/web.archive.org\/web\/20221003013950\/https:\/\/www.statista.com\/topics\/1464\/big-data\/#topicHeader__wrapper . Retrieved 27 October 2022 .   \n \n\n\u2191 Wise, J. (12 October 2022). \"Big Data Statistics 2022: Facts, Market Size & Industry Growth\". Earthweb. Archived from the original on 10 November 2022. https:\/\/web.archive.org\/web\/20221110131001\/https:\/\/earthweb.com\/big-data-statistics\/ .   \n \n\n\u2191 Jain, A. (17 September 2016). \"The 5 V's of big data\". Watson Health Perspectives. IBM. Archived from the original on 31 March 2022. https:\/\/web.archive.org\/web\/20220331120927\/https:\/\/www.ibm.com\/blogs\/watson-health\/the-5-vs-of-big-data\/ . Retrieved 27 October 2022 .   \n \n\n\u2191 Gandomi, Amir; Haider, Murtaza (1 April 2015). \"Beyond the hype: Big data concepts, methods, and analytics\" (in en). International Journal of Information Management 35 (2): 137\u2013144. doi:10.1016\/j.ijinfomgt.2014.10.007. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0268401214001066 .   \n \n\n\u2191 6.0 6.1 Sun, Zhaohao; Zou, Huasheng; Strang, Kenneth (2015), Janssen, Marijn; M\u00e4ntym\u00e4ki, Matti; Hidders, Jan et al.., eds., \"Big Data Analytics as a Service for Business Intelligence\" (in en), Open and Big Data Management and Innovation (Cham: Springer International Publishing) 9373: 200\u2013211, doi:10.1007\/978-3-319-25013-7_16, ISBN 978-3-319-25012-0, http:\/\/link.springer.com\/10.1007\/978-3-319-25013-7_16 . Retrieved 2023-05-02   \n \n\n\u2191 \"Big Data and Analytics Services Global Market Report 2022\". ReportLinker. March 2022. Archived from the original on 09 June 2022. https:\/\/web.archive.org\/web\/20220609081444\/https:\/\/www.reportlinker.com\/p06246484\/Big-Data-and-Analytics-Services-Global-Market-Report.html . Retrieved 27 October 2022 .   \n \n\n\u2191 Vailshery, L.S. (21 February 2022). \"Global BI & analytics software market size 2019-2025\". Statista. https:\/\/www.statista.com\/statistics\/590054\/worldwide-business-analytics-software-vendor-market\/ . Retrieved 27 October 2022 .   \n \n\n\u2191 9.0 9.1 Kumar, S. (24 December 2019). \"What is a Data Repository and What is it Used for?\". Stealthbits Technologies, Inc. Archived from the original on 04 October 2022. https:\/\/web.archive.org\/web\/20221004042118\/https:\/\/stealthbits.com\/blog\/what-is-a-data-repository-and-what-is-it-used-for\/ . Retrieved 27 October 2022 .   \n \n\n\u2191 10.0 10.1 Khine, Pwint Phyu; Wang, Zhao Shun (2018). Eguchi, Kei; Chen, Tong. eds. \"Data lake: a new ideology in big data era\". ITM Web of Conferences 17: 03025. doi:10.1051\/itmconf\/20181703025. ISSN 2271-2097. https:\/\/www.itm-conferences.org\/10.1051\/itmconf\/20181703025 .   \n \n\n\u2191 11.0 11.1 Arif, Muhammad; Mujtaba, Ghulam (31 May 2015). \"A Survey: Data Warehouse Architecture\". International Journal of Hybrid Information Technology 8 (5): 349\u2013356. doi:10.14257\/ijhit.2015.8.5.37. http:\/\/gvpress.com\/journals\/IJHIT\/vol8_no5\/37.pdf .   \n \n\n\u2191 12.0 12.1 12.2 El Aissi, Mohamed El Mehdi; Benjelloun, Sarah; Loukili, Yassine; Lakhrissi, Younes; Boushaki, Abdessamad El; Chougrad, Hiba; Elhaj Ben Ali, Safae (2022), Bennani, Saad; Lakhrissi, Younes; Khaissidi, Ghizlane et al.., eds., \"Data Lake Versus Data Warehouse Architecture: A Comparative Study\" (in en), WITS 2020 (Singapore: Springer Singapore) 745: 201\u2013210, doi:10.1007\/978-981-33-6893-4_19, ISBN 978-981-336-892-7, https:\/\/link.springer.com\/10.1007\/978-981-33-6893-4_19   \n \n\n\u2191 13.0 13.1 Rehman, Khawaja Ubaid ur; Ahmad, Umair; Mahmood, Sajid (30 March 2018). \"A Comparative Analysis of Traditional and Cloud Data Warehouse\". VAWKUM Transactions on Computer Sciences 15 (1): 34. doi:10.21015\/vtcs.v15i1.487. ISSN 2308-8168. https:\/\/vfast.org\/journals\/index.php\/VTCS\/article\/view\/487 .   \n \n\n\u2191 14.0 14.1 Devlin, B. A.; Murphy, P. T. (1988). \"An architecture for a business and information system\". IBM Systems Journal 27 (1): 60\u201380. doi:10.1147\/sj.271.0060. ISSN 0018-8670. http:\/\/ieeexplore.ieee.org\/document\/5387658\/ .   \n \n\n\u2191 Garani, Georgia; Chernov, Andrey; Savvas, Ilias; Butakova, Maria (1 June 2019). \"A Data Warehouse Approach for Business Intelligence\". 2019 IEEE 28th International Conference on Enabling Technologies: Infrastructure for Collaborative Enterprises (WETICE) (Napoli, Italy: IEEE): 70\u201375. doi:10.1109\/WETICE.2019.00022. ISBN 978-1-7281-0676-2. https:\/\/ieeexplore.ieee.org\/document\/8795395\/ .   \n \n\n\u2191 16.0 16.1 Gupta, V.; Singh, J. (2014). \"A Review of Data Warehousing and Business Intelligence in different perspective\" (PDF). International Journal of Computer Science & Information Technologies 5 (6): 8263\u20138. ISSN 0975-9646. https:\/\/www.ijcsit.com\/docs\/Volume%205\/vol5issue06\/ijcsit20140506304.pdf .   \n \n\n\u2191 Sagiroglu, Seref; Sinanc, Duygu (1 May 2013). \"Big data: A review\". 2013 International Conference on Collaboration Technologies and Systems (CTS): 42\u201347. doi:10.1109\/CTS.2013.6567202. https:\/\/ieeexplore.ieee.org\/document\/6567202\/ .   \n \n\n\u2191 Moore, M. (7 April 2016). \"The 7 V\u2019s of Big Data\". Impact.com. https:\/\/impact.com\/marketing-intelligence\/7-vs-big-data\/ . Retrieved 25 September 2022 .   \n \n\n\u2191 Miloslavskaya, Natalia; Tolstoy, Alexander (1 August 2016). \"Application of Big Data, Fast Data, and Data Lake Concepts to Information Security Issues\". 2016 IEEE 4th International Conference on Future Internet of Things and Cloud Workshops (FiCloudW) (Vienna, Austria: IEEE): 148\u2013153. doi:10.1109\/W-FiCloud.2016.41. ISBN 978-1-5090-3946-3. http:\/\/ieeexplore.ieee.org\/document\/7592715\/ .   \n \n\n\u2191 Giebler, Corinna; Stach, Christoph; Schwarz, Holger; Mitschang, Bernhard (2018). \"BRAID - A Hybrid Processing Architecture for Big Data:\". Proceedings of the 7th International Conference on Data Science, Technology and Applications (Porto, Portugal: SCITEPRESS - Science and Technology Publications): 294\u2013301. doi:10.5220\/0006861802940301. ISBN 978-989-758-318-6. http:\/\/www.scitepress.org\/DigitalLibrary\/Link.aspx?doi=10.5220\/0006861802940301 .   \n \n\n\u2191 Lin, Jimmy (2017). \"The Lambda and the Kappa\". IEEE Internet Computing 21 (5): 60\u201366. doi:10.1109\/MIC.2017.3481351. ISSN 1089-7801. http:\/\/ieeexplore.ieee.org\/document\/8039313\/ .   \n \n\n\u2191 22.0 22.1 Devlin, B. (20 April 2020). \"Thirty Years of Data Warehousing \u2013 Part 1\". IRM UK connects. https:\/\/www.irmconnects.com\/thirty-years-of-data-warehousing-part-1\/ . Retrieved 27 October 2022 .   \n \n\n\u2191 Inmon, William H. (2005). Building the data warehouse (4th ed ed.). Indianapolis, Ind: Wiley. ISBN 978-0-7645-9944-6.   \n \n\n\u2191 Chandra, Pravin; Gupta, Manoj K. (1 June 2018). \"Comprehensive survey on data warehousing research\" (in en). International Journal of Information Technology 10 (2): 217\u2013224. doi:10.1007\/s41870-017-0067-y. ISSN 2511-2104. http:\/\/link.springer.com\/10.1007\/s41870-017-0067-y .   \n \n\n\u2191 Sim\u00f5es, D. (October 2010). \"Enterprise data warehouses: A conceptual framework for a successful implementation\" (PDF). Proceedings of the 2010 Canadian Council for Small Business & Entrepreneurship Annual Conference: 1\u201319. https:\/\/www.researchgate.net\/profile\/Dora-Simoes\/publication\/233813118_Enterprise_Data_Warehouses_A_conceptual_framework_for_a_successful_implementation\/links\/09e4150c654d7e5312000000\/Enterprise-Data-Warehouses-A-conceptual-framework-for-a-successful-implementation.pdf .   \n \n\n\u2191 Al-Debei, M.M. (2011). \"Data Warehouse as a Backbone for Business Intelligence: Issues and Challenges\". European Journal of Economics, Finance and Administrative Sciences 33 (2011): 153\u201366. http:\/\/eacademic.ju.edu.jo\/m.aldebei\/Lists\/Published%20Research\/DispForm.aspx?ID=15 .   \n \n\n\u2191 Market Research Future (9 December 2021). \"Data Warehouse as a Service (DWaaS) Market Predicted to Garner USD 7.69 Billion at a CAGR of 24.5% by 2028 - Report by Market Research Future (MRFR)\". yahoo! finance. https:\/\/finance.yahoo.com\/news\/data-warehouse-dwaas-market-predicted-153000649.html . Retrieved 27 October 2022 .   \n \n\n\u2191 Chaudhuri, Surajit; Dayal, Umeshwar (1 March 1997). \"An overview of data warehousing and OLAP technology\" (in en). ACM SIGMOD Record 26 (1): 65\u201374. doi:10.1145\/248603.248616. ISSN 0163-5808. https:\/\/dl.acm.org\/doi\/10.1145\/248603.248616 .   \n \n\n\u2191 29.0 29.1 29.2 29.3 Codd, E.F.; Codd, S.B.; Salley, C.T. (1993). \"Providing OLAP to User-Analysts: An IT Mandate\" (PDF). E. F. Codd & Associates. pp. 1\u201320. http:\/\/www.estgv.ipv.pt\/PaginasPessoais\/jloureiro\/ESI_AID2007_2008\/fichas\/codd.pdf .   \n \n\n\u2191 Gupta, A. (2020). \"The Best Applications of Data Warehousing\". DataChannel Blog. DataChannel Technologies. https:\/\/www.datachannel.co\/blogs\/best-applications-of-data-warehousing . Retrieved 27 October 2022 .   \n \n\n\u2191 31.0 31.1 31.2 31.3 Hai, Rihan; Koutras, Christos; Quix, Christoph; Jarke, Matthias (2021). Data Lakes: A Survey of Functions and Systems. doi:10.48550\/ARXIV.2106.09592. https:\/\/arxiv.org\/abs\/2106.09592 .   \n \n\n\u2191 32.0 32.1 Zagan, Elisabeta; Danubianu, Mirela (1 May 2020). \"Data Lake Approaches: A Survey\". 2020 International Conference on Development and Application Systems (DAS) (Suceava, Romania: IEEE): 189\u2013193. doi:10.1109\/DAS49615.2020.9108912. ISBN 978-1-7281-6870-8. https:\/\/ieeexplore.ieee.org\/document\/9108912\/ .   \n \n\n\u2191 33.0 33.1 33.2 Cherradi, Mohamed; EL Haddadi, Anass (2022), Ben Ahmed, Mohamed; Boudhir, Anouar Abdelhakim; Kara\u0219, \u0130smail Rak\u0131p et al.., eds., \"Data Lakes: A Survey Paper\" (in en), Innovations in Smart Cities Applications Volume 5 (Cham: Springer International Publishing) 393: 823\u2013835, doi:10.1007\/978-3-030-94191-8_66, ISBN 978-3-030-94190-1, https:\/\/link.springer.com\/10.1007\/978-3-030-94191-8_66 . Retrieved 2023-05-02   \n \n\n\u2191 34.0 34.1 Dixon, J. (14 October 2010). \"Pentaho, Hadoop, and Data Lakes\". James Dixon's Blog. https:\/\/jamesdixon.wordpress.com\/2010\/10\/14\/pentaho-hadoop-and-data-lakes\/ . Retrieved 27 October 2022 .   \n \n\n\u2191 King, T. (3 March 2016). \"The Emergence of Data Lake: Pros and Cons\". Solutions Review. https:\/\/solutionsreview.com\/data-integration\/the-emergence-of-data-lake-pros-and-cons\/ . Retrieved 27 October 2022 .   \n \n\n\u2191 Alrehamy, Hassan; Walker, Coral (2015) (in en). Personal Data Lake With Data Gravity Pull. doi:10.13140\/RG.2.1.2817.8641. http:\/\/rgdoi.net\/10.13140\/RG.2.1.2817.8641 .   \n \n\n\u2191 37.0 37.1 37.2 Yang, Qishan; Ge, Mouzhi; Helfert, Markus (2019). \"Analysis of Data Warehouse Architectures: Modeling and Classification:\". Proceedings of the 21st International Conference on Enterprise Information Systems (Heraklion, Crete, Greece: SCITEPRESS - Science and Technology Publications): 604\u2013611. doi:10.5220\/0007728006040611. ISBN 978-989-758-372-8. http:\/\/www.scitepress.org\/DigitalLibrary\/Link.aspx?doi=10.5220\/0007728006040611 .   \n \n\n\u2191 38.0 38.1 Yessad, Lamia; Labiod, Aissa (1 November 2016). \"Comparative study of data warehouses modeling approaches: Inmon, Kimball and Data Vault\". 2016 International Conference on System Reliability and Science (ICSRS) (Paris, France: IEEE): 95\u201399. doi:10.1109\/ICSRS.2016.7815845. ISBN 978-1-5090-3277-8. http:\/\/ieeexplore.ieee.org\/document\/7815845\/ .   \n \n\n\u2191 39.0 39.1 Oueslati, Wided; Akaichi, Jalel (30 November 2010). \"A Survey on Data Warehouse Evolution\". International Journal of Database Management Systems 2 (4): 11\u201324. doi:10.5121\/ijdms.2010.2402. http:\/\/www.airccse.org\/journal\/ijdms\/papers\/1110ijdms02.pdf .   \n \n\n\u2191 40.0 40.1 40.2 Esmail Ali, F.S. (2014). \"A Survey of Real-Time Data Warehouse and ETL\" (PDF). International Scientific Journal of Management Information Systems 9 (3): 3\u20139. https:\/\/www.ef.uns.ac.rs\/mis\/archive-pdf\/2014%20-%20No3\/31_Fahd%20Sabry%20Esmail%20Ali%20v5.pdf .   \n \n\n\u2191 Aftab, Umar; Siddiqui, Ghazanfar Farooq (1 December 2018). \"Big Data Augmentation with Data Warehouse: A Survey\". 2018 IEEE International Conference on Big Data (Big Data) (Seattle, WA, USA: IEEE): 2785\u20132794. doi:10.1109\/BigData.2018.8622206. ISBN 978-1-5386-5035-6. https:\/\/ieeexplore.ieee.org\/document\/8622206\/ .   \n \n\n\u2191 Alsqour, M.; Matouk, K.; Owoc, M.L. (2012). \"A survey of data warehouse architectures \u2014 Preliminary results\". In Polskie Towarzystwo Informatyczne; Institute of Electrical and Electronics Engineers. 2012 Federated Conference on Computer Science and Information Systems (FedCSIS 2012): Wroclaw, Poland, 9 - 12 September 2012 ; [consisting of various conferences, symposia, workshops and special sessions]. Piscataway, NJ: IEEE. pp. 1121\u20136. ISBN 978-83-60810-48-4. https:\/\/ieeexplore.ieee.org\/document\/6354451 .   \n \n\n\u2191 Rizzi, Stefano; Abell\u00f3, Alberto; Lechtenb\u00f6rger, Jens; Trujillo, Juan (10 November 2006). \"Research in data warehouse modeling and design: dead or alive?\" (in en). Proceedings of the 9th ACM international workshop on Data warehousing and OLAP (Arlington Virginia USA: ACM): 3\u201310. doi:10.1145\/1183512.1183515. ISBN 978-1-59593-530-4. https:\/\/dl.acm.org\/doi\/10.1145\/1183512.1183515 .   \n \n\n\u2191 Quix, Christoph; Hai, Rihan; Vatov, Ivan (30 December 2016). \"Metadata Extraction and Management in Data Lakes With GEMMS\". Complex Systems Informatics and Modeling Quarterly (9): 67\u201383. doi:10.7250\/csimq.2016-9.04. https:\/\/csimq-journals.rtu.lv\/article\/view\/csimq.2016-9.04 .   \n \n\n\u2191 Maccioni, Antonio; Torlone, Riccardo (2018), Krogstie, John; Reijers, Hajo A., eds., \"KAYAK: A Framework for Just-in-Time Data Preparation in a Data Lake\", Advanced Information Systems Engineering (Cham: Springer International Publishing) 10816: 474\u2013489, doi:10.1007\/978-3-319-91563-0_29, ISBN 978-3-319-91562-3, http:\/\/link.springer.com\/10.1007\/978-3-319-91563-0_29 . Retrieved 2023-05-02   \n \n\n\u2191 Gao, Yihan; Huang, Silu; Parameswaran, Aditya (27 May 2018). \"Navigating the Data Lake with DATAMARAN: Automatically Extracting Structure from Log Datasets\" (in en). Proceedings of the 2018 International Conference on Management of Data (Houston TX USA: ACM): 943\u2013958. doi:10.1145\/3183713.3183746. ISBN 978-1-4503-4703-7. https:\/\/dl.acm.org\/doi\/10.1145\/3183713.3183746 .   \n \n\n\u2191 Astriani, Winda; Trisminingsih, Rina (2016). \"Extraction, Transformation, and Loading (ETL) Module for Hotspot Spatial Data Warehouse Using Geokettle\" (in en). Procedia Environmental Sciences 33: 626\u2013634. doi:10.1016\/j.proenv.2016.03.117. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1878029616300032 .   \n \n\n\u2191 Halevy, A.V.; Korn, F.; Noy, N.F. et al. (2016). \"Managing Google\u2019s data lake: An overview of the Goods system\". Bulletin of the Technical Committee on Data Engineering 39 (3): 5\u201314. http:\/\/sites.computer.org\/debull\/A16sept\/issue1.htm .   \n \n\n\u2191 Dehne, Frank; Robillard, David; Rau-Chaplin, Andrew; Burke, Neil (1 September 2016). \"VOLAP: A Scalable Distributed System for Real-Time OLAP with High Velocity Data\". 2016 IEEE International Conference on Cluster Computing (CLUSTER) (Taipei, Taiwan: IEEE): 354\u2013363. doi:10.1109\/CLUSTER.2016.29. ISBN 978-1-5090-3653-0. http:\/\/ieeexplore.ieee.org\/document\/7776530\/ .   \n \n\n\u2191 Hurtado, Carlos A.; Gutierrez, Claudio; Mendelzon, Alberto O. (1 September 2005). \"Capturing summarizability with integrity constraints in OLAP\" (in en). ACM Transactions on Database Systems 30 (3): 854\u2013886. doi:10.1145\/1093382.1093388. ISSN 0362-5915. https:\/\/dl.acm.org\/doi\/10.1145\/1093382.1093388 .   \n \n\n\u2191 51.0 51.1 Farid, Mina; Roatis, Alexandra; Ilyas, Ihab F.; Hoffmann, Hella-Franziska; Chu, Xu (26 June 2016). \"CLAMS: Bringing Quality to Data Lakes\" (in en). Proceedings of the 2016 International Conference on Management of Data (San Francisco California USA: ACM): 2089\u20132092. doi:10.1145\/2882903.2899391. ISBN 978-1-4503-3531-7. https:\/\/dl.acm.org\/doi\/10.1145\/2882903.2899391 .   \n \n\n\u2191 Zhang, Yi; Ives, Zachary G. (1 August 2019). \"Juneau: data lake management for Jupyter\" (in en). Proceedings of the VLDB Endowment 12 (12): 1902\u20131905. doi:10.14778\/3352063.3352095. ISSN 2150-8097. https:\/\/dl.acm.org\/doi\/10.14778\/3352063.3352095 .   \n \n\n\u2191 Zhu, Erkang; Deng, Dong; Nargesian, Fatemeh; Miller, Ren\u00e9e J. (25 June 2019). \"JOSIE: Overlap Set Similarity Search for Finding Joinable Tables in Data Lakes\" (in en). Proceedings of the 2019 International Conference on Management of Data (Amsterdam Netherlands: ACM): 847\u2013864. doi:10.1145\/3299869.3300065. ISBN 978-1-4503-5643-5. https:\/\/dl.acm.org\/doi\/10.1145\/3299869.3300065 .   \n \n\n\u2191 Beheshti, Amin; Benatallah, Boualem; Nouri, Reza; Chhieng, Van Munin; Xiong, HuangTao; Zhao, Xu (6 November 2017). \"CoreDB: a Data Lake Service\" (in en). Proceedings of the 2017 ACM on Conference on Information and Knowledge Management (Singapore Singapore: ACM): 2451\u20132454. doi:10.1145\/3132847.3133171. ISBN 978-1-4503-4918-5. https:\/\/dl.acm.org\/doi\/10.1145\/3132847.3133171 .   \n \n\n\u2191 Hai, Rihan; Geisler, Sandra; Quix, Christoph (26 June 2016). \"Constance: An Intelligent Data Lake System\" (in en). Proceedings of the 2016 International Conference on Management of Data (San Francisco California USA: ACM): 2097\u20132100. doi:10.1145\/2882903.2899389. ISBN 978-1-4503-3531-7. https:\/\/dl.acm.org\/doi\/10.1145\/2882903.2899389 .   \n \n\n\u2191 Ahmed, A.S.; Salem, A.M.; Alhabibi, Y.A. (2006). \"Combining the Data Warehouse and Operational Data Store\". Proceedings of the Eighth International Conference on Enterprise Information Systems (Paphos, Cyprus: SciTePress - Science and and Technology Publications): 282\u2013288. doi:10.5220\/0002490802820288. ISBN 978-972-8865-41-2. http:\/\/www.scitepress.org\/DigitalLibrary\/Link.aspx?doi=10.5220\/0002490802820288 .   \n \n\n\u2191 \"Software Architecture: N Tier, 3 Tier, 1 Tier, 2 Tier Architecture\". Appsierra Blog. Appsierra. https:\/\/www.appsierra.com\/blog\/tiers-in-software-architecture . Retrieved 27 October 2022 .   \n \n\n\u2191 Han, S.W. (1997). \"Three-Tier Architecture for Sentinel Applications and Tools: Separating Presentation from Functionality\". University of Florida, Gainsville. https:\/\/ufl-flvc.primo.exlibrisgroup.com\/permalink\/01FALSC_UFL\/6ad6fc\/alma990286760440306597 .   \n \n\n\u2191 \"What is three-tier architecture?\". IBM. https:\/\/www.ibm.com\/topics\/three-tier-architecture . Retrieved 27 October 2022 .   \n \n\n\u2191 Phaneendra, S.V.; Reddy, M. (September 2013). \"Big Data - Solutions for RDBMS Problems - A Survey\" (PDF). International Journal of Advanced Research 2 (9): 3686\u201391. https:\/\/www.ijarcce.com\/upload\/2013\/september\/71-o-V_I_K_R_A_M_-big_data_solution_for_rdbms_problems.pdf .   \n \n\n\u2191 Simitsis, A.; Vassiliadis, P.; Sellis, T. (2005). \"Optimizing ETL Processes in Data Warehouses\". 21st International Conference on Data Engineering (ICDE'05) (Tokyo, Japan: IEEE): 564\u2013575. doi:10.1109\/ICDE.2005.103. ISBN 978-0-7695-2285-2. http:\/\/ieeexplore.ieee.org\/document\/1410172\/ .   \n \n\n\u2191 Prasser, Fabian; Spengler, Helmut; Bild, Raffael; Eicher, Johanna; Kuhn, Klaus A. (1 June 2019). \"Privacy-enhancing ETL-processes for biomedical data\" (in en). International Journal of Medical Informatics 126: 72\u201381. doi:10.1016\/j.ijmedinf.2019.03.006. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1386505618307007 .   \n \n\n\u2191 Rousidis, Dimitris; Garoufallou, Emmanouel; Balatsoukas, Panos; Sicilia, Miguel-Angel (18 December 2014). \"Metadata for Big Data: A preliminary investigation of metadata quality issues in research data repositories\". Information Services & Use 34 (3-4): 279\u2013286. doi:10.3233\/ISU-140746. https:\/\/www.medra.org\/servlet\/aliasResolver?alias=iospress&doi=10.3233\/ISU-140746 .   \n \n\n\u2191 Mailvaganam, H. (2007). \"Introduction to OLAP: Slice, Dice and Drill!\". Data Warehousing Review. Archived from the original on 28 September 2018. https:\/\/web.archive.org\/web\/20180928201202\/http:\/\/dwreview.com\/OLAP\/Introduction_OLAP.html . Retrieved 27 October 2022 .   \n \n\n\u2191 Pendse, N. (6 September 2001). \"What is OLAP?\". DSSResources.com. Business Intelligence Ltd. https:\/\/dssresources.com\/papers\/features\/pendse04072002.htm . Retrieved 27 October 2022 .   \n \n\n\u2191 Xu, Jian; Luo, Yong Qiang; Zhou, Xin Xin (1 June 2013). \"Solution for Data Growth Problem of MOLAP\". Applied Mechanics and Materials 321-324: 2551\u20132556. doi:10.4028\/www.scientific.net\/AMM.321-324.2551. ISSN 1662-7482. https:\/\/www.scientific.net\/AMM.321-324.2551 .   \n \n\n\u2191 Dehne, F.; Eavis, T.; Rau-Chaplin, A. (1 May 2003). \"Parallel multi-dimensional ROLAP indexing\". CCGrid 2003. 3rd IEEE\/ACM International Symposium on Cluster Computing and the Grid, 2003. Proceedings.: 86\u201393. doi:10.1109\/CCGRID.2003.1199356. https:\/\/ieeexplore.ieee.org\/document\/1199356\/ .   \n \n\n\u2191 Shvachko, Konstantin; Kuang, Hairong; Radia, Sanjay; Chansler, Robert (1 May 2010). \"The Hadoop Distributed File System\". 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST): 1\u201310. doi:10.1109\/MSST.2010.5496972. https:\/\/ieeexplore.ieee.org\/document\/5496972\/ .   \n \n\n\u2191 Luo, Zhenxiao; Niu, Lu; Korukanti, Venki; Sun, Yutian; Basmanova, Masha; He, Yi; Wang, Beinan; Agrawal, Devesh et al. (1 May 2022). \"From Batch Processing to Real Time Analytics: Running Presto\u00ae at Scale\". 2022 IEEE 38th International Conference on Data Engineering (ICDE) (Kuala Lumpur, Malaysia: IEEE): 1598\u20131609. doi:10.1109\/ICDE53745.2022.00165. ISBN 978-1-6654-0883-7. https:\/\/ieeexplore.ieee.org\/document\/9835663\/ .   \n \n\n\u2191 Sethi, Raghav; Traverso, Martin; Sundstrom, Dain; Phillips, David; Xie, Wenlei; Sun, Yutian; Yegitbasi, Nezih; Jin, Haozhun et al. (1 April 2019). \"Presto: SQL on Everything\". 2019 IEEE 35th International Conference on Data Engineering (ICDE) (Macao, Macao: IEEE): 1802\u20131813. doi:10.1109\/ICDE.2019.00196. ISBN 978-1-5386-7474-1. https:\/\/ieeexplore.ieee.org\/document\/8731547\/ .   \n \n\n\u2191 Kinley, J. (2013). \"The Lambda architecture: principles for architecting realtime Big Data systems\". Tumblr. Archived from the original on 03 May 2019. https:\/\/web.archive.org\/web\/20190503030514\/http:\/\/jameskinley.tumblr.com\/post\/37398560534\/the-lambda-architecture-principles-for . Retrieved 27 October 2022 .   \n \n\n\u2191 Bertran, P.F. (4 April 2013). \"trident-lambda-splout\". GitHub. https:\/\/github.com\/pereferrera\/trident-lambda-splout . Retrieved 27 October 2022 .   \n \n\n\u2191 Carbone, P.; Ewen, S.; Haridi, S. et al. (December 2015). \"Apache Flink\u2122: Stream and Batch Processing in a Single Engine\". Bulletin of the Technical Committee on Data Engineering 38 (4): 28\u201338. http:\/\/sites.computer.org\/debull\/A15dec\/issue1.htm .   \n \n\n\u2191 Kreps, J. (2 July 2014). \"Questioning the Lambda Architecture\". O'Reilly Radar. O\u2019Reilly Media, Inc. https:\/\/www.oreilly.com\/radar\/questioning-the-lambda-architecture\/ . Retrieved 27 October 2022 .   \n \n\n\u2191 \"Data Vault vs Star Schema vs Third Normal Form: Which Data Model to Use?\". Matillion Blog. Matillion Limited. 24 November 2021. https:\/\/www.matillion.com\/resources\/blog\/data-vault-vs-star-schema-vs-third-normal-form-which-data-model-to-use . Retrieved 27 October 2022 .   \n \n\n\u2191 Patranabish, D. (16 April 2015). \"Data lakes: The new enabler of scalability in cross channel analytics\". The Economic Times CIO. Times Internet Limited. https:\/\/cio.economictimes.indiatimes.com\/tech-talk\/data-lakes-the-new-enabler-of-scalability-in-cross-channel-analytics\/585 . Retrieved 27 October 2022 .   \n \n\n\u2191 77.0 77.1 77.2 77.3 77.4 Nargesian, Fatemeh; Zhu, Erkang; Miller, Ren\u00e9e J.; Pu, Ken Q.; Arocena, Patricia C. (1 August 2019). \"Data lake management: challenges and opportunities\" (in en). Proceedings of the VLDB Endowment 12 (12): 1986\u20131989. doi:10.14778\/3352063.3352116. ISSN 2150-8097. https:\/\/dl.acm.org\/doi\/10.14778\/3352063.3352116 .   \n \n\n\u2191 \"A Brief Look at 4 Major Data Compliance Standards: GDPR, HIPAA, PCI DSS, CCPA\". PentaSecurity Blog. Penta Security Systems, Inc. 6 August 2020. https:\/\/www.pentasecurity.com\/blog\/4-data-compliance-standards-gdpr-hipaa-pci-dss-ccpa\/ . Retrieved 27 October 2022 .   \n \n\n\u2191 79.0 79.1 79.2 79.3 Sawadogo, Pegdwend\u00e9; Darmont, J\u00e9r\u00f4me (1 February 2021). \"On data lake architectures and metadata management\" (in en). Journal of Intelligent Information Systems 56 (1): 97\u2013120. doi:10.1007\/s10844-020-00608-7. ISSN 0925-9902. https:\/\/link.springer.com\/10.1007\/s10844-020-00608-7 .   \n \n\n\u2191 \"Overview of Amazon Web Services\" (PDF). Amazon Web Services. 5 August 2021. https:\/\/d1.awsstatic.com\/whitepapers\/aws-overview.pdf . Retrieved 27 October 2022 .   \n \n\n\u2191 Pandis, Ippokratis (1 July 2021). \"The evolution of Amazon redshift\" (in en). Proceedings of the VLDB Endowment 14 (12): 3162\u20133174. doi:10.14778\/3476311.3476391. ISSN 2150-8097. https:\/\/dl.acm.org\/doi\/10.14778\/3476311.3476391 .   \n \n\n\u2191 \"Data management\". Research Areas. Google Research. https:\/\/research.google\/research-areas\/data-management\/ . Retrieved 25 September 2022 .   \n \n\n\u2191 \"Azure documentation\". Microsoft Learn. Microsoft Corporation. https:\/\/learn.microsoft.com\/en-us\/azure\/?product=popular . Retrieved 27 October 2022 .   \n \n\n\u2191 \"Autonomous Data Warehouse\". Oracle. https:\/\/www.oracle.com\/autonomous-database\/autonomous-data-warehouse\/ . Retrieved 27 October 2022 .   \n \n\n\u2191 Dageville, Benoit; Cruanes, Thierry; Zukowski, Marcin; Antonov, Vadim; Avanes, Artin; Bock, Jon; Claybaugh, Jonathan; Engovatov, Daniel et al. (14 June 2016). \"The Snowflake Elastic Data Warehouse\" (in en). Proceedings of the 2016 International Conference on Management of Data (San Francisco California USA: ACM): 215\u2013226. doi:10.1145\/2882903.2903741. ISBN 978-1-4503-3531-7. https:\/\/dl.acm.org\/doi\/10.1145\/2882903.2903741 .   \n \n\n\u2191 \"Analytics tools and solutions\". IBM. https:\/\/www.ibm.com\/analytics . Retrieved 25 September 2022 .   \n \n\n\u2191 Mathis, Christian (1 November 2017). \"Data Lakes\" (in en). Datenbank-Spektrum 17 (3): 289\u2013293. doi:10.1007\/s13222-017-0272-7. ISSN 1618-2162. http:\/\/link.springer.com\/10.1007\/s13222-017-0272-7 .   \n \n\n\u2191 Zagan, Elisabeta; Danubianu, Mirela (11 June 2021). \"Cloud DATA LAKE: The new trend of data storage\". 2021 3rd International Congress on Human-Computer Interaction, Optimization and Robotic Applications (HORA) (Ankara, Turkey: IEEE): 1\u20134. doi:10.1109\/HORA52670.2021.9461293. ISBN 978-1-6654-4058-5. https:\/\/ieeexplore.ieee.org\/document\/9461293\/ .   \n \n\n\u2191 \"Data Lake\". Microsoft. https:\/\/azure.microsoft.com\/en-in\/solutions\/data-lake\/ . Retrieved 25 September 2022 .   \n \n\n\u2191 Ramakrishnan, Raghu; Sridharan, Baskar; Douceur, John R.; Kasturi, Pavan; Krishnamachari-Sampath, Balaji; Krishnamoorthy, Karthick; Li, Peng; Manu, Mitica et al. (9 May 2017). \"Azure Data Lake Store: A Hyperscale Distributed File Service for Big Data Analytics\" (in en). Proceedings of the 2017 ACM International Conference on Management of Data (Chicago Illinois USA: ACM): 51\u201363. doi:10.1145\/3035918.3056100. ISBN 978-1-4503-4197-4. https:\/\/dl.acm.org\/doi\/10.1145\/3035918.3056100 .   \n \n\n\u2191 \"AWS Lake Formation\". Amazon Web Services. https:\/\/aws.amazon.com\/lake-formation\/?whats-new-cards.sort-by=item.additionalFields.postDateTime&whats-new-cards.sort-order=desc . Retrieved 25 September 2022 .   \n \n\n\u2191 \"What is a data lake?\". Amazon Web Services. https:\/\/aws.amazon.com\/big-data\/datalakes-and-analytics\/what-is-a-data-lake\/ . Retrieved 25 September 2022 .   \n \n\n\u2191 \"BigLake\". Google Cloud. https:\/\/cloud.google.com\/biglake . Retrieved 25 September 2022 .   \n \n\n\u2191 \"Cloudera SDX Data Lake Service\". Cloudera. https:\/\/www.cloudera.com\/products\/sdx\/data-lake-service.html . Retrieved 25 September 2022 .   \n \n\n\u2191 \"Snowflake for Data Lakes\". Snowflake, Inc. https:\/\/www.snowflake.com\/en\/data-cloud\/workloads\/data-lake\/ . Retrieved 25 September 2022 .   \n \n\n\u2191 Elgendy, Nada; Elragal, Ahmed (2014), Perner, Petra, ed., \"Big Data Analytics: A Literature Review Paper\", Advances in Data Mining. Applications and Theoretical Aspects (Cham: Springer International Publishing) 8557: 214\u2013227, doi:10.1007\/978-3-319-08976-8_16, ISBN 978-3-319-08975-1, http:\/\/link.springer.com\/10.1007\/978-3-319-08976-8_16 . Retrieved 2023-05-03   \n \n\n\u2191 Jin, Xiaolong; Wah, Benjamin W.; Cheng, Xueqi; Wang, Yuanzhuo (1 June 2015). \"Significance and Challenges of Big Data Research\" (in en). Big Data Research 2 (2): 59\u201364. doi:10.1016\/j.bdr.2015.01.006. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2214579615000076 .   \n \n\n\u2191 Agrawal, Rajeev; Nyamful, Christopher (15 March 2016). \"Challenges of big data storage and management\". Global Journal of Information Technology 6 (1). doi:10.18844\/gjit.v6i1.383. ISSN 2301-2617. https:\/\/un-pub.eu\/ojs\/index.php\/gjit\/article\/view\/383 .   \n \n\n\u2191 Padgavankar, M.H.; Gupta, S.R. (2014). \"Big Data Storage and Challenge\". Big Data Storage and Challenges 5 (2): 2218-2223. ISSN 0975-9646. https:\/\/www.csd.uoc.gr\/~hy108\/downloads\/bigdata.pdf .   \n \n\n\u2191 Kadadi, Anirudh; Agrawal, Rajeev; Nyamful, Christopher; Atiq, Rahman (1 October 2014). \"Challenges of data integration and interoperability in big data\". 2014 IEEE International Conference on Big Data (Big Data) (Washington, DC, USA: IEEE): 38\u201340. doi:10.1109\/BigData.2014.7004486. ISBN 978-1-4799-5666-1. http:\/\/ieeexplore.ieee.org\/document\/7004486\/ .   \n \n\n\u2191 \"Best Data Integration Tools\". PeerSpot. PeerSpot Ltd. October 2022. https:\/\/www.peerspot.com\/categories\/data-integration-tools . Retrieved 27 October 2022 .   \n \n\n\u2191 Toshniwal, R.; Dastidar, K.G.; Nath, A. (February 2015). \"Big Data Security Issues and Challenges\". International Journal of Innovative Research in Advanced Engineering 2 (2): 15\u201320. Archived from the original on 21 January 2022. https:\/\/web.archive.org\/web\/20220121204247\/https:\/\/www.ijirae.com\/volumes\/Vol2\/iss2\/03.FBCS10080.pdf .   \n \n\n\u2191 Demchenko, Yuri; Ngo, Canh; de Laat, Cees; Membrey, Peter; Gordijenko, Daniil (2014), Jonker, Willem; Petkovi\u0107, Milan, eds., \"Big Security for Big Data: Addressing Security Challenges for the Big Data Infrastructure\" (in en), Secure Data Management (Cham: Springer International Publishing) 8425: 76\u201394, doi:10.1007\/978-3-319-06811-4_13, ISBN 978-3-319-06810-7, https:\/\/link.springer.com\/10.1007\/978-3-319-06811-4_13 . Retrieved 2023-05-03   \n \n\n\u2191 Chen, Edward T. (18 June 2014). \"Implementation Issues of Enterprise data Warehousing and Business Intelligence in the Healthcare Industry\" (in en). Communications of the IIMA 12 (2). doi:10.58729\/1941-6687.1186. ISSN 1941-6687. https:\/\/scholarworks.lib.csusb.edu\/ciima\/vol12\/iss2\/3 .   \n \n\n\u2191 Cuzzocrea, Alfredo; Bellatreche, Ladjel; Song, Il-Yeol (28 October 2013). \"Data warehousing and OLAP over big data: current challenges and future research directions\" (in en). Proceedings of the sixteenth international workshop on Data warehousing and OLAP (San Francisco California USA: ACM): 67\u201370. doi:10.1145\/2513190.2517828. ISBN 978-1-4503-2412-0. https:\/\/dl.acm.org\/doi\/10.1145\/2513190.2517828 .   \n \n\n\u2191 Singh, R.; Singh, K. (May 2010). \"A Descriptive Classification of Causes of Data Quality Problems in Data Warehousing\" (PDF). International Journal of Computer Science Issues 7 (3): 41\u201350. https:\/\/www.ijcsi.org\/papers\/7-3-2-41-50.pdf .   \n \n\n\u2191 Longbottom, C.; Bamforth, R. (October 2013). \"Optimising the data warehouse\" (PDF). Quocirca Ltd. https:\/\/www.it-daily.net\/downloads\/WP_Optimising-the-data-warehouse.pdf . Retrieved 27 October 2022 .   \n \n\n\u2191 Santos, Ricardo Jorge; Bernardino, Jorge; Vieira, Marco (1 April 2011). \"A survey on data security in data warehousing: Issues, challenges and opportunities\". 2011 IEEE EUROCON - International Conference on Computer as a Tool: 1\u20134. doi:10.1109\/EUROCON.2011.5929314. https:\/\/ieeexplore.ieee.org\/document\/5929314\/ .   \n \n\n\u2191 \"Responsibilities of a Data Warehouse Governance Committee\". Oracle Help Center. Oracle. https:\/\/docs.oracle.com\/cd\/E29633_01\/CDMOG\/GUID-7E43F311-4510-4F1E-A17E-693F94BD0EC7.htm . Retrieved 27 October 2022 .   \n \n\n\u2191 Gupta, Saurabh; Giri, Venkata (2018). Practical Enterprise Data Lake Insights: handle data-driven challenges in an Enterprise Big Data Lake. For professionals by professionals. New York, NY: Apress. ISBN 978-1-4842-3521-8.   \n \n\n\u2191 Giebler, Corinna; Gr\u00f6ger, Christoph; Hoos, Eva; Schwarz, Holger; Mitschang, Bernhard (2019), Ordonez, Carlos; Song, Il-Yeol; Anderst-Kotsis, Gabriele et al.., eds., \"Leveraging the Data Lake: Current State and Challenges\" (in en), Big Data Analytics and Knowledge Discovery (Cham: Springer International Publishing) 11708: 179\u2013188, doi:10.1007\/978-3-030-27520-4_13, ISBN 978-3-030-27519-8, http:\/\/link.springer.com\/10.1007\/978-3-030-27520-4_13 . Retrieved 2023-05-03   \n \n\n\u2191 Lock, M. (May 2016). \"Maximizing Your Data Lake with a Cloud or Hybrid Approach\" (PDF). Aberdeen Group. https:\/\/technology-signals.com\/wp-content\/uploads\/download-manager-files\/maximizingyourdatalake.pdf . Retrieved 27 October 2022 .   \n \n\n\u2191 Kumar, N. (2020). \"Cloud data warehouse is the future of data storage\". Sigmoid Blog. Sigmoid. https:\/\/www.sigmoid.com\/blogs\/cloud-data-warehouse-is-the-future-of-data-storage\/ . Retrieved 27 October 2022 .   \n \n\n\u2191 Kahn, Michael G; Mui, Joyce Y; Ames, Michael J; Yamsani, Anoop K; Pozdeyev, Nikita; Rafaels, Nicholas; Brooks, Ian M (15 March 2022). \"Migrating a research data warehouse to a public cloud: challenges and opportunities\" (in en). Journal of the American Medical Informatics Association 29 (4): 592\u2013600. doi:10.1093\/jamia\/ocab278. ISSN 1527-974X. PMC PMC8922165. PMID 34919694. https:\/\/academic.oup.com\/jamia\/article\/29\/4\/592\/6468865 .   \n \n\n\u2191 Mishra, Nilamadhab; Lin, Chung-Chih; Chang, Hsien-Tsung (2015). \"A Cognitive Adopted Framework for IoT Big-Data Management and Knowledge Discovery Prospective\" (in en). International Journal of Distributed Sensor Networks 2015: 1\u201312. doi:10.1155\/2015\/718390. ISSN 1550-1329. http:\/\/www.hindawi.com\/journals\/ijdsn\/2015\/718390\/ .   \n \n\n\u2191 Alserafi, Ayman; Abell\u00f3, Alberto; Romero, Oscar; Calders, Toon (2019), Schewe, Klaus-Dieter; Singh, Neeraj Kumar, eds., \"Keeping the Data Lake in Form: DS-kNN Datasets Categorization Using Proximity Mining\" (in en), Model and Data Engineering (Cham: Springer International Publishing) 11815: 35\u201349, doi:10.1007\/978-3-030-32065-2_3, ISBN 978-3-030-32064-5, http:\/\/link.springer.com\/10.1007\/978-3-030-32065-2_3 . Retrieved 2023-05-03   \n \n\n\u2191 Bogatu, Alex; Fernandes, Alvaro A. A.; Paton, Norman W.; Konstantinou, Nikolaos (1 April 2020). \"Dataset Discovery in Data Lakes\". 2020 IEEE 36th International Conference on Data Engineering (ICDE) (Dallas, TX, USA: IEEE): 709\u2013720. doi:10.1109\/ICDE48307.2020.00067. ISBN 978-1-7281-2903-7. https:\/\/ieeexplore.ieee.org\/document\/9101607\/ .   \n \n\n\u2191 Zaharia, M.; Ghodsi, A.; Xin, R. et al. (2021). \"Lakehouse: A New Generation of Open Platforms that Unify Data Warehousing and Advanced Analytics\". Proceedings of the 11th Conference on Innovative Data Systems Research: 1\u20138. https:\/\/researchr.org\/publication\/Zaharia0XA21 .   \n \n\n\nNotes \nThis presentation is faithful to the original, with only a few minor changes to presentation. In some cases important information was missing from the references, and that information was added. Inline URLs from the original were turned into full citations for this version. The original, in Table 3, attributes the reference as \"Metadata Extraction and Management in Data Lakes with GEMMS\" but uses citation 30, which is something different, and a citation for \"Metadata Extraction and Management in Data Lakes with GEMMS\" doesn't exist in the original; it was added as new for this version. In the original, some URLs from citations were either broken or had overwritten information, requiring an archived version, which was used for this version.\n\n\n\n\n\nSource: <a rel=\"external_link\" class=\"external\" href=\"https:\/\/www.limswiki.org\/index.php\/Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\">https:\/\/www.limswiki.org\/index.php\/Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management<\/a>\nCategories: LIMSwiki journal articles (added in 2023)LIMSwiki journal articles (all)LIMSwiki journal articles on data management and sharingNavigation menuPage actionsJournalDiscussionView sourceHistoryPage actionsJournalDiscussionMoreToolsIn other languagesPersonal toolsLog inNavigationMain pageEncyclopedic articlesRecent changesRandom pageHelp about MediaWikiSearch\u00a0 ToolsWhat links hereRelated changesSpecial pagesPermanent linkPage informationPopular publications\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\nPrint\/exportCreate a bookDownload as PDFDownload as PDFDownload as Plain textPrintable version This page was last edited on 3 May 2023, at 16:15.Content is available under a Creative Commons Attribution-ShareAlike 4.0 International License unless otherwise noted.This page has been accessed 239 times.Privacy policyAbout LIMSWikiDisclaimers\n\n\n\n","99089d094ae9eb5f9ae5bdabb8d706dc_html":"<body class=\"mediawiki ltr sitedir-ltr mw-hide-empty-elt ns-206 ns-subject page-Journal_An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management rootpage-Journal_An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management skin-monobook action-view skin--responsive\"><div id=\"rdp-ebb-globalWrapper\"><div id=\"rdp-ebb-column-content\"><div id=\"rdp-ebb-content\" class=\"mw-body\" role=\"main\"><a id=\"rdp-ebb-top\"><\/a>\n<h1 id=\"rdp-ebb-firstHeading\" class=\"firstHeading\" lang=\"en\">Journal:An overview of data warehouse and data lake in modern enterprise data management<\/h1><div id=\"rdp-ebb-bodyContent\" class=\"mw-body-content\"><!-- start content --><div id=\"rdp-ebb-mw-content-text\" lang=\"en\" dir=\"ltr\" class=\"mw-content-ltr\"><div class=\"mw-parser-output\">\n\n\n<h2><span class=\"mw-headline\" id=\"Abstract\">Abstract<\/span><\/h2>\n<p>Data is the lifeblood of any organization. In today\u2019s world, organizations recognize the vital role of data in modern <a href=\"https:\/\/www.limswiki.org\/index.php\/Business_intelligence\" title=\"Business intelligence\" class=\"wiki-link\" data-key=\"cb8c6c58a636a17adacd11b7617cba5e\">business intelligence<\/a> systems for making meaningful decisions and staying competitive in the field. Efficient and optimal data analytics provides a competitive edge to its performance and services. Major organizations generate, collect, and process vast amounts of data, falling under the category of \"big data.\" <a href=\"https:\/\/www.limswiki.org\/index.php\/Information_management\" title=\"Information management\" class=\"wiki-link\" data-key=\"f8672d270c0750a858ed940158ca0a73\">Managing<\/a> and <a href=\"https:\/\/www.limswiki.org\/index.php\/Data_analysis\" title=\"Data analysis\" class=\"wiki-link\" data-key=\"545c95e40ca67c9e63cd0a16042a5bd1\">analyzing<\/a> the sheer volume and variety of big data is a cumbersome process. At the same time, proper utilization of the vast collection of an organization\u2019s <a href=\"https:\/\/www.limswiki.org\/index.php\/Information\" title=\"Information\" class=\"wiki-link\" data-key=\"6300a14d9c2776dcca0999b5ed940e7d\">information<\/a> can generate meaningful insights into business tactics. In this regard, two of the more popular data management systems in the area of big data analytics\u2014the <a href=\"https:\/\/www.limswiki.org\/index.php\/Data_warehouse\" title=\"Data warehouse\" class=\"wiki-link\" data-key=\"ca506499cdf544371c0a0d549ff0e9ee\">data warehouse<\/a> and <a href=\"https:\/\/www.limswiki.org\/index.php\/Data_lake\" title=\"Data lake\" class=\"wiki-link\" data-key=\"cbe28db47d4d3ce56b947c2959cc9eea\">data lake<\/a>\u2014act as platforms to accumulate the big data generated and used by organizations. Although seemingly similar, both of them differ in terms of their characteristics and applications. \n<\/p><p>This article presents a detailed overview of the roles of data warehouses and data lakes in modern enterprise data management. We detail the definitions, characteristics, and related works for the respective data management frameworks. Furthermore, we explain the architecture and design considerations of the current state of the art. Finally, we provide a perspective on the challenges and promising research directions for the future.\n<\/p><p><b>Keywords<\/b>: big data, data warehousing, data lake, enterprise data management, OLAP, ETL tools, metadata, cloud computing, internet of things\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Introduction\">Introduction<\/span><\/h2>\n<p>\"Big data analytics\" is one of the buzzwords in today\u2019s digital world. It entails <a href=\"https:\/\/www.limswiki.org\/index.php\/Data_analysis\" title=\"Data analysis\" class=\"wiki-link\" data-key=\"545c95e40ca67c9e63cd0a16042a5bd1\">examining<\/a> big data and uncovering any hidden patterns, correlations, etc. available in the data.<sup id=\"rdp-ebb-cite_ref-1\" class=\"reference\"><a href=\"#cite_note-1\">[1]<\/a><\/sup> Big data analytics extracts and analyzes random data sets, forming them into meaningful <a href=\"https:\/\/www.limswiki.org\/index.php\/Information\" title=\"Information\" class=\"wiki-link\" data-key=\"6300a14d9c2776dcca0999b5ed940e7d\">information<\/a>. According to statistics, the overall amount of data generated in the world in 2021 was approximately 79 zettabytes, and this is expected to double by 2025.<sup id=\"rdp-ebb-cite_ref-2\" class=\"reference\"><a href=\"#cite_note-2\">[2]<\/a><\/sup> This unprecedented amount of data was the result of a data explosion that occurred, wherein data interactions increased by 5,000 percent since 2010.<sup id=\"rdp-ebb-cite_ref-3\" class=\"reference\"><a href=\"#cite_note-3\">[3]<\/a><\/sup>\n<\/p><p>Big data deals with the volume, variety, and velocity of data, while seeking the veracity (insightfulness) and value to data. These are known, in part, as the \"Vs\" of big data.<sup id=\"rdp-ebb-cite_ref-4\" class=\"reference\"><a href=\"#cite_note-4\">[4]<\/a><\/sup> An unprecedented amount of diverse data is acquired, stored, and processed with high <a href=\"https:\/\/www.limswiki.org\/index.php\/Data_quality\" title=\"Data quality\" class=\"wiki-link\" data-key=\"7fe43b05eae4dfa9b5c0547cc8cfcceb\">data quality<\/a> for various application domains. These data originate from business transactions, real-time streaming, social media, video analytics, and <a href=\"https:\/\/www.limswiki.org\/index.php\/Data_mining\" title=\"Data mining\" class=\"wiki-link\" data-key=\"be09d3680fe1608addedf6f62692ee47\">text mining<\/a>, creating a huge amount of semi- or unstructured data to be stored in different information silos.<sup id=\"rdp-ebb-cite_ref-5\" class=\"reference\"><a href=\"#cite_note-5\">[5]<\/a><\/sup> The efficient integration and analysis of these multiple data across silos are required to divulge complete insight into the database. This is an open research topic of interest.\n<\/p><p>Big data and its related emerging technologies have been changing the way e-commerce and e-services operate and have been opening new frontiers in business analytics and related research.<sup id=\"rdp-ebb-cite_ref-:0_6-0\" class=\"reference\"><a href=\"#cite_note-:0-6\">[6]<\/a><\/sup> Big data analytics systems play a big role in the modern enterprise management domain, from product distribution to sales and marketing, as well as the analysis of hidden trends, similarities, and other insights, giving companies opportunities to optimize their data to find new opportunities within it.<sup id=\"rdp-ebb-cite_ref-7\" class=\"reference\"><a href=\"#cite_note-7\">[7]<\/a><\/sup> Since organizations with better and more accurate data can make more informed business decisions by looking at market trends and customer preferences, they can gain competitive advantages over others. Hence, organizations invest tremendously in <a href=\"https:\/\/www.limswiki.org\/index.php\/Artificial_intelligence\" title=\"Artificial intelligence\" class=\"wiki-link\" data-key=\"0c45a597361ca47e1cd8112af676276e\">artificial intelligence<\/a> (AI) and big data technologies to strive toward digital transformation and data-driven decision making, which ultimately leads to advanced <a href=\"https:\/\/www.limswiki.org\/index.php\/Business_intelligence\" title=\"Business intelligence\" class=\"wiki-link\" data-key=\"cb8c6c58a636a17adacd11b7617cba5e\">business intelligence<\/a> (BI).<sup id=\"rdp-ebb-cite_ref-:0_6-1\" class=\"reference\"><a href=\"#cite_note-:0-6\">[6]<\/a><\/sup> As per reports, the worldwide big data analytics and BI software applications markets seem as though they will increase by USD 68 billion and 17.6 billion by 2024\u20132025, respectively.<sup id=\"rdp-ebb-cite_ref-8\" class=\"reference\"><a href=\"#cite_note-8\">[8]<\/a><\/sup>\n<\/p><p>Big data repositories exist in many forms, as per the requirements of corporations.<sup id=\"rdp-ebb-cite_ref-:1_9-0\" class=\"reference\"><a href=\"#cite_note-:1-9\">[9]<\/a><\/sup> An effective data repository needs to unify, regulate, evaluate, and deploy a huge amount of data resources to enhance analytics and query performance. Based on the nature and the application scenario, there are many different types of data repositories outside of traditional relational databases. Two of the more popular data repositories among them are enterprise <a href=\"https:\/\/www.limswiki.org\/index.php\/Data_warehouse\" title=\"Data warehouse\" class=\"wiki-link\" data-key=\"ca506499cdf544371c0a0d549ff0e9ee\">data warehouses<\/a> and <a href=\"https:\/\/www.limswiki.org\/index.php\/Data_lake\" title=\"Data lake\" class=\"wiki-link\" data-key=\"cbe28db47d4d3ce56b947c2959cc9eea\">data lakes<\/a>.<sup id=\"rdp-ebb-cite_ref-:2_10-0\" class=\"reference\"><a href=\"#cite_note-:2-10\">[10]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-:3_11-0\" class=\"reference\"><a href=\"#cite_note-:3-11\">[11]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-:4_12-0\" class=\"reference\"><a href=\"#cite_note-:4-12\">[12]<\/a><\/sup>\n<\/p><p>A data warehouse (DW) is a data repository which stores structured, filtered, and processed data that has been treated for a specific purpose, whereas a data lake (DL) is a vast pool of data for which the purpose is not or has not yet been defined.<sup id=\"rdp-ebb-cite_ref-:1_9-1\" class=\"reference\"><a href=\"#cite_note-:1-9\">[9]<\/a><\/sup> In detail, DWs store large amounts of data collected by different sources, typically using predefined schemas. Typically, a DW is a purpose-built relational database running on specialized hardware either on the premises of an organization or in the <a href=\"https:\/\/www.limswiki.org\/index.php\/Cloud_computing\" title=\"Cloud computing\" class=\"wiki-link\" data-key=\"fcfe5882eaa018d920cedb88398b604f\">cloud<\/a>.<sup id=\"rdp-ebb-cite_ref-:15_13-0\" class=\"reference\"><a href=\"#cite_note-:15-13\">[13]<\/a><\/sup> DWs have been used widely for storing enterprise data and fueling BI and analytics applications.<sup id=\"rdp-ebb-cite_ref-:16_14-0\" class=\"reference\"><a href=\"#cite_note-:16-14\">[14]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-15\" class=\"reference\"><a href=\"#cite_note-15\">[15]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-:17_16-0\" class=\"reference\"><a href=\"#cite_note-:17-16\">[16]<\/a><\/sup>\n<\/p><p>Data lakes (DLs) have emerged as big data repositories that store raw data and provide a rich list of functionalities with the help of <a href=\"https:\/\/www.limswiki.org\/index.php\/Metadata\" title=\"Metadata\" class=\"wiki-link\" data-key=\"f872d4d6272811392bafe802f3edf2d8\">metadata<\/a> descriptions.<sup id=\"rdp-ebb-cite_ref-:2_10-1\" class=\"reference\"><a href=\"#cite_note-:2-10\">[10]<\/a><\/sup> Although the DL is also a form of enterprise data storage, it does not inherently include the same analytics features commonly associated with DWs. Instead, they are repositories storing raw data in their original formats and providing a common access interface. From the lake, data may flow downstream to a DW to get processed, packaged, and become ready for consumption. As a relatively new concept, there has been very limited research discussing various aspects of DLs, especially in internet articles or blogs.\n<\/p><p>Although DWs and DLs share some overlapping features and use cases, there are fundamental differences in the <a href=\"https:\/\/www.limswiki.org\/index.php\/Information_management\" title=\"Information management\" class=\"wiki-link\" data-key=\"f8672d270c0750a858ed940158ca0a73\">data management<\/a> philosophies, design characteristics, and ideal use conditions for each of these technologies. In this context, we provide a detailed overview and differences between both the DW and DL data management schemes in this survey paper. Furthermore, we consolidate the concepts and give a detailed analysis of different design aspects, various tools and utilities, etc., along with recent developments that have come into existence.\n<\/p><p>The remainder of this paper is organized as follows. In the next section, the terminology and basic definitions of big data analytics and the data management schemes are analyzed. Furthermore, the related works in the field are also summarized. After this summation, the architectures of both the DW and DL are presented, followed by their key design and practical aspects, presented at length. Afterwards, the various popular tools and services available for enterprise data management are summarized, followed by explanations of the open challenges and promising directions for these technologies. In particular, the pros and cons of various methods are critically discussed, and the observations are presented. Finally, conclusions are drawn from this research effort.\n<\/p>\n<h2><span id=\"rdp-ebb-Definitions_of_big_data_analytics,_data_warehouse,_and_data_lake\"><\/span><span class=\"mw-headline\" id=\"Definitions_of_big_data_analytics.2C_data_warehouse.2C_and_data_lake\">Definitions of big data analytics, data warehouse, and data lake<\/span><\/h2>\n<p>The definitions and fundamental notions of various data management schemes are provided in this section. Furthermore, related works and review papers on this topic are also summarized.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Big_data_analytics\">Big data analytics<\/span><\/h3>\n<p>With significant advancements in technology has come the unprecedented usage of computer networks, multimedia, the <a href=\"https:\/\/www.limswiki.org\/index.php\/Internet_of_things\" title=\"Internet of things\" class=\"wiki-link\" data-key=\"13e0b826fa1770fe4bea72e3cb942f0f\">internet of things<\/a> (IoT), social media, and cloud computing.<sup id=\"rdp-ebb-cite_ref-17\" class=\"reference\"><a href=\"#cite_note-17\">[17]<\/a><\/sup> As a result, a huge amount of data, known as \u201cbig data,\u201d has been generated. Effective data processing is required to collect, manage, and analyze these data efficiently. The process of big data processing is aimed at <a href=\"https:\/\/www.limswiki.org\/index.php\/Data_mining\" title=\"Data mining\" class=\"wiki-link\" data-key=\"be09d3680fe1608addedf6f62692ee47\">data mining<\/a> (i.e., extracting knowledge from large amounts of data), leveraging data management, <a href=\"https:\/\/www.limswiki.org\/index.php\/Machine_learning\" title=\"Machine learning\" class=\"wiki-link\" data-key=\"79aab39cfa124c958cd1dbcab3dde122\">machine learning<\/a> (ML), high-performance computing, statistical charting, pattern recognition, etc. The important characteristics of big data (known as the seven \"Vs\" of big data) are as follows<sup id=\"rdp-ebb-cite_ref-MooreThe7_18-0\" class=\"reference\"><a href=\"#cite_note-MooreThe7-18\">[18]<\/a><\/sup>:\n<\/p>\n<ul><li>Volume, or the available amount of data;<\/li>\n<li>Velocity, or the speed of data processing;<\/li>\n<li>Variety, or the different types of big data;<\/li>\n<li>Volatility, or the variability of the data;<\/li>\n<li>Veracity, or the accuracy of the data;<\/li>\n<li>Visualization, or the depiction of big data-generated insights through visual representation; and<\/li>\n<li>Value, or the benefits organizations derive from the data.<\/li><\/ul>\n<p>Typically, there are mainly three kinds of big data processing possible: batch processing, stream processing, and hybrid processing.<sup id=\"rdp-ebb-cite_ref-19\" class=\"reference\"><a href=\"#cite_note-19\">[19]<\/a><\/sup> In batch processing, data stored in the non-volatile memory will be processed, and the probability and temporal characteristics of data conversion processes will be decided by the requirements of the problems. In stream processing, the collected data will be processed without storing them in non-volatile media, and the temporal characteristics of data conversion processes will mainly be determined by the incoming data rate. This is suitable for domains that require low response times. Another kind of big data processing, known as hybrid processing, combines both the batch and stream processing techniques to achieve high accuracy and a low processing time.<sup id=\"rdp-ebb-cite_ref-20\" class=\"reference\"><a href=\"#cite_note-20\">[20]<\/a><\/sup> Some examples of hybrid big data processing are Lambda and Kappa Architecture.<sup id=\"rdp-ebb-cite_ref-21\" class=\"reference\"><a href=\"#cite_note-21\">[21]<\/a><\/sup> Lambda Architecture processes huge quantities of data, enabling batch processing and stream processing methods with a hybrid approach. Kappa Architecture is a simpler alternative to Lambda Architecture, since it leverages the same technology stack to handle both real-time stream processing and historical batch processing. However, it avoids maintaining two different code bases for the batch and speed layers. The major notion is to facilitate real-time data processing using a single stream-processing engine, thus bypassing the multi-layered Lambda Architecture without compromising the standard <a href=\"https:\/\/www.limswiki.org\/index.php\/Quality_(business)\" title=\"Quality (business)\" class=\"wiki-link\" data-key=\"c4ac43430d1c3a3a15d1255257aaea37\">quality<\/a> of service.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Data_warehouse\">Data warehouse<\/span><\/h3>\n<p>The concept of DWs was introduced in the late 1980s by IBM researchers Barry Devlin and Paul Murphy, with the aim to deliver an architectural model to solve the flow of data to decision support environments.<sup id=\"rdp-ebb-cite_ref-:5_22-0\" class=\"reference\"><a href=\"#cite_note-:5-22\">[22]<\/a><\/sup> According to the definition by Inmon, \u201ca data warehouse is a subject-oriented, nonvolatile, integrated, time-variant collection of data in support of management decisions.\u201d<sup id=\"rdp-ebb-cite_ref-23\" class=\"reference\"><a href=\"#cite_note-23\">[23]<\/a><\/sup> Formally, a DW is a large data repository wherein data can be stored and integrated from various sources in a well-structured manner and help in the decision-making process via proper data analytics.<sup id=\"rdp-ebb-cite_ref-24\" class=\"reference\"><a href=\"#cite_note-24\">[24]<\/a><\/sup> The process of compiling information into a DW is known as data warehousing.\n<\/p><p>In enterprise data management, data warehousing is referred to as a set of decision-making systems targeted toward empowering the information specialist (leader, administrator, or analyst) to improve decision making and make decisions quicker. Hence, DW systems act as an important tool of BI, being used in enterprise data management by most medium and large organizations.<sup id=\"rdp-ebb-cite_ref-25\" class=\"reference\"><a href=\"#cite_note-25\">[25]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-26\" class=\"reference\"><a href=\"#cite_note-26\">[26]<\/a><\/sup> The past decade has seen unprecedented development both in the number of products and services offered and in the wide-scale adoption of these advancements by the industry. According to a comprehensive research report by Market Research Future (MRFR) titled \u201cData Warehouse as a Service Market information by Usage, by Deployment, by Application and Organization Size\u2014forecast to 2028,\u201d the market size will reach USD 7.69 billion, growing at a compound annual growth rate of 24.5%, by 2028.<sup id=\"rdp-ebb-cite_ref-27\" class=\"reference\"><a href=\"#cite_note-27\">[27]<\/a><\/sup>\n<\/p><p>In the DW framework, data are periodically extracted from programs that aid in business operations and duplicated onto specialized processing units. They may then be approved, converted, reconstructed, and augmented with input from various options. The developed DW then becomes a primary origin of data for the production, analysis, and presentation of reports via instantaneous reports, e-portals, and digital readouts. It employs \u201conline analytical processing\u201d (OLAP), whose utility and execution needs differ from those of the \u201conline transaction processing\u201d (OLTP) implementations typically backed up by functional databases.<sup id=\"rdp-ebb-cite_ref-28\" class=\"reference\"><a href=\"#cite_note-28\">[28]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-:6_29-0\" class=\"reference\"><a href=\"#cite_note-:6-29\">[29]<\/a><\/sup> OLTP programs often computerize the handling of administrative data processes, such as order entry and banking transactions, which are an organization\u2019s necessary activities. DWs, on the other hand, are primarily concerned with decision assistance. As shown in Figure 1a, a DW integrates data from various sources and helps with analysis, data mining, and reporting. A detailed description of a DW\u2019s architecture is presented in the next major section.\n<\/p><p><br \/>\n<a href=\"https:\/\/www.limswiki.org\/index.php\/File:Fig1_Nambiar_BigDataCogComp22_6-4.png\" class=\"image wiki-link\" data-key=\"45d710b792e75d8d69e4792c84fd7aa5\"><img alt=\"Fig1 Nambiar BigDataCogComp22 6-4.png\" src=\"https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/f\/f9\/Fig1_Nambiar_BigDataCogComp22_6-4.png\" decoding=\"async\" style=\"width: 100%;max-width: 400px;height: auto;\" \/><\/a>\n<\/p>\n<div style=\"clear:both;\"><\/div>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table border=\"0\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><blockquote><p><b>Figure 1.<\/b> <b>(a)<\/b> Data warehouse architecture vs. <b>(b)<\/b> data lake architecture.<\/p><\/blockquote>\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<p>DW advancements have benefited various sectors, including production (for supply shipment and client assistance), business (for profiling of clients and stock governance), monetary administration (for claims investigation, risk assessment, billing examination, and detecting fraud), logistics (for vehicle administration), broadcast communications (in order to analyze calls), utility companies (in order to analyze power use), and medical services.<sup id=\"rdp-ebb-cite_ref-30\" class=\"reference\"><a href=\"#cite_note-30\">[30]<\/a><\/sup> The field of data warehousing has seen immense research and development over the last two decades in various research categories such as DW architecture, design, and evolution.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Data_lake\">Data lake<\/span><\/h3>\n<p>By the beginning of the twenty-first century, new types of diverse data were emerging in ever-increasing volumes on the internet and at its interface to the enterprise (e.g., web-based business transactions, real-time streaming, sensor data, and social media). With the huge amount of data around, the need to have better solutions for storing and analyzing large amounts of semi-structured and unstructured data to gain relevant information and valuable insight became apparent. Traditional schema-on-write approaches such as the extract, transform, and load (ETL) process are too inefficient for such data management requirements. This gave rise to another popular modern enterprise data management scheme, the DL.<sup id=\"rdp-ebb-cite_ref-:7_31-0\" class=\"reference\"><a href=\"#cite_note-:7-31\">[31]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-:8_32-0\" class=\"reference\"><a href=\"#cite_note-:8-32\">[32]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-:9_33-0\" class=\"reference\"><a href=\"#cite_note-:9-33\">[33]<\/a><\/sup>\n<\/p><p>DLs are centralized storage repositories that enable users to store raw, unprocessed data in their original format, including unstructured, semi-structured, or structured data, at scale. These help enterprises to make better business decisions via visualizations or dashboards from big data analysis, ML, and real-time analytics. A pictorial representation of a DL is given in Figure 1b, above.\n<\/p><p>According to Dixon, \u201cwhilst a data warehouse seems to be a bottle of water cleaned and ready for consumption, then 'Data Lake' is considered as a whole lake of data in a more natural state.\u201d<sup id=\"rdp-ebb-cite_ref-:10_34-0\" class=\"reference\"><a href=\"#cite_note-:10-34\">[34]<\/a><\/sup> Another definition for the DL is provided by King<sup id=\"rdp-ebb-cite_ref-35\" class=\"reference\"><a href=\"#cite_note-35\">[35]<\/a><\/sup>, as a mechanism that \u201cstores disparate information while ignoring almost everything.\u201d An explanation of DLs from an architectural viewpoint is given by Alrehamy and Walker<sup id=\"rdp-ebb-cite_ref-36\" class=\"reference\"><a href=\"#cite_note-36\">[36]<\/a><\/sup>: \u201cA data lake uses a flat architecture to store data in its raw format. Each data entity in the lake is associated with a unique identifier and a set of extended metadata, and consumers can use purpose-built schemas to query relevant data, which will result in a smaller set of data that can be analyzed to help answer a consumer\u2019s question.\u201d A DL houses data in its original raw form. The data in DLs can vary drastically in size and structure, and they lack any specific organizational structure. A DL can accommodate either very small or huge amounts of data as required. All of these features provide flexibility and scalability to DLs. At the same time, challenges related to the implementation and data analytics associated with DLs also arise.\n<\/p><p>DLs are becoming increasingly popular for organizations to store their data in a centralized manner. A DL may contain unstructured or multi-structured data, where most of them may have unrealized value for the enterprise. This allows organizations to store their data from different sources without any overhead related to the transformation of the data.<sup id=\"rdp-ebb-cite_ref-:7_31-1\" class=\"reference\"><a href=\"#cite_note-:7-31\">[31]<\/a><\/sup> This also allows <i>ad hoc<\/i> data analyses to be performed on this data, which can then be used by organizations to drive key insights and data-driven decision making. DLs replace the previous way of organizing and processing data from various sources with a centralized, efficient, and flexible repository that allows organizations to maximize their gains from a data-driven ecosystem. DLs also allow organizations to scale them to their needs. This is achieved by separating storage from the computational part. Complex transformation and preprocessing of data in the case of DWs is eliminated. The upfront financial overhead of data ingestion is also reduced. Once data are collated in the lake or hub, it is available for analysis for the organization.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"The_differences_between_data_warehouses_and_data_lakes\">The differences between data warehouses and data lakes<\/span><\/h3>\n<p>Although DWs and DLs are used as two interchangeable terms, they are not the same.<sup id=\"rdp-ebb-cite_ref-:5_22-1\" class=\"reference\"><a href=\"#cite_note-:5-22\">[22]<\/a><\/sup> One of the major differences between them is the different structures (i.e., processed vs. raw data). A DW stores data in processed and filtered form, whereas a DL stores raw or unprocessed data. Specifically, data are processed and organized into a single schema before being put into the warehouse, whereas raw and unstructured data are fed into a DL. Analysis is performed on the cleansed data in the warehouse. On the contrary, in a DL, data are selected and organized as and when needed.\n<\/p><p>As for storing processed data, a DW is economical. On the contrary, DLs have a comparatively larger capacity than the DW and are ideal for raw and unprocessed data analysis and employing ML. Another key difference is the objective or purpose of use. Typically, processed data that flow into DWs are used for specific purposes, and hence the storage space will not be wasted, whereas the purpose of usage for the DL is not defined and can ideally be used for any purpose. To use processed or filtered data, no specialized expertise is required, as merely familiarization with the presentation of data (e.g., charts, sheets, tables, and presentations) will do. Hence, DWs can be used by any business or individual. On the contrary, it is comparatively difficult to analyze DLs without familiarity with unprocessed data, hence requiring data scientists with appropriate skills or tools to comprehend them for specific business use. Accessibility or ease of use of data repositories is yet another aspect that differentiates DWs and DLs. Since the architecture of a DL has no proper structure, it has flexibility of use. Instead, the structure of a DW makes sure that no foreign particles invade it, and it is very costly to manipulate. This feature makes it very secure, too. A detailed analysis of the differences between DWs and DLs is given in Table 1.\n<\/p>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table class=\"wikitable\" border=\"1\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td colspan=\"3\" style=\"background-color:white; padding-left:10px; padding-right:10px;\"><b>Table 1.<\/b> Differences between data warehouses and data lakes.\n<\/td><\/tr>\n<tr>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Parameters\n<\/th>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Data warehouse\n<\/th>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Data lake\n<\/th><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Data\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">DWs focuse only on business processes.\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">DLs store everything.\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Processing\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Data are highly processed.\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Data are mainly unprocessed.\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Type of data\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">They are mostly in the tabular form and structure.\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">They can be unstructured, semi-structured, or structured.\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Task\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">DWs are optimized for data retrieval.\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">DLs share data stewardship\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Agility\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">DWs are less agile and have fixed configurations compared with DLs.\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">DLs are highly agile and can be configured and reconfigured as needed.\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Users\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">DWs are widely used by business professionals and business analysts.\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">DLs are used by data scientists, data developers, and business analysts.\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Storage\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">DW has expensive storage that gives fast response time.\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">DL has a design that features lower overall costs.\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Security\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">DW allows better control of the data.\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">DL allows less control of the data.\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Schema\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">DW feartures schema on writing (predefined schemas).\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">DL features schema on reading (no predefined schemas).\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Data processing\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">It's time-consuming to introduce new content.\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">It helps with fast ingestion of new data.\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Data granularity\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Data tends to be at the summary or aggregated level of detail.\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Data tends to be at a low level of detail or granularity.\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Tools\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">DWs feature mostly commercial tools.\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">DLs can use open-source tools such as Hadoop or Map Reduce.\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<h4><span class=\"mw-headline\" id=\"A_literature_review_of_data_warehouses_and_data_lakes\">A literature review of data warehouses and data lakes<\/span><\/h4>\n<p>A summary of various research works in the field of DWs and DLs is presented here. Table 2 presents a list of various survey articles on DWs and DLs. Mainly, DW review works address architecture modeling and its comparisons<sup id=\"rdp-ebb-cite_ref-:11_37-0\" class=\"reference\"><a href=\"#cite_note-:11-37\">[37]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-:12_38-0\" class=\"reference\"><a href=\"#cite_note-:12-38\">[38]<\/a><\/sup>, the evolution of the DW concept<sup id=\"rdp-ebb-cite_ref-:13_39-0\" class=\"reference\"><a href=\"#cite_note-:13-39\">[39]<\/a><\/sup>, real-time data warehousing and ETL<sup id=\"rdp-ebb-cite_ref-:14_40-0\" class=\"reference\"><a href=\"#cite_note-:14-40\">[40]<\/a><\/sup>, etc. Compared with the DW literature reviews, DL papers are relatively fewer in number. DL review works summarize recent approaches and the architecture of DLs<sup id=\"rdp-ebb-cite_ref-:9_33-1\" class=\"reference\"><a href=\"#cite_note-:9-33\">[33]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-:10_34-1\" class=\"reference\"><a href=\"#cite_note-:10-34\">[34]<\/a><\/sup> as well as the design and implementation aspects.<sup id=\"rdp-ebb-cite_ref-:7_31-2\" class=\"reference\"><a href=\"#cite_note-:7-31\">[31]<\/a><\/sup> To the best of our knowledge, only one work on comparing DWs and DLs was found in the literature.<sup id=\"rdp-ebb-cite_ref-:4_12-1\" class=\"reference\"><a href=\"#cite_note-:4-12\">[12]<\/a><\/sup> In contrast to that article, our work provides a comprehensive analysis of both data management schemes by addressing various aspects, such as definitions, architecture, practical design considerations, tools and services, challenges, and opportunities in detail. In addition to the survey papers, we also consolidate various works on DWs and DLs in the reported literature and classify them in Table 3 based on their functions and utility.\n<\/p>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table class=\"wikitable\" border=\"1\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td colspan=\"3\" style=\"background-color:white; padding-left:10px; padding-right:10px;\"><b>Table 2.<\/b> Summary of existing survey articles on data warehouses and data lakes.\n<\/td><\/tr>\n<tr>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Topic\n<\/th>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Survey article\n<\/th>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Contributions\n<\/th><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Data warehouse\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Arif and Mujtaba<sup id=\"rdp-ebb-cite_ref-:3_11-1\" class=\"reference\"><a href=\"#cite_note-:3-11\">[11]<\/a><\/sup>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Data warehouse survey\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Data lake vs. data warehouse\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">El Aissi <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-:4_12-2\" class=\"reference\"><a href=\"#cite_note-:4-12\">[12]<\/a><\/sup>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Explores the two architectures of data warehouses and data lakes\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Data warehouse\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Codd <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-:6_29-1\" class=\"reference\"><a href=\"#cite_note-:6-29\">[29]<\/a><\/sup>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Data warehouse concepts, multilingualism issues in data warehouse design and solutions\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Data lake\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Hai <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-:7_31-3\" class=\"reference\"><a href=\"#cite_note-:7-31\">[31]<\/a><\/sup>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">A survey on designing, implementing, and applying data lakes\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Data lake\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Zagan and Danubianu<sup id=\"rdp-ebb-cite_ref-:8_32-1\" class=\"reference\"><a href=\"#cite_note-:8-32\">[32]<\/a><\/sup>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Recent approaches and architectures using data lakes\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Data lake\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Cherradi and El Haddadi<sup id=\"rdp-ebb-cite_ref-:9_33-2\" class=\"reference\"><a href=\"#cite_note-:9-33\">[33]<\/a><\/sup>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Overview of data lake definitions, architectures, and technologies\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Data warehouse\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Yang <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-:11_37-1\" class=\"reference\"><a href=\"#cite_note-:11-37\">[37]<\/a><\/sup>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Data warehouse architecture modeling and classifications\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Data warehouse\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Yessad and Labiod<sup id=\"rdp-ebb-cite_ref-:12_38-1\" class=\"reference\"><a href=\"#cite_note-:12-38\">[38]<\/a><\/sup>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Comparative study on data warehouse architectures\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Data warehouse\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Oueslati and Akaichi<sup id=\"rdp-ebb-cite_ref-:13_39-1\" class=\"reference\"><a href=\"#cite_note-:13-39\">[39]<\/a><\/sup>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Data warehouse evolution\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Data warehouse\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Esmail Ali<sup id=\"rdp-ebb-cite_ref-:14_40-1\" class=\"reference\"><a href=\"#cite_note-:14-40\">[40]<\/a><\/sup>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Real-time data warehouse and ETL\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Data warehouse and big data\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Aftab and Siddiqui<sup id=\"rdp-ebb-cite_ref-41\" class=\"reference\"><a href=\"#cite_note-41\">[41]<\/a><\/sup>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">A comprehensive survey on big data, big data analytics, augmentation, and big data warehouses\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Data warehouse\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Alsqour <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-42\" class=\"reference\"><a href=\"#cite_note-42\">[42]<\/a><\/sup>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Architectures of data warehouses and their selection\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Data warehouse\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Rizzi <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-43\" class=\"reference\"><a href=\"#cite_note-43\">[43]<\/a><\/sup>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Data warehouse modeling and design\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table class=\"wikitable\" border=\"1\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td colspan=\"5\" style=\"background-color:white; padding-left:10px; padding-right:10px;\"><b>Table 3.<\/b> Related works: classification of data warehouse and data lake solutions.\n<\/td><\/tr>\n<tr>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Systems or topic\n<\/th>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Data warehouse\n<\/th>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Data lake\n<\/th>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Function or work performed\n<\/th>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Reference\n<\/th><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">OLAP\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\u2713\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Online analytical processing (OLAP)\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Codd <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-:6_29-2\" class=\"reference\"><a href=\"#cite_note-:6-29\">[29]<\/a><\/sup>\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">DWHA\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\u2713\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Modeling and classification of data warehouses\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Yang <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-:11_37-2\" class=\"reference\"><a href=\"#cite_note-:11-37\">[37]<\/a><\/sup>\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">GEMMS\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\u2713\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Metadata extraction, metadata modeling\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Quix <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-44\" class=\"reference\"><a href=\"#cite_note-44\">[44]<\/a><\/sup>\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">KAYAK\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\u2713\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Dataset preparation and organization\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Maccioni and Torlone<sup id=\"rdp-ebb-cite_ref-45\" class=\"reference\"><a href=\"#cite_note-45\">[45]<\/a><\/sup>\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">DATAMARAN\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\u2713\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Metadata extraction\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Gao <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-46\" class=\"reference\"><a href=\"#cite_note-46\">[46]<\/a><\/sup>\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Geokettle\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\u2713\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Data warehouse architecture, design, and testing\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Astriani and Trisminingsih<sup id=\"rdp-ebb-cite_ref-47\" class=\"reference\"><a href=\"#cite_note-47\">[47]<\/a><\/sup>\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">GOODS\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\u2713\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Dataset preparation and organization, metadata enrichment\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Halevy <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-48\" class=\"reference\"><a href=\"#cite_note-48\">[48]<\/a><\/sup>\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">VOLAP\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\u2713\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">OLAP, query processing, and optimization\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Dehne <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-49\" class=\"reference\"><a href=\"#cite_note-49\">[49]<\/a><\/sup>\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Dimension constraints\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\u2713\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Multidimensional data modeling, OLAP, query processing, and optimization\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Hurtado <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-50\" class=\"reference\"><a href=\"#cite_note-50\">[50]<\/a><\/sup>\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">CLAMS\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\u2713\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Data quality improvement\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Farid <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-:18_51-0\" class=\"reference\"><a href=\"#cite_note-:18-51\">[51]<\/a><\/sup>\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Juneau\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\u2713\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Dataset preparation and organization, discover related data sets, and query-driven data discovery\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Zhang and Ives<sup id=\"rdp-ebb-cite_ref-52\" class=\"reference\"><a href=\"#cite_note-52\">[52]<\/a><\/sup>\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">JOSIE\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\u2713\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Discover related data sets and query-driven data discovery\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Zhu <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-53\" class=\"reference\"><a href=\"#cite_note-53\">[53]<\/a><\/sup>\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">CoreDB\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\u2713\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Metadata enrichment and query heterogeneous data\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Beheshti <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-54\" class=\"reference\"><a href=\"#cite_note-54\">[54]<\/a><\/sup>\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Constance\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\u2713\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Unified interface for query processing and data exploration\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Hai <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-55\" class=\"reference\"><a href=\"#cite_note-55\">[55]<\/a><\/sup>\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">ODS\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\u2713\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Operational data store\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Ahmed <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-56\" class=\"reference\"><a href=\"#cite_note-56\">[56]<\/a><\/sup>\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<h2><span class=\"mw-headline\" id=\"Architecture\">Architecture<\/span><\/h2>\n<p>In this section, the architectures of the DW and DL schemes are described in detail. Furthermore, the classification of DW and DL solutions based on function is carried out and summarized as a table.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Data_warehouse_architecture\">Data warehouse architecture<\/span><\/h3>\n<p>The DW architecture contains historical and commutative data from multiple sources. Basically, there are three kinds of architectures<sup id=\"rdp-ebb-cite_ref-57\" class=\"reference\"><a href=\"#cite_note-57\">[57]<\/a><\/sup>:\n<\/p>\n<ul><li><i>Single-tier architecture<\/i>: This kind of single-layer model minimizes the amount of data stored. It helps remove data redundancy. However, its disadvantage is the lack of a component that separates analytical and transactional processing. This kind of architecture is not frequently used in practice.<\/li>\n<li><i>Two-tier architecture<\/i>: This model separates physically available sources and the DW by means of a staging area. Such an architecture makes sure that all data loaded into the warehouse are in an appropriate cleansed format. Nevertheless, this architecture is not expandable nor can it support many end users. Additionally, it has connectivity problems due to network limitations.<\/li>\n<li><i>Three-tier architecture<\/i>: This is the most widely used architecture for DWs.<sup id=\"rdp-ebb-cite_ref-58\" class=\"reference\"><a href=\"#cite_note-58\">[58]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-59\" class=\"reference\"><a href=\"#cite_note-59\">[59]<\/a><\/sup> It consists of a top, middle, and bottom tier. In the bottom tier, data are cleansed, transformed, and loaded via backend tools. This tier serves as the database of the DW. The middle tier is an OLAP server that presents an abstract view of the database by acting as a mediator between the end user and the database. The top tier, the front-end client layer, consists of the tools and an <a href=\"https:\/\/www.limswiki.org\/index.php\/Application_programming_interface\" title=\"Application programming interface\" class=\"wiki-link\" data-key=\"36fc319869eba4613cb0854b421b0934\">application programming interface<\/a> (API) that are used to connect and get data out from the DW (e.g., query tools, reporting tools, managed query tools, analysis tools, and data mining tools).<\/li><\/ul>\n<p>The architecture of a DW is shown in Figure 2. It consists of a central information repository that is surrounded by some key DW components, making the entire environment functional, manageable, and accessible.\n<\/p><p><br \/>\n<a href=\"https:\/\/www.limswiki.org\/index.php\/File:Fig2_Nambiar_BigDataCogComp22_6-4.png\" class=\"image wiki-link\" data-key=\"a7282ecb5cac42d33177552e014800d4\"><img alt=\"Fig2 Nambiar BigDataCogComp22 6-4.png\" src=\"https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/c\/ce\/Fig2_Nambiar_BigDataCogComp22_6-4.png\" decoding=\"async\" style=\"width: 100%;max-width: 400px;height: auto;\" \/><\/a>\n<\/p>\n<div style=\"clear:both;\"><\/div>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table border=\"0\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><blockquote><p><b>Figure 2.<\/b> Data warehouse architecture.<\/p><\/blockquote>\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<p>Various components of the DW (from Figure 2) are now described.\n<\/p><p><b>Data warehouse database<\/b>: The core foundation of the DW environment is its central database. This is implemented using relational database management system (RDBMS) technology.<sup id=\"rdp-ebb-cite_ref-60\" class=\"reference\"><a href=\"#cite_note-60\">[60]<\/a><\/sup> However, there is a limitation to such implementations, since the traditional RDBMS system is optimized for transactional database processing and not for data warehousing. In this regard, the alternative means are (1) the usage of relational databases in parallel, which enables shared memory on various multiprocessor configurations or parallel processors, (2) new index structures to get rid of relational table scanning and improve the speed, and (3) multidimensional databases (MDDBs) used to circumvent the limitations caused by the relational DW models.\n<\/p><p><b>Extract, transform, and load (ETL) tools<\/b>: All the conversions, summarizations, and changes required to transform data into a unified format in the DW are carried out via ETL tools.<sup id=\"rdp-ebb-cite_ref-61\" class=\"reference\"><a href=\"#cite_note-61\">[61]<\/a><\/sup> This ETL process helps the DW achieve enhanced system performance and BI, timely access to data, and a high return on investment:\n<\/p>\n<ul><li><i>Extraction<\/i>: This involves connecting systems and collecting the data needed for analytical processing.<\/li>\n<li><i>Transformation<\/i>: The extracted data are converted into a standard format.<\/li>\n<li><i>Loading<\/i>: The transformed data are imported into a large DW.<\/li><\/ul>\n<p>ETL anonymizes data as per <a href=\"https:\/\/www.limswiki.org\/index.php\/Regulatory_compliance\" title=\"Regulatory compliance\" class=\"wiki-link\" data-key=\"7dbc9be278a8efda25a4b592ee6ef0ca\">regulatory stipulations<\/a>, thereby anonymizing confidential and sensitive information before loading it into the target data store.<sup id=\"rdp-ebb-cite_ref-62\" class=\"reference\"><a href=\"#cite_note-62\">[62]<\/a><\/sup> ETL eliminates unwanted data in operational databases from loading into DWs. ETL tools carry out amendments to the data arriving from different sources and calculate summaries and derived data. Such ETL tools generate background jobs, Cobol programs, shell scripts, etc. that regularly update the data in the DW. ETL tools also help with maintaining the metadata.\n<\/p><p><b>Metadata<\/b>: Metadata is the data about the data that define the DW.<sup id=\"rdp-ebb-cite_ref-63\" class=\"reference\"><a href=\"#cite_note-63\">[63]<\/a><\/sup> It deals with some high-level technological concepts and helps with building, maintaining, and managing the DW. Metadata plays an important role in transforming data into knowledge, since it defines the source, usage, values, and features of the DW and how to update and process the data in a DW. This is the most difficult tool to choose due to the lack of a clear standard. Efforts are being made among data warehousing tool vendors to unify a metadata model. One category of metadata known as technical metadata contains information about the warehouse that is used by its designers and administrators, whereas another category called business metadata contains details that enable end users to understand the information stored in the DW.\n<\/p><p><b>Query tools<\/b>: Query tools allow users to interact with the DW system and collect information relevant to businesses to make strategic decisions. Such tools can be of different types:\n<\/p>\n<ul><li><i>Query and reporting tools<\/i>: Such tools help organizations generate regular operational reports and support high-volume batch jobs such as printing and calculating. Some popular reporting tools are Brio, Oracle, Powersoft, and SAS Institute. Similarly, query tools help end users to resolve pitfalls in <a href=\"https:\/\/www.limswiki.org\/index.php\/SQL\" title=\"SQL\" class=\"wiki-link\" data-key=\"eef2f4a8c6f89c1a940da05abf1ace65\">SQL<\/a> and database structure by inserting a meta-layer between the users and the database.<\/li>\n<li><i>Application development tools<\/i>: In addition to the built-in graphical and analytical tools, application development tools are leveraged to satisfy the analytical needs of an organization.<\/li>\n<li><i>Data mining tools<\/i>: This tool helps in automating the process of discovering meaningful new correlations and structures by mining large amounts of data.<\/li>\n<li><i>OLAP tools<\/i>: OLAP tools exploit the concepts of a multidimensional database and help analyze the data using complex multidimensional views.<sup id=\"rdp-ebb-cite_ref-:6_29-3\" class=\"reference\"><a href=\"#cite_note-:6-29\">[29]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-64\" class=\"reference\"><a href=\"#cite_note-64\">[64]<\/a><\/sup> There are two types of OLAP tools: multidimensional OLAP (MOLAP) and relational OLAP (ROLAP).<sup id=\"rdp-ebb-cite_ref-65\" class=\"reference\"><a href=\"#cite_note-65\">[65]<\/a><\/sup> With MOLAP, a cube is aggregated from the relational data source. Based on the user report request, the MOLAP tool generates a prompt result, since all the data are already pre-aggregated within the cube.<sup id=\"rdp-ebb-cite_ref-66\" class=\"reference\"><a href=\"#cite_note-66\">[66]<\/a><\/sup> In the case of ROLAP, the ROLAP engine acts as a smart SQL generator. It comes with a \u201cdesigner\u201d piece, wherein the administrator specifies the association between the relational tables, attributes, and hierarchy map and the underlying database tables.<sup id=\"rdp-ebb-cite_ref-67\" class=\"reference\"><a href=\"#cite_note-67\">[67]<\/a><\/sup><\/li><\/ul>\n<h3><span class=\"mw-headline\" id=\"Data_lake_architecture\">Data lake architecture<\/span><\/h3>\n<p>The architecture of a business DL is depicted in Figure 3. Although it is treated as a single repository, it can be distinguished as separate layers in most cases.\n<\/p><p><br \/>\n<a href=\"https:\/\/www.limswiki.org\/index.php\/File:Fig3_Nambiar_BigDataCogComp22_6-4.png\" class=\"image wiki-link\" data-key=\"650921fd02a721178bc34615bfa44be4\"><img alt=\"Fig3 Nambiar BigDataCogComp22 6-4.png\" src=\"https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/c\/c5\/Fig3_Nambiar_BigDataCogComp22_6-4.png\" decoding=\"async\" style=\"width: 100%;max-width: 400px;height: auto;\" \/><\/a>\n<\/p>\n<div style=\"clear:both;\"><\/div>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table border=\"0\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><blockquote><p><b>Figure 3.<\/b> Data lake building blocks.<\/p><\/blockquote>\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<p>Various components of the DL (from Figure 3) are now described.\n<\/p><p><b>Raw data layer<\/b>: This layer is also known as the ingestion layer or landing area because it acts as the sink of the DL. The prime goal is to ingest raw data as quickly and as efficiently as possible. No transformations are allowed at this stage. With the help of the archive, it is possible to get back to a point in time with raw data. Overriding (i.e., handling duplicate versions of the same data) is not permitted. End users are not granted access to this layer. These are not ready-to-use data, and they need a lot of knowledge in terms of relevant consumption.\n<\/p><p><b>Standardized data layer<\/b>: This is optional in most implementations. If one expects fast growth for his or her DL architecture, then this is a good option. The prime objective of the standardized layer is to boost the performance of the data transfer from the raw layer to the curated layer. In the raw layer, data are stored in their native format, whereas in the standardized layer, the appropriate format that fits best for cleansing is selected.\n<\/p><p><b>Cleansed layer or curated layer<\/b>: In this layer, data are transformed into consumable data sets and stored in files or tables. This is one of the most complex parts of the whole DL solution since it requires <a href=\"https:\/\/www.limswiki.org\/index.php\/Data_cleansing\" title=\"Data cleansing\" class=\"wiki-link\" data-key=\"c0cec85355e07dc9cbfe96983a4e27a2\">cleansing<\/a>, transformation, denormalization, and consolidation of different objects. Furthermore, the data are organized by purpose, type, and file structure. Usually, end users are granted access only to this layer.\n<\/p><p><b>Application layer<\/b>: This is also known as the trusted layer, secure layer, or production layer. This is sourced from the cleansed layer and enforced with requisite business logic. In case the applications use ML models on the DL, they are obtained from here. The structure of the data is the same as in the cleansed layer.\n<\/p><p><b>Sandbox data layer<\/b>: This is also another optional layer that is meant for analysts\u2019 and data scientists\u2019 work to carry out experiments and search for patterns or correlations. The sandbox data layer is the proper place to enrich the data with any source from the internet.\n<\/p><p><b>Security<\/b>: While DLs are not exposed to a broad audience, the security aspects are of great importance, especially during the initial phase and architecture. These are not like relational databases, which have an artillery of security mechanisms.\n<\/p><p><b>Governance<\/b>: Monitoring and logging operations become crucial at some point while performing analysis.\n<\/p><p><b>Metadata<\/b>: This is the data about data. Most of the schemas reload additional details of the purpose of data, with descriptions on how they are meant to be exploited.\n<\/p><p><b>Stewardship<\/b>: Based on the scale that is required, either the creation of a separate role or delegation of this responsibility to the users will be carried out, possibly through some metadata solutions.\n<\/p><p><b>Master data<\/b>: This is an essential part of serving ready-to-use data. It can be either stored on the DL or referenced while executing ETL processes.\n<\/p><p><b>Archive<\/b>: DLs keep some archive data that come from data warehousing. Otherwise, performance and storage-related problems may occur.\n<\/p><p><b>Offload<\/b>: This area helps to offload some time- and resource-consuming ETL processes to a DL in case of relational data warehousing solutions.\n<\/p><p><b>Orchestration and ETL processes<\/b>: Once the data are pushed from the raw layer through the cleansed layer and to the sandbox and application layers, a tool is required to orchestrate the flow. Either an orchestration tool or some additional resources to execute them are leveraged in this regard.\n<\/p><p>Many implementations of a DL are originally based on Apache Hadoop. The Highly Available Object Oriented Data Platform (Hadoop) is a widely popular big data tool especially suitable for batch processing workloads of big data.<sup id=\"rdp-ebb-cite_ref-68\" class=\"reference\"><a href=\"#cite_note-68\">[68]<\/a><\/sup> It uses the Hadoop Distributed File System (HDFS) as its core storage and MapReduce (MR) as the basic computing model. Novel computing models are constantly proposed to cope with the increasing needs for batch processing performance (e.g., Tez, Spark, and Presto).<sup id=\"rdp-ebb-cite_ref-69\" class=\"reference\"><a href=\"#cite_note-69\">[69]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-70\" class=\"reference\"><a href=\"#cite_note-70\">[70]<\/a><\/sup> The MR model has also been replaced with the directed acyclic graph (DAG) model, which improves computing models\u2019 abstract concurrency. \n<\/p><p>The second phase of DL evolution has happened with the arrival of Lambda Architecture<sup id=\"rdp-ebb-cite_ref-71\" class=\"reference\"><a href=\"#cite_note-71\">[71]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-72\" class=\"reference\"><a href=\"#cite_note-72\">[72]<\/a><\/sup>, owing to the constant changes in data processing capabilities and processing demand. It presents stream computing engines, such as Storm, Spark Streaming, and Flink.<sup id=\"rdp-ebb-cite_ref-73\" class=\"reference\"><a href=\"#cite_note-73\">[73]<\/a><\/sup> In such a framework, batch processing is combined with stream computing to meet the needs of many emerging applications. Yet another advanced phase is seen with Kappa Architecture.<sup id=\"rdp-ebb-cite_ref-74\" class=\"reference\"><a href=\"#cite_note-74\">[74]<\/a><\/sup> The two models of batch processing and stream computing are unified by improving the stream computing concurrency and increasing the time window of streaming data. In this regard, stream computing is used that features an inherent and scalable distributed architecture.\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Design_aspects\">Design aspects<\/span><\/h2>\n<p>The design aspects and practical implementation constraints are to be studied in detail to develop a suitable data management solution. This section presents the design aspects to be considered in DW- and DL-based enterprise data management.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Data_warehouse_design_considerations_for_business_needs\">Data warehouse design considerations for business needs<\/span><\/h3>\n<p>To design a successful DW, one should also realize the requirements of an organization and develop a framework for them. There are some key criteria to keep in mind when choosing a DW. The very first design consideration in a DW is the business and user needs. Hence, during the designing phase, the integration of the DW with existing business processes and compatibility checks with long-term strategies have to be ensured. Enterprises have to clearly comprehend the purpose of their DW, any technical requirements, benefits of end users from the system, improved means of reporting for BI, and analytics. In this regard, finding the notion of what information is important to the business is quintessential to the success of the DW. To facilitate this, creating an appropriate data model of the business is a key aspect when designing DWs (e.g., SQL Developer Data Modeler [SDDM]). Furthermore, a data flow diagram can also help in depicting the data flow within the company in diagram format.\n<\/p><p>While designing a DW, yet another important practical consideration is to leverage a recognized DW modeling standard (e.g., 3NF, star schema (dimensional), and Data Vault).<sup id=\"rdp-ebb-cite_ref-75\" class=\"reference\"><a href=\"#cite_note-75\">[75]<\/a><\/sup> Selecting such a standard architecture and sticking to the same one can augment the efficiency within a DW development approach. Similarly, an agile DW methodology is also an important practical aspect. With proper planning, DW projects can be compartmentalized to smaller pieces capable of delivering faster. This design trick helps to prioritize the DW as a business\u2019s needs change.\n<\/p><p>The choice of storage is also an important consideration. Enterprises can opt for either on-premises architecture or a cloud DW.<sup id=\"rdp-ebb-cite_ref-:15_13-1\" class=\"reference\"><a href=\"#cite_note-:15-13\">[13]<\/a><\/sup> On-premises architectures require setting up the physical environment, including all the servers necessary to power ETL processes, storage, and analytic operations, whereas third-party cloud implementations can skip this step. However, a few circumstances exist where it still makes sense to consider an on-premises approach. For example, if most of the critical databases are on-premises and are old enough, they will not work well with cloud-based DWs. Furthermore, if the organization has to deal with strict regulatory requirements, which might include no offshore data storage, an on-premises setting might be the better choice. Nevertheless, cloud-based services provide the most flexible data warehousing service in the market in terms of storage and cloud's pay-as-you-go nature.\n<\/p><p>The organization\u2019s ecosystem also plays a key role. Adopting a DW automation tool ensures the efficient usage of IT resources, faster implementation through projects, and better support by enforcing coding standards (e.g., Wherescape, AnalytixDS, Ajilius). The data modeling planning step imparts detailed, reusable documentation of a DW\u2019s implementation. Specifically, it assesses the data structures, investigates how to efficiently represent these sources in the DW, specifies OLAP requirements, etc.\n<\/p><p>Selection of the appropriate ETL or extract, load, and transform (ELT) solution is yet another design concern.<sup id=\"rdp-ebb-cite_ref-:14_40-2\" class=\"reference\"><a href=\"#cite_note-:14-40\">[40]<\/a><\/sup> When businesses use expensive in-house analytics systems, much prep work including transformations can be conducted, as in the ETL scheme. However, ELT is a better approach when the destination is a cloud-based DW. Once data are collocated, the power of a single cloud engine can be leveraged to perform integrations and transformations efficiently. Organizations can transform their raw data at any time according to their use case, rather than a step in the data pipeline.\n<\/p><p>Semantic and reporting layers represent another consideration. Based on previously documented data models, an OLAP server is implemented to facilitate the analytical queries of the users and to empower BI systems. In this regard, data engineers should carefully consider time-to-analysis and latency requirements to assess the analytical processing capabilities of the DW. Similarly, while designing the reporting layer, the implementation of reporting interfaces or delivery methods as well as permissible access have to be set by the administrator.\n<\/p><p>Finally, ease of scalability should be considered. Understanding current business needs is critical to BI and decision making. This includes how much data the organization currently has and how quickly its needs are likely to grow. Staffing and vendor costs need to be taken into consideration while deciding the scale of growth.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Data_lake_design_aspects_for_enterprise_data_management\">Data lake design aspects for enterprise data management<\/span><\/h3>\n<p>At a high level, the concept of a DL seems to be simple. Irrespective of the format, it stores data from multiple sources in one place, leverages big data technologies, and deploys on a commodity infrastructure. However, many a time, reality may fail due to various practical constraints. Hence, it is quite important to consider several key criteria while designing an enterprise DL. Of primary concern is focusing on business objectives rather than technology. By anchoring the business objectives, a DL can prioritize the efforts and outcomes accordingly. For instance, for a particular business objective, there may be some data that are more valuable than others. This kind of comprehension and analysis is the key to an enterprise\u2019s DL success. With such an oriented goal, DLs can start small and then accordingly learn, adapt, and produce accelerated outcomes for a business. In particular, some key factors in this regard are (1) whether it solves an actual business problem, (2) if it imparts new capabilities, and (3) the access or ownership of data, among others.\n<\/p><p>Scalability and durability are two more major criteria to consider.<sup id=\"rdp-ebb-cite_ref-76\" class=\"reference\"><a href=\"#cite_note-76\">[76]<\/a><\/sup> Scalability enables scaling to any size of data while importing them in real time. This is an essential criterion for a DL since it is a centralized data repository for an entire organization. Durability deals with providing consistent uptime while ensuring no loss or corruption of data.\n<\/p><p>Another key design aspect in a DL is its capability to store unstructured, semi-structured, and structured data, which helps organizations to transfer anything from raw, unprocessed data to fully aggregated analytical outcomes.<sup id=\"rdp-ebb-cite_ref-:19_77-0\" class=\"reference\"><a href=\"#cite_note-:19-77\">[77]<\/a><\/sup> In particular, the DL has to deliver business-ready data. Practically speaking, data by themselves have no meaning. Although file formats and schemas can parse the data (e.g., JSON and <a href=\"https:\/\/www.limswiki.org\/index.php\/XML\" class=\"mw-redirect wiki-link\" title=\"XML\" data-key=\"fda82e3b4db7e4b2856b016933a1d2d1\">XML<\/a>), they fail at delivering insight into their meaning. To circumvent such a limitation, a critical component of any DL technical design is the incorporation of a knowledge catalog. Such a catalog helps in finding and understanding information assets. The knowledge catalog\u2019s contents include the semantic meaning of the data, format and ownership of data, and data policies, among other elements.\n<\/p><p>Security considerations are also of prime importance in a DL in the cloud. The three domains of security are <a href=\"https:\/\/www.limswiki.org\/index.php\/Encryption\" title=\"Encryption\" class=\"wiki-link\" data-key=\"86a503652ed5cc9d8e2b0252a480b5e1\">encryption<\/a>, network-level security, and access control. Network-level security imparts a robust defense strategy by denying inappropriate access at the network level, whereas encryption ensures security at least for those types of data that are not publicly available. Security should be part of DL design from the beginning. Compliance standards that regulate data protection and privacy are incorporated in many industries, such as the <a href=\"https:\/\/www.limswiki.org\/index.php\/Payment_Card_Industry_Data_Security_Standard\" title=\"Payment Card Industry Data Security Standard\" class=\"wiki-link\" data-key=\"3f2d3426e353c09797e25da107eb38d7\">Payment Card Industry Data Security Standard<\/a> (PCI DSS) for financial services and <a href=\"https:\/\/www.limswiki.org\/index.php\/Health_Insurance_Portability_and_Accountability_Act\" title=\"Health Insurance Portability and Accountability Act\" class=\"wiki-link\" data-key=\"b70673a0117c21576016cb7498867153\">Health Insurance Portability and Accountability Act<\/a> (HIPAA) for healthcare.<sup id=\"rdp-ebb-cite_ref-78\" class=\"reference\"><a href=\"#cite_note-78\">[78]<\/a><\/sup> Furthermore, two of the biggest regulations regarding consumer privacy\u2014California\u2019s Consumer Privacy Act (CCPA) and the European Union\u2019s <a href=\"https:\/\/www.limswiki.org\/index.php\/General_Data_Protection_Regulation\" title=\"General Data Protection Regulation\" class=\"wiki-link\" data-key=\"3f4bdf6f0dcb360b1e79aad8674c2447\">General Data Protection Regulation<\/a> (GDPR)\u2014restrict the ownership, use, and management of personal and private data.\n<\/p><p>A DL design must also include metadata storage functionality to help users to search and learn about the data sets in the lake.<sup id=\"rdp-ebb-cite_ref-:20_79-0\" class=\"reference\"><a href=\"#cite_note-:20-79\">[79]<\/a><\/sup> A DL allows the storage of all data that are independent of the fixed schema. Instead, data are read at the time of processing, should they be parsed and adapted into a schema, only as necessary. This feature saves plenty of time for enterprises.\n<\/p><p>Architecture in motion is another interesting concept (i.e., the architecture will likely include more than one DL and must be adaptable to address changing requirements). For instance, on-premises work with Hadoop could be moved to the cloud or a hybrid platform in the future. By facilitating the innovation of multi-cloud storage, a DL can be easily upgraded to be used across data centers, on premises, and in private clouds. In addition, ML and automation can augment the data flow capabilities of an enterprise\u2019s DL design.\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Tools_and_utilities\">Tools and utilities<\/span><\/h2>\n<p>In this section, we categorize and detail the popular DW and DL tools and services.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Popular_data_warehouse_tools_and_services\">Popular data warehouse tools and services<\/span><\/h3>\n<p>An enterprise DW is one of the primary components of BI.<sup id=\"rdp-ebb-cite_ref-:16_14-1\" class=\"reference\"><a href=\"#cite_note-:16-14\">[14]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-:17_16-1\" class=\"reference\"><a href=\"#cite_note-:17-16\">[16]<\/a><\/sup> It stores data from one or more heterogeneous sources and then analyzes and extracts insights from them to support decision making. Some of the popular top data warehousing tools are explained.\n<\/p><p><b>Amazon Web Services (AWS) data warehouse tools<\/b>: AWS is one of the major leaders in data warehousing solutions.<sup id=\"rdp-ebb-cite_ref-80\" class=\"reference\"><a href=\"#cite_note-80\">[80]<\/a><\/sup> AWS has many services, such as AWS Redshift, AWS S3, and Amazon Relational Database Service (ARDS), making it a very cost-effective and highly scalable platform. AWS Redshift is a suitable platform for businesses that require advanced capabilities that exploit high-end tools.<sup id=\"rdp-ebb-cite_ref-81\" class=\"reference\"><a href=\"#cite_note-81\">[81]<\/a><\/sup> It consists of an in-house team that organizes AWS\u2019s extensive menu of services. Amazon Simple Storage Service (AWS S3) is a low-cost storage solution with industry-leading scalability, performance, and security features. ARDS is an AWS cloud data storage service that runs and scales a relational database. It has resizable and cost-effective technology that facilitates an industry-standard relational database and manages all database management activities.\n<\/p><p><b>Google data warehouse tools<\/b>: Google is highly acclaimed for its data management skills along with its dominance as a search engine. Google\u2019s DW tools excel in cutting-edge structured data management and analytics by incorporating machine intelligence.<sup id=\"rdp-ebb-cite_ref-GoogleDataMan_82-0\" class=\"reference\"><a href=\"#cite_note-GoogleDataMan-82\">[82]<\/a><\/sup> Google BigQuery is a business-level cloud-based data warehousing solution platform specially designed to save time by storing and querying large data sets through using super-fast SQL searches against multi-terabyte data sets in seconds, offering customers real-time data insights. Google Cloud Data Fusion is a cloud ETL solution which is entirely managed and allows data integration at any size with a visual point-and-click interface. Dataflow is another cloud-based data-processing service that can be used to stream data in batches or in real time. Google Data Studio enables turning the data into entirely customizable, easy-to-read reports and dashboards.\n<\/p><p><b>Microsoft Azure Data Warehouse tools<\/b>: Microsoft Azure is a recent cloud computing platform that provides <a href=\"https:\/\/www.limswiki.org\/index.php\/Infrastructure_as_a_service\" title=\"Infrastructure as a service\" class=\"wiki-link\" data-key=\"70b93c66f23363688d45f0d354e5c032\">infrastructure as a service<\/a> (IaaS), <a href=\"https:\/\/www.limswiki.org\/index.php\/Platform_as_a_service\" title=\"Platform as a service\" class=\"wiki-link\" data-key=\"abad55890b97c6a6153458ad3d62762f\">platform as a service<\/a> (PaaS), and <a href=\"https:\/\/www.limswiki.org\/index.php\/Software_as_a_service\" title=\"Software as a service\" class=\"wiki-link\" data-key=\"ae8c8a7cd5ee1a264f4f0bbd4a4caedd\">software as a service<\/a> (SaaS) as well as 200+ products and cloud services.<sup id=\"rdp-ebb-cite_ref-83\" class=\"reference\"><a href=\"#cite_note-83\">[83]<\/a><\/sup> Azure SQL Database is suitable for data warehousing applications with up to 8 TB of data volume and a large number of active users, facilitating advanced query processing. Azure Synapse Analytics consists of data integration, big data analytics, and enterprise data warehousing capabilities by also integrating ML technologies.\n<\/p><p><b>Oracle Autonomous Data Warehouse<\/b>: Oracle Autonomous Data Warehouse<sup id=\"rdp-ebb-cite_ref-84\" class=\"reference\"><a href=\"#cite_note-84\">[84]<\/a><\/sup> is a cloud-based DW service that manages the complexities associated with DW development, data protection, data application development, etc. The setting, safeguarding, regulating, and backing up of data are all automated using this technology. This cloud computing solution is easy to use, secure, quick to respond, and scalable.\n<\/p><p><b>Snowflake<\/b>: Snowflake<sup id=\"rdp-ebb-cite_ref-85\" class=\"reference\"><a href=\"#cite_note-85\">[85]<\/a><\/sup> is a cloud-based DW tool offering a quick, easy-to-use, and adaptable DW platform. It has a comprehensive SaaS architecture since it runs entirely in the cloud. This makes data processing easier by permitting users to work with a single language\u2014SQL\u2014for data blending, analysis, and transformations on a variety of data types. Snowflake\u2019s multi-tenant design enables real-time data exchange throughout the enterprise without relocating data.\n<\/p><p><b>IBM Data Warehouse tools<\/b>: IBM is a preferred choice for large business clients due to its huge install base, vertical data models, various data management solutions, and real-time analytics.<sup id=\"rdp-ebb-cite_ref-IBMAnal_86-0\" class=\"reference\"><a href=\"#cite_note-IBMAnal-86\">[86]<\/a><\/sup> IBM DB2 Warehouse is a cloud DW that enables self-scaling data storage and processing and deployment flexibility. Another tool is IBM Datastage, which can take data from a source system, transform it, and feed it into a target system. This enables the users to merge data from several corporate systems using either an on-premises or cloud-based parallel architecture.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Popular_data_lake_tools_and_services\">Popular data lake tools and services<\/span><\/h3>\n<p>A DL stores structured data from relational databases, where semi-structured data, unstructured data, and binary data and can be set up on-premises or in the cloud.<sup id=\"rdp-ebb-cite_ref-87\" class=\"reference\"><a href=\"#cite_note-87\">[87]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-88\" class=\"reference\"><a href=\"#cite_note-88\">[88]<\/a><\/sup> Some of the most popular DL tools and services are analyzed.\n<\/p><p><b>Azure Data Lake<\/b>: Azure Data Lake makes it easy for developers and data scientists to store data of any size, shape, and speed and conduct all types of processing and analytics across platforms and languages.<sup id=\"rdp-ebb-cite_ref-MicrosoftDataLake_89-0\" class=\"reference\"><a href=\"#cite_note-MicrosoftDataLake-89\">[89]<\/a><\/sup> It removes the complexities associated with ingesting and storing the data and makes it faster to bring up and execute with batch, streaming, and interactive analytics.<sup id=\"rdp-ebb-cite_ref-90\" class=\"reference\"><a href=\"#cite_note-90\">[90]<\/a><\/sup> Some of the key features of Azure Data Lake include unlimited scale and data durability, on-par performance even with demanding workloads, high security with flexible mechanisms, and cost optimization through independent scaling of storage.\n<\/p><p><b>AWS<\/b>: AWS claims to provide \u201cthe most secure, scalable, comprehensive, and cost-effective portfolio of services for customers to build their data lake in the cloud.\u201d<sup id=\"rdp-ebb-cite_ref-AWSLakeForm_91-0\" class=\"reference\"><a href=\"#cite_note-AWSLakeForm-91\">[91]<\/a><\/sup> AWS Lake Formation helps to set up a secure DL that can collect and catalog data from databases and object storage, move the data into the new Amazon Simple Storage Service (S3) DL, and clean and classify the data using ML algorithms. It offers various aspects of scalability, agility, and flexibility that are required by the companies to fuse data and analytics approaches. AWS customers include NETFLIX, Zillow, NASDAQ, Yelp, and iRobot.<sup id=\"rdp-ebb-cite_ref-AWSWhatIsADataLake_92-0\" class=\"reference\"><a href=\"#cite_note-AWSWhatIsADataLake-92\">[92]<\/a><\/sup>\n<\/p><p><b>Google BigLake<\/b>: BigLake is a storage engine that unifies DWs and DLs. It removes the need to duplicate or move data, thus making the system efficient and cost-effective. BigLake provides detailed access controls and performance acceleration across BigQuery and multi-cloud DLs, with open formats to ensure a unified, flexible, and cost-effective lakehouse architecture. The top features of BigLake include (1) users being able to enforce consistent access controls across most analytics engines with a single copy of data and (2) unified governance and management at scale. Users can extend BigQuery to multi-cloud DLs and open formats with fine-grained security controls without setting up a new infrastructure.<sup id=\"rdp-ebb-cite_ref-GoogleBigLake_93-0\" class=\"reference\"><a href=\"#cite_note-GoogleBigLake-93\">[93]<\/a><\/sup>\n<\/p><p><b>Cloudera<\/b>: Cloudera SDX is a DL service for creating safe, secure, and governed DLs with protective rings around the data wherever they stored, from object stores to the HDFS. It provides the capabilities needed for (1) data schema and metadata information, (2) metadata governance and management, (3) data access authorization and authentication, and (4) compliance-ready access auditing.<sup id=\"rdp-ebb-cite_ref-ClouderaSDXData_94-0\" class=\"reference\"><a href=\"#cite_note-ClouderaSDXData-94\">[94]<\/a><\/sup>\n<\/p><p><b>Snowflake<\/b>: Snowflake\u2019s cross-cloud platform breaks down silos and enables a DL strategy. Data scientists, analysts, and developers can seamlessly leverage governed data self-service for a variety of workloads. The key features of Snowflake include (1) all data on one platform that combines structured, semi-structured, and unstructured data of any format across clouds and regions; (2) fast, reliable processing and querying, simplifying the architecture with an elastic engine to power many workloads; and (3) secure collaboration via easy integration of external data without ETL.<sup id=\"rdp-ebb-cite_ref-SnowflakeDataLake_95-0\" class=\"reference\"><a href=\"#cite_note-SnowflakeDataLake-95\">[95]<\/a><\/sup>\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Challenges\">Challenges<\/span><\/h2>\n<p>This section addresses some of the key challenges in big data analytics problems. In addition, the implementation challenges encountered in DW and DL paradigms are also critically analyzed.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Challenges_in_big_data_analytics\">Challenges in big data analytics<\/span><\/h3>\n<p>In the past few years, big data have been accumulated in every walk of human life, including healthcare, retail, public administration, and research. Web-based applications have to deal with big data frequently, such as internet text and documents (corpus, etc.), social network analysis, prediction markets, and internet search indexing.<sup id=\"rdp-ebb-cite_ref-96\" class=\"reference\"><a href=\"#cite_note-96\">[96]<\/a><\/sup> Although we can clearly observe the potential and current advantages of big data, there are some inherent challenges also present that have to be tackled to achieve the full potential of big data analytics.<sup id=\"rdp-ebb-cite_ref-97\" class=\"reference\"><a href=\"#cite_note-97\">[97]<\/a><\/sup>\n<\/p><p>The first hurdle for big data analytics is the storage mediums and higher I\/O speed.<sup id=\"rdp-ebb-cite_ref-98\" class=\"reference\"><a href=\"#cite_note-98\">[98]<\/a><\/sup> Storage of big data causes a financial overhead which is not affordable or profitable for many enterprises. Furthermore, this also results in slower processes.<sup id=\"rdp-ebb-cite_ref-99\" class=\"reference\"><a href=\"#cite_note-99\">[99]<\/a><\/sup> In decades gone by, analysts made use of hard disk drives for data storage purposes, but this is slower in terms of random I\/O performance compared with sequential I\/O. To overcome this limitation, the concept of solid-state drives (SSDs) and phase change memory were introduced. However, the currently available storage tech simply does not possess the required performance for processing big data and delivering insights in a timely fashion. Companies opt for various modern techniques to handle large data sets, such as compression (reducing the number of bits within the data), data tiering (storing data in several storage tiers), and deduplication (the process of removing duplicates and unwanted data).\n<\/p><p>Anther challenge is the lack of proper understanding of big data and the lack of knowledge professionals. Due to insufficient understanding, organizations may fail in big data initiatives. This may be due to the absence of skilled data professionals, the lack of a transparent picture for employees, or improper usage of data repositories, among other reasons. It is highly encouraged to conduct big data workshops and seminars at companies to enable every level of the organization to inculcate a basic understanding of knowledge concepts. Furthermore, companies should invest in recruiting skilled professionals, supplying training programs to the staff, as well as purchasing knowledge analytics solutions powered by advanced AI or ML tools.\n<\/p><p>Yet another challenge in big data analytics is the confusion with suitable tool selection. For instance, many a time, it is not so clear whether Hadoop or Spark is a better option for data analytics and storage. Sometimes, the wrong selection may result in poor decisions and the selection of inappropriate technology. Hence, money, time, effort, and work hours are wasted. The best solution would be to make use of experienced professionals or data consulting to obtain a recommendation for the tools that can support a company based on its scenario.\n<\/p><p>Data in a corporation come from various sources, such as customer logs, financial reports, social media platforms, e-mails, and reports created by employees. Integrating data from such a huge spread of sources is another challenging task.<sup id=\"rdp-ebb-cite_ref-100\" class=\"reference\"><a href=\"#cite_note-100\">[100]<\/a><\/sup> This consolidation task, known as <a href=\"https:\/\/www.limswiki.org\/index.php\/Data_integration\" title=\"Data integration\" class=\"wiki-link\" data-key=\"fd01c635859e1d5b9583e43e31ef6718\">data integration<\/a>, is crucial for BI. Hence, enterprises purchase proper tools for data integration purposes. Talend Data Integration, IBM InfoSphere Xplenty, Informatica PowerCenter, and Microsoft SQL QlikView are some of the popular data integration tools.<sup id=\"rdp-ebb-cite_ref-101\" class=\"reference\"><a href=\"#cite_note-101\">[101]<\/a><\/sup>\n<\/p><p>Security of huge sets of knowledge, especially ones that involve many confidential details of customers, is one of the inevitable challenges in big data analytics.<sup id=\"rdp-ebb-cite_ref-102\" class=\"reference\"><a href=\"#cite_note-102\">[102]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-103\" class=\"reference\"><a href=\"#cite_note-103\">[103]<\/a><\/sup> The careless treatment of data repositories may invite malicious hackers, which can cost millions for a stolen record or a knowledge breach. The remedy would be to foster a <a href=\"https:\/\/www.limswiki.org\/index.php\/Cybersecurity\" class=\"mw-redirect wiki-link\" title=\"Cybersecurity\" data-key=\"ba653dc2a1384e5f9f6ac9dc1a740109\">cybersecurity<\/a> division of a company to guard their data and to implement various security actions such as data encryption, data segregation, identity and access control, implementation of endpoint security, real-time security monitoring, and using big data security tools (e.g., IBM Guardian).\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Data_warehouse_implementation_challenges\">Data warehouse implementation challenges<\/span><\/h3>\n<p>Implementation of a DW requires proper planning and execution based on proper methods. Some of the major challenging considerations that arise with data warehousing are design, construction, and implementation.<sup id=\"rdp-ebb-cite_ref-104\" class=\"reference\"><a href=\"#cite_note-104\">[104]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-105\" class=\"reference\"><a href=\"#cite_note-105\">[105]<\/a><\/sup>\n<\/p><p>The efficiency and working of a DW are dependent on the data that support its operations. With incorrect or redundant data, DW managers cannot accurately measure the exact costs. A key solution is to automate the system to improve the lead data quality and make sure that the sales team receives complete, correct, and consistent lead information. Another major concern in a DW is the <a href=\"https:\/\/www.limswiki.org\/index.php\/Quality_control\" title=\"Quality control\" class=\"wiki-link\" data-key=\"1e0e0c2eb3e45aff02f5d61799821f0f\">quality control<\/a> of data (i.e., quality and consistency of data).<sup id=\"rdp-ebb-cite_ref-106\" class=\"reference\"><a href=\"#cite_note-106\">[106]<\/a><\/sup> The BI process can be fine-tuned by incorporating flexibility to accept and integrate analytics as well as update the warehouse\u2019s schema to handle evolutions.\n<\/p><p>Another major challenge is differences in naming, domain definitions, and identification numbers from heterogeneous sources. The DW has to be designed in such a way that it can accommodate the addition and attrition of data sources and the evolution of the sources and source data, thus avoiding major redesign. Yet another challenge is customizing the available source data into the data model of the DW because the capabilities of a DW may change over time based on the change in technology.<sup id=\"rdp-ebb-cite_ref-107\" class=\"reference\"><a href=\"#cite_note-107\">[107]<\/a><\/sup> Further, broader skills are required for the administration of DWs in traditional database administration. Hence, managing the DW in a large organization, the design of the management function, and selecting the management team for a database warehouse are some of the important aspects of a DW.\n<\/p><p>Data security is another critical requirement in DWs, given that business data are extremely sensitive and can be easily obtained.<sup id=\"rdp-ebb-cite_ref-108\" class=\"reference\"><a href=\"#cite_note-108\">[108]<\/a><\/sup> Unfortunately, the typical security paradigm\u2014based on tables, lines, and characteristics\u2014is incompatible with DWs. Following that, the model should be changed to one that is firmly integrated with the applicable model and is focused on the key notions of multidimensional display, such as facts, aspects, and measures. Furthermore, as is frequently advised in computer programming, <a href=\"https:\/\/www.limswiki.org\/index.php\/Information_security\" title=\"Information security\" class=\"wiki-link\" data-key=\"9eff362d944224ff1d4ffe3a149d7cff\">information security<\/a> should be considered at all stages of the improvement process, from prerequisite analysis to execution and upkeep. In addition, DW governance is yet another important consideration, which includes approval of the data modeling standards and metadata standards, the design of a data access policy, and a data <a href=\"https:\/\/www.limswiki.org\/index.php\/Backup\" title=\"Backup\" class=\"wiki-link\" data-key=\"e12548e6bf5f28bfee99099fe8662dde\">backup<\/a> strategy.<sup id=\"rdp-ebb-cite_ref-109\" class=\"reference\"><a href=\"#cite_note-109\">[109]<\/a><\/sup>\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Data_lake_implementation_challenges\">Data lake implementation challenges<\/span><\/h3>\n<p>The DL is relatively novel technology and has not matured yet. Hence, there are many challenges in its implementation, including many of the same challenges that early DWs confronted.<sup id=\"rdp-ebb-cite_ref-:19_77-1\" class=\"reference\"><a href=\"#cite_note-:19-77\">[77]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-110\" class=\"reference\"><a href=\"#cite_note-110\">[110]<\/a><\/sup> The first challenge is the high cost of DLs. They are expensive to implement and maintain. DL platforms that exploit the cloud may be easier to deploy, but they may also come with high fees. Some of the platforms such as Hadoop are open-source and hence free of cost. Nevertheless, the implementation and management may take more time and more expert staff. Management difficulty is another issue.<sup id=\"rdp-ebb-cite_ref-:19_77-2\" class=\"reference\"><a href=\"#cite_note-:19-77\">[77]<\/a><\/sup> The management of the DL involves various complex tasks, such as ensuring the capacity of the host infrastructure to cope with the growth of the DL and dealing with data redundancy and data security. This puts forth challenges even to skilled engineers. Furthermore, it is required to have more domain experts and engineers with real expertise in setting up and managing DLs. In the current scenario, there is a shortage of both data scientists and data engineers in the field. This lack of skills is yet another challenge.\n<\/p><p>Another aspect for consideration is the long time to value (i.e., it takes years to become full-fledged and to be integrated well with the <a href=\"https:\/\/www.limswiki.org\/index.php\/Workflow\" title=\"Workflow\" class=\"wiki-link\" data-key=\"92bd8748272e20d891008dcb8243e8a8\">workflow<\/a> and analytics tools to impart real value to the enterprise).<sup id=\"rdp-ebb-cite_ref-111\" class=\"reference\"><a href=\"#cite_note-111\">[111]<\/a><\/sup> As mentioned in the case of DWs, in the case of DLs, data security is also a major concern. It requires special security measures to be considered to enforce data governance rules and to secure the data in the DL with the help of cybersecurity specialists and security tools. Another critical challenge is the computation resources and increase in computing power. This is due to the fact that data are growing unprecedentedly faster than computing power. At the same rate, the existing computers are not well equipped to host and manage them at the same rate due to a lack of power. Similarly, open-source data platforms also find many core problems surrounding DLs which are too costly to manage. This also requires massive computing power to overcome such serious skill gaps.\n<\/p><p>To build a better DL, modernization of the way businesses build and manage DLs is required. One key takeaway is to take full advantage of the cloud, as opposed to building cumbersome DLs on a tailor-made infrastructure.<sup id=\"rdp-ebb-cite_ref-112\" class=\"reference\"><a href=\"#cite_note-112\">[112]<\/a><\/sup> It helps to get rid of data silos and to build DLs that are applicable to various use cases, rather than only fitting them to a certain range of needs.\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Opportunities_and_future_directions\">Opportunities and future directions<\/span><\/h2>\n<p>Based on our survey, we discuss novel trends in modern enterprise data management and point out some promising directions for future research in this section.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Data_warehouses:_Opportunities_and_future_directions\">Data warehouses: Opportunities and future directions<\/span><\/h3>\n<p>The business management landscape has witnessed a massive change with the emergence of the DW. The advancements in cloud technology, the IoT, and big data analytics have brought effective data solutions to modern DWs.<sup id=\"rdp-ebb-cite_ref-:20_79-1\" class=\"reference\"><a href=\"#cite_note-:20-79\">[79]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-113\" class=\"reference\"><a href=\"#cite_note-113\">[113]<\/a><\/sup> With the rapid evolution of technology, many enterprises have migrated their data to the cloud to expand their networks and markets. Cloud DWs help to overcome the huge costs of purchasing, infrastructure, installation, etc.<sup id=\"rdp-ebb-cite_ref-114\" class=\"reference\"><a href=\"#cite_note-114\">[114]<\/a><\/sup> Hence, in the coming years, more sophisticated technology in cloud DWs is envisaged to enhance intense, easy-to-use, and economical data clouds as well. The long-term gains for the adoption of cloud warehousing are mainly data availability and scalability. The flexibility to store a variety of data formats\u2014not just relational\u2014combined with the intrinsic flexibility of cloud-based services enables a very broad distribution of cloud services.\n<\/p><p>Another massive change is in the means of data analytics. In contrast to the older times, wherein data analytics and BI occurred in two different divisions, which delayed the overall efficiency of the system, the modern DW provides an advanced structure for storage and faster data flow, thus making them easily accessible for business users. Such an agility model is powered by data fragmentation, allowing access to and the analysis of data across the enterprise in real time.\n<\/p><p>Another big advancement is found in IoT platforms used for sharing and storing data. This has changed the face of data streaming by enabling users to store and access data across multiple devices. The concept of the IoT is more pertinent to the real world due to the increasing popularity of mobile devices, embedded and ubiquitous communication technologies, cloud computing, and data analytics. In a broader sense, as with the internet, the IoT enables devices to exist in many places and facilitates applications from trivial to the most crucial. Several technologies such as computational intelligence and big data can be incorporated together with the IoT to improve data management and knowledge discovery on a large scale. Much research in this sense has been carried out by Mishra <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-115\" class=\"reference\"><a href=\"#cite_note-115\">[115]<\/a><\/sup>\n<\/p><p>In summary, the future of DWs comprises features that enable the following:\n<\/p>\n<ul><li>All data are accessible from a single location;<\/li>\n<li>The capability to outsource the task of maintaining that service\u2019s high availability to all customers;<\/li>\n<li>Governance based on policies;<\/li>\n<li>Platforms with high user experience (UX) discoverability; and<\/li>\n<li>Platforms that cater to all customers.<\/li><\/ul>\n<h3><span class=\"mw-headline\" id=\"Data_lakes:_Opportunities_and_future_directions\">Data lakes: Opportunities and future directions<\/span><\/h3>\n<p>One of the core capabilities of a DL architecture is its ability to quickly and easily ingest multiple types of data (e.g., real-time streaming data from on-premises storage platforms, structured data generated and processed by mainframes and DWs, and unstructured or semi-structured data). The ingestion process makes use of a high degree of parallelism and low latency since it requires interfacing with external data sources with limited bandwidth. Hence, ingestion will not carry out any deep analysis of the downloaded data. However, there are possibilities for applying shallow data sketches on the downloaded contents and their metadata to maintain a basic organization of the ingested data sets.\n<\/p><p>In another phase of DL management (i.e., the data extraction stage), the raw data are transformed into a predetermined data model. Although various studies have been conducted on this topic, there still remains room for improvement. Rather than conducting extraction on one file at a time, one can take advantage of the knowledge from the history of extractions. Similarly, in the cleaning phase of the DL, not much work has not been performed in the literature other than some approaches such as CLAMS.<sup id=\"rdp-ebb-cite_ref-:18_51-1\" class=\"reference\"><a href=\"#cite_note-:18-51\">[51]<\/a><\/sup> One opportunity in this regard will be to make use of the lake\u2019s wisdom and perform collective data cleaning. In addition, it is important to investigate the possible means of errors in the lake and to get rid of them efficiently to obtain a clean DL.\n<\/p><p>The common methods to retrieve the data from the DL are query-based retrieval (i.e., a user starts a search with a query for data retrieval) and data-based retrieval (i.e., a user navigates a DL as a linkage graph or a hierarchical structure to find data of interest).<sup id=\"rdp-ebb-cite_ref-:19_77-3\" class=\"reference\"><a href=\"#cite_note-:19-77\">[77]<\/a><\/sup> A new direction may be to incorporate analysis-driven or context-driven approaches (i.e., augmenting a data set with relevant data and some contextual information to facilitate learning tasks).\n<\/p><p>Another direction of research is related to the exploration of ML in DLs. Specifically, many studies are underway focusing on ML application toward data set organization and discovery. The data set discovery task is often associated with finding \u201csimilar\u201d attributes extracted from the data, metadata, etc. which could be further coupled with classification or clustering tasks. Some recent works have leveraged ML techniques, such as the KNN classifier<sup id=\"rdp-ebb-cite_ref-116\" class=\"reference\"><a href=\"#cite_note-116\">[116]<\/a><\/sup> and a logistic regression model for optimizing feature coefficients.<sup id=\"rdp-ebb-cite_ref-117\" class=\"reference\"><a href=\"#cite_note-117\">[117]<\/a><\/sup> More advanced deep learning and similar sophisticated ML techniques are envisaged to augment the data set discovery process in the coming years.\n<\/p><p>Metadata management is an important task in a DL, since a DL does not come with descriptive data catalogs.<sup id=\"rdp-ebb-cite_ref-:19_77-4\" class=\"reference\"><a href=\"#cite_note-:19-77\">[77]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-:20_79-2\" class=\"reference\"><a href=\"#cite_note-:20-79\">[79]<\/a><\/sup> Due to the lack of such explicit metadata of data sets, especially during the discovery and cleaning of data, there is a chance for a DL to become a data swamp. Hence, it is quite necessary to extract meaningful metadata from data sources and to support efficient storage and query answering of metadata. In this field of metadata management, there remain more topics to explore further in extracting knowledge from lake data and incorporating them into existing knowledge bases. Yet another key aspect is <a href=\"https:\/\/www.limswiki.org\/index.php\/Version_control\" title=\"Version control\" class=\"wiki-link\" data-key=\"81823f6b21d385f8db9ac0a17b571cc1\">data versioning<\/a>, wherein new versions of the already existing files enter into a dynamic DL.<sup id=\"rdp-ebb-cite_ref-:20_79-3\" class=\"reference\"><a href=\"#cite_note-:20-79\">[79]<\/a><\/sup> Since versioning-related operations can affect all stages of a DL, it is a crucial aspect to address. There are some large-scale data set version control tools, such as DataHub, that provide a Git-like interface to handle version creation, branching, and merging operations. Nevertheless, more research and development may be carried out further to deal with schema evolution.\n<\/p><p>As a final note, there is an emerging data management architecture trend called the \"data lakehouse\" that couples the flexibility of a DL with the data management capabilities of a DW. Specifically, it is considered a unique data storage solution for all data\u2014unstructured, semi-structured, and structured\u2014while providing the data quality and data governance standards of a DW.<sup id=\"rdp-ebb-cite_ref-118\" class=\"reference\"><a href=\"#cite_note-118\">[118]<\/a><\/sup> Such a data lakehouse would be capable of imparting better data governance, reduced data movement and redundancy, efficient use time, etc., even with a simplified schema. This topic of the data lakehouse is envisaged to be an excellent research area of data management in the future.\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Conclusions\">Conclusions<\/span><\/h2>\n<p>Enterprises and business organizations exploit a huge volume of data to understand their customers and to make informed business decisions to stay competitive in the field. However, big data come in a variety of formats and types (e.g., structured, semi-structured and unstructured data), making it difficult for businesses to manage and use them effectively. Based on the structure of the data, typically, two types of data storage are utilized in enterprise data management: the DW and DL. Despite being used interchangeably, they are two distinct storage forms with unique characteristics that serve different purposes.\n<\/p><p>In this review, a comparative analysis of DWs and DLs was undertaken by highlighting the key differences between the two data management approaches. In particular, the definitions of the DW and DL, highlighting their characteristics and key differences, were detailed. Furthermore, the architecture and design aspects of both DWs and DLs are clearly discussed. In addition, a detailed overview of the popular DW and DL tools and services was also provided. The key challenges of big data analytics in general, as well as the challenges of implementation of DWs and DLs, were also critically analyzed in this survey. Finally, the opportunities and future research directions were contemplated. We hope that the thorough comparison of existing DWs vs. DLs and the discussion of open research challenges in this survey will motivate the future development of enterprise data management and benefit the research community significantly.\n<\/p>\n<h2><span id=\"rdp-ebb-Abbreviations,_acronyms,_and_initialisms\"><\/span><span class=\"mw-headline\" id=\"Abbreviations.2C_acronyms.2C_and_initialisms\">Abbreviations, acronyms, and initialisms<\/span><\/h2>\n<ul><li><b>AI<\/b>: artificial intelligence<\/li>\n<li><b>API<\/b>: application programming interface<\/li>\n<li><b>ARDS<\/b>: Amazon Relational Database Service<\/li>\n<li><b>AWS<\/b>: Amazon Web Services<\/li>\n<li><b>AWS S3<\/b>: AWS Simple Storage Service<\/li>\n<li><b>BI<\/b>: business intelligence<\/li>\n<li><b>CCPA<\/b>: California Consumer Privacy Act<\/li>\n<li><b>DAG<\/b>: directed acyclic graph<\/li>\n<li><b>DL<\/b>: data lake<\/li>\n<li><b>DW<\/b>: data warehouse<\/li>\n<li><b>ELT<\/b>: extract, load, and transform<\/li>\n<li><b>ETL<\/b>: extract, transform, and load<\/li>\n<li><b>GDPR<\/b>: General Data Protection Regulation<\/li>\n<li><b>HDFS<\/b>: Hadoop Distributed File System<\/li>\n<li><b>HIPAA<\/b>: Health Insurance Portability and Accountability Act<\/li>\n<li><b>IaaS<\/b>: infrastructure as a service<\/li>\n<li><b>IoT<\/b>: internet of things<\/li>\n<li><b>MDDB<\/b>: multidimensional databases<\/li>\n<li><b>ML<\/b>: machine learning<\/li>\n<li><b>MOLAP<\/b>: multidimensional OLAP<\/li>\n<li><b>MR<\/b>: MapReduce<\/li>\n<li><b>MRFR<\/b>: Market Research Future<\/li>\n<li><b>OLAP<\/b>: online analytical processing<\/li>\n<li><b>OLTP<\/b>: online transaction processing<\/li>\n<li><b>PaaS<\/b>: platform as a service<\/li>\n<li><b>PCI DSS<\/b>: Payment Card Industry Data Security Standard<\/li>\n<li><b>RDBMS<\/b>: relational database management system<\/li>\n<li><b>ROLAP<\/b>: relational OLAP<\/li>\n<li><b>SaaS<\/b>: software as a service<\/li>\n<li><b>SDDM<\/b>: SQL Developer Data Modeler<\/li>\n<li><b>SSD<\/b>: solid-state drive<\/li><\/ul>\n<h2><span class=\"mw-headline\" id=\"Acknowledgements\">Acknowledgements<\/span><\/h2>\n<h3><span class=\"mw-headline\" id=\"Author_contributions\">Author contributions<\/span><\/h3>\n<p>Conceptualization, A.N. and D.M.; methodology, A.N. and D.M.; validation, A.N.; formal analysis, D.M.; investigation, A.N.; data curation, A.N. and D.M.; writing\u2014original draft preparation, A.N. and D.M.; writing\u2014review and editing, A.N. and D.M.; visualization, A.N.; supervision, A.N.; project administration, A.N. All authors have read and agreed to the published version of the manuscript.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Funding\">Funding<\/span><\/h3>\n<p>This research received no external funding.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Conflicts_of_interest\">Conflicts of interest<\/span><\/h3>\n<p>The authors declare no conflict of interest.\n<\/p>\n<h2><span class=\"mw-headline\" id=\"References\">References<\/span><\/h2>\n<div class=\"reflist references-column-width\" style=\"-moz-column-width: 30em; -webkit-column-width: 30em; column-width: 30em; list-style-type: decimal;\">\n<div class=\"mw-references-wrap mw-references-columns\"><ol class=\"references\">\n<li id=\"cite_note-1\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-1\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Tsai, Chun-Wei; Lai, Chin-Feng; Chao, Han-Chieh; Vasilakos, Athanasios V. (1 December 2015). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.journalofbigdata.com\/content\/2\/1\/21\" target=\"_blank\">\"Big data analytics: a survey\"<\/a> (in en). <i>Journal of Big Data<\/i> <b>2<\/b> (1): 21. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1186%2Fs40537-015-0030-3\" target=\"_blank\">10.1186\/s40537-015-0030-3<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2196-1115\" target=\"_blank\">2196-1115<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/www.journalofbigdata.com\/content\/2\/1\/21\" target=\"_blank\">http:\/\/www.journalofbigdata.com\/content\/2\/1\/21<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Big+data+analytics%3A+a+survey&rft.jtitle=Journal+of+Big+Data&rft.aulast=Tsai&rft.aufirst=Chun-Wei&rft.au=Tsai%2C%26%2332%3BChun-Wei&rft.au=Lai%2C%26%2332%3BChin-Feng&rft.au=Chao%2C%26%2332%3BHan-Chieh&rft.au=Vasilakos%2C%26%2332%3BAthanasios+V.&rft.date=1+December+2015&rft.volume=2&rft.issue=1&rft.pages=21&rft_id=info:doi\/10.1186%2Fs40537-015-0030-3&rft.issn=2196-1115&rft_id=http%3A%2F%2Fwww.journalofbigdata.com%2Fcontent%2F2%2F1%2F21&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-2\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-2\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Statista Research Department (13 June 2022). <a rel=\"nofollow\" class=\"external text\" href=\"#topicHeader__wrapper\">\"Big data - Statistics & Facts\"<\/a>. Statista. Archived from <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.statista.com\/topics\/1464\/big-data\/\" target=\"_blank\">the original<\/a> on 03 October 2022<span class=\"printonly\">. <a rel=\"nofollow\" class=\"external free\" href=\"#topicHeader__wrapper\">https:\/\/web.archive.org\/web\/20221003013950\/https:\/\/www.statista.com\/topics\/1464\/big-data\/#topicHeader__wrapper<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 27 October 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Big+data+-+Statistics+%26+Facts&rft.atitle=&rft.aulast=Statista+Research+Department&rft.au=Statista+Research+Department&rft.date=13+June+2022&rft.pub=Statista&rft_id=https%3A%2F%2Fweb.archive.org%2Fweb%2F20221003013950%2Fhttps%3A%2F%2Fwww.statista.com%2Ftopics%2F1464%2Fbig-data%2F%23topicHeader__wrapper&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-3\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-3\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Wise, J. (12 October 2022). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/web.archive.org\/web\/20221110131001\/https:\/\/earthweb.com\/big-data-statistics\/\" target=\"_blank\">\"Big Data Statistics 2022: Facts, Market Size & Industry Growth\"<\/a>. <i>Earthweb<\/i>. Archived from <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/earthweb.com\/big-data-statistics\/\" target=\"_blank\">the original<\/a> on 10 November 2022<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/web.archive.org\/web\/20221110131001\/https:\/\/earthweb.com\/big-data-statistics\/\" target=\"_blank\">https:\/\/web.archive.org\/web\/20221110131001\/https:\/\/earthweb.com\/big-data-statistics\/<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Big+Data+Statistics+2022%3A+Facts%2C+Market+Size+%26+Industry+Growth&rft.atitle=Earthweb&rft.aulast=Wise%2C+J.&rft.au=Wise%2C+J.&rft.date=12+October+2022&rft_id=https%3A%2F%2Fweb.archive.org%2Fweb%2F20221110131001%2Fhttps%3A%2F%2Fearthweb.com%2Fbig-data-statistics%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-4\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-4\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Jain, A. (17 September 2016). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/web.archive.org\/web\/20220331120927\/https:\/\/www.ibm.com\/blogs\/watson-health\/the-5-vs-of-big-data\/\" target=\"_blank\">\"The 5 V's of big data\"<\/a>. <i>Watson Health Perspectives<\/i>. IBM. Archived from <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.ibm.com\/blogs\/watson-health\/the-5-vs-of-big-data\/\" target=\"_blank\">the original<\/a> on 31 March 2022<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/web.archive.org\/web\/20220331120927\/https:\/\/www.ibm.com\/blogs\/watson-health\/the-5-vs-of-big-data\/\" target=\"_blank\">https:\/\/web.archive.org\/web\/20220331120927\/https:\/\/www.ibm.com\/blogs\/watson-health\/the-5-vs-of-big-data\/<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 27 October 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=The+5+V%27s+of+big+data&rft.atitle=Watson+Health+Perspectives&rft.aulast=Jain%2C+A.&rft.au=Jain%2C+A.&rft.date=17+September+2016&rft.pub=IBM&rft_id=https%3A%2F%2Fweb.archive.org%2Fweb%2F20220331120927%2Fhttps%3A%2F%2Fwww.ibm.com%2Fblogs%2Fwatson-health%2Fthe-5-vs-of-big-data%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-5\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-5\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Gandomi, Amir; Haider, Murtaza (1 April 2015). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0268401214001066\" target=\"_blank\">\"Beyond the hype: Big data concepts, methods, and analytics\"<\/a> (in en). <i>International Journal of Information Management<\/i> <b>35<\/b> (2): 137\u2013144. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.ijinfomgt.2014.10.007\" target=\"_blank\">10.1016\/j.ijinfomgt.2014.10.007<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0268401214001066\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0268401214001066<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Beyond+the+hype%3A+Big+data+concepts%2C+methods%2C+and+analytics&rft.jtitle=International+Journal+of+Information+Management&rft.aulast=Gandomi&rft.aufirst=Amir&rft.au=Gandomi%2C%26%2332%3BAmir&rft.au=Haider%2C%26%2332%3BMurtaza&rft.date=1+April+2015&rft.volume=35&rft.issue=2&rft.pages=137%E2%80%93144&rft_id=info:doi\/10.1016%2Fj.ijinfomgt.2014.10.007&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS0268401214001066&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:0-6\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:0_6-0\">6.0<\/a><\/sup> <sup><a href=\"#cite_ref-:0_6-1\">6.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation\" id=\"rdp-ebb-CITEREFSunZouStrang2015\">Sun, Zhaohao; Zou, Huasheng; Strang, Kenneth (2015), Janssen, Marijn; M\u00e4ntym\u00e4ki, Matti; Hidders, Jan <i>et al.<\/i>., eds., <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/link.springer.com\/10.1007\/978-3-319-25013-7_16\" target=\"_blank\">\"Big Data Analytics as a Service for Business Intelligence\"<\/a> (in en), <i>Open and Big Data Management and Innovation<\/i> (Cham: Springer International Publishing) <b>9373<\/b>: 200\u2013211, <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1007%2F978-3-319-25013-7_16\" target=\"_blank\">10.1007\/978-3-319-25013-7_16<\/a>, <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-3-319-25012-0<span class=\"printonly\">, <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/link.springer.com\/10.1007\/978-3-319-25013-7_16\" target=\"_blank\">http:\/\/link.springer.com\/10.1007\/978-3-319-25013-7_16<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 2023-05-02<\/span><\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Big+Data+Analytics+as+a+Service+for+Business+Intelligence&rft.jtitle=Open+and+Big+Data+Management+and+Innovation&rft.aulast=Sun&rft.aufirst=Zhaohao&rft.au=Sun%2C%26%2332%3BZhaohao&rft.au=Zou%2C%26%2332%3BHuasheng&rft.au=Strang%2C%26%2332%3BKenneth&rft.date=2015&rft.volume=9373&rft.pages=200%E2%80%93211&rft.place=Cham&rft.pub=Springer+International+Publishing&rft_id=info:doi\/10.1007%2F978-3-319-25013-7_16&rft.isbn=978-3-319-25012-0&rft_id=http%3A%2F%2Flink.springer.com%2F10.1007%2F978-3-319-25013-7_16&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-7\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-7\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/web.archive.org\/web\/20220609081444\/https:\/\/www.reportlinker.com\/p06246484\/Big-Data-and-Analytics-Services-Global-Market-Report.html\" target=\"_blank\">\"Big Data and Analytics Services Global Market Report 2022\"<\/a>. ReportLinker. March 2022. Archived from <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.reportlinker.com\/p06246484\/Big-Data-and-Analytics-Services-Global-Market-Report.html\" target=\"_blank\">the original<\/a> on 09 June 2022<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/web.archive.org\/web\/20220609081444\/https:\/\/www.reportlinker.com\/p06246484\/Big-Data-and-Analytics-Services-Global-Market-Report.html\" target=\"_blank\">https:\/\/web.archive.org\/web\/20220609081444\/https:\/\/www.reportlinker.com\/p06246484\/Big-Data-and-Analytics-Services-Global-Market-Report.html<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 27 October 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Big+Data+and+Analytics+Services+Global+Market+Report+2022&rft.atitle=&rft.date=March+2022&rft.pub=ReportLinker&rft_id=https%3A%2F%2Fweb.archive.org%2Fweb%2F20220609081444%2Fhttps%3A%2F%2Fwww.reportlinker.com%2Fp06246484%2FBig-Data-and-Analytics-Services-Global-Market-Report.html&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-8\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-8\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Vailshery, L.S. (21 February 2022). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.statista.com\/statistics\/590054\/worldwide-business-analytics-software-vendor-market\/\" target=\"_blank\">\"Global BI & analytics software market size 2019-2025\"<\/a>. Statista<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.statista.com\/statistics\/590054\/worldwide-business-analytics-software-vendor-market\/\" target=\"_blank\">https:\/\/www.statista.com\/statistics\/590054\/worldwide-business-analytics-software-vendor-market\/<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 27 October 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Global+BI+%26+analytics+software+market+size+2019-2025&rft.atitle=&rft.aulast=Vailshery%2C+L.S.&rft.au=Vailshery%2C+L.S.&rft.date=21+February+2022&rft.pub=Statista&rft_id=https%3A%2F%2Fwww.statista.com%2Fstatistics%2F590054%2Fworldwide-business-analytics-software-vendor-market%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:1-9\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:1_9-0\">9.0<\/a><\/sup> <sup><a href=\"#cite_ref-:1_9-1\">9.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation web\">Kumar, S. (24 December 2019). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/web.archive.org\/web\/20221004042118\/https:\/\/stealthbits.com\/blog\/what-is-a-data-repository-and-what-is-it-used-for\/\" target=\"_blank\">\"What is a Data Repository and What is it Used for?\"<\/a>. Stealthbits Technologies, Inc. Archived from <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/stealthbits.com\/blog\/what-is-a-data-repository-and-what-is-it-used-for\/\" target=\"_blank\">the original<\/a> on 04 October 2022<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/web.archive.org\/web\/20221004042118\/https:\/\/stealthbits.com\/blog\/what-is-a-data-repository-and-what-is-it-used-for\/\" target=\"_blank\">https:\/\/web.archive.org\/web\/20221004042118\/https:\/\/stealthbits.com\/blog\/what-is-a-data-repository-and-what-is-it-used-for\/<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 27 October 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=What+is+a+Data+Repository+and+What+is+it+Used+for%3F&rft.atitle=&rft.aulast=Kumar%2C+S.&rft.au=Kumar%2C+S.&rft.date=24+December+2019&rft.pub=Stealthbits+Technologies%2C+Inc&rft_id=https%3A%2F%2Fweb.archive.org%2Fweb%2F20221004042118%2Fhttps%3A%2F%2Fstealthbits.com%2Fblog%2Fwhat-is-a-data-repository-and-what-is-it-used-for%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:2-10\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:2_10-0\">10.0<\/a><\/sup> <sup><a href=\"#cite_ref-:2_10-1\">10.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Khine, Pwint Phyu; Wang, Zhao Shun (2018). Eguchi, Kei; Chen, Tong. eds. <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.itm-conferences.org\/10.1051\/itmconf\/20181703025\" target=\"_blank\">\"Data lake: a new ideology in big data era\"<\/a>. <i>ITM Web of Conferences<\/i> <b>17<\/b>: 03025. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1051%2Fitmconf%2F20181703025\" target=\"_blank\">10.1051\/itmconf\/20181703025<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2271-2097\" target=\"_blank\">2271-2097<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.itm-conferences.org\/10.1051\/itmconf\/20181703025\" target=\"_blank\">https:\/\/www.itm-conferences.org\/10.1051\/itmconf\/20181703025<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Data+lake%3A+a+new+ideology+in+big+data+era&rft.jtitle=ITM+Web+of+Conferences&rft.aulast=Khine&rft.aufirst=Pwint+Phyu&rft.au=Khine%2C%26%2332%3BPwint+Phyu&rft.au=Wang%2C%26%2332%3BZhao+Shun&rft.date=2018&rft.volume=17&rft.pages=03025&rft_id=info:doi\/10.1051%2Fitmconf%2F20181703025&rft.issn=2271-2097&rft_id=https%3A%2F%2Fwww.itm-conferences.org%2F10.1051%2Fitmconf%2F20181703025&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:3-11\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:3_11-0\">11.0<\/a><\/sup> <sup><a href=\"#cite_ref-:3_11-1\">11.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Arif, Muhammad; Mujtaba, Ghulam (31 May 2015). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/gvpress.com\/journals\/IJHIT\/vol8_no5\/37.pdf\" target=\"_blank\">\"A Survey: Data Warehouse Architecture\"<\/a>. <i>International Journal of Hybrid Information Technology<\/i> <b>8<\/b> (5): 349\u2013356. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.14257%2Fijhit.2015.8.5.37\" target=\"_blank\">10.14257\/ijhit.2015.8.5.37<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/gvpress.com\/journals\/IJHIT\/vol8_no5\/37.pdf\" target=\"_blank\">http:\/\/gvpress.com\/journals\/IJHIT\/vol8_no5\/37.pdf<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=A+Survey%3A+Data+Warehouse+Architecture&rft.jtitle=International+Journal+of+Hybrid+Information+Technology&rft.aulast=Arif&rft.aufirst=Muhammad&rft.au=Arif%2C%26%2332%3BMuhammad&rft.au=Mujtaba%2C%26%2332%3BGhulam&rft.date=31+May+2015&rft.volume=8&rft.issue=5&rft.pages=349%E2%80%93356&rft_id=info:doi\/10.14257%2Fijhit.2015.8.5.37&rft_id=http%3A%2F%2Fgvpress.com%2Fjournals%2FIJHIT%2Fvol8_no5%2F37.pdf&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:4-12\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:4_12-0\">12.0<\/a><\/sup> <sup><a href=\"#cite_ref-:4_12-1\">12.1<\/a><\/sup> <sup><a href=\"#cite_ref-:4_12-2\">12.2<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation\" id=\"rdp-ebb-CITEREFEl_AissiBenjellounLoukiliLakhrissi2022\">El Aissi, Mohamed El Mehdi; Benjelloun, Sarah; Loukili, Yassine; Lakhrissi, Younes; Boushaki, Abdessamad El; Chougrad, Hiba; Elhaj Ben Ali, Safae (2022), Bennani, Saad; Lakhrissi, Younes; Khaissidi, Ghizlane <i>et al.<\/i>., eds., <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/link.springer.com\/10.1007\/978-981-33-6893-4_19\" target=\"_blank\">\"Data Lake Versus Data Warehouse Architecture: A Comparative Study\"<\/a> (in en), <i>WITS 2020<\/i> (Singapore: Springer Singapore) <b>745<\/b>: 201\u2013210, <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1007%2F978-981-33-6893-4_19\" target=\"_blank\">10.1007\/978-981-33-6893-4_19<\/a>, <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-981-336-892-7<span class=\"printonly\">, <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/link.springer.com\/10.1007\/978-981-33-6893-4_19\" target=\"_blank\">https:\/\/link.springer.com\/10.1007\/978-981-33-6893-4_19<\/a><\/span><\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Data+Lake+Versus+Data+Warehouse+Architecture%3A+A+Comparative+Study&rft.jtitle=WITS+2020&rft.aulast=El+Aissi&rft.aufirst=Mohamed+El+Mehdi&rft.au=El+Aissi%2C%26%2332%3BMohamed+El+Mehdi&rft.au=Benjelloun%2C%26%2332%3BSarah&rft.au=Loukili%2C%26%2332%3BYassine&rft.au=Lakhrissi%2C%26%2332%3BYounes&rft.au=Boushaki%2C%26%2332%3BAbdessamad+El&rft.au=Chougrad%2C%26%2332%3BHiba&rft.au=Elhaj+Ben+Ali%2C%26%2332%3BSafae&rft.date=2022&rft.volume=745&rft.pages=201%E2%80%93210&rft.place=Singapore&rft.pub=Springer+Singapore&rft_id=info:doi\/10.1007%2F978-981-33-6893-4_19&rft.isbn=978-981-336-892-7&rft_id=https%3A%2F%2Flink.springer.com%2F10.1007%2F978-981-33-6893-4_19&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:15-13\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:15_13-0\">13.0<\/a><\/sup> <sup><a href=\"#cite_ref-:15_13-1\">13.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Rehman, Khawaja Ubaid ur; Ahmad, Umair; Mahmood, Sajid (30 March 2018). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/vfast.org\/journals\/index.php\/VTCS\/article\/view\/487\" target=\"_blank\">\"A Comparative Analysis of Traditional and Cloud Data Warehouse\"<\/a>. <i>VAWKUM Transactions on Computer Sciences<\/i> <b>15<\/b> (1): 34. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.21015%2Fvtcs.v15i1.487\" target=\"_blank\">10.21015\/vtcs.v15i1.487<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2308-8168\" target=\"_blank\">2308-8168<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/vfast.org\/journals\/index.php\/VTCS\/article\/view\/487\" target=\"_blank\">https:\/\/vfast.org\/journals\/index.php\/VTCS\/article\/view\/487<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=A+Comparative+Analysis+of+Traditional+and+Cloud+Data+Warehouse&rft.jtitle=VAWKUM+Transactions+on+Computer+Sciences&rft.aulast=Rehman&rft.aufirst=Khawaja+Ubaid+ur&rft.au=Rehman%2C%26%2332%3BKhawaja+Ubaid+ur&rft.au=Ahmad%2C%26%2332%3BUmair&rft.au=Mahmood%2C%26%2332%3BSajid&rft.date=30+March+2018&rft.volume=15&rft.issue=1&rft.pages=34&rft_id=info:doi\/10.21015%2Fvtcs.v15i1.487&rft.issn=2308-8168&rft_id=https%3A%2F%2Fvfast.org%2Fjournals%2Findex.php%2FVTCS%2Farticle%2Fview%2F487&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:16-14\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:16_14-0\">14.0<\/a><\/sup> <sup><a href=\"#cite_ref-:16_14-1\">14.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Devlin, B. A.; Murphy, P. T. (1988). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/ieeexplore.ieee.org\/document\/5387658\/\" target=\"_blank\">\"An architecture for a business and information system\"<\/a>. <i>IBM Systems Journal<\/i> <b>27<\/b> (1): 60\u201380. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1147%2Fsj.271.0060\" target=\"_blank\">10.1147\/sj.271.0060<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0018-8670\" target=\"_blank\">0018-8670<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/ieeexplore.ieee.org\/document\/5387658\/\" target=\"_blank\">http:\/\/ieeexplore.ieee.org\/document\/5387658\/<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=An+architecture+for+a+business+and+information+system&rft.jtitle=IBM+Systems+Journal&rft.aulast=Devlin&rft.aufirst=B.+A.&rft.au=Devlin%2C%26%2332%3BB.+A.&rft.au=Murphy%2C%26%2332%3BP.+T.&rft.date=1988&rft.volume=27&rft.issue=1&rft.pages=60%E2%80%9380&rft_id=info:doi\/10.1147%2Fsj.271.0060&rft.issn=0018-8670&rft_id=http%3A%2F%2Fieeexplore.ieee.org%2Fdocument%2F5387658%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-15\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-15\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Garani, Georgia; Chernov, Andrey; Savvas, Ilias; Butakova, Maria (1 June 2019). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/ieeexplore.ieee.org\/document\/8795395\/\" target=\"_blank\">\"A Data Warehouse Approach for Business Intelligence\"<\/a>. <i>2019 IEEE 28th International Conference on Enabling Technologies: Infrastructure for Collaborative Enterprises (WETICE)<\/i> (Napoli, Italy: IEEE): 70\u201375. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1109%2FWETICE.2019.00022\" target=\"_blank\">10.1109\/WETICE.2019.00022<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-1-7281-0676-2<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/ieeexplore.ieee.org\/document\/8795395\/\" target=\"_blank\">https:\/\/ieeexplore.ieee.org\/document\/8795395\/<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=A+Data+Warehouse+Approach+for+Business+Intelligence&rft.jtitle=2019+IEEE+28th+International+Conference+on+Enabling+Technologies%3A+Infrastructure+for+Collaborative+Enterprises+%28WETICE%29&rft.aulast=Garani&rft.aufirst=Georgia&rft.au=Garani%2C%26%2332%3BGeorgia&rft.au=Chernov%2C%26%2332%3BAndrey&rft.au=Savvas%2C%26%2332%3BIlias&rft.au=Butakova%2C%26%2332%3BMaria&rft.date=1+June+2019&rft.pages=70%E2%80%9375&rft.place=Napoli%2C+Italy&rft.pub=IEEE&rft_id=info:doi\/10.1109%2FWETICE.2019.00022&rft.isbn=978-1-7281-0676-2&rft_id=https%3A%2F%2Fieeexplore.ieee.org%2Fdocument%2F8795395%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:17-16\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:17_16-0\">16.0<\/a><\/sup> <sup><a href=\"#cite_ref-:17_16-1\">16.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Gupta, V.; Singh, J. (2014). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.ijcsit.com\/docs\/Volume%205\/vol5issue06\/ijcsit20140506304.pdf\" target=\"_blank\">\"A Review of Data Warehousing and Business Intelligence in different perspective\"<\/a> (PDF). <i>International Journal of Computer Science & Information Technologies<\/i> <b>5<\/b> (6): 8263\u20138. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0975-9646\" target=\"_blank\">0975-9646<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.ijcsit.com\/docs\/Volume%205\/vol5issue06\/ijcsit20140506304.pdf\" target=\"_blank\">https:\/\/www.ijcsit.com\/docs\/Volume%205\/vol5issue06\/ijcsit20140506304.pdf<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=A+Review+of+Data+Warehousing+and+Business+Intelligence+in+different+perspective&rft.jtitle=International+Journal+of+Computer+Science+%26+Information+Technologies&rft.aulast=Gupta%2C+V.%3B+Singh%2C+J.&rft.au=Gupta%2C+V.%3B+Singh%2C+J.&rft.date=2014&rft.volume=5&rft.issue=6&rft.pages=8263%E2%80%938&rft.issn=0975-9646&rft_id=https%3A%2F%2Fwww.ijcsit.com%2Fdocs%2FVolume%25205%2Fvol5issue06%2Fijcsit20140506304.pdf&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-17\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-17\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Sagiroglu, Seref; Sinanc, Duygu (1 May 2013). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/ieeexplore.ieee.org\/document\/6567202\/\" target=\"_blank\">\"Big data: A review\"<\/a>. <i>2013 International Conference on Collaboration Technologies and Systems (CTS)<\/i>: 42\u201347. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1109%2FCTS.2013.6567202\" target=\"_blank\">10.1109\/CTS.2013.6567202<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/ieeexplore.ieee.org\/document\/6567202\/\" target=\"_blank\">https:\/\/ieeexplore.ieee.org\/document\/6567202\/<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Big+data%3A+A+review&rft.jtitle=2013+International+Conference+on+Collaboration+Technologies+and+Systems+%28CTS%29&rft.aulast=Sagiroglu&rft.aufirst=Seref&rft.au=Sagiroglu%2C%26%2332%3BSeref&rft.au=Sinanc%2C%26%2332%3BDuygu&rft.date=1+May+2013&rft.pages=42%E2%80%9347&rft_id=info:doi\/10.1109%2FCTS.2013.6567202&rft_id=https%3A%2F%2Fieeexplore.ieee.org%2Fdocument%2F6567202%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-MooreThe7-18\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-MooreThe7_18-0\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Moore, M. (7 April 2016). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/impact.com\/marketing-intelligence\/7-vs-big-data\/\" target=\"_blank\">\"The 7 V\u2019s of Big Data\"<\/a>. <i>Impact.com<\/i><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/impact.com\/marketing-intelligence\/7-vs-big-data\/\" target=\"_blank\">https:\/\/impact.com\/marketing-intelligence\/7-vs-big-data\/<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 25 September 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=The+7+V%E2%80%99s+of+Big+Data&rft.atitle=Impact.com&rft.aulast=Moore%2C+M.&rft.au=Moore%2C+M.&rft.date=7+April+2016&rft_id=https%3A%2F%2Fimpact.com%2Fmarketing-intelligence%2F7-vs-big-data%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-19\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-19\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Miloslavskaya, Natalia; Tolstoy, Alexander (1 August 2016). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/ieeexplore.ieee.org\/document\/7592715\/\" target=\"_blank\">\"Application of Big Data, Fast Data, and Data Lake Concepts to Information Security Issues\"<\/a>. <i>2016 IEEE 4th International Conference on Future Internet of Things and Cloud Workshops (FiCloudW)<\/i> (Vienna, Austria: IEEE): 148\u2013153. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1109%2FW-FiCloud.2016.41\" target=\"_blank\">10.1109\/W-FiCloud.2016.41<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-1-5090-3946-3<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/ieeexplore.ieee.org\/document\/7592715\/\" target=\"_blank\">http:\/\/ieeexplore.ieee.org\/document\/7592715\/<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Application+of+Big+Data%2C+Fast+Data%2C+and+Data+Lake+Concepts+to+Information+Security+Issues&rft.jtitle=2016+IEEE+4th+International+Conference+on+Future+Internet+of+Things+and+Cloud+Workshops+%28FiCloudW%29&rft.aulast=Miloslavskaya&rft.aufirst=Natalia&rft.au=Miloslavskaya%2C%26%2332%3BNatalia&rft.au=Tolstoy%2C%26%2332%3BAlexander&rft.date=1+August+2016&rft.pages=148%E2%80%93153&rft.place=Vienna%2C+Austria&rft.pub=IEEE&rft_id=info:doi\/10.1109%2FW-FiCloud.2016.41&rft.isbn=978-1-5090-3946-3&rft_id=http%3A%2F%2Fieeexplore.ieee.org%2Fdocument%2F7592715%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-20\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-20\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Giebler, Corinna; Stach, Christoph; Schwarz, Holger; Mitschang, Bernhard (2018). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.scitepress.org\/DigitalLibrary\/Link.aspx?doi=10.5220\/0006861802940301\" target=\"_blank\">\"BRAID - A Hybrid Processing Architecture for Big Data:\"<\/a>. <i>Proceedings of the 7th International Conference on Data Science, Technology and Applications<\/i> (Porto, Portugal: SCITEPRESS - Science and Technology Publications): 294\u2013301. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.5220%2F0006861802940301\" target=\"_blank\">10.5220\/0006861802940301<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-989-758-318-6<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/www.scitepress.org\/DigitalLibrary\/Link.aspx?doi=10.5220\/0006861802940301\" target=\"_blank\">http:\/\/www.scitepress.org\/DigitalLibrary\/Link.aspx?doi=10.5220\/0006861802940301<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=BRAID+-+A+Hybrid+Processing+Architecture+for+Big+Data%3A&rft.jtitle=Proceedings+of+the+7th+International+Conference+on+Data+Science%2C+Technology+and+Applications&rft.aulast=Giebler&rft.aufirst=Corinna&rft.au=Giebler%2C%26%2332%3BCorinna&rft.au=Stach%2C%26%2332%3BChristoph&rft.au=Schwarz%2C%26%2332%3BHolger&rft.au=Mitschang%2C%26%2332%3BBernhard&rft.date=2018&rft.pages=294%E2%80%93301&rft.place=Porto%2C+Portugal&rft.pub=SCITEPRESS+-+Science+and+Technology+Publications&rft_id=info:doi\/10.5220%2F0006861802940301&rft.isbn=978-989-758-318-6&rft_id=http%3A%2F%2Fwww.scitepress.org%2FDigitalLibrary%2FLink.aspx%3Fdoi%3D10.5220%2F0006861802940301&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-21\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-21\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Lin, Jimmy (2017). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/ieeexplore.ieee.org\/document\/8039313\/\" target=\"_blank\">\"The Lambda and the Kappa\"<\/a>. <i>IEEE Internet Computing<\/i> <b>21<\/b> (5): 60\u201366. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1109%2FMIC.2017.3481351\" target=\"_blank\">10.1109\/MIC.2017.3481351<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1089-7801\" target=\"_blank\">1089-7801<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/ieeexplore.ieee.org\/document\/8039313\/\" target=\"_blank\">http:\/\/ieeexplore.ieee.org\/document\/8039313\/<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=The+Lambda+and+the+Kappa&rft.jtitle=IEEE+Internet+Computing&rft.aulast=Lin&rft.aufirst=Jimmy&rft.au=Lin%2C%26%2332%3BJimmy&rft.date=2017&rft.volume=21&rft.issue=5&rft.pages=60%E2%80%9366&rft_id=info:doi\/10.1109%2FMIC.2017.3481351&rft.issn=1089-7801&rft_id=http%3A%2F%2Fieeexplore.ieee.org%2Fdocument%2F8039313%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:5-22\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:5_22-0\">22.0<\/a><\/sup> <sup><a href=\"#cite_ref-:5_22-1\">22.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation web\">Devlin, B. (20 April 2020). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.irmconnects.com\/thirty-years-of-data-warehousing-part-1\/\" target=\"_blank\">\"Thirty Years of Data Warehousing \u2013 Part 1\"<\/a>. <i>IRM UK connects<\/i><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.irmconnects.com\/thirty-years-of-data-warehousing-part-1\/\" target=\"_blank\">https:\/\/www.irmconnects.com\/thirty-years-of-data-warehousing-part-1\/<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 27 October 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Thirty+Years+of+Data+Warehousing+%E2%80%93+Part+1&rft.atitle=IRM+UK+connects&rft.aulast=Devlin%2C+B.&rft.au=Devlin%2C+B.&rft.date=20+April+2020&rft_id=https%3A%2F%2Fwww.irmconnects.com%2Fthirty-years-of-data-warehousing-part-1%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-23\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-23\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation book\">Inmon, William H. (2005). <i>Building the data warehouse<\/i> (4th ed ed.). Indianapolis, Ind: Wiley. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-0-7645-9944-6.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=book&rft.btitle=Building+the+data+warehouse&rft.aulast=Inmon&rft.aufirst=William+H.&rft.au=Inmon%2C%26%2332%3BWilliam+H.&rft.date=2005&rft.edition=4th+ed&rft.place=Indianapolis%2C+Ind&rft.pub=Wiley&rft.isbn=978-0-7645-9944-6&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-24\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-24\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Chandra, Pravin; Gupta, Manoj K. (1 June 2018). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/link.springer.com\/10.1007\/s41870-017-0067-y\" target=\"_blank\">\"Comprehensive survey on data warehousing research\"<\/a> (in en). <i>International Journal of Information Technology<\/i> <b>10<\/b> (2): 217\u2013224. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1007%2Fs41870-017-0067-y\" target=\"_blank\">10.1007\/s41870-017-0067-y<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2511-2104\" target=\"_blank\">2511-2104<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/link.springer.com\/10.1007\/s41870-017-0067-y\" target=\"_blank\">http:\/\/link.springer.com\/10.1007\/s41870-017-0067-y<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Comprehensive+survey+on+data+warehousing+research&rft.jtitle=International+Journal+of+Information+Technology&rft.aulast=Chandra&rft.aufirst=Pravin&rft.au=Chandra%2C%26%2332%3BPravin&rft.au=Gupta%2C%26%2332%3BManoj+K.&rft.date=1+June+2018&rft.volume=10&rft.issue=2&rft.pages=217%E2%80%93224&rft_id=info:doi\/10.1007%2Fs41870-017-0067-y&rft.issn=2511-2104&rft_id=http%3A%2F%2Flink.springer.com%2F10.1007%2Fs41870-017-0067-y&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-25\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-25\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Sim\u00f5es, D. (October 2010). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.researchgate.net\/profile\/Dora-Simoes\/publication\/233813118_Enterprise_Data_Warehouses_A_conceptual_framework_for_a_successful_implementation\/links\/09e4150c654d7e5312000000\/Enterprise-Data-Warehouses-A-conceptual-framework-for-a-successful-implementation.pdf\" target=\"_blank\">\"Enterprise data warehouses: A conceptual framework for a successful implementation\"<\/a> (PDF). <i>Proceedings of the 2010 Canadian Council for Small Business & Entrepreneurship Annual Conference<\/i>: 1\u201319<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.researchgate.net\/profile\/Dora-Simoes\/publication\/233813118_Enterprise_Data_Warehouses_A_conceptual_framework_for_a_successful_implementation\/links\/09e4150c654d7e5312000000\/Enterprise-Data-Warehouses-A-conceptual-framework-for-a-successful-implementation.pdf\" target=\"_blank\">https:\/\/www.researchgate.net\/profile\/Dora-Simoes\/publication\/233813118_Enterprise_Data_Warehouses_A_conceptual_framework_for_a_successful_implementation\/links\/09e4150c654d7e5312000000\/Enterprise-Data-Warehouses-A-conceptual-framework-for-a-successful-implementation.pdf<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Enterprise+data+warehouses%3A+A+conceptual+framework+for+a+successful+implementation&rft.jtitle=Proceedings+of+the+2010+Canadian+Council+for+Small+Business+%26+Entrepreneurship+Annual+Conference&rft.aulast=Sim%C3%B5es%2C+D.&rft.au=Sim%C3%B5es%2C+D.&rft.date=October+2010&rft.pages=1%E2%80%9319&rft_id=https%3A%2F%2Fwww.researchgate.net%2Fprofile%2FDora-Simoes%2Fpublication%2F233813118_Enterprise_Data_Warehouses_A_conceptual_framework_for_a_successful_implementation%2Flinks%2F09e4150c654d7e5312000000%2FEnterprise-Data-Warehouses-A-conceptual-framework-for-a-successful-implementation.pdf&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-26\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-26\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Al-Debei, M.M. (2011). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/eacademic.ju.edu.jo\/m.aldebei\/Lists\/Published%20Research\/DispForm.aspx?ID=15\" target=\"_blank\">\"Data Warehouse as a Backbone for Business Intelligence: Issues and Challenges\"<\/a>. <i>European Journal of Economics, Finance and Administrative Sciences<\/i> <b>33<\/b> (2011): 153\u201366<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/eacademic.ju.edu.jo\/m.aldebei\/Lists\/Published%20Research\/DispForm.aspx?ID=15\" target=\"_blank\">http:\/\/eacademic.ju.edu.jo\/m.aldebei\/Lists\/Published%20Research\/DispForm.aspx?ID=15<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Data+Warehouse+as+a+Backbone+for+Business+Intelligence%3A+Issues+and+Challenges&rft.jtitle=European+Journal+of+Economics%2C+Finance+and+Administrative+Sciences&rft.aulast=Al-Debei%2C+M.M.&rft.au=Al-Debei%2C+M.M.&rft.date=2011&rft.volume=33&rft.issue=2011&rft.pages=153%E2%80%9366&rft_id=http%3A%2F%2Feacademic.ju.edu.jo%2Fm.aldebei%2FLists%2FPublished%2520Research%2FDispForm.aspx%3FID%3D15&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-27\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-27\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Market Research Future (9 December 2021). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/finance.yahoo.com\/news\/data-warehouse-dwaas-market-predicted-153000649.html\" target=\"_blank\">\"Data Warehouse as a Service (DWaaS) Market Predicted to Garner USD 7.69 Billion at a CAGR of 24.5% by 2028 - Report by Market Research Future (MRFR)\"<\/a>. <i>yahoo! finance<\/i><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/finance.yahoo.com\/news\/data-warehouse-dwaas-market-predicted-153000649.html\" target=\"_blank\">https:\/\/finance.yahoo.com\/news\/data-warehouse-dwaas-market-predicted-153000649.html<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 27 October 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Data+Warehouse+as+a+Service+%28DWaaS%29+Market+Predicted+to+Garner+USD+7.69+Billion+at+a+CAGR+of+24.5%25+by+2028+-+Report+by+Market+Research+Future+%28MRFR%29&rft.atitle=yahoo%21+finance&rft.aulast=Market+Research+Future&rft.au=Market+Research+Future&rft.date=9+December+2021&rft_id=https%3A%2F%2Ffinance.yahoo.com%2Fnews%2Fdata-warehouse-dwaas-market-predicted-153000649.html&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-28\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-28\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Chaudhuri, Surajit; Dayal, Umeshwar (1 March 1997). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/dl.acm.org\/doi\/10.1145\/248603.248616\" target=\"_blank\">\"An overview of data warehousing and OLAP technology\"<\/a> (in en). <i>ACM SIGMOD Record<\/i> <b>26<\/b> (1): 65\u201374. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1145%2F248603.248616\" target=\"_blank\">10.1145\/248603.248616<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0163-5808\" target=\"_blank\">0163-5808<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/dl.acm.org\/doi\/10.1145\/248603.248616\" target=\"_blank\">https:\/\/dl.acm.org\/doi\/10.1145\/248603.248616<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=An+overview+of+data+warehousing+and+OLAP+technology&rft.jtitle=ACM+SIGMOD+Record&rft.aulast=Chaudhuri&rft.aufirst=Surajit&rft.au=Chaudhuri%2C%26%2332%3BSurajit&rft.au=Dayal%2C%26%2332%3BUmeshwar&rft.date=1+March+1997&rft.volume=26&rft.issue=1&rft.pages=65%E2%80%9374&rft_id=info:doi\/10.1145%2F248603.248616&rft.issn=0163-5808&rft_id=https%3A%2F%2Fdl.acm.org%2Fdoi%2F10.1145%2F248603.248616&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:6-29\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:6_29-0\">29.0<\/a><\/sup> <sup><a href=\"#cite_ref-:6_29-1\">29.1<\/a><\/sup> <sup><a href=\"#cite_ref-:6_29-2\">29.2<\/a><\/sup> <sup><a href=\"#cite_ref-:6_29-3\">29.3<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation web\">Codd, E.F.; Codd, S.B.; Salley, C.T. (1993). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.estgv.ipv.pt\/PaginasPessoais\/jloureiro\/ESI_AID2007_2008\/fichas\/codd.pdf\" target=\"_blank\">\"Providing OLAP to User-Analysts: An IT Mandate\"<\/a> (PDF). E. F. Codd & Associates. pp. 1\u201320<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/www.estgv.ipv.pt\/PaginasPessoais\/jloureiro\/ESI_AID2007_2008\/fichas\/codd.pdf\" target=\"_blank\">http:\/\/www.estgv.ipv.pt\/PaginasPessoais\/jloureiro\/ESI_AID2007_2008\/fichas\/codd.pdf<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Providing+OLAP+to+User-Analysts%3A+An+IT+Mandate&rft.atitle=&rft.aulast=Codd%2C+E.F.%3B+Codd%2C+S.B.%3B+Salley%2C+C.T.&rft.au=Codd%2C+E.F.%3B+Codd%2C+S.B.%3B+Salley%2C+C.T.&rft.date=1993&rft.pages=pp.+1%E2%80%9320&rft.pub=E.+F.+Codd+%26+Associates&rft_id=http%3A%2F%2Fwww.estgv.ipv.pt%2FPaginasPessoais%2Fjloureiro%2FESI_AID2007_2008%2Ffichas%2Fcodd.pdf&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-30\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-30\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Gupta, A. (2020). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.datachannel.co\/blogs\/best-applications-of-data-warehousing\" target=\"_blank\">\"The Best Applications of Data Warehousing\"<\/a>. <i>DataChannel Blog<\/i>. DataChannel Technologies<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.datachannel.co\/blogs\/best-applications-of-data-warehousing\" target=\"_blank\">https:\/\/www.datachannel.co\/blogs\/best-applications-of-data-warehousing<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 27 October 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=The+Best+Applications+of+Data+Warehousing&rft.atitle=DataChannel+Blog&rft.aulast=Gupta%2C+A.&rft.au=Gupta%2C+A.&rft.date=2020&rft.pub=DataChannel+Technologies&rft_id=https%3A%2F%2Fwww.datachannel.co%2Fblogs%2Fbest-applications-of-data-warehousing&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:7-31\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:7_31-0\">31.0<\/a><\/sup> <sup><a href=\"#cite_ref-:7_31-1\">31.1<\/a><\/sup> <sup><a href=\"#cite_ref-:7_31-2\">31.2<\/a><\/sup> <sup><a href=\"#cite_ref-:7_31-3\">31.3<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Hai, Rihan; Koutras, Christos; Quix, Christoph; Jarke, Matthias (2021). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/arxiv.org\/abs\/2106.09592\" target=\"_blank\"><i>Data Lakes: A Survey of Functions and Systems<\/i><\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.48550%2FARXIV.2106.09592\" target=\"_blank\">10.48550\/ARXIV.2106.09592<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/arxiv.org\/abs\/2106.09592\" target=\"_blank\">https:\/\/arxiv.org\/abs\/2106.09592<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=book&rft.btitle=Data+Lakes%3A+A+Survey+of+Functions+and+Systems&rft.aulast=Hai&rft.aufirst=Rihan&rft.au=Hai%2C%26%2332%3BRihan&rft.au=Koutras%2C%26%2332%3BChristos&rft.au=Quix%2C%26%2332%3BChristoph&rft.au=Jarke%2C%26%2332%3BMatthias&rft.date=2021&rft_id=info:doi\/10.48550%2FARXIV.2106.09592&rft_id=https%3A%2F%2Farxiv.org%2Fabs%2F2106.09592&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:8-32\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:8_32-0\">32.0<\/a><\/sup> <sup><a href=\"#cite_ref-:8_32-1\">32.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Zagan, Elisabeta; Danubianu, Mirela (1 May 2020). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/ieeexplore.ieee.org\/document\/9108912\/\" target=\"_blank\">\"Data Lake Approaches: A Survey\"<\/a>. <i>2020 International Conference on Development and Application Systems (DAS)<\/i> (Suceava, Romania: IEEE): 189\u2013193. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1109%2FDAS49615.2020.9108912\" target=\"_blank\">10.1109\/DAS49615.2020.9108912<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-1-7281-6870-8<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/ieeexplore.ieee.org\/document\/9108912\/\" target=\"_blank\">https:\/\/ieeexplore.ieee.org\/document\/9108912\/<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Data+Lake+Approaches%3A+A+Survey&rft.jtitle=2020+International+Conference+on+Development+and+Application+Systems+%28DAS%29&rft.aulast=Zagan&rft.aufirst=Elisabeta&rft.au=Zagan%2C%26%2332%3BElisabeta&rft.au=Danubianu%2C%26%2332%3BMirela&rft.date=1+May+2020&rft.pages=189%E2%80%93193&rft.place=Suceava%2C+Romania&rft.pub=IEEE&rft_id=info:doi\/10.1109%2FDAS49615.2020.9108912&rft.isbn=978-1-7281-6870-8&rft_id=https%3A%2F%2Fieeexplore.ieee.org%2Fdocument%2F9108912%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:9-33\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:9_33-0\">33.0<\/a><\/sup> <sup><a href=\"#cite_ref-:9_33-1\">33.1<\/a><\/sup> <sup><a href=\"#cite_ref-:9_33-2\">33.2<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation\" id=\"rdp-ebb-CITEREFCherradiEL_Haddadi2022\">Cherradi, Mohamed; EL Haddadi, Anass (2022), Ben Ahmed, Mohamed; Boudhir, Anouar Abdelhakim; Kara\u0219, \u0130smail Rak\u0131p <i>et al.<\/i>., eds., <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/link.springer.com\/10.1007\/978-3-030-94191-8_66\" target=\"_blank\">\"Data Lakes: A Survey Paper\"<\/a> (in en), <i>Innovations in Smart Cities Applications Volume 5<\/i> (Cham: Springer International Publishing) <b>393<\/b>: 823\u2013835, <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1007%2F978-3-030-94191-8_66\" target=\"_blank\">10.1007\/978-3-030-94191-8_66<\/a>, <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-3-030-94190-1<span class=\"printonly\">, <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/link.springer.com\/10.1007\/978-3-030-94191-8_66\" target=\"_blank\">https:\/\/link.springer.com\/10.1007\/978-3-030-94191-8_66<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 2023-05-02<\/span><\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Data+Lakes%3A+A+Survey+Paper&rft.jtitle=Innovations+in+Smart+Cities+Applications+Volume+5&rft.aulast=Cherradi&rft.aufirst=Mohamed&rft.au=Cherradi%2C%26%2332%3BMohamed&rft.au=EL+Haddadi%2C%26%2332%3BAnass&rft.date=2022&rft.volume=393&rft.pages=823%E2%80%93835&rft.place=Cham&rft.pub=Springer+International+Publishing&rft_id=info:doi\/10.1007%2F978-3-030-94191-8_66&rft.isbn=978-3-030-94190-1&rft_id=https%3A%2F%2Flink.springer.com%2F10.1007%2F978-3-030-94191-8_66&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:10-34\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:10_34-0\">34.0<\/a><\/sup> <sup><a href=\"#cite_ref-:10_34-1\">34.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation web\">Dixon, J. (14 October 2010). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/jamesdixon.wordpress.com\/2010\/10\/14\/pentaho-hadoop-and-data-lakes\/\" target=\"_blank\">\"Pentaho, Hadoop, and Data Lakes\"<\/a>. <i>James Dixon's Blog<\/i><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/jamesdixon.wordpress.com\/2010\/10\/14\/pentaho-hadoop-and-data-lakes\/\" target=\"_blank\">https:\/\/jamesdixon.wordpress.com\/2010\/10\/14\/pentaho-hadoop-and-data-lakes\/<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 27 October 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Pentaho%2C+Hadoop%2C+and+Data+Lakes&rft.atitle=James+Dixon%27s+Blog&rft.aulast=Dixon%2C+J.&rft.au=Dixon%2C+J.&rft.date=14+October+2010&rft_id=https%3A%2F%2Fjamesdixon.wordpress.com%2F2010%2F10%2F14%2Fpentaho-hadoop-and-data-lakes%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-35\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-35\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">King, T. (3 March 2016). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/solutionsreview.com\/data-integration\/the-emergence-of-data-lake-pros-and-cons\/\" target=\"_blank\">\"The Emergence of Data Lake: Pros and Cons\"<\/a>. <i>Solutions Review<\/i><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/solutionsreview.com\/data-integration\/the-emergence-of-data-lake-pros-and-cons\/\" target=\"_blank\">https:\/\/solutionsreview.com\/data-integration\/the-emergence-of-data-lake-pros-and-cons\/<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 27 October 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=The+Emergence+of+Data+Lake%3A+Pros+and+Cons&rft.atitle=Solutions+Review&rft.aulast=King%2C+T.&rft.au=King%2C+T.&rft.date=3+March+2016&rft_id=https%3A%2F%2Fsolutionsreview.com%2Fdata-integration%2Fthe-emergence-of-data-lake-pros-and-cons%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-36\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-36\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Alrehamy, Hassan; Walker, Coral (2015) (in en). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/rgdoi.net\/10.13140\/RG.2.1.2817.8641\" target=\"_blank\"><i>Personal Data Lake With Data Gravity Pull<\/i><\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.13140%2FRG.2.1.2817.8641\" target=\"_blank\">10.13140\/RG.2.1.2817.8641<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/rgdoi.net\/10.13140\/RG.2.1.2817.8641\" target=\"_blank\">http:\/\/rgdoi.net\/10.13140\/RG.2.1.2817.8641<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=book&rft.btitle=Personal+Data+Lake+With+Data+Gravity+Pull&rft.aulast=Alrehamy&rft.aufirst=Hassan&rft.au=Alrehamy%2C%26%2332%3BHassan&rft.au=Walker%2C%26%2332%3BCoral&rft.date=2015&rft_id=info:doi\/10.13140%2FRG.2.1.2817.8641&rft_id=http%3A%2F%2Frgdoi.net%2F10.13140%2FRG.2.1.2817.8641&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:11-37\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:11_37-0\">37.0<\/a><\/sup> <sup><a href=\"#cite_ref-:11_37-1\">37.1<\/a><\/sup> <sup><a href=\"#cite_ref-:11_37-2\">37.2<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Yang, Qishan; Ge, Mouzhi; Helfert, Markus (2019). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.scitepress.org\/DigitalLibrary\/Link.aspx?doi=10.5220\/0007728006040611\" target=\"_blank\">\"Analysis of Data Warehouse Architectures: Modeling and Classification:\"<\/a>. <i>Proceedings of the 21st International Conference on Enterprise Information Systems<\/i> (Heraklion, Crete, Greece: SCITEPRESS - Science and Technology Publications): 604\u2013611. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.5220%2F0007728006040611\" target=\"_blank\">10.5220\/0007728006040611<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-989-758-372-8<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/www.scitepress.org\/DigitalLibrary\/Link.aspx?doi=10.5220\/0007728006040611\" target=\"_blank\">http:\/\/www.scitepress.org\/DigitalLibrary\/Link.aspx?doi=10.5220\/0007728006040611<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Analysis+of+Data+Warehouse+Architectures%3A+Modeling+and+Classification%3A&rft.jtitle=Proceedings+of+the+21st+International+Conference+on+Enterprise+Information+Systems&rft.aulast=Yang&rft.aufirst=Qishan&rft.au=Yang%2C%26%2332%3BQishan&rft.au=Ge%2C%26%2332%3BMouzhi&rft.au=Helfert%2C%26%2332%3BMarkus&rft.date=2019&rft.pages=604%E2%80%93611&rft.place=Heraklion%2C+Crete%2C+Greece&rft.pub=SCITEPRESS+-+Science+and+Technology+Publications&rft_id=info:doi\/10.5220%2F0007728006040611&rft.isbn=978-989-758-372-8&rft_id=http%3A%2F%2Fwww.scitepress.org%2FDigitalLibrary%2FLink.aspx%3Fdoi%3D10.5220%2F0007728006040611&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:12-38\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:12_38-0\">38.0<\/a><\/sup> <sup><a href=\"#cite_ref-:12_38-1\">38.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Yessad, Lamia; Labiod, Aissa (1 November 2016). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/ieeexplore.ieee.org\/document\/7815845\/\" target=\"_blank\">\"Comparative study of data warehouses modeling approaches: Inmon, Kimball and Data Vault\"<\/a>. <i>2016 International Conference on System Reliability and Science (ICSRS)<\/i> (Paris, France: IEEE): 95\u201399. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1109%2FICSRS.2016.7815845\" target=\"_blank\">10.1109\/ICSRS.2016.7815845<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-1-5090-3277-8<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/ieeexplore.ieee.org\/document\/7815845\/\" target=\"_blank\">http:\/\/ieeexplore.ieee.org\/document\/7815845\/<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Comparative+study+of+data+warehouses+modeling+approaches%3A+Inmon%2C+Kimball+and+Data+Vault&rft.jtitle=2016+International+Conference+on+System+Reliability+and+Science+%28ICSRS%29&rft.aulast=Yessad&rft.aufirst=Lamia&rft.au=Yessad%2C%26%2332%3BLamia&rft.au=Labiod%2C%26%2332%3BAissa&rft.date=1+November+2016&rft.pages=95%E2%80%9399&rft.place=Paris%2C+France&rft.pub=IEEE&rft_id=info:doi\/10.1109%2FICSRS.2016.7815845&rft.isbn=978-1-5090-3277-8&rft_id=http%3A%2F%2Fieeexplore.ieee.org%2Fdocument%2F7815845%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:13-39\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:13_39-0\">39.0<\/a><\/sup> <sup><a href=\"#cite_ref-:13_39-1\">39.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Oueslati, Wided; Akaichi, Jalel (30 November 2010). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.airccse.org\/journal\/ijdms\/papers\/1110ijdms02.pdf\" target=\"_blank\">\"A Survey on Data Warehouse Evolution\"<\/a>. <i>International Journal of Database Management Systems<\/i> <b>2<\/b> (4): 11\u201324. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.5121%2Fijdms.2010.2402\" target=\"_blank\">10.5121\/ijdms.2010.2402<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/www.airccse.org\/journal\/ijdms\/papers\/1110ijdms02.pdf\" target=\"_blank\">http:\/\/www.airccse.org\/journal\/ijdms\/papers\/1110ijdms02.pdf<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=A+Survey+on+Data+Warehouse+Evolution&rft.jtitle=International+Journal+of+Database+Management+Systems&rft.aulast=Oueslati&rft.aufirst=Wided&rft.au=Oueslati%2C%26%2332%3BWided&rft.au=Akaichi%2C%26%2332%3BJalel&rft.date=30+November+2010&rft.volume=2&rft.issue=4&rft.pages=11%E2%80%9324&rft_id=info:doi\/10.5121%2Fijdms.2010.2402&rft_id=http%3A%2F%2Fwww.airccse.org%2Fjournal%2Fijdms%2Fpapers%2F1110ijdms02.pdf&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:14-40\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:14_40-0\">40.0<\/a><\/sup> <sup><a href=\"#cite_ref-:14_40-1\">40.1<\/a><\/sup> <sup><a href=\"#cite_ref-:14_40-2\">40.2<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Esmail Ali, F.S. (2014). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.ef.uns.ac.rs\/mis\/archive-pdf\/2014%20-%20No3\/31_Fahd%20Sabry%20Esmail%20Ali%20v5.pdf\" target=\"_blank\">\"A Survey of Real-Time Data Warehouse and ETL\"<\/a> (PDF). <i>International Scientific Journal of Management Information Systems<\/i> <b>9<\/b> (3): 3\u20139<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.ef.uns.ac.rs\/mis\/archive-pdf\/2014%20-%20No3\/31_Fahd%20Sabry%20Esmail%20Ali%20v5.pdf\" target=\"_blank\">https:\/\/www.ef.uns.ac.rs\/mis\/archive-pdf\/2014%20-%20No3\/31_Fahd%20Sabry%20Esmail%20Ali%20v5.pdf<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=A+Survey+of+Real-Time+Data+Warehouse+and+ETL&rft.jtitle=International+Scientific+Journal+of+Management+Information+Systems&rft.aulast=Esmail+Ali%2C+F.S.&rft.au=Esmail+Ali%2C+F.S.&rft.date=2014&rft.volume=9&rft.issue=3&rft.pages=3%E2%80%939&rft_id=https%3A%2F%2Fwww.ef.uns.ac.rs%2Fmis%2Farchive-pdf%2F2014%2520-%2520No3%2F31_Fahd%2520Sabry%2520Esmail%2520Ali%2520v5.pdf&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-41\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-41\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Aftab, Umar; Siddiqui, Ghazanfar Farooq (1 December 2018). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/ieeexplore.ieee.org\/document\/8622206\/\" target=\"_blank\">\"Big Data Augmentation with Data Warehouse: A Survey\"<\/a>. <i>2018 IEEE International Conference on Big Data (Big Data)<\/i> (Seattle, WA, USA: IEEE): 2785\u20132794. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1109%2FBigData.2018.8622206\" target=\"_blank\">10.1109\/BigData.2018.8622206<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-1-5386-5035-6<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/ieeexplore.ieee.org\/document\/8622206\/\" target=\"_blank\">https:\/\/ieeexplore.ieee.org\/document\/8622206\/<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Big+Data+Augmentation+with+Data+Warehouse%3A+A+Survey&rft.jtitle=2018+IEEE+International+Conference+on+Big+Data+%28Big+Data%29&rft.aulast=Aftab&rft.aufirst=Umar&rft.au=Aftab%2C%26%2332%3BUmar&rft.au=Siddiqui%2C%26%2332%3BGhazanfar+Farooq&rft.date=1+December+2018&rft.pages=2785%E2%80%932794&rft.place=Seattle%2C+WA%2C+USA&rft.pub=IEEE&rft_id=info:doi\/10.1109%2FBigData.2018.8622206&rft.isbn=978-1-5386-5035-6&rft_id=https%3A%2F%2Fieeexplore.ieee.org%2Fdocument%2F8622206%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-42\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-42\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation book\">Alsqour, M.; Matouk, K.; Owoc, M.L. (2012). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/ieeexplore.ieee.org\/document\/6354451\" target=\"_blank\">\"A survey of data warehouse architectures \u2014 Preliminary results\"<\/a>. In Polskie Towarzystwo Informatyczne; Institute of Electrical and Electronics Engineers. <i>2012 Federated Conference on Computer Science and Information Systems (FedCSIS 2012): Wroclaw, Poland, 9 - 12 September 2012 ; [consisting of various conferences, symposia, workshops and special sessions]<\/i>. Piscataway, NJ: IEEE. pp. 1121\u20136. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-83-60810-48-4<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/ieeexplore.ieee.org\/document\/6354451\" target=\"_blank\">https:\/\/ieeexplore.ieee.org\/document\/6354451<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=A+survey+of+data+warehouse+architectures+%E2%80%94+Preliminary+results&rft.atitle=2012+Federated+Conference+on+Computer+Science+and+Information+Systems+%28FedCSIS+2012%29%3A+Wroclaw%2C+Poland%2C+9+-+12+September+2012+%3B+%5Bconsisting+of+various+conferences%2C+symposia%2C+workshops+and+special+sessions%5D&rft.aulast=Alsqour%2C+M.%3B+Matouk%2C+K.%3B+Owoc%2C+M.L.&rft.au=Alsqour%2C+M.%3B+Matouk%2C+K.%3B+Owoc%2C+M.L.&rft.date=2012&rft.pages=pp.%26nbsp%3B1121%E2%80%936&rft.place=Piscataway%2C+NJ&rft.pub=IEEE&rft.isbn=978-83-60810-48-4&rft_id=https%3A%2F%2Fieeexplore.ieee.org%2Fdocument%2F6354451&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-43\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-43\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Rizzi, Stefano; Abell\u00f3, Alberto; Lechtenb\u00f6rger, Jens; Trujillo, Juan (10 November 2006). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/dl.acm.org\/doi\/10.1145\/1183512.1183515\" target=\"_blank\">\"Research in data warehouse modeling and design: dead or alive?\"<\/a> (in en). <i>Proceedings of the 9th ACM international workshop on Data warehousing and OLAP<\/i> (Arlington Virginia USA: ACM): 3\u201310. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1145%2F1183512.1183515\" target=\"_blank\">10.1145\/1183512.1183515<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-1-59593-530-4<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/dl.acm.org\/doi\/10.1145\/1183512.1183515\" target=\"_blank\">https:\/\/dl.acm.org\/doi\/10.1145\/1183512.1183515<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Research+in+data+warehouse+modeling+and+design%3A+dead+or+alive%3F&rft.jtitle=Proceedings+of+the+9th+ACM+international+workshop+on+Data+warehousing+and+OLAP&rft.aulast=Rizzi&rft.aufirst=Stefano&rft.au=Rizzi%2C%26%2332%3BStefano&rft.au=Abell%C3%B3%2C%26%2332%3BAlberto&rft.au=Lechtenb%C3%B6rger%2C%26%2332%3BJens&rft.au=Trujillo%2C%26%2332%3BJuan&rft.date=10+November+2006&rft.pages=3%E2%80%9310&rft.place=Arlington+Virginia+USA&rft.pub=ACM&rft_id=info:doi\/10.1145%2F1183512.1183515&rft.isbn=978-1-59593-530-4&rft_id=https%3A%2F%2Fdl.acm.org%2Fdoi%2F10.1145%2F1183512.1183515&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-44\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-44\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Quix, Christoph; Hai, Rihan; Vatov, Ivan (30 December 2016). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/csimq-journals.rtu.lv\/article\/view\/csimq.2016-9.04\" target=\"_blank\">\"Metadata Extraction and Management in Data Lakes With GEMMS\"<\/a>. <i>Complex Systems Informatics and Modeling Quarterly<\/i> (9): 67\u201383. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.7250%2Fcsimq.2016-9.04\" target=\"_blank\">10.7250\/csimq.2016-9.04<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/csimq-journals.rtu.lv\/article\/view\/csimq.2016-9.04\" target=\"_blank\">https:\/\/csimq-journals.rtu.lv\/article\/view\/csimq.2016-9.04<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Metadata+Extraction+and+Management+in+Data+Lakes+With+GEMMS&rft.jtitle=Complex+Systems+Informatics+and+Modeling+Quarterly&rft.aulast=Quix&rft.aufirst=Christoph&rft.au=Quix%2C%26%2332%3BChristoph&rft.au=Hai%2C%26%2332%3BRihan&rft.au=Vatov%2C%26%2332%3BIvan&rft.date=30+December+2016&rft.issue=9&rft.pages=67%E2%80%9383&rft_id=info:doi\/10.7250%2Fcsimq.2016-9.04&rft_id=https%3A%2F%2Fcsimq-journals.rtu.lv%2Farticle%2Fview%2Fcsimq.2016-9.04&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-45\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-45\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation\" id=\"rdp-ebb-CITEREFMaccioniTorlone2018\">Maccioni, Antonio; Torlone, Riccardo (2018), Krogstie, John; Reijers, Hajo A., eds., <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/link.springer.com\/10.1007\/978-3-319-91563-0_29\" target=\"_blank\">\"KAYAK: A Framework for Just-in-Time Data Preparation in a Data Lake\"<\/a>, <i>Advanced Information Systems Engineering<\/i> (Cham: Springer International Publishing) <b>10816<\/b>: 474\u2013489, <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1007%2F978-3-319-91563-0_29\" target=\"_blank\">10.1007\/978-3-319-91563-0_29<\/a>, <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-3-319-91562-3<span class=\"printonly\">, <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/link.springer.com\/10.1007\/978-3-319-91563-0_29\" target=\"_blank\">http:\/\/link.springer.com\/10.1007\/978-3-319-91563-0_29<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 2023-05-02<\/span><\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=KAYAK%3A+A+Framework+for+Just-in-Time+Data+Preparation+in+a+Data+Lake&rft.jtitle=Advanced+Information+Systems+Engineering&rft.aulast=Maccioni&rft.aufirst=Antonio&rft.au=Maccioni%2C%26%2332%3BAntonio&rft.au=Torlone%2C%26%2332%3BRiccardo&rft.date=2018&rft.volume=10816&rft.pages=474%E2%80%93489&rft.place=Cham&rft.pub=Springer+International+Publishing&rft_id=info:doi\/10.1007%2F978-3-319-91563-0_29&rft.isbn=978-3-319-91562-3&rft_id=http%3A%2F%2Flink.springer.com%2F10.1007%2F978-3-319-91563-0_29&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-46\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-46\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Gao, Yihan; Huang, Silu; Parameswaran, Aditya (27 May 2018). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/dl.acm.org\/doi\/10.1145\/3183713.3183746\" target=\"_blank\">\"Navigating the Data Lake with DATAMARAN: Automatically Extracting Structure from Log Datasets\"<\/a> (in en). <i>Proceedings of the 2018 International Conference on Management of Data<\/i> (Houston TX USA: ACM): 943\u2013958. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1145%2F3183713.3183746\" target=\"_blank\">10.1145\/3183713.3183746<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-1-4503-4703-7<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/dl.acm.org\/doi\/10.1145\/3183713.3183746\" target=\"_blank\">https:\/\/dl.acm.org\/doi\/10.1145\/3183713.3183746<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Navigating+the+Data+Lake+with+DATAMARAN%3A+Automatically+Extracting+Structure+from+Log+Datasets&rft.jtitle=Proceedings+of+the+2018+International+Conference+on+Management+of+Data&rft.aulast=Gao&rft.aufirst=Yihan&rft.au=Gao%2C%26%2332%3BYihan&rft.au=Huang%2C%26%2332%3BSilu&rft.au=Parameswaran%2C%26%2332%3BAditya&rft.date=27+May+2018&rft.pages=943%E2%80%93958&rft.place=Houston+TX+USA&rft.pub=ACM&rft_id=info:doi\/10.1145%2F3183713.3183746&rft.isbn=978-1-4503-4703-7&rft_id=https%3A%2F%2Fdl.acm.org%2Fdoi%2F10.1145%2F3183713.3183746&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-47\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-47\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Astriani, Winda; Trisminingsih, Rina (2016). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1878029616300032\" target=\"_blank\">\"Extraction, Transformation, and Loading (ETL) Module for Hotspot Spatial Data Warehouse Using Geokettle\"<\/a> (in en). <i>Procedia Environmental Sciences<\/i> <b>33<\/b>: 626\u2013634. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.proenv.2016.03.117\" target=\"_blank\">10.1016\/j.proenv.2016.03.117<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1878029616300032\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1878029616300032<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Extraction%2C+Transformation%2C+and+Loading+%28ETL%29+Module+for+Hotspot+Spatial+Data+Warehouse+Using+Geokettle&rft.jtitle=Procedia+Environmental+Sciences&rft.aulast=Astriani&rft.aufirst=Winda&rft.au=Astriani%2C%26%2332%3BWinda&rft.au=Trisminingsih%2C%26%2332%3BRina&rft.date=2016&rft.volume=33&rft.pages=626%E2%80%93634&rft_id=info:doi\/10.1016%2Fj.proenv.2016.03.117&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS1878029616300032&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-48\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-48\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Halevy, A.V.; Korn, F.; Noy, N.F. et al. (2016). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/sites.computer.org\/debull\/A16sept\/issue1.htm\" target=\"_blank\">\"Managing Google\u2019s data lake: An overview of the Goods system\"<\/a>. <i>Bulletin of the Technical Committee on Data Engineering<\/i> <b>39<\/b> (3): 5\u201314<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/sites.computer.org\/debull\/A16sept\/issue1.htm\" target=\"_blank\">http:\/\/sites.computer.org\/debull\/A16sept\/issue1.htm<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Managing+Google%E2%80%99s+data+lake%3A+An+overview+of+the+Goods+system&rft.jtitle=Bulletin+of+the+Technical+Committee+on+Data+Engineering&rft.aulast=Halevy%2C+A.V.%3B+Korn%2C+F.%3B+Noy%2C+N.F.+et+al.&rft.au=Halevy%2C+A.V.%3B+Korn%2C+F.%3B+Noy%2C+N.F.+et+al.&rft.date=2016&rft.volume=39&rft.issue=3&rft.pages=5%E2%80%9314&rft_id=http%3A%2F%2Fsites.computer.org%2Fdebull%2FA16sept%2Fissue1.htm&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-49\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-49\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Dehne, Frank; Robillard, David; Rau-Chaplin, Andrew; Burke, Neil (1 September 2016). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/ieeexplore.ieee.org\/document\/7776530\/\" target=\"_blank\">\"VOLAP: A Scalable Distributed System for Real-Time OLAP with High Velocity Data\"<\/a>. <i>2016 IEEE International Conference on Cluster Computing (CLUSTER)<\/i> (Taipei, Taiwan: IEEE): 354\u2013363. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1109%2FCLUSTER.2016.29\" target=\"_blank\">10.1109\/CLUSTER.2016.29<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-1-5090-3653-0<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/ieeexplore.ieee.org\/document\/7776530\/\" target=\"_blank\">http:\/\/ieeexplore.ieee.org\/document\/7776530\/<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=VOLAP%3A+A+Scalable+Distributed+System+for+Real-Time+OLAP+with+High+Velocity+Data&rft.jtitle=2016+IEEE+International+Conference+on+Cluster+Computing+%28CLUSTER%29&rft.aulast=Dehne&rft.aufirst=Frank&rft.au=Dehne%2C%26%2332%3BFrank&rft.au=Robillard%2C%26%2332%3BDavid&rft.au=Rau-Chaplin%2C%26%2332%3BAndrew&rft.au=Burke%2C%26%2332%3BNeil&rft.date=1+September+2016&rft.pages=354%E2%80%93363&rft.place=Taipei%2C+Taiwan&rft.pub=IEEE&rft_id=info:doi\/10.1109%2FCLUSTER.2016.29&rft.isbn=978-1-5090-3653-0&rft_id=http%3A%2F%2Fieeexplore.ieee.org%2Fdocument%2F7776530%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-50\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-50\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Hurtado, Carlos A.; Gutierrez, Claudio; Mendelzon, Alberto O. (1 September 2005). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/dl.acm.org\/doi\/10.1145\/1093382.1093388\" target=\"_blank\">\"Capturing summarizability with integrity constraints in OLAP\"<\/a> (in en). <i>ACM Transactions on Database Systems<\/i> <b>30<\/b> (3): 854\u2013886. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1145%2F1093382.1093388\" target=\"_blank\">10.1145\/1093382.1093388<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0362-5915\" target=\"_blank\">0362-5915<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/dl.acm.org\/doi\/10.1145\/1093382.1093388\" target=\"_blank\">https:\/\/dl.acm.org\/doi\/10.1145\/1093382.1093388<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Capturing+summarizability+with+integrity+constraints+in+OLAP&rft.jtitle=ACM+Transactions+on+Database+Systems&rft.aulast=Hurtado&rft.aufirst=Carlos+A.&rft.au=Hurtado%2C%26%2332%3BCarlos+A.&rft.au=Gutierrez%2C%26%2332%3BClaudio&rft.au=Mendelzon%2C%26%2332%3BAlberto+O.&rft.date=1+September+2005&rft.volume=30&rft.issue=3&rft.pages=854%E2%80%93886&rft_id=info:doi\/10.1145%2F1093382.1093388&rft.issn=0362-5915&rft_id=https%3A%2F%2Fdl.acm.org%2Fdoi%2F10.1145%2F1093382.1093388&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:18-51\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:18_51-0\">51.0<\/a><\/sup> <sup><a href=\"#cite_ref-:18_51-1\">51.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Farid, Mina; Roatis, Alexandra; Ilyas, Ihab F.; Hoffmann, Hella-Franziska; Chu, Xu (26 June 2016). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/dl.acm.org\/doi\/10.1145\/2882903.2899391\" target=\"_blank\">\"CLAMS: Bringing Quality to Data Lakes\"<\/a> (in en). <i>Proceedings of the 2016 International Conference on Management of Data<\/i> (San Francisco California USA: ACM): 2089\u20132092. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1145%2F2882903.2899391\" target=\"_blank\">10.1145\/2882903.2899391<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-1-4503-3531-7<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/dl.acm.org\/doi\/10.1145\/2882903.2899391\" target=\"_blank\">https:\/\/dl.acm.org\/doi\/10.1145\/2882903.2899391<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=CLAMS%3A+Bringing+Quality+to+Data+Lakes&rft.jtitle=Proceedings+of+the+2016+International+Conference+on+Management+of+Data&rft.aulast=Farid&rft.aufirst=Mina&rft.au=Farid%2C%26%2332%3BMina&rft.au=Roatis%2C%26%2332%3BAlexandra&rft.au=Ilyas%2C%26%2332%3BIhab+F.&rft.au=Hoffmann%2C%26%2332%3BHella-Franziska&rft.au=Chu%2C%26%2332%3BXu&rft.date=26+June+2016&rft.pages=2089%E2%80%932092&rft.place=San+Francisco+California+USA&rft.pub=ACM&rft_id=info:doi\/10.1145%2F2882903.2899391&rft.isbn=978-1-4503-3531-7&rft_id=https%3A%2F%2Fdl.acm.org%2Fdoi%2F10.1145%2F2882903.2899391&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-52\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-52\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Zhang, Yi; Ives, Zachary G. (1 August 2019). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/dl.acm.org\/doi\/10.14778\/3352063.3352095\" target=\"_blank\">\"Juneau: data lake management for Jupyter\"<\/a> (in en). <i>Proceedings of the VLDB Endowment<\/i> <b>12<\/b> (12): 1902\u20131905. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.14778%2F3352063.3352095\" target=\"_blank\">10.14778\/3352063.3352095<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2150-8097\" target=\"_blank\">2150-8097<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/dl.acm.org\/doi\/10.14778\/3352063.3352095\" target=\"_blank\">https:\/\/dl.acm.org\/doi\/10.14778\/3352063.3352095<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Juneau%3A+data+lake+management+for+Jupyter&rft.jtitle=Proceedings+of+the+VLDB+Endowment&rft.aulast=Zhang&rft.aufirst=Yi&rft.au=Zhang%2C%26%2332%3BYi&rft.au=Ives%2C%26%2332%3BZachary+G.&rft.date=1+August+2019&rft.volume=12&rft.issue=12&rft.pages=1902%E2%80%931905&rft_id=info:doi\/10.14778%2F3352063.3352095&rft.issn=2150-8097&rft_id=https%3A%2F%2Fdl.acm.org%2Fdoi%2F10.14778%2F3352063.3352095&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-53\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-53\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Zhu, Erkang; Deng, Dong; Nargesian, Fatemeh; Miller, Ren\u00e9e J. (25 June 2019). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/dl.acm.org\/doi\/10.1145\/3299869.3300065\" target=\"_blank\">\"JOSIE: Overlap Set Similarity Search for Finding Joinable Tables in Data Lakes\"<\/a> (in en). <i>Proceedings of the 2019 International Conference on Management of Data<\/i> (Amsterdam Netherlands: ACM): 847\u2013864. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1145%2F3299869.3300065\" target=\"_blank\">10.1145\/3299869.3300065<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-1-4503-5643-5<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/dl.acm.org\/doi\/10.1145\/3299869.3300065\" target=\"_blank\">https:\/\/dl.acm.org\/doi\/10.1145\/3299869.3300065<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=JOSIE%3A+Overlap+Set+Similarity+Search+for+Finding+Joinable+Tables+in+Data+Lakes&rft.jtitle=Proceedings+of+the+2019+International+Conference+on+Management+of+Data&rft.aulast=Zhu&rft.aufirst=Erkang&rft.au=Zhu%2C%26%2332%3BErkang&rft.au=Deng%2C%26%2332%3BDong&rft.au=Nargesian%2C%26%2332%3BFatemeh&rft.au=Miller%2C%26%2332%3BRen%C3%A9e+J.&rft.date=25+June+2019&rft.pages=847%E2%80%93864&rft.place=Amsterdam+Netherlands&rft.pub=ACM&rft_id=info:doi\/10.1145%2F3299869.3300065&rft.isbn=978-1-4503-5643-5&rft_id=https%3A%2F%2Fdl.acm.org%2Fdoi%2F10.1145%2F3299869.3300065&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-54\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-54\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Beheshti, Amin; Benatallah, Boualem; Nouri, Reza; Chhieng, Van Munin; Xiong, HuangTao; Zhao, Xu (6 November 2017). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/dl.acm.org\/doi\/10.1145\/3132847.3133171\" target=\"_blank\">\"CoreDB: a Data Lake Service\"<\/a> (in en). <i>Proceedings of the 2017 ACM on Conference on Information and Knowledge Management<\/i> (Singapore Singapore: ACM): 2451\u20132454. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1145%2F3132847.3133171\" target=\"_blank\">10.1145\/3132847.3133171<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-1-4503-4918-5<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/dl.acm.org\/doi\/10.1145\/3132847.3133171\" target=\"_blank\">https:\/\/dl.acm.org\/doi\/10.1145\/3132847.3133171<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=CoreDB%3A+a+Data+Lake+Service&rft.jtitle=Proceedings+of+the+2017+ACM+on+Conference+on+Information+and+Knowledge+Management&rft.aulast=Beheshti&rft.aufirst=Amin&rft.au=Beheshti%2C%26%2332%3BAmin&rft.au=Benatallah%2C%26%2332%3BBoualem&rft.au=Nouri%2C%26%2332%3BReza&rft.au=Chhieng%2C%26%2332%3BVan+Munin&rft.au=Xiong%2C%26%2332%3BHuangTao&rft.au=Zhao%2C%26%2332%3BXu&rft.date=6+November+2017&rft.pages=2451%E2%80%932454&rft.place=Singapore+Singapore&rft.pub=ACM&rft_id=info:doi\/10.1145%2F3132847.3133171&rft.isbn=978-1-4503-4918-5&rft_id=https%3A%2F%2Fdl.acm.org%2Fdoi%2F10.1145%2F3132847.3133171&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-55\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-55\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Hai, Rihan; Geisler, Sandra; Quix, Christoph (26 June 2016). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/dl.acm.org\/doi\/10.1145\/2882903.2899389\" target=\"_blank\">\"Constance: An Intelligent Data Lake System\"<\/a> (in en). <i>Proceedings of the 2016 International Conference on Management of Data<\/i> (San Francisco California USA: ACM): 2097\u20132100. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1145%2F2882903.2899389\" target=\"_blank\">10.1145\/2882903.2899389<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-1-4503-3531-7<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/dl.acm.org\/doi\/10.1145\/2882903.2899389\" target=\"_blank\">https:\/\/dl.acm.org\/doi\/10.1145\/2882903.2899389<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Constance%3A+An+Intelligent+Data+Lake+System&rft.jtitle=Proceedings+of+the+2016+International+Conference+on+Management+of+Data&rft.aulast=Hai&rft.aufirst=Rihan&rft.au=Hai%2C%26%2332%3BRihan&rft.au=Geisler%2C%26%2332%3BSandra&rft.au=Quix%2C%26%2332%3BChristoph&rft.date=26+June+2016&rft.pages=2097%E2%80%932100&rft.place=San+Francisco+California+USA&rft.pub=ACM&rft_id=info:doi\/10.1145%2F2882903.2899389&rft.isbn=978-1-4503-3531-7&rft_id=https%3A%2F%2Fdl.acm.org%2Fdoi%2F10.1145%2F2882903.2899389&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-56\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-56\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Ahmed, A.S.; Salem, A.M.; Alhabibi, Y.A. (2006). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.scitepress.org\/DigitalLibrary\/Link.aspx?doi=10.5220\/0002490802820288\" target=\"_blank\">\"Combining the Data Warehouse and Operational Data Store\"<\/a>. <i>Proceedings of the Eighth International Conference on Enterprise Information Systems<\/i> (Paphos, Cyprus: SciTePress - Science and and Technology Publications): 282\u2013288. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.5220%2F0002490802820288\" target=\"_blank\">10.5220\/0002490802820288<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-972-8865-41-2<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/www.scitepress.org\/DigitalLibrary\/Link.aspx?doi=10.5220\/0002490802820288\" target=\"_blank\">http:\/\/www.scitepress.org\/DigitalLibrary\/Link.aspx?doi=10.5220\/0002490802820288<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Combining+the+Data+Warehouse+and+Operational+Data+Store&rft.jtitle=Proceedings+of+the+Eighth+International+Conference+on+Enterprise+Information+Systems&rft.aulast=Ahmed%2C+A.S.%3B+Salem%2C+A.M.%3B+Alhabibi%2C+Y.A.&rft.au=Ahmed%2C+A.S.%3B+Salem%2C+A.M.%3B+Alhabibi%2C+Y.A.&rft.date=2006&rft.pages=282%E2%80%93288&rft.place=Paphos%2C+Cyprus&rft.pub=SciTePress+-+Science+and+and+Technology+Publications&rft_id=info:doi\/10.5220%2F0002490802820288&rft.isbn=978-972-8865-41-2&rft_id=http%3A%2F%2Fwww.scitepress.org%2FDigitalLibrary%2FLink.aspx%3Fdoi%3D10.5220%2F0002490802820288&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-57\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-57\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.appsierra.com\/blog\/tiers-in-software-architecture\" target=\"_blank\">\"Software Architecture: N Tier, 3 Tier, 1 Tier, 2 Tier Architecture\"<\/a>. <i>Appsierra Blog<\/i>. Appsierra<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.appsierra.com\/blog\/tiers-in-software-architecture\" target=\"_blank\">https:\/\/www.appsierra.com\/blog\/tiers-in-software-architecture<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 27 October 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Software+Architecture%3A+N+Tier%2C+3+Tier%2C+1+Tier%2C+2+Tier+Architecture&rft.atitle=Appsierra+Blog&rft.pub=Appsierra&rft_id=https%3A%2F%2Fwww.appsierra.com%2Fblog%2Ftiers-in-software-architecture&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-58\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-58\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Han, S.W. (1997). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/ufl-flvc.primo.exlibrisgroup.com\/permalink\/01FALSC_UFL\/6ad6fc\/alma990286760440306597\" target=\"_blank\">\"Three-Tier Architecture for Sentinel Applications and Tools: Separating Presentation from Functionality\"<\/a>. University of Florida, Gainsville<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/ufl-flvc.primo.exlibrisgroup.com\/permalink\/01FALSC_UFL\/6ad6fc\/alma990286760440306597\" target=\"_blank\">https:\/\/ufl-flvc.primo.exlibrisgroup.com\/permalink\/01FALSC_UFL\/6ad6fc\/alma990286760440306597<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Three-Tier+Architecture+for+Sentinel+Applications+and+Tools%3A+Separating+Presentation+from+Functionality&rft.atitle=&rft.aulast=Han%2C+S.W.&rft.au=Han%2C+S.W.&rft.date=1997&rft.pub=University+of+Florida%2C+Gainsville&rft_id=https%3A%2F%2Fufl-flvc.primo.exlibrisgroup.com%2Fpermalink%2F01FALSC_UFL%2F6ad6fc%2Falma990286760440306597&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-59\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-59\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.ibm.com\/topics\/three-tier-architecture\" target=\"_blank\">\"What is three-tier architecture?\"<\/a>. IBM<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.ibm.com\/topics\/three-tier-architecture\" target=\"_blank\">https:\/\/www.ibm.com\/topics\/three-tier-architecture<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 27 October 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=What+is+three-tier+architecture%3F&rft.atitle=&rft.pub=IBM&rft_id=https%3A%2F%2Fwww.ibm.com%2Ftopics%2Fthree-tier-architecture&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-60\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-60\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Phaneendra, S.V.; Reddy, M. (September 2013). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.ijarcce.com\/upload\/2013\/september\/71-o-V_I_K_R_A_M_-big_data_solution_for_rdbms_problems.pdf\" target=\"_blank\">\"Big Data - Solutions for RDBMS Problems - A Survey\"<\/a> (PDF). <i>International Journal of Advanced Research<\/i> <b>2<\/b> (9): 3686\u201391<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.ijarcce.com\/upload\/2013\/september\/71-o-V_I_K_R_A_M_-big_data_solution_for_rdbms_problems.pdf\" target=\"_blank\">https:\/\/www.ijarcce.com\/upload\/2013\/september\/71-o-V_I_K_R_A_M_-big_data_solution_for_rdbms_problems.pdf<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Big+Data+-+Solutions+for+RDBMS+Problems+-+A+Survey&rft.jtitle=International+Journal+of+Advanced+Research&rft.aulast=Phaneendra%2C+S.V.%3B+Reddy%2C+M.&rft.au=Phaneendra%2C+S.V.%3B+Reddy%2C+M.&rft.date=September+2013&rft.volume=2&rft.issue=9&rft.pages=3686%E2%80%9391&rft_id=https%3A%2F%2Fwww.ijarcce.com%2Fupload%2F2013%2Fseptember%2F71-o-V_I_K_R_A_M_-big_data_solution_for_rdbms_problems.pdf&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-61\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-61\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Simitsis, A.; Vassiliadis, P.; Sellis, T. (2005). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/ieeexplore.ieee.org\/document\/1410172\/\" target=\"_blank\">\"Optimizing ETL Processes in Data Warehouses\"<\/a>. <i>21st International Conference on Data Engineering (ICDE'05)<\/i> (Tokyo, Japan: IEEE): 564\u2013575. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1109%2FICDE.2005.103\" target=\"_blank\">10.1109\/ICDE.2005.103<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-0-7695-2285-2<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/ieeexplore.ieee.org\/document\/1410172\/\" target=\"_blank\">http:\/\/ieeexplore.ieee.org\/document\/1410172\/<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Optimizing+ETL+Processes+in+Data+Warehouses&rft.jtitle=21st+International+Conference+on+Data+Engineering+%28ICDE%2705%29&rft.aulast=Simitsis&rft.aufirst=A.&rft.au=Simitsis%2C%26%2332%3BA.&rft.au=Vassiliadis%2C%26%2332%3BP.&rft.au=Sellis%2C%26%2332%3BT.&rft.date=2005&rft.pages=564%E2%80%93575&rft.place=Tokyo%2C+Japan&rft.pub=IEEE&rft_id=info:doi\/10.1109%2FICDE.2005.103&rft.isbn=978-0-7695-2285-2&rft_id=http%3A%2F%2Fieeexplore.ieee.org%2Fdocument%2F1410172%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-62\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-62\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Prasser, Fabian; Spengler, Helmut; Bild, Raffael; Eicher, Johanna; Kuhn, Klaus A. (1 June 2019). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1386505618307007\" target=\"_blank\">\"Privacy-enhancing ETL-processes for biomedical data\"<\/a> (in en). <i>International Journal of Medical Informatics<\/i> <b>126<\/b>: 72\u201381. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.ijmedinf.2019.03.006\" target=\"_blank\">10.1016\/j.ijmedinf.2019.03.006<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1386505618307007\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1386505618307007<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Privacy-enhancing+ETL-processes+for+biomedical+data&rft.jtitle=International+Journal+of+Medical+Informatics&rft.aulast=Prasser&rft.aufirst=Fabian&rft.au=Prasser%2C%26%2332%3BFabian&rft.au=Spengler%2C%26%2332%3BHelmut&rft.au=Bild%2C%26%2332%3BRaffael&rft.au=Eicher%2C%26%2332%3BJohanna&rft.au=Kuhn%2C%26%2332%3BKlaus+A.&rft.date=1+June+2019&rft.volume=126&rft.pages=72%E2%80%9381&rft_id=info:doi\/10.1016%2Fj.ijmedinf.2019.03.006&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS1386505618307007&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-63\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-63\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Rousidis, Dimitris; Garoufallou, Emmanouel; Balatsoukas, Panos; Sicilia, Miguel-Angel (18 December 2014). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.medra.org\/servlet\/aliasResolver?alias=iospress&doi=10.3233\/ISU-140746\" target=\"_blank\">\"Metadata for Big Data: A preliminary investigation of metadata quality issues in research data repositories\"<\/a>. <i>Information Services & Use<\/i> <b>34<\/b> (3-4): 279\u2013286. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.3233%2FISU-140746\" target=\"_blank\">10.3233\/ISU-140746<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.medra.org\/servlet\/aliasResolver?alias=iospress&doi=10.3233\/ISU-140746\" target=\"_blank\">https:\/\/www.medra.org\/servlet\/aliasResolver?alias=iospress&doi=10.3233\/ISU-140746<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Metadata+for+Big+Data%3A+A+preliminary+investigation+of+metadata+quality+issues+in+research+data+repositories&rft.jtitle=Information+Services+%26+Use&rft.aulast=Rousidis&rft.aufirst=Dimitris&rft.au=Rousidis%2C%26%2332%3BDimitris&rft.au=Garoufallou%2C%26%2332%3BEmmanouel&rft.au=Balatsoukas%2C%26%2332%3BPanos&rft.au=Sicilia%2C%26%2332%3BMiguel-Angel&rft.date=18+December+2014&rft.volume=34&rft.issue=3-4&rft.pages=279%E2%80%93286&rft_id=info:doi\/10.3233%2FISU-140746&rft_id=https%3A%2F%2Fwww.medra.org%2Fservlet%2FaliasResolver%3Falias%3Diospress%26doi%3D10.3233%2FISU-140746&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-64\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-64\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Mailvaganam, H. (2007). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/web.archive.org\/web\/20180928201202\/http:\/\/dwreview.com\/OLAP\/Introduction_OLAP.html\" target=\"_blank\">\"Introduction to OLAP: Slice, Dice and Drill!\"<\/a>. <i>Data Warehousing Review<\/i>. Archived from <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dwreview.com\/OLAP\/Introduction_OLAP.html\" target=\"_blank\">the original<\/a> on 28 September 2018<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/web.archive.org\/web\/20180928201202\/http:\/\/dwreview.com\/OLAP\/Introduction_OLAP.html\" target=\"_blank\">https:\/\/web.archive.org\/web\/20180928201202\/http:\/\/dwreview.com\/OLAP\/Introduction_OLAP.html<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 27 October 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Introduction+to+OLAP%3A+Slice%2C+Dice+and+Drill%21&rft.atitle=Data+Warehousing+Review&rft.aulast=Mailvaganam%2C+H.&rft.au=Mailvaganam%2C+H.&rft.date=2007&rft_id=https%3A%2F%2Fweb.archive.org%2Fweb%2F20180928201202%2Fhttp%3A%2F%2Fdwreview.com%2FOLAP%2FIntroduction_OLAP.html&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-65\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-65\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Pendse, N. (6 September 2001). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/dssresources.com\/papers\/features\/pendse04072002.htm\" target=\"_blank\">\"What is OLAP?\"<\/a>. <i>DSSResources.com<\/i>. Business Intelligence Ltd<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/dssresources.com\/papers\/features\/pendse04072002.htm\" target=\"_blank\">https:\/\/dssresources.com\/papers\/features\/pendse04072002.htm<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 27 October 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=What+is+OLAP%3F&rft.atitle=DSSResources.com&rft.aulast=Pendse%2C+N.&rft.au=Pendse%2C+N.&rft.date=6+September+2001&rft.pub=Business+Intelligence+Ltd&rft_id=https%3A%2F%2Fdssresources.com%2Fpapers%2Ffeatures%2Fpendse04072002.htm&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-66\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-66\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Xu, Jian; Luo, Yong Qiang; Zhou, Xin Xin (1 June 2013). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.scientific.net\/AMM.321-324.2551\" target=\"_blank\">\"Solution for Data Growth Problem of MOLAP\"<\/a>. <i>Applied Mechanics and Materials<\/i> <b>321-324<\/b>: 2551\u20132556. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.4028%2Fwww.scientific.net%2FAMM.321-324.2551\" target=\"_blank\">10.4028\/www.scientific.net\/AMM.321-324.2551<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1662-7482\" target=\"_blank\">1662-7482<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.scientific.net\/AMM.321-324.2551\" target=\"_blank\">https:\/\/www.scientific.net\/AMM.321-324.2551<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Solution+for+Data+Growth+Problem+of+MOLAP&rft.jtitle=Applied+Mechanics+and+Materials&rft.aulast=Xu&rft.aufirst=Jian&rft.au=Xu%2C%26%2332%3BJian&rft.au=Luo%2C%26%2332%3BYong+Qiang&rft.au=Zhou%2C%26%2332%3BXin+Xin&rft.date=1+June+2013&rft.volume=321-324&rft.pages=2551%E2%80%932556&rft_id=info:doi\/10.4028%2Fwww.scientific.net%2FAMM.321-324.2551&rft.issn=1662-7482&rft_id=https%3A%2F%2Fwww.scientific.net%2FAMM.321-324.2551&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-67\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-67\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Dehne, F.; Eavis, T.; Rau-Chaplin, A. (1 May 2003). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/ieeexplore.ieee.org\/document\/1199356\/\" target=\"_blank\">\"Parallel multi-dimensional ROLAP indexing\"<\/a>. <i>CCGrid 2003. 3rd IEEE\/ACM International Symposium on Cluster Computing and the Grid, 2003. Proceedings.<\/i>: 86\u201393. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1109%2FCCGRID.2003.1199356\" target=\"_blank\">10.1109\/CCGRID.2003.1199356<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/ieeexplore.ieee.org\/document\/1199356\/\" target=\"_blank\">https:\/\/ieeexplore.ieee.org\/document\/1199356\/<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Parallel+multi-dimensional+ROLAP+indexing&rft.jtitle=CCGrid+2003.+3rd+IEEE%2FACM+International+Symposium+on+Cluster+Computing+and+the+Grid%2C+2003.+Proceedings.&rft.aulast=Dehne&rft.aufirst=F.&rft.au=Dehne%2C%26%2332%3BF.&rft.au=Eavis%2C%26%2332%3BT.&rft.au=Rau-Chaplin%2C%26%2332%3BA.&rft.date=1+May+2003&rft.pages=86%E2%80%9393&rft_id=info:doi\/10.1109%2FCCGRID.2003.1199356&rft_id=https%3A%2F%2Fieeexplore.ieee.org%2Fdocument%2F1199356%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-68\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-68\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Shvachko, Konstantin; Kuang, Hairong; Radia, Sanjay; Chansler, Robert (1 May 2010). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/ieeexplore.ieee.org\/document\/5496972\/\" target=\"_blank\">\"The Hadoop Distributed File System\"<\/a>. <i>2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST)<\/i>: 1\u201310. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1109%2FMSST.2010.5496972\" target=\"_blank\">10.1109\/MSST.2010.5496972<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/ieeexplore.ieee.org\/document\/5496972\/\" target=\"_blank\">https:\/\/ieeexplore.ieee.org\/document\/5496972\/<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=The+Hadoop+Distributed+File+System&rft.jtitle=2010+IEEE+26th+Symposium+on+Mass+Storage+Systems+and+Technologies+%28MSST%29&rft.aulast=Shvachko&rft.aufirst=Konstantin&rft.au=Shvachko%2C%26%2332%3BKonstantin&rft.au=Kuang%2C%26%2332%3BHairong&rft.au=Radia%2C%26%2332%3BSanjay&rft.au=Chansler%2C%26%2332%3BRobert&rft.date=1+May+2010&rft.pages=1%E2%80%9310&rft_id=info:doi\/10.1109%2FMSST.2010.5496972&rft_id=https%3A%2F%2Fieeexplore.ieee.org%2Fdocument%2F5496972%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-69\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-69\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Luo, Zhenxiao; Niu, Lu; Korukanti, Venki; Sun, Yutian; Basmanova, Masha; He, Yi; Wang, Beinan; Agrawal, Devesh <i>et al.<\/i> (1 May 2022). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/ieeexplore.ieee.org\/document\/9835663\/\" target=\"_blank\">\"From Batch Processing to Real Time Analytics: Running Presto\u00ae at Scale\"<\/a>. <i>2022 IEEE 38th International Conference on Data Engineering (ICDE)<\/i> (Kuala Lumpur, Malaysia: IEEE): 1598\u20131609. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1109%2FICDE53745.2022.00165\" target=\"_blank\">10.1109\/ICDE53745.2022.00165<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-1-6654-0883-7<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/ieeexplore.ieee.org\/document\/9835663\/\" target=\"_blank\">https:\/\/ieeexplore.ieee.org\/document\/9835663\/<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=From+Batch+Processing+to+Real+Time+Analytics%3A+Running+Presto%C2%AE+at+Scale&rft.jtitle=2022+IEEE+38th+International+Conference+on+Data+Engineering+%28ICDE%29&rft.aulast=Luo&rft.aufirst=Zhenxiao&rft.au=Luo%2C%26%2332%3BZhenxiao&rft.au=Niu%2C%26%2332%3BLu&rft.au=Korukanti%2C%26%2332%3BVenki&rft.au=Sun%2C%26%2332%3BYutian&rft.au=Basmanova%2C%26%2332%3BMasha&rft.au=He%2C%26%2332%3BYi&rft.au=Wang%2C%26%2332%3BBeinan&rft.au=Agrawal%2C%26%2332%3BDevesh&rft.au=Luo%2C%26%2332%3BHao&rft.date=1+May+2022&rft.pages=1598%E2%80%931609&rft.place=Kuala+Lumpur%2C+Malaysia&rft.pub=IEEE&rft_id=info:doi\/10.1109%2FICDE53745.2022.00165&rft.isbn=978-1-6654-0883-7&rft_id=https%3A%2F%2Fieeexplore.ieee.org%2Fdocument%2F9835663%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-70\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-70\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Sethi, Raghav; Traverso, Martin; Sundstrom, Dain; Phillips, David; Xie, Wenlei; Sun, Yutian; Yegitbasi, Nezih; Jin, Haozhun <i>et al.<\/i> (1 April 2019). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/ieeexplore.ieee.org\/document\/8731547\/\" target=\"_blank\">\"Presto: SQL on Everything\"<\/a>. <i>2019 IEEE 35th International Conference on Data Engineering (ICDE)<\/i> (Macao, Macao: IEEE): 1802\u20131813. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1109%2FICDE.2019.00196\" target=\"_blank\">10.1109\/ICDE.2019.00196<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-1-5386-7474-1<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/ieeexplore.ieee.org\/document\/8731547\/\" target=\"_blank\">https:\/\/ieeexplore.ieee.org\/document\/8731547\/<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Presto%3A+SQL+on+Everything&rft.jtitle=2019+IEEE+35th+International+Conference+on+Data+Engineering+%28ICDE%29&rft.aulast=Sethi&rft.aufirst=Raghav&rft.au=Sethi%2C%26%2332%3BRaghav&rft.au=Traverso%2C%26%2332%3BMartin&rft.au=Sundstrom%2C%26%2332%3BDain&rft.au=Phillips%2C%26%2332%3BDavid&rft.au=Xie%2C%26%2332%3BWenlei&rft.au=Sun%2C%26%2332%3BYutian&rft.au=Yegitbasi%2C%26%2332%3BNezih&rft.au=Jin%2C%26%2332%3BHaozhun&rft.au=Hwang%2C%26%2332%3BEric&rft.date=1+April+2019&rft.pages=1802%E2%80%931813&rft.place=Macao%2C+Macao&rft.pub=IEEE&rft_id=info:doi\/10.1109%2FICDE.2019.00196&rft.isbn=978-1-5386-7474-1&rft_id=https%3A%2F%2Fieeexplore.ieee.org%2Fdocument%2F8731547%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-71\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-71\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Kinley, J. (2013). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/web.archive.org\/web\/20190503030514\/http:\/\/jameskinley.tumblr.com\/post\/37398560534\/the-lambda-architecture-principles-for\" target=\"_blank\">\"The Lambda architecture: principles for architecting realtime Big Data systems\"<\/a>. <i>Tumblr<\/i>. Archived from <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/jameskinley.tumblr.com\/post\/37398560534\/the-lambda-architecture-principles-for\" target=\"_blank\">the original<\/a> on 03 May 2019<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/web.archive.org\/web\/20190503030514\/http:\/\/jameskinley.tumblr.com\/post\/37398560534\/the-lambda-architecture-principles-for\" target=\"_blank\">https:\/\/web.archive.org\/web\/20190503030514\/http:\/\/jameskinley.tumblr.com\/post\/37398560534\/the-lambda-architecture-principles-for<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 27 October 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=The+Lambda+architecture%3A+principles+for+architecting+realtime+Big+Data+systems&rft.atitle=Tumblr&rft.aulast=Kinley%2C+J.&rft.au=Kinley%2C+J.&rft.date=2013&rft_id=https%3A%2F%2Fweb.archive.org%2Fweb%2F20190503030514%2Fhttp%3A%2F%2Fjameskinley.tumblr.com%2Fpost%2F37398560534%2Fthe-lambda-architecture-principles-for&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-72\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-72\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Bertran, P.F. (4 April 2013). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/github.com\/pereferrera\/trident-lambda-splout\" target=\"_blank\">\"trident-lambda-splout\"<\/a>. <i>GitHub<\/i><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/github.com\/pereferrera\/trident-lambda-splout\" target=\"_blank\">https:\/\/github.com\/pereferrera\/trident-lambda-splout<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 27 October 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=trident-lambda-splout&rft.atitle=GitHub&rft.aulast=Bertran%2C+P.F.&rft.au=Bertran%2C+P.F.&rft.date=4+April+2013&rft_id=https%3A%2F%2Fgithub.com%2Fpereferrera%2Ftrident-lambda-splout&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-73\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-73\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Carbone, P.; Ewen, S.; Haridi, S. et al. (December 2015). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/sites.computer.org\/debull\/A15dec\/issue1.htm\" target=\"_blank\">\"Apache Flink\u2122: Stream and Batch Processing in a Single Engine\"<\/a>. <i>Bulletin of the Technical Committee on Data Engineering<\/i> <b>38<\/b> (4): 28\u201338<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/sites.computer.org\/debull\/A15dec\/issue1.htm\" target=\"_blank\">http:\/\/sites.computer.org\/debull\/A15dec\/issue1.htm<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Apache+Flink%E2%84%A2%3A+Stream+and+Batch+Processing+in+a+Single+Engine&rft.jtitle=Bulletin+of+the+Technical+Committee+on+Data+Engineering&rft.aulast=Carbone%2C+P.%3B+Ewen%2C+S.%3B+Haridi%2C+S.+et+al.&rft.au=Carbone%2C+P.%3B+Ewen%2C+S.%3B+Haridi%2C+S.+et+al.&rft.date=December+2015&rft.volume=38&rft.issue=4&rft.pages=28%E2%80%9338&rft_id=http%3A%2F%2Fsites.computer.org%2Fdebull%2FA15dec%2Fissue1.htm&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-74\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-74\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Kreps, J. (2 July 2014). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.oreilly.com\/radar\/questioning-the-lambda-architecture\/\" target=\"_blank\">\"Questioning the Lambda Architecture\"<\/a>. <i>O'Reilly Radar<\/i>. O\u2019Reilly Media, Inc<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.oreilly.com\/radar\/questioning-the-lambda-architecture\/\" target=\"_blank\">https:\/\/www.oreilly.com\/radar\/questioning-the-lambda-architecture\/<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 27 October 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Questioning+the+Lambda+Architecture&rft.atitle=O%27Reilly+Radar&rft.aulast=Kreps%2C+J.&rft.au=Kreps%2C+J.&rft.date=2+July+2014&rft.pub=O%E2%80%99Reilly+Media%2C+Inc&rft_id=https%3A%2F%2Fwww.oreilly.com%2Fradar%2Fquestioning-the-lambda-architecture%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-75\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-75\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.matillion.com\/resources\/blog\/data-vault-vs-star-schema-vs-third-normal-form-which-data-model-to-use\" target=\"_blank\">\"Data Vault vs Star Schema vs Third Normal Form: Which Data Model to Use?\"<\/a>. <i>Matillion Blog<\/i>. Matillion Limited. 24 November 2021<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.matillion.com\/resources\/blog\/data-vault-vs-star-schema-vs-third-normal-form-which-data-model-to-use\" target=\"_blank\">https:\/\/www.matillion.com\/resources\/blog\/data-vault-vs-star-schema-vs-third-normal-form-which-data-model-to-use<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 27 October 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Data+Vault+vs+Star+Schema+vs+Third+Normal+Form%3A+Which+Data+Model+to+Use%3F&rft.atitle=Matillion+Blog&rft.date=24+November+2021&rft.pub=Matillion+Limited&rft_id=https%3A%2F%2Fwww.matillion.com%2Fresources%2Fblog%2Fdata-vault-vs-star-schema-vs-third-normal-form-which-data-model-to-use&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-76\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-76\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Patranabish, D. (16 April 2015). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/cio.economictimes.indiatimes.com\/tech-talk\/data-lakes-the-new-enabler-of-scalability-in-cross-channel-analytics\/585\" target=\"_blank\">\"Data lakes: The new enabler of scalability in cross channel analytics\"<\/a>. <i>The Economic Times CIO<\/i>. Times Internet Limited<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/cio.economictimes.indiatimes.com\/tech-talk\/data-lakes-the-new-enabler-of-scalability-in-cross-channel-analytics\/585\" target=\"_blank\">https:\/\/cio.economictimes.indiatimes.com\/tech-talk\/data-lakes-the-new-enabler-of-scalability-in-cross-channel-analytics\/585<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 27 October 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Data+lakes%3A+The+new+enabler+of+scalability+in+cross+channel+analytics&rft.atitle=The+Economic+Times+CIO&rft.aulast=Patranabish%2C+D.&rft.au=Patranabish%2C+D.&rft.date=16+April+2015&rft.pub=Times+Internet+Limited&rft_id=https%3A%2F%2Fcio.economictimes.indiatimes.com%2Ftech-talk%2Fdata-lakes-the-new-enabler-of-scalability-in-cross-channel-analytics%2F585&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:19-77\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:19_77-0\">77.0<\/a><\/sup> <sup><a href=\"#cite_ref-:19_77-1\">77.1<\/a><\/sup> <sup><a href=\"#cite_ref-:19_77-2\">77.2<\/a><\/sup> <sup><a href=\"#cite_ref-:19_77-3\">77.3<\/a><\/sup> <sup><a href=\"#cite_ref-:19_77-4\">77.4<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Nargesian, Fatemeh; Zhu, Erkang; Miller, Ren\u00e9e J.; Pu, Ken Q.; Arocena, Patricia C. (1 August 2019). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/dl.acm.org\/doi\/10.14778\/3352063.3352116\" target=\"_blank\">\"Data lake management: challenges and opportunities\"<\/a> (in en). <i>Proceedings of the VLDB Endowment<\/i> <b>12<\/b> (12): 1986\u20131989. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.14778%2F3352063.3352116\" target=\"_blank\">10.14778\/3352063.3352116<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2150-8097\" target=\"_blank\">2150-8097<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/dl.acm.org\/doi\/10.14778\/3352063.3352116\" target=\"_blank\">https:\/\/dl.acm.org\/doi\/10.14778\/3352063.3352116<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Data+lake+management%3A+challenges+and+opportunities&rft.jtitle=Proceedings+of+the+VLDB+Endowment&rft.aulast=Nargesian&rft.aufirst=Fatemeh&rft.au=Nargesian%2C%26%2332%3BFatemeh&rft.au=Zhu%2C%26%2332%3BErkang&rft.au=Miller%2C%26%2332%3BRen%C3%A9e+J.&rft.au=Pu%2C%26%2332%3BKen+Q.&rft.au=Arocena%2C%26%2332%3BPatricia+C.&rft.date=1+August+2019&rft.volume=12&rft.issue=12&rft.pages=1986%E2%80%931989&rft_id=info:doi\/10.14778%2F3352063.3352116&rft.issn=2150-8097&rft_id=https%3A%2F%2Fdl.acm.org%2Fdoi%2F10.14778%2F3352063.3352116&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-78\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-78\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.pentasecurity.com\/blog\/4-data-compliance-standards-gdpr-hipaa-pci-dss-ccpa\/\" target=\"_blank\">\"A Brief Look at 4 Major Data Compliance Standards: GDPR, HIPAA, PCI DSS, CCPA\"<\/a>. <i>PentaSecurity Blog<\/i>. Penta Security Systems, Inc. 6 August 2020<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.pentasecurity.com\/blog\/4-data-compliance-standards-gdpr-hipaa-pci-dss-ccpa\/\" target=\"_blank\">https:\/\/www.pentasecurity.com\/blog\/4-data-compliance-standards-gdpr-hipaa-pci-dss-ccpa\/<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 27 October 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=A+Brief+Look+at+4+Major+Data+Compliance+Standards%3A+GDPR%2C+HIPAA%2C+PCI+DSS%2C+CCPA&rft.atitle=PentaSecurity+Blog&rft.date=6+August+2020&rft.pub=Penta+Security+Systems%2C+Inc&rft_id=https%3A%2F%2Fwww.pentasecurity.com%2Fblog%2F4-data-compliance-standards-gdpr-hipaa-pci-dss-ccpa%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:20-79\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:20_79-0\">79.0<\/a><\/sup> <sup><a href=\"#cite_ref-:20_79-1\">79.1<\/a><\/sup> <sup><a href=\"#cite_ref-:20_79-2\">79.2<\/a><\/sup> <sup><a href=\"#cite_ref-:20_79-3\">79.3<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Sawadogo, Pegdwend\u00e9; Darmont, J\u00e9r\u00f4me (1 February 2021). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/link.springer.com\/10.1007\/s10844-020-00608-7\" target=\"_blank\">\"On data lake architectures and metadata management\"<\/a> (in en). <i>Journal of Intelligent Information Systems<\/i> <b>56<\/b> (1): 97\u2013120. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1007%2Fs10844-020-00608-7\" target=\"_blank\">10.1007\/s10844-020-00608-7<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0925-9902\" target=\"_blank\">0925-9902<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/link.springer.com\/10.1007\/s10844-020-00608-7\" target=\"_blank\">https:\/\/link.springer.com\/10.1007\/s10844-020-00608-7<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=On+data+lake+architectures+and+metadata+management&rft.jtitle=Journal+of+Intelligent+Information+Systems&rft.aulast=Sawadogo&rft.aufirst=Pegdwend%C3%A9&rft.au=Sawadogo%2C%26%2332%3BPegdwend%C3%A9&rft.au=Darmont%2C%26%2332%3BJ%C3%A9r%C3%B4me&rft.date=1+February+2021&rft.volume=56&rft.issue=1&rft.pages=97%E2%80%93120&rft_id=info:doi\/10.1007%2Fs10844-020-00608-7&rft.issn=0925-9902&rft_id=https%3A%2F%2Flink.springer.com%2F10.1007%2Fs10844-020-00608-7&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-80\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-80\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/d1.awsstatic.com\/whitepapers\/aws-overview.pdf\" target=\"_blank\">\"Overview of Amazon Web Services\"<\/a> (PDF). Amazon Web Services. 5 August 2021<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/d1.awsstatic.com\/whitepapers\/aws-overview.pdf\" target=\"_blank\">https:\/\/d1.awsstatic.com\/whitepapers\/aws-overview.pdf<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 27 October 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Overview+of+Amazon+Web+Services&rft.atitle=&rft.date=5+August+2021&rft.pub=Amazon+Web+Services&rft_id=https%3A%2F%2Fd1.awsstatic.com%2Fwhitepapers%2Faws-overview.pdf&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-81\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-81\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Pandis, Ippokratis (1 July 2021). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/dl.acm.org\/doi\/10.14778\/3476311.3476391\" target=\"_blank\">\"The evolution of Amazon redshift\"<\/a> (in en). <i>Proceedings of the VLDB Endowment<\/i> <b>14<\/b> (12): 3162\u20133174. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.14778%2F3476311.3476391\" target=\"_blank\">10.14778\/3476311.3476391<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2150-8097\" target=\"_blank\">2150-8097<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/dl.acm.org\/doi\/10.14778\/3476311.3476391\" target=\"_blank\">https:\/\/dl.acm.org\/doi\/10.14778\/3476311.3476391<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=The+evolution+of+Amazon+redshift&rft.jtitle=Proceedings+of+the+VLDB+Endowment&rft.aulast=Pandis&rft.aufirst=Ippokratis&rft.au=Pandis%2C%26%2332%3BIppokratis&rft.date=1+July+2021&rft.volume=14&rft.issue=12&rft.pages=3162%E2%80%933174&rft_id=info:doi\/10.14778%2F3476311.3476391&rft.issn=2150-8097&rft_id=https%3A%2F%2Fdl.acm.org%2Fdoi%2F10.14778%2F3476311.3476391&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-GoogleDataMan-82\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-GoogleDataMan_82-0\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/research.google\/research-areas\/data-management\/\" target=\"_blank\">\"Data management\"<\/a>. <i>Research Areas<\/i>. Google Research<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/research.google\/research-areas\/data-management\/\" target=\"_blank\">https:\/\/research.google\/research-areas\/data-management\/<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 25 September 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Data+management&rft.atitle=Research+Areas&rft.pub=Google+Research&rft_id=https%3A%2F%2Fresearch.google%2Fresearch-areas%2Fdata-management%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-83\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-83\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/learn.microsoft.com\/en-us\/azure\/?product=popular\" target=\"_blank\">\"Azure documentation\"<\/a>. <i>Microsoft Learn<\/i>. Microsoft Corporation<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/learn.microsoft.com\/en-us\/azure\/?product=popular\" target=\"_blank\">https:\/\/learn.microsoft.com\/en-us\/azure\/?product=popular<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 27 October 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Azure+documentation&rft.atitle=Microsoft+Learn&rft.pub=Microsoft+Corporation&rft_id=https%3A%2F%2Flearn.microsoft.com%2Fen-us%2Fazure%2F%3Fproduct%3Dpopular&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-84\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-84\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.oracle.com\/autonomous-database\/autonomous-data-warehouse\/\" target=\"_blank\">\"Autonomous Data Warehouse\"<\/a>. Oracle<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.oracle.com\/autonomous-database\/autonomous-data-warehouse\/\" target=\"_blank\">https:\/\/www.oracle.com\/autonomous-database\/autonomous-data-warehouse\/<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 27 October 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Autonomous+Data+Warehouse&rft.atitle=&rft.pub=Oracle&rft_id=https%3A%2F%2Fwww.oracle.com%2Fautonomous-database%2Fautonomous-data-warehouse%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-85\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-85\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Dageville, Benoit; Cruanes, Thierry; Zukowski, Marcin; Antonov, Vadim; Avanes, Artin; Bock, Jon; Claybaugh, Jonathan; Engovatov, Daniel <i>et al.<\/i> (14 June 2016). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/dl.acm.org\/doi\/10.1145\/2882903.2903741\" target=\"_blank\">\"The Snowflake Elastic Data Warehouse\"<\/a> (in en). <i>Proceedings of the 2016 International Conference on Management of Data<\/i> (San Francisco California USA: ACM): 215\u2013226. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1145%2F2882903.2903741\" target=\"_blank\">10.1145\/2882903.2903741<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-1-4503-3531-7<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/dl.acm.org\/doi\/10.1145\/2882903.2903741\" target=\"_blank\">https:\/\/dl.acm.org\/doi\/10.1145\/2882903.2903741<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=The+Snowflake+Elastic+Data+Warehouse&rft.jtitle=Proceedings+of+the+2016+International+Conference+on+Management+of+Data&rft.aulast=Dageville&rft.aufirst=Benoit&rft.au=Dageville%2C%26%2332%3BBenoit&rft.au=Cruanes%2C%26%2332%3BThierry&rft.au=Zukowski%2C%26%2332%3BMarcin&rft.au=Antonov%2C%26%2332%3BVadim&rft.au=Avanes%2C%26%2332%3BArtin&rft.au=Bock%2C%26%2332%3BJon&rft.au=Claybaugh%2C%26%2332%3BJonathan&rft.au=Engovatov%2C%26%2332%3BDaniel&rft.au=Hentschel%2C%26%2332%3BMartin&rft.date=14+June+2016&rft.pages=215%E2%80%93226&rft.place=San+Francisco+California+USA&rft.pub=ACM&rft_id=info:doi\/10.1145%2F2882903.2903741&rft.isbn=978-1-4503-3531-7&rft_id=https%3A%2F%2Fdl.acm.org%2Fdoi%2F10.1145%2F2882903.2903741&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-IBMAnal-86\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-IBMAnal_86-0\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.ibm.com\/analytics\" target=\"_blank\">\"Analytics tools and solutions\"<\/a>. IBM<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.ibm.com\/analytics\" target=\"_blank\">https:\/\/www.ibm.com\/analytics<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 25 September 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Analytics+tools+and+solutions&rft.atitle=&rft.pub=IBM&rft_id=https%3A%2F%2Fwww.ibm.com%2Fanalytics&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-87\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-87\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Mathis, Christian (1 November 2017). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/link.springer.com\/10.1007\/s13222-017-0272-7\" target=\"_blank\">\"Data Lakes\"<\/a> (in en). <i>Datenbank-Spektrum<\/i> <b>17<\/b> (3): 289\u2013293. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1007%2Fs13222-017-0272-7\" target=\"_blank\">10.1007\/s13222-017-0272-7<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1618-2162\" target=\"_blank\">1618-2162<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/link.springer.com\/10.1007\/s13222-017-0272-7\" target=\"_blank\">http:\/\/link.springer.com\/10.1007\/s13222-017-0272-7<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Data+Lakes&rft.jtitle=Datenbank-Spektrum&rft.aulast=Mathis&rft.aufirst=Christian&rft.au=Mathis%2C%26%2332%3BChristian&rft.date=1+November+2017&rft.volume=17&rft.issue=3&rft.pages=289%E2%80%93293&rft_id=info:doi\/10.1007%2Fs13222-017-0272-7&rft.issn=1618-2162&rft_id=http%3A%2F%2Flink.springer.com%2F10.1007%2Fs13222-017-0272-7&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-88\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-88\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Zagan, Elisabeta; Danubianu, Mirela (11 June 2021). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/ieeexplore.ieee.org\/document\/9461293\/\" target=\"_blank\">\"Cloud DATA LAKE: The new trend of data storage\"<\/a>. <i>2021 3rd International Congress on Human-Computer Interaction, Optimization and Robotic Applications (HORA)<\/i> (Ankara, Turkey: IEEE): 1\u20134. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1109%2FHORA52670.2021.9461293\" target=\"_blank\">10.1109\/HORA52670.2021.9461293<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-1-6654-4058-5<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/ieeexplore.ieee.org\/document\/9461293\/\" target=\"_blank\">https:\/\/ieeexplore.ieee.org\/document\/9461293\/<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Cloud+DATA+LAKE%3A+The+new+trend+of+data+storage&rft.jtitle=2021+3rd+International+Congress+on+Human-Computer+Interaction%2C+Optimization+and+Robotic+Applications+%28HORA%29&rft.aulast=Zagan&rft.aufirst=Elisabeta&rft.au=Zagan%2C%26%2332%3BElisabeta&rft.au=Danubianu%2C%26%2332%3BMirela&rft.date=11+June+2021&rft.pages=1%E2%80%934&rft.place=Ankara%2C+Turkey&rft.pub=IEEE&rft_id=info:doi\/10.1109%2FHORA52670.2021.9461293&rft.isbn=978-1-6654-4058-5&rft_id=https%3A%2F%2Fieeexplore.ieee.org%2Fdocument%2F9461293%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-MicrosoftDataLake-89\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-MicrosoftDataLake_89-0\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/azure.microsoft.com\/en-in\/solutions\/data-lake\/\" target=\"_blank\">\"Data Lake\"<\/a>. Microsoft<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/azure.microsoft.com\/en-in\/solutions\/data-lake\/\" target=\"_blank\">https:\/\/azure.microsoft.com\/en-in\/solutions\/data-lake\/<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 25 September 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Data+Lake&rft.atitle=&rft.pub=Microsoft&rft_id=https%3A%2F%2Fazure.microsoft.com%2Fen-in%2Fsolutions%2Fdata-lake%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-90\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-90\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Ramakrishnan, Raghu; Sridharan, Baskar; Douceur, John R.; Kasturi, Pavan; Krishnamachari-Sampath, Balaji; Krishnamoorthy, Karthick; Li, Peng; Manu, Mitica <i>et al.<\/i> (9 May 2017). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/dl.acm.org\/doi\/10.1145\/3035918.3056100\" target=\"_blank\">\"Azure Data Lake Store: A Hyperscale Distributed File Service for Big Data Analytics\"<\/a> (in en). <i>Proceedings of the 2017 ACM International Conference on Management of Data<\/i> (Chicago Illinois USA: ACM): 51\u201363. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1145%2F3035918.3056100\" target=\"_blank\">10.1145\/3035918.3056100<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-1-4503-4197-4<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/dl.acm.org\/doi\/10.1145\/3035918.3056100\" target=\"_blank\">https:\/\/dl.acm.org\/doi\/10.1145\/3035918.3056100<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Azure+Data+Lake+Store%3A+A+Hyperscale+Distributed+File+Service+for+Big+Data+Analytics&rft.jtitle=Proceedings+of+the+2017+ACM+International+Conference+on+Management+of+Data&rft.aulast=Ramakrishnan&rft.aufirst=Raghu&rft.au=Ramakrishnan%2C%26%2332%3BRaghu&rft.au=Sridharan%2C%26%2332%3BBaskar&rft.au=Douceur%2C%26%2332%3BJohn+R.&rft.au=Kasturi%2C%26%2332%3BPavan&rft.au=Krishnamachari-Sampath%2C%26%2332%3BBalaji&rft.au=Krishnamoorthy%2C%26%2332%3BKarthick&rft.au=Li%2C%26%2332%3BPeng&rft.au=Manu%2C%26%2332%3BMitica&rft.au=Michaylov%2C%26%2332%3BSpiro&rft.date=9+May+2017&rft.pages=51%E2%80%9363&rft.place=Chicago+Illinois+USA&rft.pub=ACM&rft_id=info:doi\/10.1145%2F3035918.3056100&rft.isbn=978-1-4503-4197-4&rft_id=https%3A%2F%2Fdl.acm.org%2Fdoi%2F10.1145%2F3035918.3056100&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-AWSLakeForm-91\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-AWSLakeForm_91-0\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/aws.amazon.com\/lake-formation\/?whats-new-cards.sort-by=item.additionalFields.postDateTime&whats-new-cards.sort-order=desc\" target=\"_blank\">\"AWS Lake Formation\"<\/a>. Amazon Web Services<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/aws.amazon.com\/lake-formation\/?whats-new-cards.sort-by=item.additionalFields.postDateTime&whats-new-cards.sort-order=desc\" target=\"_blank\">https:\/\/aws.amazon.com\/lake-formation\/?whats-new-cards.sort-by=item.additionalFields.postDateTime&whats-new-cards.sort-order=desc<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 25 September 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=AWS+Lake+Formation&rft.atitle=&rft.pub=Amazon+Web+Services&rft_id=https%3A%2F%2Faws.amazon.com%2Flake-formation%2F%3Fwhats-new-cards.sort-by%3Ditem.additionalFields.postDateTime%26whats-new-cards.sort-order%3Ddesc&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-AWSWhatIsADataLake-92\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-AWSWhatIsADataLake_92-0\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/aws.amazon.com\/big-data\/datalakes-and-analytics\/what-is-a-data-lake\/\" target=\"_blank\">\"What is a data lake?\"<\/a>. Amazon Web Services<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/aws.amazon.com\/big-data\/datalakes-and-analytics\/what-is-a-data-lake\/\" target=\"_blank\">https:\/\/aws.amazon.com\/big-data\/datalakes-and-analytics\/what-is-a-data-lake\/<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 25 September 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=What+is+a+data+lake%3F&rft.atitle=&rft.pub=Amazon+Web+Services&rft_id=https%3A%2F%2Faws.amazon.com%2Fbig-data%2Fdatalakes-and-analytics%2Fwhat-is-a-data-lake%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-GoogleBigLake-93\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-GoogleBigLake_93-0\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/cloud.google.com\/biglake\" target=\"_blank\">\"BigLake\"<\/a>. Google Cloud<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/cloud.google.com\/biglake\" target=\"_blank\">https:\/\/cloud.google.com\/biglake<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 25 September 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=BigLake&rft.atitle=&rft.pub=Google+Cloud&rft_id=https%3A%2F%2Fcloud.google.com%2Fbiglake&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-ClouderaSDXData-94\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-ClouderaSDXData_94-0\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.cloudera.com\/products\/sdx\/data-lake-service.html\" target=\"_blank\">\"Cloudera SDX Data Lake Service\"<\/a>. Cloudera<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.cloudera.com\/products\/sdx\/data-lake-service.html\" target=\"_blank\">https:\/\/www.cloudera.com\/products\/sdx\/data-lake-service.html<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 25 September 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Cloudera+SDX+Data+Lake+Service&rft.atitle=&rft.pub=Cloudera&rft_id=https%3A%2F%2Fwww.cloudera.com%2Fproducts%2Fsdx%2Fdata-lake-service.html&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-SnowflakeDataLake-95\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-SnowflakeDataLake_95-0\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.snowflake.com\/en\/data-cloud\/workloads\/data-lake\/\" target=\"_blank\">\"Snowflake for Data Lakes\"<\/a>. Snowflake, Inc<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.snowflake.com\/en\/data-cloud\/workloads\/data-lake\/\" target=\"_blank\">https:\/\/www.snowflake.com\/en\/data-cloud\/workloads\/data-lake\/<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 25 September 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Snowflake+for+Data+Lakes&rft.atitle=&rft.pub=Snowflake%2C+Inc&rft_id=https%3A%2F%2Fwww.snowflake.com%2Fen%2Fdata-cloud%2Fworkloads%2Fdata-lake%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-96\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-96\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation\" id=\"rdp-ebb-CITEREFElgendyElragal2014\">Elgendy, Nada; Elragal, Ahmed (2014), Perner, Petra, ed., <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/link.springer.com\/10.1007\/978-3-319-08976-8_16\" target=\"_blank\">\"Big Data Analytics: A Literature Review Paper\"<\/a>, <i>Advances in Data Mining. Applications and Theoretical Aspects<\/i> (Cham: Springer International Publishing) <b>8557<\/b>: 214\u2013227, <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1007%2F978-3-319-08976-8_16\" target=\"_blank\">10.1007\/978-3-319-08976-8_16<\/a>, <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-3-319-08975-1<span class=\"printonly\">, <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/link.springer.com\/10.1007\/978-3-319-08976-8_16\" target=\"_blank\">http:\/\/link.springer.com\/10.1007\/978-3-319-08976-8_16<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 2023-05-03<\/span><\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Big+Data+Analytics%3A+A+Literature+Review+Paper&rft.jtitle=Advances+in+Data+Mining.+Applications+and+Theoretical+Aspects&rft.aulast=Elgendy&rft.aufirst=Nada&rft.au=Elgendy%2C%26%2332%3BNada&rft.au=Elragal%2C%26%2332%3BAhmed&rft.date=2014&rft.volume=8557&rft.pages=214%E2%80%93227&rft.place=Cham&rft.pub=Springer+International+Publishing&rft_id=info:doi\/10.1007%2F978-3-319-08976-8_16&rft.isbn=978-3-319-08975-1&rft_id=http%3A%2F%2Flink.springer.com%2F10.1007%2F978-3-319-08976-8_16&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-97\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-97\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Jin, Xiaolong; Wah, Benjamin W.; Cheng, Xueqi; Wang, Yuanzhuo (1 June 2015). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2214579615000076\" target=\"_blank\">\"Significance and Challenges of Big Data Research\"<\/a> (in en). <i>Big Data Research<\/i> <b>2<\/b> (2): 59\u201364. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.bdr.2015.01.006\" target=\"_blank\">10.1016\/j.bdr.2015.01.006<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2214579615000076\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2214579615000076<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Significance+and+Challenges+of+Big+Data+Research&rft.jtitle=Big+Data+Research&rft.aulast=Jin&rft.aufirst=Xiaolong&rft.au=Jin%2C%26%2332%3BXiaolong&rft.au=Wah%2C%26%2332%3BBenjamin+W.&rft.au=Cheng%2C%26%2332%3BXueqi&rft.au=Wang%2C%26%2332%3BYuanzhuo&rft.date=1+June+2015&rft.volume=2&rft.issue=2&rft.pages=59%E2%80%9364&rft_id=info:doi\/10.1016%2Fj.bdr.2015.01.006&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS2214579615000076&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-98\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-98\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Agrawal, Rajeev; Nyamful, Christopher (15 March 2016). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/un-pub.eu\/ojs\/index.php\/gjit\/article\/view\/383\" target=\"_blank\">\"Challenges of big data storage and management\"<\/a>. <i>Global Journal of Information Technology<\/i> <b>6<\/b> (1). <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.18844%2Fgjit.v6i1.383\" target=\"_blank\">10.18844\/gjit.v6i1.383<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2301-2617\" target=\"_blank\">2301-2617<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/un-pub.eu\/ojs\/index.php\/gjit\/article\/view\/383\" target=\"_blank\">https:\/\/un-pub.eu\/ojs\/index.php\/gjit\/article\/view\/383<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Challenges+of+big+data+storage+and+management&rft.jtitle=Global+Journal+of+Information+Technology&rft.aulast=Agrawal&rft.aufirst=Rajeev&rft.au=Agrawal%2C%26%2332%3BRajeev&rft.au=Nyamful%2C%26%2332%3BChristopher&rft.date=15+March+2016&rft.volume=6&rft.issue=1&rft_id=info:doi\/10.18844%2Fgjit.v6i1.383&rft.issn=2301-2617&rft_id=https%3A%2F%2Fun-pub.eu%2Fojs%2Findex.php%2Fgjit%2Farticle%2Fview%2F383&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-99\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-99\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Padgavankar, M.H.; Gupta, S.R. (2014). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.csd.uoc.gr\/~hy108\/downloads\/bigdata.pdf\" target=\"_blank\">\"Big Data Storage and Challenge\"<\/a>. <i>Big Data Storage and Challenges<\/i> <b>5<\/b> (2): 2218-2223. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0975-9646\" target=\"_blank\">0975-9646<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.csd.uoc.gr\/~hy108\/downloads\/bigdata.pdf\" target=\"_blank\">https:\/\/www.csd.uoc.gr\/~hy108\/downloads\/bigdata.pdf<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Big+Data+Storage+and+Challenge&rft.jtitle=Big+Data+Storage+and+Challenges&rft.aulast=Padgavankar%2C+M.H.%3B+Gupta%2C+S.R.&rft.au=Padgavankar%2C+M.H.%3B+Gupta%2C+S.R.&rft.date=2014&rft.volume=5&rft.issue=2&rft.pages=2218-2223&rft.issn=0975-9646&rft_id=https%3A%2F%2Fwww.csd.uoc.gr%2F%7Ehy108%2Fdownloads%2Fbigdata.pdf&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-100\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-100\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Kadadi, Anirudh; Agrawal, Rajeev; Nyamful, Christopher; Atiq, Rahman (1 October 2014). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/ieeexplore.ieee.org\/document\/7004486\/\" target=\"_blank\">\"Challenges of data integration and interoperability in big data\"<\/a>. <i>2014 IEEE International Conference on Big Data (Big Data)<\/i> (Washington, DC, USA: IEEE): 38\u201340. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1109%2FBigData.2014.7004486\" target=\"_blank\">10.1109\/BigData.2014.7004486<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-1-4799-5666-1<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/ieeexplore.ieee.org\/document\/7004486\/\" target=\"_blank\">http:\/\/ieeexplore.ieee.org\/document\/7004486\/<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Challenges+of+data+integration+and+interoperability+in+big+data&rft.jtitle=2014+IEEE+International+Conference+on+Big+Data+%28Big+Data%29&rft.aulast=Kadadi&rft.aufirst=Anirudh&rft.au=Kadadi%2C%26%2332%3BAnirudh&rft.au=Agrawal%2C%26%2332%3BRajeev&rft.au=Nyamful%2C%26%2332%3BChristopher&rft.au=Atiq%2C%26%2332%3BRahman&rft.date=1+October+2014&rft.pages=38%E2%80%9340&rft.place=Washington%2C+DC%2C+USA&rft.pub=IEEE&rft_id=info:doi\/10.1109%2FBigData.2014.7004486&rft.isbn=978-1-4799-5666-1&rft_id=http%3A%2F%2Fieeexplore.ieee.org%2Fdocument%2F7004486%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-101\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-101\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.peerspot.com\/categories\/data-integration-tools\" target=\"_blank\">\"Best Data Integration Tools\"<\/a>. <i>PeerSpot<\/i>. PeerSpot Ltd. October 2022<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.peerspot.com\/categories\/data-integration-tools\" target=\"_blank\">https:\/\/www.peerspot.com\/categories\/data-integration-tools<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 27 October 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Best+Data+Integration+Tools&rft.atitle=PeerSpot&rft.date=October+2022&rft.pub=PeerSpot+Ltd&rft_id=https%3A%2F%2Fwww.peerspot.com%2Fcategories%2Fdata-integration-tools&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-102\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-102\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Toshniwal, R.; Dastidar, K.G.; Nath, A. (February 2015). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/web.archive.org\/web\/20220121204247\/https:\/\/www.ijirae.com\/volumes\/Vol2\/iss2\/03.FBCS10080.pdf\" target=\"_blank\">\"Big Data Security Issues and Challenges\"<\/a>. <i>International Journal of Innovative Research in Advanced Engineering<\/i> <b>2<\/b> (2): 15\u201320. Archived from <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.ijirae.com\/volumes\/Vol2\/iss2\/03.FBCS10080.pdf\" target=\"_blank\">the original<\/a> on 21 January 2022<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/web.archive.org\/web\/20220121204247\/https:\/\/www.ijirae.com\/volumes\/Vol2\/iss2\/03.FBCS10080.pdf\" target=\"_blank\">https:\/\/web.archive.org\/web\/20220121204247\/https:\/\/www.ijirae.com\/volumes\/Vol2\/iss2\/03.FBCS10080.pdf<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Big+Data+Security+Issues+and+Challenges&rft.jtitle=International+Journal+of+Innovative+Research+in+Advanced+Engineering&rft.aulast=Toshniwal%2C+R.%3B+Dastidar%2C+K.G.%3B+Nath%2C+A.&rft.au=Toshniwal%2C+R.%3B+Dastidar%2C+K.G.%3B+Nath%2C+A.&rft.date=February+2015&rft.volume=2&rft.issue=2&rft.pages=15%E2%80%9320&rft_id=https%3A%2F%2Fweb.archive.org%2Fweb%2F20220121204247%2Fhttps%3A%2F%2Fwww.ijirae.com%2Fvolumes%2FVol2%2Fiss2%2F03.FBCS10080.pdf&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-103\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-103\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation\" id=\"rdp-ebb-CITEREFDemchenkoNgode_LaatMembrey2014\">Demchenko, Yuri; Ngo, Canh; de Laat, Cees; Membrey, Peter; Gordijenko, Daniil (2014), Jonker, Willem; Petkovi\u0107, Milan, eds., <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/link.springer.com\/10.1007\/978-3-319-06811-4_13\" target=\"_blank\">\"Big Security for Big Data: Addressing Security Challenges for the Big Data Infrastructure\"<\/a> (in en), <i>Secure Data Management<\/i> (Cham: Springer International Publishing) <b>8425<\/b>: 76\u201394, <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1007%2F978-3-319-06811-4_13\" target=\"_blank\">10.1007\/978-3-319-06811-4_13<\/a>, <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-3-319-06810-7<span class=\"printonly\">, <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/link.springer.com\/10.1007\/978-3-319-06811-4_13\" target=\"_blank\">https:\/\/link.springer.com\/10.1007\/978-3-319-06811-4_13<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 2023-05-03<\/span><\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Big+Security+for+Big+Data%3A+Addressing+Security+Challenges+for+the+Big+Data+Infrastructure&rft.jtitle=Secure+Data+Management&rft.aulast=Demchenko&rft.aufirst=Yuri&rft.au=Demchenko%2C%26%2332%3BYuri&rft.au=Ngo%2C%26%2332%3BCanh&rft.au=de+Laat%2C%26%2332%3BCees&rft.au=Membrey%2C%26%2332%3BPeter&rft.au=Gordijenko%2C%26%2332%3BDaniil&rft.date=2014&rft.volume=8425&rft.pages=76%E2%80%9394&rft.place=Cham&rft.pub=Springer+International+Publishing&rft_id=info:doi\/10.1007%2F978-3-319-06811-4_13&rft.isbn=978-3-319-06810-7&rft_id=https%3A%2F%2Flink.springer.com%2F10.1007%2F978-3-319-06811-4_13&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-104\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-104\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Chen, Edward T. (18 June 2014). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/scholarworks.lib.csusb.edu\/ciima\/vol12\/iss2\/3\" target=\"_blank\">\"Implementation Issues of Enterprise data Warehousing and Business Intelligence in the Healthcare Industry\"<\/a> (in en). <i>Communications of the IIMA<\/i> <b>12<\/b> (2). <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.58729%2F1941-6687.1186\" target=\"_blank\">10.58729\/1941-6687.1186<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1941-6687\" target=\"_blank\">1941-6687<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/scholarworks.lib.csusb.edu\/ciima\/vol12\/iss2\/3\" target=\"_blank\">https:\/\/scholarworks.lib.csusb.edu\/ciima\/vol12\/iss2\/3<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Implementation+Issues+of+Enterprise+data+Warehousing+and+Business+Intelligence+in+the+Healthcare+Industry&rft.jtitle=Communications+of+the+IIMA&rft.aulast=Chen&rft.aufirst=Edward+T.&rft.au=Chen%2C%26%2332%3BEdward+T.&rft.date=18+June+2014&rft.volume=12&rft.issue=2&rft_id=info:doi\/10.58729%2F1941-6687.1186&rft.issn=1941-6687&rft_id=https%3A%2F%2Fscholarworks.lib.csusb.edu%2Fciima%2Fvol12%2Fiss2%2F3&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-105\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-105\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Cuzzocrea, Alfredo; Bellatreche, Ladjel; Song, Il-Yeol (28 October 2013). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/dl.acm.org\/doi\/10.1145\/2513190.2517828\" target=\"_blank\">\"Data warehousing and OLAP over big data: current challenges and future research directions\"<\/a> (in en). <i>Proceedings of the sixteenth international workshop on Data warehousing and OLAP<\/i> (San Francisco California USA: ACM): 67\u201370. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1145%2F2513190.2517828\" target=\"_blank\">10.1145\/2513190.2517828<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-1-4503-2412-0<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/dl.acm.org\/doi\/10.1145\/2513190.2517828\" target=\"_blank\">https:\/\/dl.acm.org\/doi\/10.1145\/2513190.2517828<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Data+warehousing+and+OLAP+over+big+data%3A+current+challenges+and+future+research+directions&rft.jtitle=Proceedings+of+the+sixteenth+international+workshop+on+Data+warehousing+and+OLAP&rft.aulast=Cuzzocrea&rft.aufirst=Alfredo&rft.au=Cuzzocrea%2C%26%2332%3BAlfredo&rft.au=Bellatreche%2C%26%2332%3BLadjel&rft.au=Song%2C%26%2332%3BIl-Yeol&rft.date=28+October+2013&rft.pages=67%E2%80%9370&rft.place=San+Francisco+California+USA&rft.pub=ACM&rft_id=info:doi\/10.1145%2F2513190.2517828&rft.isbn=978-1-4503-2412-0&rft_id=https%3A%2F%2Fdl.acm.org%2Fdoi%2F10.1145%2F2513190.2517828&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-106\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-106\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Singh, R.; Singh, K. (May 2010). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.ijcsi.org\/papers\/7-3-2-41-50.pdf\" target=\"_blank\">\"A Descriptive Classification of Causes of Data Quality Problems in Data Warehousing\"<\/a> (PDF). <i>International Journal of Computer Science Issues<\/i> <b>7<\/b> (3): 41\u201350<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.ijcsi.org\/papers\/7-3-2-41-50.pdf\" target=\"_blank\">https:\/\/www.ijcsi.org\/papers\/7-3-2-41-50.pdf<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=A+Descriptive+Classification+of+Causes+of+Data+Quality+Problems+in+Data+Warehousing&rft.jtitle=International+Journal+of+Computer+Science+Issues&rft.aulast=Singh%2C+R.%3B+Singh%2C+K.&rft.au=Singh%2C+R.%3B+Singh%2C+K.&rft.date=May+2010&rft.volume=7&rft.issue=3&rft.pages=41%E2%80%9350&rft_id=https%3A%2F%2Fwww.ijcsi.org%2Fpapers%2F7-3-2-41-50.pdf&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-107\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-107\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Longbottom, C.; Bamforth, R. (October 2013). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.it-daily.net\/downloads\/WP_Optimising-the-data-warehouse.pdf\" target=\"_blank\">\"Optimising the data warehouse\"<\/a> (PDF). Quocirca Ltd<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.it-daily.net\/downloads\/WP_Optimising-the-data-warehouse.pdf\" target=\"_blank\">https:\/\/www.it-daily.net\/downloads\/WP_Optimising-the-data-warehouse.pdf<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 27 October 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Optimising+the+data+warehouse&rft.atitle=&rft.aulast=Longbottom%2C+C.%3B+Bamforth%2C+R.&rft.au=Longbottom%2C+C.%3B+Bamforth%2C+R.&rft.date=October+2013&rft.pub=Quocirca+Ltd&rft_id=https%3A%2F%2Fwww.it-daily.net%2Fdownloads%2FWP_Optimising-the-data-warehouse.pdf&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-108\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-108\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Santos, Ricardo Jorge; Bernardino, Jorge; Vieira, Marco (1 April 2011). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/ieeexplore.ieee.org\/document\/5929314\/\" target=\"_blank\">\"A survey on data security in data warehousing: Issues, challenges and opportunities\"<\/a>. <i>2011 IEEE EUROCON - International Conference on Computer as a Tool<\/i>: 1\u20134. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1109%2FEUROCON.2011.5929314\" target=\"_blank\">10.1109\/EUROCON.2011.5929314<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/ieeexplore.ieee.org\/document\/5929314\/\" target=\"_blank\">https:\/\/ieeexplore.ieee.org\/document\/5929314\/<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=A+survey+on+data+security+in+data+warehousing%3A+Issues%2C+challenges+and+opportunities&rft.jtitle=2011+IEEE+EUROCON+-+International+Conference+on+Computer+as+a+Tool&rft.aulast=Santos&rft.aufirst=Ricardo+Jorge&rft.au=Santos%2C%26%2332%3BRicardo+Jorge&rft.au=Bernardino%2C%26%2332%3BJorge&rft.au=Vieira%2C%26%2332%3BMarco&rft.date=1+April+2011&rft.pages=1%E2%80%934&rft_id=info:doi\/10.1109%2FEUROCON.2011.5929314&rft_id=https%3A%2F%2Fieeexplore.ieee.org%2Fdocument%2F5929314%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-109\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-109\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/docs.oracle.com\/cd\/E29633_01\/CDMOG\/GUID-7E43F311-4510-4F1E-A17E-693F94BD0EC7.htm\" target=\"_blank\">\"Responsibilities of a Data Warehouse Governance Committee\"<\/a>. <i>Oracle Help Center<\/i>. Oracle<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/docs.oracle.com\/cd\/E29633_01\/CDMOG\/GUID-7E43F311-4510-4F1E-A17E-693F94BD0EC7.htm\" target=\"_blank\">https:\/\/docs.oracle.com\/cd\/E29633_01\/CDMOG\/GUID-7E43F311-4510-4F1E-A17E-693F94BD0EC7.htm<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 27 October 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Responsibilities+of+a+Data+Warehouse+Governance+Committee&rft.atitle=Oracle+Help+Center&rft.pub=Oracle&rft_id=https%3A%2F%2Fdocs.oracle.com%2Fcd%2FE29633_01%2FCDMOG%2FGUID-7E43F311-4510-4F1E-A17E-693F94BD0EC7.htm&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-110\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-110\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation book\">Gupta, Saurabh; Giri, Venkata (2018). <i>Practical Enterprise Data Lake Insights: handle data-driven challenges in an Enterprise Big Data Lake<\/i>. For professionals by professionals. New York, NY: Apress. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-1-4842-3521-8.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=book&rft.btitle=Practical+Enterprise+Data+Lake+Insights%3A+handle+data-driven+challenges+in+an+Enterprise+Big+Data+Lake&rft.aulast=Gupta&rft.aufirst=Saurabh&rft.au=Gupta%2C%26%2332%3BSaurabh&rft.au=Giri%2C%26%2332%3BVenkata&rft.date=2018&rft.series=For+professionals+by+professionals&rft.place=New+York%2C+NY&rft.pub=Apress&rft.isbn=978-1-4842-3521-8&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-111\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-111\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation\" id=\"rdp-ebb-CITEREFGieblerGr.C3.B6gerHoosSchwarz2019\">Giebler, Corinna; Gr\u00f6ger, Christoph; Hoos, Eva; Schwarz, Holger; Mitschang, Bernhard (2019), Ordonez, Carlos; Song, Il-Yeol; Anderst-Kotsis, Gabriele <i>et al.<\/i>., eds., <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/link.springer.com\/10.1007\/978-3-030-27520-4_13\" target=\"_blank\">\"Leveraging the Data Lake: Current State and Challenges\"<\/a> (in en), <i>Big Data Analytics and Knowledge Discovery<\/i> (Cham: Springer International Publishing) <b>11708<\/b>: 179\u2013188, <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1007%2F978-3-030-27520-4_13\" target=\"_blank\">10.1007\/978-3-030-27520-4_13<\/a>, <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-3-030-27519-8<span class=\"printonly\">, <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/link.springer.com\/10.1007\/978-3-030-27520-4_13\" target=\"_blank\">http:\/\/link.springer.com\/10.1007\/978-3-030-27520-4_13<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 2023-05-03<\/span><\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Leveraging+the+Data+Lake%3A+Current+State+and+Challenges&rft.jtitle=Big+Data+Analytics+and+Knowledge+Discovery&rft.aulast=Giebler&rft.aufirst=Corinna&rft.au=Giebler%2C%26%2332%3BCorinna&rft.au=Gr%C3%B6ger%2C%26%2332%3BChristoph&rft.au=Hoos%2C%26%2332%3BEva&rft.au=Schwarz%2C%26%2332%3BHolger&rft.au=Mitschang%2C%26%2332%3BBernhard&rft.date=2019&rft.volume=11708&rft.pages=179%E2%80%93188&rft.place=Cham&rft.pub=Springer+International+Publishing&rft_id=info:doi\/10.1007%2F978-3-030-27520-4_13&rft.isbn=978-3-030-27519-8&rft_id=http%3A%2F%2Flink.springer.com%2F10.1007%2F978-3-030-27520-4_13&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-112\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-112\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Lock, M. (May 2016). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/technology-signals.com\/wp-content\/uploads\/download-manager-files\/maximizingyourdatalake.pdf\" target=\"_blank\">\"Maximizing Your Data Lake with a Cloud or Hybrid Approach\"<\/a> (PDF). Aberdeen Group<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/technology-signals.com\/wp-content\/uploads\/download-manager-files\/maximizingyourdatalake.pdf\" target=\"_blank\">https:\/\/technology-signals.com\/wp-content\/uploads\/download-manager-files\/maximizingyourdatalake.pdf<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 27 October 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Maximizing+Your+Data+Lake+with+a+Cloud+or+Hybrid+Approach&rft.atitle=&rft.aulast=Lock%2C+M.&rft.au=Lock%2C+M.&rft.date=May+2016&rft.pub=Aberdeen+Group&rft_id=https%3A%2F%2Ftechnology-signals.com%2Fwp-content%2Fuploads%2Fdownload-manager-files%2Fmaximizingyourdatalake.pdf&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-113\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-113\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Kumar, N. (2020). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.sigmoid.com\/blogs\/cloud-data-warehouse-is-the-future-of-data-storage\/\" target=\"_blank\">\"Cloud data warehouse is the future of data storage\"<\/a>. <i>Sigmoid Blog<\/i>. Sigmoid<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.sigmoid.com\/blogs\/cloud-data-warehouse-is-the-future-of-data-storage\/\" target=\"_blank\">https:\/\/www.sigmoid.com\/blogs\/cloud-data-warehouse-is-the-future-of-data-storage\/<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 27 October 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Cloud+data+warehouse+is+the+future+of+data+storage&rft.atitle=Sigmoid+Blog&rft.aulast=Kumar%2C+N.&rft.au=Kumar%2C+N.&rft.date=2020&rft.pub=Sigmoid&rft_id=https%3A%2F%2Fwww.sigmoid.com%2Fblogs%2Fcloud-data-warehouse-is-the-future-of-data-storage%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-114\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-114\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Kahn, Michael G; Mui, Joyce Y; Ames, Michael J; Yamsani, Anoop K; Pozdeyev, Nikita; Rafaels, Nicholas; Brooks, Ian M (15 March 2022). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/academic.oup.com\/jamia\/article\/29\/4\/592\/6468865\" target=\"_blank\">\"Migrating a research data warehouse to a public cloud: challenges and opportunities\"<\/a> (in en). <i>Journal of the American Medical Informatics Association<\/i> <b>29<\/b> (4): 592\u2013600. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1093%2Fjamia%2Focab278\" target=\"_blank\">10.1093\/jamia\/ocab278<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1527-974X\" target=\"_blank\">1527-974X<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC8922165\/\" target=\"_blank\">PMC8922165<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/34919694\" target=\"_blank\">34919694<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/academic.oup.com\/jamia\/article\/29\/4\/592\/6468865\" target=\"_blank\">https:\/\/academic.oup.com\/jamia\/article\/29\/4\/592\/6468865<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Migrating+a+research+data+warehouse+to+a+public+cloud%3A+challenges+and+opportunities&rft.jtitle=Journal+of+the+American+Medical+Informatics+Association&rft.aulast=Kahn&rft.aufirst=Michael+G&rft.au=Kahn%2C%26%2332%3BMichael+G&rft.au=Mui%2C%26%2332%3BJoyce+Y&rft.au=Ames%2C%26%2332%3BMichael+J&rft.au=Yamsani%2C%26%2332%3BAnoop+K&rft.au=Pozdeyev%2C%26%2332%3BNikita&rft.au=Rafaels%2C%26%2332%3BNicholas&rft.au=Brooks%2C%26%2332%3BIan+M&rft.date=15+March+2022&rft.volume=29&rft.issue=4&rft.pages=592%E2%80%93600&rft_id=info:doi\/10.1093%2Fjamia%2Focab278&rft.issn=1527-974X&rft_id=info:pmc\/PMC8922165&rft_id=info:pmid\/34919694&rft_id=https%3A%2F%2Facademic.oup.com%2Fjamia%2Farticle%2F29%2F4%2F592%2F6468865&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-115\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-115\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Mishra, Nilamadhab; Lin, Chung-Chih; Chang, Hsien-Tsung (2015). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.hindawi.com\/journals\/ijdsn\/2015\/718390\/\" target=\"_blank\">\"A Cognitive Adopted Framework for IoT Big-Data Management and Knowledge Discovery Prospective\"<\/a> (in en). <i>International Journal of Distributed Sensor Networks<\/i> <b>2015<\/b>: 1\u201312. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1155%2F2015%2F718390\" target=\"_blank\">10.1155\/2015\/718390<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1550-1329\" target=\"_blank\">1550-1329<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/www.hindawi.com\/journals\/ijdsn\/2015\/718390\/\" target=\"_blank\">http:\/\/www.hindawi.com\/journals\/ijdsn\/2015\/718390\/<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=A+Cognitive+Adopted+Framework+for+IoT+Big-Data+Management+and+Knowledge+Discovery+Prospective&rft.jtitle=International+Journal+of+Distributed+Sensor+Networks&rft.aulast=Mishra&rft.aufirst=Nilamadhab&rft.au=Mishra%2C%26%2332%3BNilamadhab&rft.au=Lin%2C%26%2332%3BChung-Chih&rft.au=Chang%2C%26%2332%3BHsien-Tsung&rft.date=2015&rft.volume=2015&rft.pages=1%E2%80%9312&rft_id=info:doi\/10.1155%2F2015%2F718390&rft.issn=1550-1329&rft_id=http%3A%2F%2Fwww.hindawi.com%2Fjournals%2Fijdsn%2F2015%2F718390%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-116\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-116\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation\" id=\"rdp-ebb-CITEREFAlserafiAbell.C3.B3RomeroCalders2019\">Alserafi, Ayman; Abell\u00f3, Alberto; Romero, Oscar; Calders, Toon (2019), Schewe, Klaus-Dieter; Singh, Neeraj Kumar, eds., <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/link.springer.com\/10.1007\/978-3-030-32065-2_3\" target=\"_blank\">\"Keeping the Data Lake in Form: DS-kNN Datasets Categorization Using Proximity Mining\"<\/a> (in en), <i>Model and Data Engineering<\/i> (Cham: Springer International Publishing) <b>11815<\/b>: 35\u201349, <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1007%2F978-3-030-32065-2_3\" target=\"_blank\">10.1007\/978-3-030-32065-2_3<\/a>, <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-3-030-32064-5<span class=\"printonly\">, <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/link.springer.com\/10.1007\/978-3-030-32065-2_3\" target=\"_blank\">http:\/\/link.springer.com\/10.1007\/978-3-030-32065-2_3<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 2023-05-03<\/span><\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Keeping+the+Data+Lake+in+Form%3A+DS-kNN+Datasets+Categorization+Using+Proximity+Mining&rft.jtitle=Model+and+Data+Engineering&rft.aulast=Alserafi&rft.aufirst=Ayman&rft.au=Alserafi%2C%26%2332%3BAyman&rft.au=Abell%C3%B3%2C%26%2332%3BAlberto&rft.au=Romero%2C%26%2332%3BOscar&rft.au=Calders%2C%26%2332%3BToon&rft.date=2019&rft.volume=11815&rft.pages=35%E2%80%9349&rft.place=Cham&rft.pub=Springer+International+Publishing&rft_id=info:doi\/10.1007%2F978-3-030-32065-2_3&rft.isbn=978-3-030-32064-5&rft_id=http%3A%2F%2Flink.springer.com%2F10.1007%2F978-3-030-32065-2_3&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-117\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-117\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Bogatu, Alex; Fernandes, Alvaro A. A.; Paton, Norman W.; Konstantinou, Nikolaos (1 April 2020). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/ieeexplore.ieee.org\/document\/9101607\/\" target=\"_blank\">\"Dataset Discovery in Data Lakes\"<\/a>. <i>2020 IEEE 36th International Conference on Data Engineering (ICDE)<\/i> (Dallas, TX, USA: IEEE): 709\u2013720. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1109%2FICDE48307.2020.00067\" target=\"_blank\">10.1109\/ICDE48307.2020.00067<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-1-7281-2903-7<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/ieeexplore.ieee.org\/document\/9101607\/\" target=\"_blank\">https:\/\/ieeexplore.ieee.org\/document\/9101607\/<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Dataset+Discovery+in+Data+Lakes&rft.jtitle=2020+IEEE+36th+International+Conference+on+Data+Engineering+%28ICDE%29&rft.aulast=Bogatu&rft.aufirst=Alex&rft.au=Bogatu%2C%26%2332%3BAlex&rft.au=Fernandes%2C%26%2332%3BAlvaro+A.+A.&rft.au=Paton%2C%26%2332%3BNorman+W.&rft.au=Konstantinou%2C%26%2332%3BNikolaos&rft.date=1+April+2020&rft.pages=709%E2%80%93720&rft.place=Dallas%2C+TX%2C+USA&rft.pub=IEEE&rft_id=info:doi\/10.1109%2FICDE48307.2020.00067&rft.isbn=978-1-7281-2903-7&rft_id=https%3A%2F%2Fieeexplore.ieee.org%2Fdocument%2F9101607%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-118\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-118\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Zaharia, M.; Ghodsi, A.; Xin, R. et al. (2021). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/researchr.org\/publication\/Zaharia0XA21\" target=\"_blank\">\"Lakehouse: A New Generation of Open Platforms that Unify Data Warehousing and Advanced Analytics\"<\/a>. <i>Proceedings of the 11th Conference on Innovative Data Systems Research<\/i>: 1\u20138<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/researchr.org\/publication\/Zaharia0XA21\" target=\"_blank\">https:\/\/researchr.org\/publication\/Zaharia0XA21<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Lakehouse%3A+A+New+Generation+of+Open+Platforms+that+Unify+Data+Warehousing+and+Advanced+Analytics&rft.jtitle=Proceedings+of+the+11th+Conference+on+Innovative+Data+Systems+Research&rft.aulast=Zaharia%2C+M.%3B+Ghodsi%2C+A.%3B+Xin%2C+R.+et+al.&rft.au=Zaharia%2C+M.%3B+Ghodsi%2C+A.%3B+Xin%2C+R.+et+al.&rft.date=2021&rft.pages=1%E2%80%938&rft_id=https%3A%2F%2Fresearchr.org%2Fpublication%2FZaharia0XA21&rfr_id=info:sid\/en.wikipedia.org:Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<\/ol><\/div><\/div>\n<h2><span class=\"mw-headline\" id=\"Notes\">Notes<\/span><\/h2>\n<p>This presentation is faithful to the original, with only a few minor changes to presentation. In some cases important information was missing from the references, and that information was added. Inline URLs from the original were turned into full citations for this version. The original, in Table 3, attributes the reference as \"Metadata Extraction and Management in Data Lakes with GEMMS\" but uses citation 30, which is something different, and a citation for \"Metadata Extraction and Management in Data Lakes with GEMMS\" doesn't exist in the original; it was added as new for this version. In the original, some URLs from citations were either broken or had overwritten information, requiring an archived version, which was used for this version.\n<\/p>\n<!-- \nNewPP limit report\nCached time: 20230630150354\nCache expiry: 86400\nDynamic content: false\nComplications: []\nCPU time usage: 2.010 seconds\nReal time usage: 2.159 seconds\nPreprocessor visited node count: 101947\/1000000\nPost\u2010expand include size: 798652\/2097152 bytes\nTemplate argument size: 276329\/2097152 bytes\nHighest expansion depth: 25\/40\nExpensive parser function count: 0\/100\nUnstrip recursion depth: 0\/20\nUnstrip post\u2010expand size: 240150\/5000000 bytes\n-->\n<!--\nTransclusion expansion time report (%,ms,calls,template)\n100.00% 1747.640 1 -total\n 90.99% 1590.160 1 Template:Reflist\n 75.33% 1316.454 118 Template:Citation\/core\n 50.61% 884.484 67 Template:Cite_journal\n 21.65% 378.328 40 Template:Cite_web\n 12.39% 216.473 98 Template:Date\n 6.79% 118.617 8 Template:Citation\n 5.41% 94.610 121 Template:Citation\/identifier\n 3.15% 55.100 149 Template:Citation\/make_link\n 3.00% 52.471 1 Template:Infobox_journal_article\n-->\n\n<!-- Saved in parser cache with key limswiki:pcache:idhash:14122-0!canonical and timestamp 20230630150352 and revision id 51904. Serialized with JSON.\n -->\n<\/div><\/div><div class=\"printfooter\">Source: <a rel=\"external_link\" class=\"external\" href=\"https:\/\/www.limswiki.org\/index.php\/Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management\">https:\/\/www.limswiki.org\/index.php\/Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management<\/a><\/div>\n<!-- end content --><div class=\"visualClear\"><\/div><\/div><\/div><div class=\"visualClear\"><\/div><\/div><!-- end of the left (by default at least) column --><div class=\"visualClear\"><\/div><\/div>\n\n\n\n<\/body>","99089d094ae9eb5f9ae5bdabb8d706dc_images":["https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/f\/f9\/Fig1_Nambiar_BigDataCogComp22_6-4.png","https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/c\/ce\/Fig2_Nambiar_BigDataCogComp22_6-4.png","https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/c\/c5\/Fig3_Nambiar_BigDataCogComp22_6-4.png"],"99089d094ae9eb5f9ae5bdabb8d706dc_timestamp":1688138449,"19be31afe217dcc35a45c9d74f9d4aa9_type":"article","19be31afe217dcc35a45c9d74f9d4aa9_title":"A critical literature review of historic scientific analog data: Uses, successes, and challenges (Kelly et al. 2022)","19be31afe217dcc35a45c9d74f9d4aa9_url":"https:\/\/www.limswiki.org\/index.php\/Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges","19be31afe217dcc35a45c9d74f9d4aa9_plaintext":"\n\nJournal:A critical literature review of historic scientific analog data: Uses, successes, and challengesFrom LIMSWikiJump to navigationJump to searchFull article title\n \nA critical literature review of historic scientific analog data: Uses, successes, and challengesJournal\n \nData Science JournalAuthor(s)\n \nKelly, Julia A.; Farrell, Shannon L.; Hendrickson, Lois G.; Luby, James; Mastel, Kristen L.Author affiliation(s)\n \nUniversity of MinnesotaPrimary contact\n \nEmail: jkelly at umn dot eduYear published\n \n2022Volume and issue\n \n21Article #\n \n14DOI\n \n10.5334\/dsj-2022-014ISSN\n \n1683-1470Distribution license\n \nCreative Commons Attribution 4.0 InternationalWebsite\n \nhttps:\/\/datascience.codata.org\/articles\/10.5334\/dsj-2022-014Download\n \nhttps:\/\/storage.googleapis.com\/jnl-up-j-dsj-files\/journals\/1\/articles\/1444\/submission\/proof\/1444-1-10637-1-10-20220728.pdf (PDF)\n\nContents \n\n1 Abstract \n2 Introduction \n3 Types of analog data \n4 History of concern about analog data \n5 Ways that older analog data is utilized \n6 Challenges with reusing older data \n7 Possible paths forward \n8 Conclusions \n9 Abbreviations, acronyms, and initialisms \n10 Acknowledgements \n\n10.1 Author contributions \n10.2 Competing interests \n\n\n11 References \n12 Notes \n\n\n\nAbstract \nFor years, scientists in fields from climate change to biodiversity to hydrology have used older data to address contemporary issues. Since the 1960s, researchers, recognizing the value of this data, have expressed concern about its management and potential for loss. No widespread solutions have emerged to address the myriad issues around its storage, access, and findability. This paper summarizes observations and concerns of researchers in various disciplines who have articulated problems associated with analog data and highlights examples of projects that have used historical data. The authors also examined selected papers to discover how researchers located historical data and how they used it. While many researchers are not producing huge amounts of analog data today, there are still large volumes of it that are at risk. To address this concern, the authors recommend the development of best practices for managing historic data. This will take communication across disciplines and the involvement of researchers, departments, institutions, and associations in the process.\nKeywords: analog data, historic data, data policies, risk of loss, data rescue, dark data\n\nIntroduction \nConcerns about the management of data\u2014including its preservation, findability, and reuse\u2014are almost entirely focused on recently-generated data in electronic, machine-readable formats. While many of the principles of the management of electronic data such as proper description and good organization apply to data in any format, the discussions about applying those principles to older data in non-electronic formats have not received much attention.\nIn this paper we review publications in various scientific fields that discuss older data that is in analog or print format and the use or reuse of older data in general. By analog data we mean items in print format such as numeric data as well as field or lab notebooks, photographs, drawings, and maps. Analog data may also be called historic data, legacy data, heritage data, or dark data, although these and other phrases can include older data that is not necessarily in print format. Some authors also use the term \"data rescue,\" which has also been used to describe recent efforts to duplicate and secure electronic data that may be at risk of loss (e.g., the Data Refuge community[1]).\nOur interest in this topic began when a few senior faculty members approached the University library for assistance in organizing and possibly housing their analog data.[2] A survey of life sciences researchers on campus revealed that many held analog data and considered it valuable but were unsure of how to preserve it.[3] Nearly all were willing to share it. Given that most researchers now either collect data digitally or quickly transfer any analog data, this is a finite problem; however, because many of the stewards of analog data are nearing retirement, it is timely. We undertook this literature review to learn how scientific researchers are dealing with the analog data in their possession and if any large scale efforts have been undertaken to address the issues.\n\nTypes of analog data \nMuch of the analog data that exists in offices, labs, homes, archives, and other locations is numeric in nature. It was probably collected before electronic spreadsheets were commonly available for both capturing and analyzing data. The format could be loose notebook paper, index cards, large data sheets, or bound or unbound notebooks. It could also take the form of a log, possibly combining numeric and descriptive data in chronological order.\nThe data may also be descriptive in nature and contained in field notebooks or diaries. The tags associated with museum and herbarium specimens are often mined for the data that they note such as species, location, dates, and other parameters. Although they are inextricably tied, when we discuss analog data we are not including the specimens themselves but just the information on the tags.\nDrawings and photographs may accompany other forms of data or may stand on their own, hopefully with enough description to make them useful to current researchers. The same is true of maps, which may be printed or hand drawn.\n\nHistory of concern about analog data \nA number of authors have written about analog data over the last 50+ years, often noting its potential value and lamenting the lack of procedures, funding, and best practices to help support its ongoing use and preservation. Psychologists in the 1960s and 1970s noted not only the importance of new observations coming from the re-examination of older data but also the practice of comparing newly gathered data to historic data.[4][5] Speaking about data that authors have not retained, Wolins suggests a role for professional associations: \"If it were clearly set forth by the [American Psychological Association] ... the responsibility for retaining raw data ... this dilemma would not exist.\"[6] For a time the U.S. government played a role through the American Documentation Institute at the Library of Congress, which accepted some raw data to be preserved.[5] Recently, Buma made use of photographs in Glacier Bay to longitudinally track plant growth and establishment and noted that if it was easier to learn of the existence of older data and to obtain copies, its value would grow.[7][8]\nIn most cases, authors limit their discussions to the situation in their own subspecialty, although a few have taken a broader view. A notable example is the final report of the Ecological Society of America (ESA) committee on the Future of Long-term Ecological Data.[9] The lengthy report details the situation and offers numerous recommendations for the future. Although it does not exclusively focus on analog data, it states \"[a]mong the least secure are data in the hands of an individual researcher who has made little or no provision for long-term curation.\"[9]\nAlso in 1995, the National Research Council published both Finding the Forest in the Trees: The Challenge of Combining Diverse Environmental Data and Preserving Scientific Data on Our Physical Universe.[10][11] The first report highlights the variables, measures, and data management, and puts forward 18 recommendations. These call on professional societies, research institutions, funding agencies, and individual researchers to collaborate, carefully plan, focus on interoperability, create rich metadata, and make data more widely available.[10] The latter report notes many problems and few solutions, stating \"[t]he most important deficiencies are in the documentation, access, and long-term preservation of data in usable form.\"[11] Again, analog data was not the focus of these works, but it was covered.\nEasterday et al. note the \"potential of historical dark data to contribute to the modern digital ecological data landscape.\"[12] They note the importance of metadata and the need to promote the data and the best practices around it. In his book Repurposing Legacy Data, Berman states that \"data repurposing creates value where none was expected.\"[13] It includes case studies from a variety of disciplines and has chapters on identifying data that might lend itself to repurposing and understanding the organization of older data.[13]\nGriffin advocates for the value of \"heritage data,\" noting that much of it is at risk and in order to secure it for future use, \"certain priorities need to be re-ordered, new skills acquired and taught, resources redirected, and new networks constructed.\"[14] Griffin was active in the CODATA Data at Risk Task Group which, along with its successor, the Research Data Alliance\u2019s Data Rescue Interest Group, worked to highlight the value of older data and promote projects that used or preserved it.[15] Patil and Siegel note that bringing more dark data to the forefront will require different incentives from all those involved: \"journals, citation indexes, funding agencies, academic institutions and, not least, the researchers themselves.\"[16] Although they write from a health sciences perspective, this probably applies more broadly.\nA number of authors have drawn attention to the use or potential use of analog data in their particular fields. In fisheries, Singer et al.[17] surveyed fellow researchers to get a better idea of how and why they used fish collections in order to inform both researchers and those who manage the collections. The value and possible reuse of data collected at biological field stations has been noted since at least the 1980s.[18] Bowser emphasized the importance of data management and suggested that field station data might be deposited with libraries, historical societies or federal agencies.[18] Easterday et al.[12] make their observations about the use of data science principles by highlighting work from three California field stations, and Michener et al.[19] wrote an article entitled \"Biological Field Stations: Research Legacies and Sites for Serendipity.\"\nEcological researchers have long mined analog data and historical records in their work, according to Beans.[20] While she focuses on journal entries, maps, and photos, she highlights common challenges such as locating material and working with someone else\u2019s organizational scheme. She highlights Loren McClenachan[21][22][23], a marine ecologist who utilizes historical data in her research and also published a policy-oriented article on the benefits of using older data to set baselines in marine studies. Over 20 years ago, Olson and McCord[24][25] wrote two book chapters on data archiving in the ecological sciences. Although the emphasis is on digital data, they spell out recommendations on incentives, metadata, and components of an archive that apply to analog and digital materials.\nKwok[26] reports on the use of older data in the fields of both ecology and climate science. In the area of climate science, Br\u00f6nnimann et al. are mainly concerned with digital data but provide an overview of efforts to locate and digitize analog data, commenting that \"the fraction of yet-to-be-digitized data is difficult to quantify,\" implying that it is large indeed.[27]\nGeological researchers sometimes have an added reason to want to discover and use older data: it may have been collected using methods that are now difficult or impossible to employ due to stricter regulations. Diviacco et al.[28] writes about a project where data was both analog and digital and had been obtained using dynamite. Vearncombe et al.[29][30], using examples from the mining industry, note that \"upcycling\" of data can mean cost savings as well as new insights from reexamination of data.\nA number of disciplines have employed citizen science projects to assist in the analog data efforts. These take the form of both mining older citizen science projects for their data or initiating new projects that provide person-hours to reformat or otherwise transform or collate analog data. Clavero et al.[31][32] examine species lists to study trout decline, Hof and Bright[33] look at previous counts of hedgehogs, and Sn\u00e4ll et al.[34] consider the use of presence data from bird monitoring. A recent citizen science project on the Zooniverse platform involves identifying data in papers written by students at the University of Michigan Field Station.[35]\nWhile many authors bemoan the unfortunate state of older data in their subdisciplines, a few areas offer success stories. Researchers working in biodiversity\u2014many of whom are connected with museums or herbaria which hold physical specimens and their metadata-rich identification tags\u2014are an example. They have built networks and secured funding for several international biodiversity-related projects that address data tied to specimens as well as the objects themselves. Projects include Integrated Digitized Biocollections (iDigBio), Global Biodiversity Information Facility (GBIF), and Distributed System of Scientific Collections (DiSSCo). The progress in digitization and dissemination of biodiversity data over the last 20 years is summarized by Nelson and Ellis.[36]\nClimate researchers have also made great strides in gathering disparate data in analog and digital format and making it accessible to the global community of scientists. The EU-based Copernicus Climate Change Service (C3S) and International Data Rescue Portal (I-DARE) serve as examples.\nSome contemporary groups that rescue and reuse older analog data have very narrowly focused subject areas. The Living Data Project, sponsored by the Canadian Institute of Ecology and Evolution, funds new projects each year with topics such as \"Species ranges, diversity and life history of Neotropical birds\" and \"Responses of freshwater zooplankton to road salt pollution: A global perspective.\" Another project, based at the U.S. Department of Agriculture (USDA) National Agricultural Library (Data Rescue Case Study: Long-Term Livestock Production Data), gathered older data from throughout the US, converted it to electronic formats, and deposited it in AgData Commons.[37]\nField and lab notebooks have been the focus of a number of digitization projects. They may be held in archives, museums, libraries, or research facilities, as well as by individuals. The Biodiversity Heritage Library, in conjunction with several other institutions including the Smithsonian, includes nearly 3,000 scanned field books.[38] On a smaller scale, Texas A&M Libraries has digitized the field notebooks and specimen catalogs of W. B. Davis (1930\u20131981) and they have been viewed over 1,000 times.[39] Thomer et al.[40] propose a method for efficiently extracting species data from handwritten field notebooks.\n\nWays that older analog data is utilized \nResearchers may use older data in a variety of ways. Some strive to repeat an earlier survey or experiment as closely as possible.[41][42][43][44] Others reexamine older data or incorporate portions of it into their current work.[45][46][47][48] Authors may also have consulted earlier data as they developed their research plans. Mandates for the preservation of data that have emerged in the last 15 years have elevated the topic of data reuse, although most recent research has considered only digital data.[49][50][51]\nThe methods that researchers use to obtain older data often remain a mystery. Large data collections such as iDigBio provide background, training, examples, and other resources for potential data users and authors are likely to mention or cite these collections. This is often not true for projects that use older data. In a preliminary investigation, we conducted examinations of 66 scientific papers that used analog data, and only seven spelled out how the authors located it (see Figure 1). None of the authors of this set of papers mention going back to the original authors of the publications to obtain more detailed information, although it is hard to imagine that none of them took that step.\n\r\n\n\n\n\n\n\n\n\n\n\nFigure 1. Description of sources of historic data for scientific researchers who had re-used it in publications. Scientific papers (N = 66) that illustrated evidence of use of this data were examined to determine the source of the data and how it was identified and located by the researchers.\n\n\n\nObtaining data directly from the researchers is known to be problematic, and a statement such as \"data available on request\" in an article does not always lead to success. A 2014 study focused on 500+ articles from two to 22 years old, and the authors stated, \"o]ur results reinforce the notion that, in the long term, research data cannot be reliably preserved by individual researchers.\"[52] A new study suggests that all data associated with open data publishing needs to go into an open repository before publication. Of authors who indicated that data were available on request in publications, 1,670 (93%) did not respond to a request for data or chose not to share.[53]\nIn addition to individual researchers, various types of organizations may be in possession of analog data. Government agencies hold weather data as well as the aforementioned museum and herbarium records. Fisheries and agricultural records have also been used, along with conservation-related documents.[54][55][56][57][58] Nonprofits may also hold data from citizen science projects.[33] \nArchives can be a source for analog data; this is sometimes where researchers discover field books and diaries.[59][60] They may also hold photographs used by those conducting repeat photography work.[61][62][63] Finally, there are numerous examples of authors reusing analog data that they located using less conventional sources. This includes literature, ship logs, tax records, newspapers, and church records.[64][65][66][67][68][69][70]\n\nChallenges with reusing older data \nScientists note the challenges and potential pitfalls when combining or comparing old and new data. For example, there are few standards or best practices towards these efforts.[9][13][40] In another example, while individual authors provide rich insights from their experiences, finding general guidance for analog data is mostly lacking, unlike the situation with digital data.[18][71] Also unlike the digital data landscape, ownership and stewardship responsibilities are often unclear. Costs for reformatting and preservation of analog data can be high with few options for funding.[9][15] Another concern is that, broadly speaking, institutions have few incentives to save data.[72]\nAlthough not much is known about how individual researchers find the analog data that they reuse, several authors note the difficulty in locating it. It languishes in labs, gets redistributed to multiple locations, or simply disappears.[12][73][74][75][76] Many data repositories, especially those housed at academic institutions, require data to be in machine-readable formats. Some such as Ag Data Commons will accept scanned data. Zenodo, the European Community repository that includes data as well as software and documents, welcomes data in any format, although they are currently working on guidelines for deposit. However, data registries, where metadata about analog data could reside, have not materialized as predicted.[77]\nThere are also numerous challenges as researchers bring together data gathered years apart. First, combining old and new data sets can be complex.[11][78][79] Metadata is also a concern, as the original description may lack elements and they may have been defined differently in the earlier work.[18][80][81][82][71][83]\nFinally, interpreting historic data may involve assumptions and comparison methods that need to be selected carefully.[84][85][86][87][88] Engelhard et al., studying the distribution of North Sea cod, emphasized \"the well-known problems with fisheries data such as discarding and misreporting practices by fishers.\"[89] Beans[20] notes that this underreporting was often due to attempts to minimize taxes on a boat\u2019s catch. Historical records may also have biases that must be dealt with when comparing with current surveys.[58][90][91][92]\n\nPossible paths forward \nWhile the individuals who are the current stewards of analog data and the organizations where they work have major parts to play in the solution to this issue, other entities can also take a role in developing solutions. Although few professional societies are in a position to host a data repository, there are other important roles that they can play. They could investigate and report on the status of analog data availability, use, and status in their realm, like the ESA. If they publish journals, they could encourage authors to cite data papers and accept data papers where appropriate. Societies could call on their members to describe and preserve their own analog data. They could also endorse standards for metadata. If they have the financial means, they could fund the digitization of selected data.\nFunding agencies already play a large role in the preservation and reuse of recently-produced electronic data through their mandates, and they could also play a role with older data. Agencies could encourage pre-mandate grant recipients to make their data available or follow the lead of the USDA, which welcomes scanned as well as machine-readable data from pre-mandate grant recipients in its Ag Data Commons repository. Agencies could promote the idea of data papers for material from earlier grants and endorse particular repositories in their subject areas. Funders could also award grants to projects that preserve analog data or make it more easily findable.\nWhat can individual researchers do? They can organize, inventory, and describe any analog data in their purview and document details about how it was generated.[93] Many standards exist for doing this with digital data, and those standards can be used for analog data as well. In a survey of those holding analog data, many reported that there was a person who could describe the origins of the data but fewer had documented that information.[3] If you have used historic data, think about how you found it and how you wish you might have been able to find it. Explore the concept and content of data papers and think about whether you might have some older data that you could describe in that same way. Talk to others about the topic and look for commonalities, especially across disciplines in your organization. Consult with the science librarians at your institution to see how you might work together. Finally, also think about your professional societies and how they might play a role.\n\nConclusions \nResearchers across the sciences use older data in analog format, but little is known about how they learn of its existence or locate it. Over the last 50+ years, authors have expressed concern about its fate and noted challenges with its use. With the exception of the community of biodiversity researchers, there have been few large projects to address the preservation and findability of analog data and little interest expressed by government agencies, professional associations, and academic and research institutions that would be in a position to act on a broader scale. Best practices (including selection of metadata schema, developing a data dictionary, describing data collection methods) and policies developed to govern the preservation and dissemination of digital data could serve as an example for developments concerning analog data. In the digital realm, best practices are often developed by professional associations, both disciplinary and data-focused, as well as those who manage data repositories.\n\n Abbreviations, acronyms, and initialisms \nC3S: Copernicus Climate Change Service\nDiSSCo: Distributed System of Scientific Collections\nESA: Ecological Society of America\nGBIF: Global Biodiversity Information Facility\nI-DARE: International Data Rescue Portal\niDigBio: Integrated Digitized Biocollections\nUSDA: U.S. Department of Agriculture\nAcknowledgements \nAuthor contributions \nAll authors made significant contributions to the design of this review as well as drafting and revising the manuscript. All have approved this final version, agreed to be accountable, and have approved of the inclusion of those in the list of authors.\n\nCompeting interests \nThe authors have no competing interests to declare.\n\nReferences \n\n\n\u2191 \"Data Refuge\". University of Pennsylvania. 2022. https:\/\/www.datarefuge.org\/ .   \n \n\n\u2191 Farrell, Shannon L.; Hendrickson, Lois G.; Mastel, Kristen L.; Allen, Katherine Adina; Kelly, Julia A. (18 December 2019). \"Resurfacing Historical Scientific Data: A Case Study Involving Fruit Breeding Data\". Journal of eScience Librarianship 8 (2): e1171. doi:10.7191\/jeslib.2019.1171. https:\/\/publishing.escholarship.umassmed.edu\/jeslib\/article\/id\/476\/ .   \n \n\n\u2191 3.0 3.1 Farrell, Shannon L.; Hendrickson, Lois G.; Mastel, Kristen L.; Kelly, Julia A. (15 December 2020). \"Historical Scientific Analog Data: Life Sciences Faculty\u2019s Perspectives on Management, Reuse and Preservation\". Data Science Journal 19 (1): 51. doi:10.5334\/dsj-2020-051. ISSN 1683-1470. https:\/\/datascience.codata.org\/article\/10.5334\/dsj-2020-051\/ .   \n \n\n\u2191 Johnson, Richard W. (1 May 1964). \"Retain the Original Data! Comment.\" (in en). American Psychologist 19 (5): 350\u2013351. doi:10.1037\/h0039238. ISSN 1935-990X. http:\/\/doi.apa.org\/getdoi.cfm?doi=10.1037\/h0039238 .   \n \n\n\u2191 5.0 5.1 Craig, James R.; Reese, Sandra C. (1 August 1973). \"Retention of raw data: A problem revisited.\" (in en). American Psychologist 28 (8): 723\u2013723. doi:10.1037\/h0035667. ISSN 1935-990X. http:\/\/doi.apa.org\/getdoi.cfm?doi=10.1037\/h0035667 .   \n \n\n\u2191 Wolins, Leroy (1 September 1962). \"Responsibility for Raw Data.\" (in en). American Psychologist 17 (9): 657\u2013658. doi:10.1037\/h0038819. ISSN 1935-990X. http:\/\/doi.apa.org\/getdoi.cfm?doi=10.1037\/h0038819 .   \n \n\n\u2191 Buma, Brian (11 May 2018). Sills, Jennifer. ed. \"The hidden value of paper records\" (in en). Science 360 (6389): 613\u2013613. doi:10.1126\/science.aat5382. ISSN 0036-8075. https:\/\/www.science.org\/doi\/10.1126\/science.aat5382 .   \n \n\n\u2191 Buma, B.; Bisbing, S. M.; Wiles, G.; Bidlack, A. L. (1 December 2019). \"100 yr of primary succession highlights stochasticity and competition driving community establishment and stability\" (in en). Ecology 100 (12). doi:10.1002\/ecy.2885. ISSN 0012-9658. https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/ecy.2885 .   \n \n\n\u2191 9.0 9.1 9.2 9.3 Gross, K.L.; Pake, C.E. (1995). \"Final report of the Ecological Society of America committee on the future of Long-term Ecological Data (FLED): Volume I: text of the report\". The Ecological Society of America. pp. 122. https:\/\/andrewsforest.oregonstate.edu\/publications\/2562 .   \n \n\n\u2191 10.0 10.1 National Research Council (27 April 1995). Finding the Forest in the Trees: The Challenge of Combining Diverse Environmental Data. Washington, D.C.: National Academies Press. doi:10.17226\/4896. ISBN 978-0-309-05082-1. http:\/\/www.nap.edu\/catalog\/4896 .   \n \n\n\u2191 11.0 11.1 11.2 National Research Council (19 April 1995). Preserving Scientific Data on Our Physical Universe: A New Strategy for Archiving the Nation's Scientific Information Resources. Washington, D.C.: National Academies Press. doi:10.17226\/4871. ISBN 978-0-309-05186-6. http:\/\/www.nap.edu\/catalog\/4871 .   \n \n\n\u2191 12.0 12.1 12.2 Easterday, Kelly; Paulson, Tim; DasMohapatra, Proxima; Alagona, Peter; Feirer, Shane; Kelly, Maggi (1 October 2018). \"From the Field to the Cloud: A Review of Three Approaches to Sharing Historical Data From Field Stations Using Principles From Data Science\". Frontiers in Environmental Science 6: 88. doi:10.3389\/fenvs.2018.00088. ISSN 2296-665X. https:\/\/www.frontiersin.org\/article\/10.3389\/fenvs.2018.00088\/full .   \n \n\n\u2191 13.0 13.1 13.2 Berman, J.J. (2015). Repurposing Legacy Data. Elsevier. doi:10.1016\/c2014-0-02501-4. ISBN 978-0-12-802882-7. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/C20140025014 .   \n \n\n\u2191 Elizabeth Griffin, R. (1 June 2015). \"When are Old Data New Data?\" (in en). GeoResJ 6: 92\u201397. doi:10.1016\/j.grj.2015.02.004. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2214242815000121 .   \n \n\n\u2191 15.0 15.1 Griffin, E. (2 July 2015). \"Data at Risk and Data Rescue\". CODATA Blog. https:\/\/codata.org\/blog\/2015\/07\/02\/data-at-risk-and-data-rescue\/ .   \n \n\n\u2191 Patil, Chris; Siegel, Vivian (5 November 2009). \"Shining a light on dark data\" (in en). Disease Models & Mechanisms 2 (11-12): 521\u2013525. doi:10.1242\/dmm.004630. ISSN 1754-8411. PMC PMC2773820. PMID 19892880. https:\/\/journals.biologists.com\/dmm\/article\/2\/11-12\/521\/2278\/Shining-a-light-on-dark-data .   \n \n\n\u2191 Singer, Randal A.; Ellis, Shari; Page, Lawrence M. (1 February 2020). \"Awareness and use of biodiversity collections by fish biologists\" (in en). Journal of Fish Biology 96 (2): 297\u2013306. doi:10.1111\/jfb.14167. ISSN 0022-1112. https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/jfb.14167 .   \n \n\n\u2191 18.0 18.1 18.2 18.3 Bowser, C.J. (1986). \"Historic data sets: Lessons from the past, lessons for the future\". In Michener, William K.; Belle W. Baruch Institute for Marine Biology and Coastal Research. Research data management in the ecological sciences. The Belle W. Baruch library in marine science (1st ed ed.). Columbia, S.C: Published for the Belle W. Baruch Institute for Marine Biology and Coastal Research by the University of South Carolina Press. pp. 155\u201379. ISBN 978-0-87249-476-3.   \n \n\n\u2191 Michener, William K.; Bildstein, Keith L.; McKee, Arthur; Parmenter, Robert R.; Hargrove, William W.; McClearn, Deedra; Stromberg, Mark (1 April 2009). \"Biological Field Stations: Research Legacies and Sites for Serendipity\" (in en). BioScience 59 (4): 300\u2013310. doi:10.1525\/bio.2009.59.4.8. ISSN 0006-3568. https:\/\/academic.oup.com\/bioscience\/article-lookup\/doi\/10.1525\/bio.2009.59.4.8 .   \n \n\n\u2191 20.0 20.1 Beans, Carolyn (26 December 2018). \"Journal entries, maps, and photos help ecologists reconstruct ecosystems of the past\" (in en). Proceedings of the National Academy of Sciences 115 (52): 13138\u201313141. doi:10.1073\/pnas.1819526115. ISSN 0027-8424. PMC PMC6310833. PMID 30587550. https:\/\/pnas.org\/doi\/full\/10.1073\/pnas.1819526115 .   \n \n\n\u2191 McCLENACHAN, Loren (1 June 2009). \"Documenting Loss of Large Trophy Fish from the Florida Keys with Historical Photographs\" (in en). Conservation Biology 23 (3): 636\u2013643. doi:10.1111\/j.1523-1739.2008.01152.x. https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/j.1523-1739.2008.01152.x .   \n \n\n\u2191 McClenachan, Loren; Ferretti, Francesco; Baum, Julia K. (1 October 2012). \"From archives to conservation: why historical data are needed to set baselines for marine animals and ecosystems\" (in en). Conservation Letters 5 (5): 349\u2013359. doi:10.1111\/j.1755-263X.2012.00253.x. ISSN 1755-263X. https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/j.1755-263X.2012.00253.x .   \n \n\n\u2191 McClenachan, Loren; O\u2019Connor, Grace; Neal, Benjamin P.; Pandolfi, John M.; Jackson, Jeremy B. C. (1 September 2017). \"Ghost reefs: Nautical charts document large spatial scale of coral reef loss over 240 years\" (in en). Science Advances 3 (9): e1603155. doi:10.1126\/sciadv.1603155. ISSN 2375-2548. PMC PMC5587093. PMID 28913420. https:\/\/www.science.org\/doi\/10.1126\/sciadv.1603155 .   \n \n\n\u2191 Olson, D.; McCord, R. (August 1997). \"Data Archival: Sharing Yesterday's Data for Ecology Today and Tomorrow\". Data and Information Management in the Ecological Sciences. Oak Ridge National Laboratory. pp. 53\u20138. https:\/\/www.vcrlter.virginia.edu\/dimes\/presentations\/OLSON\/sld001.htm .   \n \n\n\u2191 Olson, R.J.; McCord, R.A. (2000). \"Archiving ecological data and information\". In Michener, William K.; Brunt, James W.. Ecological data: Design, management, and processing. Malden, MA: Blackwell Science. pp. 117\u201341. ISBN 978-0-632-05231-8.   \n \n\n\u2191 Kwok, Roberta (21 September 2017). \"Historical data: Hidden in the past\" (in en). Nature 549 (7672): 419\u2013421. doi:10.1038\/nj7672-419. ISSN 0028-0836. http:\/\/www.nature.com\/articles\/nj7672-419 .   \n \n\n\u2191 Br\u00f6nnimann, Stefan; Brugnara, Yuri; Allan, Rob J.; Brunet, Manola; Compo, Gilbert P.; Crouthamel, Richard I.; Jones, Philip D.; Jourdain, Sylvie et al. (1 June 2018). \"A roadmap to climate data rescue services\" (in en). Geoscience Data Journal 5 (1): 28\u201339. doi:10.1002\/gdj3.56. https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/gdj3.56 .   \n \n\n\u2191 Diviacco, Paolo; Wardell, Nigel; Forlin, Edy; Sauli, Chiara; Burca, Mihai; Busato, Alessandro; Centonze, Jacques; Pelos, Claudio (1 June 2015). \"Data rescue to extend the value of vintage seismic data: The OGS-SNAP experience\" (in en). GeoResJ 6: 44\u201352. doi:10.1016\/j.grj.2015.01.006. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2214242815000078 .   \n \n\n\u2191 Vearncombe, J.; Conner, G.; Bright, S. (1 October 2016). \"Value from legacy data\" (in en). Applied Earth Science 125 (4): 231\u2013246. doi:10.1080\/03717453.2016.1190442. ISSN 0371-7453. https:\/\/www.tandfonline.com\/doi\/full\/10.1080\/03717453.2016.1190442 .   \n \n\n\u2191 Vearncombe, Julian; Riganti, Angela; Isles, David; Bright, Sian (1 October 2017). \"Data upcycling\" (in en). Ore Geology Reviews 89: 887\u2013893. doi:10.1016\/j.oregeorev.2017.07.009. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0169136817305243 .   \n \n\n\u2191 Clavero, Miguel; Revilla, Eloy (1 June 2014). \"Bodiversity data: Mine centuries-old citizen science\" (in en). Nature 510 (7503): 35\u201335. doi:10.1038\/510035c. ISSN 0028-0836. http:\/\/www.nature.com\/articles\/510035c .   \n \n\n\u2191 Clavero, Miguel; Ninyerola, Miquel; Hermoso, Virgilio; Filipe, Ana Filipa; Pla, Magda; Villero, Daniel; Brotons, Llu\u00eds; Delibes, Miguel (11 January 2017). \"Historical citizen science to understand and predict climate-driven trout decline\" (in en). Proceedings of the Royal Society B: Biological Sciences 284 (1846): 20161979. doi:10.1098\/rspb.2016.1979. ISSN 0962-8452. PMC PMC5247491. PMID 28077766. https:\/\/royalsocietypublishing.org\/doi\/10.1098\/rspb.2016.1979 .   \n \n\n\u2191 33.0 33.1 Hof, Anouschka R.; Bright, Paul W. (1 August 2016). \"Quantifying the long-term decline of the West European hedgehog in England by subsampling citizen-science datasets\" (in en). European Journal of Wildlife Research 62 (4): 407\u2013413. doi:10.1007\/s10344-016-1013-1. ISSN 1612-4642. http:\/\/link.springer.com\/10.1007\/s10344-016-1013-1 .   \n \n\n\u2191 Sn\u00e4ll, Tord; Kindvall, Oskar; Nilsson, Johan; P\u00e4rt, Tomas (1 February 2011). \"Evaluating citizen-based presence data for bird monitoring\" (in en). Biological Conservation 144 (2): 804\u2013810. doi:10.1016\/j.biocon.2010.11.010. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0006320710004805 .   \n \n\n\u2191 Tallant, J.; Schell, J.; Hovinga, K.; Stuit, M. (2022). \"Unearthing Michigan Ecological Data - FAQ\". Zooniverse. https:\/\/www.zooniverse.org\/projects\/jmschell\/unearthing-michigan-ecological-data\/about\/faq .   \n \n\n\u2191 Nelson, Gil; Ellis, Shari (7 January 2019). \"The history and impact of digitization and digital data mobilization on biodiversity research\" (in en). Philosophical Transactions of the Royal Society B: Biological Sciences 374 (1763): 20170391. doi:10.1098\/rstb.2017.0391. ISSN 0962-8436. PMC PMC6282090. PMID 30455209. https:\/\/royalsocietypublishing.org\/doi\/10.1098\/rstb.2017.0391 .   \n \n\n\u2191 Patton, Bob; Nyren, Paul; Nyren, Ann; Sedivec, Kevin (2022), \"27 years of livestock production data under different stocking rate levels at the Central Grasslands Research Extension Center near Streeter, North Dakota\", Ag Data Commons, doi:10.15482\/usda.adc\/1524719, https:\/\/data.nal.usda.gov\/node\/86289   \n \n\n\u2191 \"BHL Field Notes Project\". Biodiversity Heritage Library. Smithsonian. 2022. https:\/\/www.biodiversitylibrary.org\/collection\/FieldNotesProject .   \n \n\n\u2191 \"William B. Davis Collection\". OAKTrust. Texas A&M University Libraries. 2022. https:\/\/oaktrust.library.tamu.edu\/handle\/1969.1\/129120 .   \n \n\n\u2191 40.0 40.1 Thomer, Andrea; Vaidya, Gaurav; Guralnick, Robert; Bloom, David; Russell, Laura (20 July 2012). \"From documents to datasets: A MediaWiki-based method of annotating and extracting species observations in century-old field notebooks\". ZooKeys 209: 235\u2013253. doi:10.3897\/zookeys.209.3247. ISSN 1313-2970. PMC PMC3406479. PMID 22859891. http:\/\/zookeys.pensoft.net\/articles.php?id=2909 .   \n \n\n\u2191 Lannoo, Michael J.; Lang, Kenneth; Waltz, Tim; Phillips, Gary S. (1 April 1994). \"An Altered Amphibian Assemblage: Dickinson County, Iowa, 70 Years after Frank Blanchard's Survey\". American Midland Naturalist 131 (2): 311. doi:10.2307\/2426257. https:\/\/www.jstor.org\/stable\/2426257?origin=crossref .   \n \n\n\u2191 Gent, Marty L.; Morgan, John W. (1 May 2007). \"Changes in the stand structure (1975?2000) of coastal Banksia forest in the long absence of fire\" (in en). Austral Ecology 32 (3): 239\u2013244. doi:10.1111\/j.1442-9993.2007.01667.x. ISSN 1442-9985. https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/j.1442-9993.2007.01667.x .   \n \n\n\u2191 H\u00e9dl, Radim; Pet\u0159\u00edk, Petr; Boubl\u00edk, Karel (1 October 2011). \"Long-term patterns in soil acidification due to pollution in forests of the Eastern Sudetes Mountains\" (in en). Environmental Pollution 159 (10): 2586\u20132593. doi:10.1016\/j.envpol.2011.06.014. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0269749111003423 .   \n \n\n\u2191 Riddell, E. A.; Iknayan, K. J.; Hargrove, L.; Tremor, S.; Patton, J. L.; Ramirez, R.; Wolf, B. O.; Beissinger, S. R. (5 February 2021). \"Exposure to climate change drives stability or collapse of desert mammal and bird communities\" (in en). Science 371 (6529): 633\u2013636. doi:10.1126\/science.abd4605. ISSN 0036-8075. https:\/\/www.science.org\/doi\/10.1126\/science.abd4605 .   \n \n\n\u2191 Trisurat, Yongyut; Eiadthong, Wichan; Khunrattanasiri, Weeraphart; Saengnin, Somyot; Chitechote, Auschada; Maneerat, Sompoch (1 September 2020). \"Systematic forest inventory plots and their contribution to plant distribution and climate change impact studies in Thailand\" (in en). Ecological Research 35 (5): 724\u2013732. doi:10.1111\/1440-1703.12105. ISSN 0912-3814. https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/1440-1703.12105 .   \n \n\n\u2191 Azeria, Ermias T.; Carlson, Allan; P\u00e4rt, Tomas; Wiklund, Christer G. (1 July 2006). \"Temporal dynamics and nestedness of an oceanic island bird fauna: Temporal dynamics and nestedness\" (in en). Global Ecology and Biogeography 15 (4): 328\u2013338. doi:10.1111\/j.1466-822X.2006.00227.x. https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/j.1466-822X.2006.00227.x .   \n \n\n\u2191 Brodman, Robert; Cortwright, Spencer; Resetar, Alan (1 January 2002). \"Historical Changes of Reptiles and Amphibians of Northwest Indiana Fish and Wildlife Properties\" (in en). The American Midland Naturalist 147 (1): 135\u2013144. doi:10.1674\/0003-0031(2002)147[0135:HCORAA]2.0.CO;2. ISSN 0003-0031. http:\/\/www.bioone.org\/doi\/abs\/10.1674\/0003-0031%282002%29147%5B0135%3AHCORAA%5D2.0.CO%3B2 .   \n \n\n\u2191 Fellers, Gary M.; Drost, Charles A. (1993). \"Disappearance of the cascades frog Rana cascadae at the southern end of its range, California, USA\" (in en). Biological Conservation 65 (2): 177\u2013181. doi:10.1016\/0006-3207(93)90447-9. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/0006320793904479 .   \n \n\n\u2191 Curty, Renata Gon\u00e7alves; Crowston, Kevin; Specht, Alison; Grant, Bruce W.; Dalton, Elizabeth D. (27 December 2017). Sugimoto, Cassidy Rose. ed. \"Attitudes and norms affecting scientists\u2019 data reuse\" (in en). PLOS ONE 12 (12): e0189288. doi:10.1371\/journal.pone.0189288. ISSN 1932-6203. PMC PMC5744933. PMID 29281658. https:\/\/dx.plos.org\/10.1371\/journal.pone.0189288 .   \n \n\n\u2191 Khan, Nushrat; Thelwall, Mike; Kousha, Kayvan (1 April 2021). \"Measuring the impact of biodiversity datasets: data reuse, citations and altmetrics\" (in en). Scientometrics 126 (4): 3621\u20133639. doi:10.1007\/s11192-021-03890-6. ISSN 0138-9130. https:\/\/link.springer.com\/10.1007\/s11192-021-03890-6 .   \n \n\n\u2191 Yoon, Ayoung; Kim, Youngseek (1 July 2017). \"Social scientists' data reuse behaviors: Exploring the roles of attitudinal beliefs, attitudes, norms, and data repositories\" (in en). Library & Information Science Research 39 (3): 224\u2013233. doi:10.1016\/j.lisr.2017.07.008. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0740818816302250 .   \n \n\n\u2191 Vines, Timothy H.; Albert, Arianne Y.K.; Andrew, Rose L.; D\u00e9barre, Florence; Bock, Dan G.; Franklin, Michelle T.; Gilbert, Kimberly J.; Moore, Jean-S\u00e9bastien et al. (1 January 2014). \"The Availability of Research Data Declines Rapidly with Article Age\" (in en). Current Biology 24 (1): 94\u201397. doi:10.1016\/j.cub.2013.11.014. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0960982213014000 .   \n \n\n\u2191 Gabelica, Mirko; Boj\u010di\u0107, Ru\u017eica; Puljak, Livia (1 October 2022). \"Many researchers were not compliant with their published data sharing statement: a mixed-methods study\" (in en). Journal of Clinical Epidemiology 150: 33\u201341. doi:10.1016\/j.jclinepi.2022.05.019. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S089543562200141X .   \n \n\n\u2191 Cardinale, M; Bartolino, V; Sved\u00e4ng, H; Sundel\u00f6f, A; Poulsen, R T; Casini, M (1 September 2015). \"A centurial development of the North Sea fish megafauna as reflected by the historical Swedish longlining fisheries\" (in en). Fish and Fisheries 16 (3): 522\u2013533. doi:10.1111\/faf.12074. https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/faf.12074 .   \n \n\n\u2191 Chauvel, Bruno; Guillemin, Jean-Philippe; Gasquez, Jacques; Gauvrit, Christian (1 December 2012). \"History of chemical weeding from 1944 to 2011 in France: Changes and evolution of herbicide molecules\" (in en). Crop Protection 42: 320\u2013326. doi:10.1016\/j.cropro.2012.07.011. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0261219412002062 .   \n \n\n\u2191 Edwards, Robert J.; Contreras-Balderas, Salvador (1 June 1991). \"Historical Changes in the Ichthyofauna of the Lower Rio Grande (Rio Bravo del Norte), Texas and Mexico\". The Southwestern Naturalist 36 (2): 201. doi:10.2307\/3671922. https:\/\/www.jstor.org\/stable\/3671922?origin=crossref .   \n \n\n\u2191 Chuine, Isabelle; Yiou, Pascal; Viovy, Nicolas; Seguin, Bernard; Daux, Val\u00e9rie; Ladurie, Emmanuel Le Roy (1 November 2004). \"Grape ripening as a past climate indicator\" (in en). Nature 432 (7015): 289\u2013290. doi:10.1038\/432289a. ISSN 0028-0836. http:\/\/www.nature.com\/articles\/432289a .   \n \n\n\u2191 58.0 58.1 Smith, Katherine L.; Jones, Michael L. (9 November 2007). \"When are historical data sufficient for making watershed-level stream fish management and conservation decisions?\" (in en). Environmental Monitoring and Assessment 135 (1-3): 291\u2013311. doi:10.1007\/s10661-007-9650-1. ISSN 0167-6369. http:\/\/link.springer.com\/10.1007\/s10661-007-9650-1 .   \n \n\n\u2191 Llasat, Mar\u00eda-Carmen; Barriendos, Mariano; Barrera, Antonio; Rigo, Tomeu (1 November 2005). \"Floods in Catalonia (NE Spain) since the 14th century. Climatological and meteorological aspects from historical documentary sources and old instrumental records\" (in en). Journal of Hydrology 313 (1-2): 32\u201347. doi:10.1016\/j.jhydrol.2005.02.004. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0022169405000272 .   \n \n\n\u2191 Ledneva, Anna; Miller-Rushing, Abraham J.; Primack, Richard B.; Imbres, Carolyn (1 September 2004). \"CLIMATE CHANGE AS REFLECTED IN A NATURALIST'S DIARY, MIDDLEBOROUGH, MASSACHUSETTS\" (in en). The Wilson Bulletin 116 (3): 224\u2013231. doi:10.1676\/04-016. ISSN 0043-5643. http:\/\/www.bioone.org\/doi\/abs\/10.1676\/04-016 .   \n \n\n\u2191 U.S. Department of Agriculture (July 1993). \"Snapshot in Time, Repeat Photography on the Boise National Forest 1870-1992\". U.S. Department of Agriculture. https:\/\/digitalcommons.usu.edu\/govdocs_forest\/2 .   \n \n\n\u2191 Rogers, Garry F.; Malde, Harold E.; Turner, R. M. (1984). Bibliography of repeat photography for evaluating landscape change. Salt Lake City: University of Utah Press. ISBN 978-0-87480-239-9.   \n \n\n\u2191 Webb, Robert H.; Boyer, Diane E.; Turner, R. M., eds. (2010). Repeat photography: methods and applications in the natural sciences. Washington: Island Press. ISBN 978-1-59726-712-0.   \n \n\n\u2191 Primack, Richard B.; Miller-Rushing, Abraham J. (1 February 2012). \"Uncovering, Collecting, and Analyzing Records to Investigate the Ecological Impacts of Climate Change: A Template from Thoreau's Concord\" (in en). BioScience 62 (2): 170\u2013181. doi:10.1525\/bio.2012.62.2.10. ISSN 1525-3244. https:\/\/academic.oup.com\/bioscience\/article-lookup\/doi\/10.1525\/bio.2012.62.2.10 .   \n \n\n\u2191 Lescrauwaet, A.-C. (2013). Belgian fisheries: Ten decades, seven seas, forty species: Historical time-series to reconstruct landings, catches, fleet and fishing areas from 1900. Ghent University Faculty of Sciences. pp. 256. ISBN 9789082073119. http:\/\/hdl.handle.net\/1854\/LU-4143013 .   \n \n\n\u2191 Br\u00e1zdil, Rudolf; Chrom\u00e1, Kate\u0159ina; Val\u00e1\u0161ek, Hubert; Dol\u00e1k, Luk\u00e1\u0161; \u0158ezn\u00ed\u010dkov\u00e1, Ladislava (1 January 2016). \"Damaging hailstorms in South Moravia, Czech Republic, in the seventeenth to twentieth centuries as derived from taxation records\" (in en). Theoretical and Applied Climatology 123 (1-2): 185\u2013198. doi:10.1007\/s00704-014-1338-1. ISSN 0177-798X. http:\/\/link.springer.com\/10.1007\/s00704-014-1338-1 .   \n \n\n\u2191 Van der Veken, Sebastiaan; Verheyen, Kris; Hermy, Martin (1 January 2004). \"Plant species loss in an urban area (Turnhout, Belgium) from 1880 to 1999 and its environmental determinants\" (in en). Flora - Morphology, Distribution, Functional Ecology of Plants 199 (6): 516\u2013523. doi:10.1078\/0367-2530-00180. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0367253005701407 .   \n \n\n\u2191 Martin, Kathy; Brown, Graeme A.; Young, Jessica R. (1 July 2004). \"The historic and current distribution of the Vancouver Island White-tailed Ptarmigan (Lagopus leucurus saxatilis)\" (in en). Journal of Field Ornithology 75 (3): 239\u2013256. doi:10.1648\/0273-8570-75.3.239. ISSN 0273-8570. http:\/\/www.bioone.org\/doi\/abs\/10.1648\/0273-8570-75.3.239 .   \n \n\n\u2191 Sharma, Sapna; Magnuson, John J.; Batt, Ryan D.; Winslow, Luke A.; Korhonen, Johanna; Aono, Yasuyuki (26 April 2016). \"Direct observations of ice seasonality reveal changes in climate over the past 320\u2013570 years\" (in en). Scientific Reports 6 (1): 25061. doi:10.1038\/srep25061. ISSN 2045-2322. PMC PMC4844970. PMID 27113125. https:\/\/www.nature.com\/articles\/srep25061 .   \n \n\n\u2191 Kelso, Clare; Vogel, Coleen (27 June 2007). \"The climate of Namaqualand in the nineteenth century\" (in en). Climatic Change 83 (3): 357\u2013380. doi:10.1007\/s10584-007-9264-1. ISSN 0165-0009. http:\/\/link.springer.com\/10.1007\/s10584-007-9264-1 .   \n \n\n\u2191 71.0 71.1 Wiebe, Peter H.; Allison, M. Dickson (1 June 2015). \"Bringing dark data into the light: A case study of the recovery of Northwestern Atlantic zooplankton data collected in the 1970s and 1980s\" (in en). GeoResJ 6: 195\u2013201. doi:10.1016\/j.grj.2015.03.001. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2214242815000273 .   \n \n\n\u2191 Pullin, Andrew S.; Salafsky, Nick (19 February 2010). \"Save the Whales? Save the Rainforest? Save the Data!: Editorial\" (in en). Conservation Biology 24 (4): 915\u2013917. doi:10.1111\/j.1523-1739.2010.01537.x. https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/j.1523-1739.2010.01537.x .   \n \n\n\u2191 Duckworth, Steve; Mack, Grayce; Thornhill, Kate (30 August 2022). The Trouble with Legacy Public Health Data. Open Science Framework. doi:10.17605\/OSF.IO\/UJHN2. https:\/\/osf.io\/ujhn2\/ .   \n \n\n\u2191 Curry, Andrew (11 February 2011). \"Rescue of Old Data Offers Lesson for Particle Physicists\" (in en). Science 331 (6018): 694\u2013695. doi:10.1126\/science.331.6018.694. ISSN 0036-8075. https:\/\/www.science.org\/doi\/10.1126\/science.331.6018.694 .   \n \n\n\u2191 Downs, Robert R.; Chen, Robert S. (2017). \"Curation of Scientific Data at Risk of Loss: Data Rescue and Dissemination\". Curating research data: Volume one: Practical strategies for your digital repository (Association of College and Research Libraries): 275\u201394. doi:10.7916\/D8W09BMQ. https:\/\/academiccommons.columbia.edu\/doi\/10.7916\/D8W09BMQ .   \n \n\n\u2191 Wicherts, Jelte M.; Borsboom, Denny; Kats, Judith; Molenaar, Dylan (2006). \"The poor availability of psychological research data for reanalysis.\" (in en). American Psychologist 61 (7): 726\u2013728. doi:10.1037\/0003-066X.61.7.726. ISSN 1935-990X. http:\/\/doi.apa.org\/getdoi.cfm?doi=10.1037\/0003-066X.61.7.726 .   \n \n\n\u2191 Sheffield, C.; Nakasone, S.; Ferrante, R. et al. (2011). \"Merging Metadata: Building on Existing Standards to Create a Field Book Registry\". LIBREAS. Library Ideas 18. https:\/\/libreas.eu\/ausgabe18\/texte\/08sheffield.htm .   \n \n\n\u2191 Loehle, Craig; Weatherford, Philip (1 October 2017). \"Detecting population trends with historical data: Contributions of volatility, low detectability, and metapopulation turnover to potential sampling bias\" (in en). Ecological Modelling 362: 13\u201318. doi:10.1016\/j.ecolmodel.2017.08.021. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0304380017303794 .   \n \n\n\u2191 Magurran, Anne E.; Baillie, Stephen R.; Buckland, Stephen T.; Dick, Jan McP.; Elston, David A.; Scott, E. Marian; Smith, Rognvald I.; Somerfield, Paul J. et al. (1 October 2010). \"Long-term datasets in biodiversity research and monitoring: assessing change in ecological communities through time\" (in en). Trends in Ecology & Evolution 25 (10): 574\u2013582. doi:10.1016\/j.tree.2010.06.016. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0169534710001552 .   \n \n\n\u2191 Reznick, David; Baxter, Ronald J.; Endler, John (1 June 1994). \"Long-term Studies of Tropical Stream Fish Communities:The Use of Field Notes and Museum Collections to Reconstruct Communities of the Past\" (in en). American Zoologist 34 (3): 452\u2013462. doi:10.1093\/icb\/34.3.452. ISSN 0003-1569. https:\/\/academic.oup.com\/icb\/article-lookup\/doi\/10.1093\/icb\/34.3.452 .   \n \n\n\u2191 Knapp, Kenneth R.; Bates, John J.; Barkstrom, Bruce (1 September 2007). \"Scientific Data Stewardship: Lessons Learned from a Satallite\u2013Data Rescue Effort\" (in en). Bulletin of the American Meteorological Society 88 (9): 1359\u20131362. doi:10.1175\/BAMS-88-9-1359. ISSN 0003-0007. https:\/\/journals.ametsoc.org\/doi\/10.1175\/BAMS-88-9-1359 .   \n \n\n\u2191 L\u00f6ffler, Felicitas; Wesp, Valentin; K\u00f6nig-Ries, Birgitta; Klan, Friederike (24 March 2021). Suleman, Hussein. ed. \"Dataset search in biodiversity research: Do metadata in data repositories reflect scholarly information needs?\" (in en). PLOS ONE 16 (3): e0246099. doi:10.1371\/journal.pone.0246099. ISSN 1932-6203. PMC PMC7990268. PMID 33760822. https:\/\/dx.plos.org\/10.1371\/journal.pone.0246099 .   \n \n\n\u2191 Sprague, Lori A.; Oelsner, Gretchen P.; Argue, Denise M. (1 March 2017). \"Challenges with secondary use of multi-source water-quality data in the United States\" (in en). Water Research 110: 252\u2013261. doi:10.1016\/j.watres.2016.12.024. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0043135416309642 .   \n \n\n\u2191 K\u00e9ry, Marc; Spillmann, John H.; Truong, Camille; Holderegger, Rolf (1 September 2006). \"How biased are estimates of extinction probability in revisitation studies?\" (in en). Journal of Ecology 94 (5): 980\u2013986. doi:10.1111\/j.1365-2745.2006.01151.x. https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/j.1365-2745.2006.01151.x .   \n \n\n\u2191 Pollock, Jacob F. (1 June 2006). \"Detecting Population Declines over Large Areas with Presence-Absence, Time-to-Encounter, and Count Survey Methods\" (in en). Conservation Biology 20 (3): 882\u2013892. doi:10.1111\/j.1523-1739.2006.00342.x. ISSN 0888-8892. https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/j.1523-1739.2006.00342.x .   \n \n\n\u2191 Rivadeneira, Marcelo M.; Hunt, Gene; Roy, Kaustuv (1 May 2009). \"The use of sighting records to infer species extinctions: an evaluation of different methods\" (in en). Ecology 90 (5): 1291\u20131300. doi:10.1890\/08-0316.1. ISSN 0012-9658. http:\/\/doi.wiley.com\/10.1890\/08-0316.1 .   \n \n\n\u2191 Huisman, John M.; Millar, Alan J.K. (1 January 2013). \"Australian seaweed collections: use and misuse\" (in en). Phycologia 52 (1): 2\u20135. doi:10.2216\/12-089.1. ISSN 0031-8884. https:\/\/www.tandfonline.com\/doi\/full\/10.2216\/12-089.1 .   \n \n\n\u2191 Kullman, Leif (1 August 2010). \"Alpine flora dynamics - a critical review of responses to climate change in the Swedish Scandes since the early 1950s\" (in en). Nordic Journal of Botany 28 (4): 398\u2013408. doi:10.1111\/j.1756-1051.2010.00812.x. https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/j.1756-1051.2010.00812.x .   \n \n\n\u2191 Engelhard, Georg H.; Righton, David A.; Pinnegar, John K. (1 August 2014). \"Climate change and fishing: a century of shifting distribution in North Sea cod\" (in en). Global Change Biology 20 (8): 2473\u20132483. doi:10.1111\/gcb.12513. ISSN 1354-1013. PMC PMC4282283. PMID 24375860. https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/gcb.12513 .   \n \n\n\u2191 Schulte, L.A.; Mladenoff, D.J. (2001). \"The Original US Public Land Survey Records: Their Use and Limitations in Reconstructing Presettlement Vegetation\". Journal of Forestry 99 (10): 5\u201310. doi:10.1093\/jof\/99.10.5. https:\/\/academic.oup.com\/jof\/article\/99\/10\/5\/4614271 .   \n \n\n\u2191 Delisle, Fanny; Lavoie, Claude; Jean, Martin; Lachance, Daniel (1 July 2003). \"Reconstructing the spread of invasive plants: taking into account biases associated with herbarium specimens: Invasive plants and herbarium specimens\" (in en). Journal of Biogeography 30 (7): 1033\u20131042. doi:10.1046\/j.1365-2699.2003.00897.x. http:\/\/doi.wiley.com\/10.1046\/j.1365-2699.2003.00897.x .   \n \n\n\u2191 Bavel, Bas J. P.; Curtis, Daniel R.; Hannaford, Matthew J.; Moatsos, Michail; Roosen, Joris; Soens, Tim (1 November 2019). \"Climate and society in long\u2010term perspective: Opportunities and pitfalls in the use of historical datasets\" (in en). WIREs Climate Change 10 (6). doi:10.1002\/wcc.611. ISSN 1757-7780. PMC PMC6852122. PMID 31762795. https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/wcc.611 .   \n \n\n\u2191 Faniel, Ixchel M.; Frank, Rebecca D.; Yakel, Elizabeth (26 September 2019). \"Context from the data reuser\u2019s point of view\" (in en). Journal of Documentation 75 (6): 1274\u20131297. doi:10.1108\/JD-08-2018-0133. ISSN 0022-0418. https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/JD-08-2018-0133\/full\/html .   \n \n\n\nNotes \nThis presentation is faithful to the original, with only a few minor changes to presentation. In some cases important information was missing from the references, and that information was added. The original organizes references in alphabetical order; this version organizes them by order of appearance, by design. Several inline URLs in the original were turned into formal citations for this version.\n\n\n\n\n\nSource: <a rel=\"external_link\" class=\"external\" href=\"https:\/\/www.limswiki.org\/index.php\/Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\">https:\/\/www.limswiki.org\/index.php\/Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges<\/a>\nCategories: LIMSwiki journal articles (added in 2023)LIMSwiki journal articles (all)LIMSwiki journal articles on data management and sharingNavigation menuPage actionsJournalDiscussionView sourceHistoryPage actionsJournalDiscussionMoreToolsIn other languagesPersonal toolsLog inNavigationMain pageEncyclopedic articlesRecent changesRandom pageHelp about MediaWikiSearch\u00a0 ToolsWhat links hereRelated changesSpecial pagesPermanent linkPage informationPopular publications\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\nPrint\/exportCreate a bookDownload as PDFDownload as PDFDownload as Plain textPrintable version This page was last edited on 25 April 2023, at 20:20.Content is available under a Creative Commons Attribution-ShareAlike 4.0 International License unless otherwise noted.This page has been accessed 176 times.Privacy policyAbout LIMSWikiDisclaimers\n\n\n\n","19be31afe217dcc35a45c9d74f9d4aa9_html":"<body class=\"mediawiki ltr sitedir-ltr mw-hide-empty-elt ns-206 ns-subject page-Journal_A_critical_literature_review_of_historic_scientific_analog_data_Uses_successes_and_challenges rootpage-Journal_A_critical_literature_review_of_historic_scientific_analog_data_Uses_successes_and_challenges skin-monobook action-view skin--responsive\"><div id=\"rdp-ebb-globalWrapper\"><div id=\"rdp-ebb-column-content\"><div id=\"rdp-ebb-content\" class=\"mw-body\" role=\"main\"><a id=\"rdp-ebb-top\"><\/a>\n<h1 id=\"rdp-ebb-firstHeading\" class=\"firstHeading\" lang=\"en\">Journal:A critical literature review of historic scientific analog data: Uses, successes, and challenges<\/h1><div id=\"rdp-ebb-bodyContent\" class=\"mw-body-content\"><!-- start content --><div id=\"rdp-ebb-mw-content-text\" lang=\"en\" dir=\"ltr\" class=\"mw-content-ltr\"><div class=\"mw-parser-output\">\n\n\n<h2><span class=\"mw-headline\" id=\"Abstract\">Abstract<\/span><\/h2>\n<p>For years, scientists in fields from climate change to biodiversity to hydrology have used older data to address contemporary issues. Since the 1960s, researchers, recognizing the value of this data, have expressed concern about its <a href=\"https:\/\/www.limswiki.org\/index.php\/Information_management\" title=\"Information management\" class=\"wiki-link\" data-key=\"f8672d270c0750a858ed940158ca0a73\">management<\/a> and potential for loss. No widespread solutions have emerged to address the myriad issues around its storage, access, and findability. This paper summarizes observations and concerns of researchers in various disciplines who have articulated problems associated with analog data and highlights examples of projects that have used historical data. The authors also examined selected papers to discover how researchers located historical data and how they used it. While many researchers are not producing huge amounts of analog data today, there are still large volumes of it that are at risk. To address this concern, the authors recommend the development of best practices for managing historic data. This will take communication across disciplines and the involvement of researchers, departments, institutions, and associations in the process.\n<\/p><p><b>Keywords<\/b>: analog data, historic data, data policies, risk of loss, data rescue, dark data\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Introduction\">Introduction<\/span><\/h2>\n<p>Concerns about the <a href=\"https:\/\/www.limswiki.org\/index.php\/Information_management\" title=\"Information management\" class=\"wiki-link\" data-key=\"f8672d270c0750a858ed940158ca0a73\">management of data<\/a>\u2014including its <a href=\"https:\/\/www.limswiki.org\/index.php\/Data_preservation\" title=\"Data preservation\" class=\"wiki-link\" data-key=\"1350010d31e724da3a4d2e344b91cc42\">preservation<\/a>, findability, and reuse\u2014are almost entirely focused on recently-generated data in electronic, machine-readable formats. While many of the principles of the management of electronic data such as proper description and good organization apply to data in any format, the discussions about applying those principles to older data in non-electronic formats have not received much attention.\n<\/p><p>In this paper we review publications in various scientific fields that discuss older data that is in analog or print format and the use or reuse of older data in general. By analog data we mean items in print format such as numeric data as well as field or <a href=\"https:\/\/www.limswiki.org\/index.php\/Laboratory_notebook\" title=\"Laboratory notebook\" class=\"wiki-link\" data-key=\"be60c7be96aba8e9a84537fd8835fa54\">lab notebooks<\/a>, photographs, drawings, and maps. Analog data may also be called historic data, legacy data, heritage data, or dark data, although these and other phrases can include older data that is not necessarily in print format. Some authors also use the term \"data rescue,\" which has also been used to describe recent efforts to duplicate and secure electronic data that may be at risk of loss (e.g., the Data Refuge community<sup id=\"rdp-ebb-cite_ref-UPDataRefuge_1-0\" class=\"reference\"><a href=\"#cite_note-UPDataRefuge-1\">[1]<\/a><\/sup>).\n<\/p><p>Our interest in this topic began when a few senior faculty members approached the University library for assistance in organizing and possibly housing their analog data.<sup id=\"rdp-ebb-cite_ref-2\" class=\"reference\"><a href=\"#cite_note-2\">[2]<\/a><\/sup> A survey of life sciences researchers on campus revealed that many held analog data and considered it valuable but were unsure of how to preserve it.<sup id=\"rdp-ebb-cite_ref-:0_3-0\" class=\"reference\"><a href=\"#cite_note-:0-3\">[3]<\/a><\/sup> Nearly all were willing to share it. Given that most researchers now either collect data digitally or quickly transfer any analog data, this is a finite problem; however, because many of the stewards of analog data are nearing retirement, it is timely. We undertook this literature review to learn how scientific researchers are dealing with the analog data in their possession and if any large scale efforts have been undertaken to address the issues.\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Types_of_analog_data\">Types of analog data<\/span><\/h2>\n<p>Much of the analog data that exists in offices, <a href=\"https:\/\/www.limswiki.org\/index.php\/Laboratory\" title=\"Laboratory\" class=\"wiki-link\" data-key=\"c57fc5aac9e4abf31dccae81df664c33\">labs<\/a>, homes, archives, and other locations is numeric in nature. It was probably collected before electronic spreadsheets were commonly available for both capturing and <a href=\"https:\/\/www.limswiki.org\/index.php\/Data_analysis\" title=\"Data analysis\" class=\"wiki-link\" data-key=\"545c95e40ca67c9e63cd0a16042a5bd1\">analyzing data<\/a>. The format could be loose notebook paper, index cards, large data sheets, or bound or unbound notebooks. It could also take the form of a log, possibly combining numeric and descriptive data in chronological order.\n<\/p><p>The data may also be descriptive in nature and contained in field notebooks or diaries. The tags associated with museum and herbarium specimens are often mined for the data that they note such as species, location, dates, and other parameters. Although they are inextricably tied, when we discuss analog data we are not including the specimens themselves but just the information on the tags.\n<\/p><p>Drawings and photographs may accompany other forms of data or may stand on their own, hopefully with enough description to make them useful to current researchers. The same is true of maps, which may be printed or hand drawn.\n<\/p>\n<h2><span class=\"mw-headline\" id=\"History_of_concern_about_analog_data\">History of concern about analog data<\/span><\/h2>\n<p>A number of authors have written about analog data over the last 50+ years, often noting its potential value and lamenting the lack of procedures, funding, and best practices to help support its ongoing use and preservation. Psychologists in the 1960s and 1970s noted not only the importance of new observations coming from the re-examination of older data but also the practice of comparing newly gathered data to historic data.<sup id=\"rdp-ebb-cite_ref-4\" class=\"reference\"><a href=\"#cite_note-4\">[4]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-:1_5-0\" class=\"reference\"><a href=\"#cite_note-:1-5\">[5]<\/a><\/sup> Speaking about data that authors have not retained, Wolins suggests a role for professional associations: \"If it were clearly set forth by the [American Psychological Association] ... the responsibility for retaining raw data ... this dilemma would not exist.\"<sup id=\"rdp-ebb-cite_ref-6\" class=\"reference\"><a href=\"#cite_note-6\">[6]<\/a><\/sup> For a time the U.S. government played a role through the American Documentation Institute at the Library of Congress, which accepted some raw data to be preserved.<sup id=\"rdp-ebb-cite_ref-:1_5-1\" class=\"reference\"><a href=\"#cite_note-:1-5\">[5]<\/a><\/sup> Recently, Buma made use of photographs in Glacier Bay to longitudinally track plant growth and establishment and noted that if it was easier to learn of the existence of older data and to obtain copies, its value would grow.<sup id=\"rdp-ebb-cite_ref-7\" class=\"reference\"><a href=\"#cite_note-7\">[7]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-8\" class=\"reference\"><a href=\"#cite_note-8\">[8]<\/a><\/sup>\n<\/p><p>In most cases, authors limit their discussions to the situation in their own subspecialty, although a few have taken a broader view. A notable example is the final report of the Ecological Society of America (ESA) committee on the Future of Long-term Ecological Data.<sup id=\"rdp-ebb-cite_ref-:2_9-0\" class=\"reference\"><a href=\"#cite_note-:2-9\">[9]<\/a><\/sup> The lengthy report details the situation and offers numerous recommendations for the future. Although it does not exclusively focus on analog data, it states \"[a]mong the least secure are data in the hands of an individual researcher who has made little or no provision for long-term curation.\"<sup id=\"rdp-ebb-cite_ref-:2_9-1\" class=\"reference\"><a href=\"#cite_note-:2-9\">[9]<\/a><\/sup>\n<\/p><p>Also in 1995, the National Research Council published both <i>Finding the Forest in the Trees: The Challenge of Combining Diverse Environmental Data<\/i> and <i>Preserving Scientific Data on Our Physical Universe<\/i>.<sup id=\"rdp-ebb-cite_ref-:3_10-0\" class=\"reference\"><a href=\"#cite_note-:3-10\">[10]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-:4_11-0\" class=\"reference\"><a href=\"#cite_note-:4-11\">[11]<\/a><\/sup> The first report highlights the variables, measures, and data management, and puts forward 18 recommendations. These call on professional societies, research institutions, funding agencies, and individual researchers to collaborate, carefully plan, focus on interoperability, create rich metadata, and make data more widely available.<sup id=\"rdp-ebb-cite_ref-:3_10-1\" class=\"reference\"><a href=\"#cite_note-:3-10\">[10]<\/a><\/sup> The latter report notes many problems and few solutions, stating \"[t]he most important deficiencies are in the documentation, access, and long-term preservation of data in usable form.\"<sup id=\"rdp-ebb-cite_ref-:4_11-1\" class=\"reference\"><a href=\"#cite_note-:4-11\">[11]<\/a><\/sup> Again, analog data was not the focus of these works, but it was covered.\n<\/p><p>Easterday <i>et al.<\/i> note the \"potential of historical dark data to contribute to the modern digital ecological data landscape.\"<sup id=\"rdp-ebb-cite_ref-:5_12-0\" class=\"reference\"><a href=\"#cite_note-:5-12\">[12]<\/a><\/sup> They note the importance of <a href=\"https:\/\/www.limswiki.org\/index.php\/Metadata\" title=\"Metadata\" class=\"wiki-link\" data-key=\"f872d4d6272811392bafe802f3edf2d8\">metadata<\/a> and the need to promote the data and the best practices around it. In his book <i>Repurposing Legacy Data<\/i>, Berman states that \"data repurposing creates value where none was expected.\"<sup id=\"rdp-ebb-cite_ref-:6_13-0\" class=\"reference\"><a href=\"#cite_note-:6-13\">[13]<\/a><\/sup> It includes case studies from a variety of disciplines and has chapters on identifying data that might lend itself to repurposing and understanding the organization of older data.<sup id=\"rdp-ebb-cite_ref-:6_13-1\" class=\"reference\"><a href=\"#cite_note-:6-13\">[13]<\/a><\/sup>\n<\/p><p>Griffin advocates for the value of \"heritage data,\" noting that much of it is at risk and in order to secure it for future use, \"certain priorities need to be re-ordered, new skills acquired and taught, resources redirected, and new networks constructed.\"<sup id=\"rdp-ebb-cite_ref-14\" class=\"reference\"><a href=\"#cite_note-14\">[14]<\/a><\/sup> Griffin was active in the CODATA Data at Risk Task Group which, along with its successor, the Research Data Alliance\u2019s Data Rescue Interest Group, worked to highlight the value of older data and promote projects that used or preserved it.<sup id=\"rdp-ebb-cite_ref-GriffinData15_15-0\" class=\"reference\"><a href=\"#cite_note-GriffinData15-15\">[15]<\/a><\/sup> Patil and Siegel note that bringing more dark data to the forefront will require different incentives from all those involved: \"journals, citation indexes, funding agencies, academic institutions and, not least, the researchers themselves.\"<sup id=\"rdp-ebb-cite_ref-16\" class=\"reference\"><a href=\"#cite_note-16\">[16]<\/a><\/sup> Although they write from a health sciences perspective, this probably applies more broadly.\n<\/p><p>A number of authors have drawn attention to the use or potential use of analog data in their particular fields. In fisheries, Singer <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-17\" class=\"reference\"><a href=\"#cite_note-17\">[17]<\/a><\/sup> surveyed fellow researchers to get a better idea of how and why they used fish collections in order to inform both researchers and those who manage the collections. The value and possible reuse of data collected at biological field stations has been noted since at least the 1980s.<sup id=\"rdp-ebb-cite_ref-:7_18-0\" class=\"reference\"><a href=\"#cite_note-:7-18\">[18]<\/a><\/sup> Bowser emphasized the importance of data management and suggested that field station data might be deposited with libraries, historical societies or federal agencies.<sup id=\"rdp-ebb-cite_ref-:7_18-1\" class=\"reference\"><a href=\"#cite_note-:7-18\">[18]<\/a><\/sup> Easterday <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-:5_12-1\" class=\"reference\"><a href=\"#cite_note-:5-12\">[12]<\/a><\/sup> make their observations about the use of data science principles by highlighting work from three California field stations, and Michener <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-19\" class=\"reference\"><a href=\"#cite_note-19\">[19]<\/a><\/sup> wrote an article entitled \"Biological Field Stations: Research Legacies and Sites for Serendipity.\"\n<\/p><p>Ecological researchers have long mined analog data and historical records in their work, according to Beans.<sup id=\"rdp-ebb-cite_ref-:8_20-0\" class=\"reference\"><a href=\"#cite_note-:8-20\">[20]<\/a><\/sup> While she focuses on journal entries, maps, and photos, she highlights common challenges such as locating material and working with someone else\u2019s organizational scheme. She highlights Loren McClenachan<sup id=\"rdp-ebb-cite_ref-21\" class=\"reference\"><a href=\"#cite_note-21\">[21]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-22\" class=\"reference\"><a href=\"#cite_note-22\">[22]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-23\" class=\"reference\"><a href=\"#cite_note-23\">[23]<\/a><\/sup>, a marine ecologist who utilizes historical data in her research and also published a policy-oriented article on the benefits of using older data to set baselines in marine studies. Over 20 years ago, Olson and McCord<sup id=\"rdp-ebb-cite_ref-24\" class=\"reference\"><a href=\"#cite_note-24\">[24]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-25\" class=\"reference\"><a href=\"#cite_note-25\">[25]<\/a><\/sup> wrote two book chapters on data archiving in the ecological sciences. Although the emphasis is on digital data, they spell out recommendations on incentives, metadata, and components of an archive that apply to analog and digital materials.\n<\/p><p>Kwok<sup id=\"rdp-ebb-cite_ref-26\" class=\"reference\"><a href=\"#cite_note-26\">[26]<\/a><\/sup> reports on the use of older data in the fields of both ecology and climate science. In the area of climate science, Br\u00f6nnimann <i>et al.<\/i> are mainly concerned with digital data but provide an overview of efforts to locate and digitize analog data, commenting that \"the fraction of yet-to-be-digitized data is difficult to quantify,\" implying that it is large indeed.<sup id=\"rdp-ebb-cite_ref-27\" class=\"reference\"><a href=\"#cite_note-27\">[27]<\/a><\/sup>\n<\/p><p>Geological researchers sometimes have an added reason to want to discover and use older data: it may have been collected using methods that are now difficult or impossible to employ due to stricter regulations. Diviacco <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-28\" class=\"reference\"><a href=\"#cite_note-28\">[28]<\/a><\/sup> writes about a project where data was both analog and digital and had been obtained using dynamite. Vearncombe <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-29\" class=\"reference\"><a href=\"#cite_note-29\">[29]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-30\" class=\"reference\"><a href=\"#cite_note-30\">[30]<\/a><\/sup>, using examples from the mining industry, note that \"upcycling\" of data can mean cost savings as well as new insights from reexamination of data.\n<\/p><p>A number of disciplines have employed citizen science projects to assist in the analog data efforts. These take the form of both mining older citizen science projects for their data or initiating new projects that provide person-hours to reformat or otherwise transform or collate analog data. Clavero <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-31\" class=\"reference\"><a href=\"#cite_note-31\">[31]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-32\" class=\"reference\"><a href=\"#cite_note-32\">[32]<\/a><\/sup> examine species lists to study trout decline, Hof and Bright<sup id=\"rdp-ebb-cite_ref-:9_33-0\" class=\"reference\"><a href=\"#cite_note-:9-33\">[33]<\/a><\/sup> look at previous counts of hedgehogs, and Sn\u00e4ll <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-34\" class=\"reference\"><a href=\"#cite_note-34\">[34]<\/a><\/sup> consider the use of presence data from bird monitoring. A recent citizen science project on the Zooniverse platform involves identifying data in papers written by students at the University of Michigan Field Station.<sup id=\"rdp-ebb-cite_ref-TallantUnearth22_35-0\" class=\"reference\"><a href=\"#cite_note-TallantUnearth22-35\">[35]<\/a><\/sup>\n<\/p><p>While many authors bemoan the unfortunate state of older data in their subdisciplines, a few areas offer success stories. Researchers working in biodiversity\u2014many of whom are connected with museums or herbaria which hold physical specimens and their metadata-rich identification tags\u2014are an example. They have built networks and secured funding for several international biodiversity-related projects that address data tied to specimens as well as the objects themselves. Projects include Integrated Digitized Biocollections (<a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.idigbio.org\/\" target=\"_blank\">iDigBio<\/a>), Global Biodiversity Information Facility (<a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.gbif.org\/\" target=\"_blank\">GBIF<\/a>), and Distributed System of Scientific Collections (<a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.dissco.eu\/\" target=\"_blank\">DiSSCo<\/a>). The progress in digitization and dissemination of biodiversity data over the last 20 years is summarized by Nelson and Ellis.<sup id=\"rdp-ebb-cite_ref-36\" class=\"reference\"><a href=\"#cite_note-36\">[36]<\/a><\/sup>\n<\/p><p>Climate researchers have also made great strides in gathering disparate data in analog and digital format and making it accessible to the global community of scientists. The EU-based Copernicus Climate Change Service (<a rel=\"external_link\" class=\"external text\" href=\"https:\/\/datarescue.climate.copernicus.eu\/\" target=\"_blank\">C3S<\/a>) and International Data Rescue Portal (<a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.idare-portal.org\/\" target=\"_blank\">I-DARE<\/a>) serve as examples.\n<\/p><p>Some contemporary groups that rescue and reuse older analog data have very narrowly focused subject areas. The <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.ciee-icee.ca\/ldp.html\" target=\"_blank\">Living Data Project<\/a>, sponsored by the Canadian Institute of Ecology and Evolution, funds new projects each year with topics such as \"Species ranges, diversity and life history of Neotropical birds\" and \"Responses of freshwater zooplankton to road salt pollution: A global perspective.\" Another project, based at the U.S. Department of Agriculture (USDA) National Agricultural Library (Data Rescue Case Study: Long-Term Livestock Production Data), gathered older data from throughout the US, converted it to electronic formats, and deposited it in AgData Commons.<sup id=\"rdp-ebb-cite_ref-37\" class=\"reference\"><a href=\"#cite_note-37\">[37]<\/a><\/sup>\n<\/p><p>Field and lab notebooks have been the focus of a number of digitization projects. They may be held in archives, museums, libraries, or research facilities, as well as by individuals. The Biodiversity Heritage Library, in conjunction with several other institutions including the Smithsonian, includes nearly 3,000 scanned field books.<sup id=\"rdp-ebb-cite_ref-BHLField_38-0\" class=\"reference\"><a href=\"#cite_note-BHLField-38\">[38]<\/a><\/sup> On a smaller scale, Texas A&M Libraries has digitized the field notebooks and specimen catalogs of W. B. Davis (1930\u20131981) and they have been viewed over 1,000 times.<sup id=\"rdp-ebb-cite_ref-TAMWilliam22_39-0\" class=\"reference\"><a href=\"#cite_note-TAMWilliam22-39\">[39]<\/a><\/sup> Thomer <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-:10_40-0\" class=\"reference\"><a href=\"#cite_note-:10-40\">[40]<\/a><\/sup> propose a method for efficiently extracting species data from handwritten field notebooks.\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Ways_that_older_analog_data_is_utilized\">Ways that older analog data is utilized<\/span><\/h2>\n<p>Researchers may use older data in a variety of ways. Some strive to repeat an earlier survey or experiment as closely as possible.<sup id=\"rdp-ebb-cite_ref-41\" class=\"reference\"><a href=\"#cite_note-41\">[41]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-42\" class=\"reference\"><a href=\"#cite_note-42\">[42]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-43\" class=\"reference\"><a href=\"#cite_note-43\">[43]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-44\" class=\"reference\"><a href=\"#cite_note-44\">[44]<\/a><\/sup> Others reexamine older data or incorporate portions of it into their current work.<sup id=\"rdp-ebb-cite_ref-45\" class=\"reference\"><a href=\"#cite_note-45\">[45]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-46\" class=\"reference\"><a href=\"#cite_note-46\">[46]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-47\" class=\"reference\"><a href=\"#cite_note-47\">[47]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-48\" class=\"reference\"><a href=\"#cite_note-48\">[48]<\/a><\/sup> Authors may also have consulted earlier data as they developed their research plans. Mandates for the preservation of data that have emerged in the last 15 years have elevated the topic of data reuse, although most recent research has considered only digital data.<sup id=\"rdp-ebb-cite_ref-49\" class=\"reference\"><a href=\"#cite_note-49\">[49]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-50\" class=\"reference\"><a href=\"#cite_note-50\">[50]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-51\" class=\"reference\"><a href=\"#cite_note-51\">[51]<\/a><\/sup>\n<\/p><p>The methods that researchers use to obtain older data often remain a mystery. Large data collections such as <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.idigbio.org\/research\" target=\"_blank\">iDigBio<\/a> provide background, training, examples, and other resources for potential data users and authors are likely to mention or cite these collections. This is often not true for projects that use older data. In a preliminary investigation, we conducted examinations of 66 scientific papers that used analog data, and only seven spelled out how the authors located it (see Figure 1). None of the authors of this set of papers mention going back to the original authors of the publications to obtain more detailed information, although it is hard to imagine that none of them took that step.\n<\/p><p><br \/>\n<a href=\"https:\/\/www.limswiki.org\/index.php\/File:Fig1_Kelly_DataSciJourn22_21.png\" class=\"image wiki-link\" data-key=\"eed96ee8bf7cf92af44b5aac4d888f4a\"><img alt=\"Fig1 Kelly DataSciJourn22 21.png\" src=\"https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/a\/a5\/Fig1_Kelly_DataSciJourn22_21.png\" decoding=\"async\" style=\"width: 100%;max-width: 400px;height: auto;\" \/><\/a>\n<\/p>\n<div style=\"clear:both;\"><\/div>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table border=\"0\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><blockquote><p><b>Figure 1.<\/b> Description of sources of historic data for scientific researchers who had re-used it in publications. Scientific papers (<i>N<\/i> = 66) that illustrated evidence of use of this data were examined to determine the source of the data and how it was identified and located by the researchers.<\/p><\/blockquote>\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<p>Obtaining data directly from the researchers is known to be problematic, and a statement such as \"data available on request\" in an article does not always lead to success. A 2014 study focused on 500+ articles from two to 22 years old, and the authors stated, \"o]ur results reinforce the notion that, in the long term, research data cannot be reliably preserved by individual researchers.\"<sup id=\"rdp-ebb-cite_ref-52\" class=\"reference\"><a href=\"#cite_note-52\">[52]<\/a><\/sup> A new study suggests that all data associated with open data publishing needs to go into an open repository before publication. Of authors who indicated that data were available on request in publications, 1,670 (93%) did not respond to a request for data or chose not to share.<sup id=\"rdp-ebb-cite_ref-53\" class=\"reference\"><a href=\"#cite_note-53\">[53]<\/a><\/sup>\n<\/p><p>In addition to individual researchers, various types of organizations may be in possession of analog data. Government agencies hold weather data as well as the aforementioned museum and herbarium records. Fisheries and agricultural records have also been used, along with conservation-related documents.<sup id=\"rdp-ebb-cite_ref-54\" class=\"reference\"><a href=\"#cite_note-54\">[54]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-55\" class=\"reference\"><a href=\"#cite_note-55\">[55]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-56\" class=\"reference\"><a href=\"#cite_note-56\">[56]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-57\" class=\"reference\"><a href=\"#cite_note-57\">[57]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-:11_58-0\" class=\"reference\"><a href=\"#cite_note-:11-58\">[58]<\/a><\/sup> Nonprofits may also hold data from citizen science projects.<sup id=\"rdp-ebb-cite_ref-:9_33-1\" class=\"reference\"><a href=\"#cite_note-:9-33\">[33]<\/a><\/sup> \n<\/p><p>Archives can be a source for analog data; this is sometimes where researchers discover field books and diaries.<sup id=\"rdp-ebb-cite_ref-59\" class=\"reference\"><a href=\"#cite_note-59\">[59]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-60\" class=\"reference\"><a href=\"#cite_note-60\">[60]<\/a><\/sup> They may also hold photographs used by those conducting repeat photography work.<sup id=\"rdp-ebb-cite_ref-61\" class=\"reference\"><a href=\"#cite_note-61\">[61]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-62\" class=\"reference\"><a href=\"#cite_note-62\">[62]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-63\" class=\"reference\"><a href=\"#cite_note-63\">[63]<\/a><\/sup> Finally, there are numerous examples of authors reusing analog data that they located using less conventional sources. This includes literature, ship logs, tax records, newspapers, and church records.<sup id=\"rdp-ebb-cite_ref-64\" class=\"reference\"><a href=\"#cite_note-64\">[64]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-65\" class=\"reference\"><a href=\"#cite_note-65\">[65]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-66\" class=\"reference\"><a href=\"#cite_note-66\">[66]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-67\" class=\"reference\"><a href=\"#cite_note-67\">[67]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-68\" class=\"reference\"><a href=\"#cite_note-68\">[68]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-69\" class=\"reference\"><a href=\"#cite_note-69\">[69]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-70\" class=\"reference\"><a href=\"#cite_note-70\">[70]<\/a><\/sup>\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Challenges_with_reusing_older_data\">Challenges with reusing older data<\/span><\/h2>\n<p>Scientists note the challenges and potential pitfalls when combining or comparing old and new data. For example, there are few standards or best practices towards these efforts.<sup id=\"rdp-ebb-cite_ref-:2_9-2\" class=\"reference\"><a href=\"#cite_note-:2-9\">[9]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-:6_13-2\" class=\"reference\"><a href=\"#cite_note-:6-13\">[13]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-:10_40-1\" class=\"reference\"><a href=\"#cite_note-:10-40\">[40]<\/a><\/sup> In another example, while individual authors provide rich insights from their experiences, finding general guidance for analog data is mostly lacking, unlike the situation with digital data.<sup id=\"rdp-ebb-cite_ref-:7_18-2\" class=\"reference\"><a href=\"#cite_note-:7-18\">[18]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-:12_71-0\" class=\"reference\"><a href=\"#cite_note-:12-71\">[71]<\/a><\/sup> Also unlike the digital data landscape, ownership and stewardship responsibilities are often unclear. Costs for reformatting and preservation of analog data can be high with few options for funding.<sup id=\"rdp-ebb-cite_ref-:2_9-3\" class=\"reference\"><a href=\"#cite_note-:2-9\">[9]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-GriffinData15_15-1\" class=\"reference\"><a href=\"#cite_note-GriffinData15-15\">[15]<\/a><\/sup> Another concern is that, broadly speaking, institutions have few incentives to save data.<sup id=\"rdp-ebb-cite_ref-72\" class=\"reference\"><a href=\"#cite_note-72\">[72]<\/a><\/sup>\n<\/p><p>Although not much is known about how individual researchers find the analog data that they reuse, several authors note the difficulty in locating it. It languishes in labs, gets redistributed to multiple locations, or simply disappears.<sup id=\"rdp-ebb-cite_ref-:5_12-2\" class=\"reference\"><a href=\"#cite_note-:5-12\">[12]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-73\" class=\"reference\"><a href=\"#cite_note-73\">[73]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-74\" class=\"reference\"><a href=\"#cite_note-74\">[74]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-75\" class=\"reference\"><a href=\"#cite_note-75\">[75]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-76\" class=\"reference\"><a href=\"#cite_note-76\">[76]<\/a><\/sup> Many data repositories, especially those housed at academic institutions, require data to be in machine-readable formats. Some such as <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/data.nal.usda.gov\/\" target=\"_blank\">Ag Data Commons<\/a> will accept scanned data. <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/zenodo.org\/\" target=\"_blank\">Zenodo<\/a>, the European Community repository that includes data as well as software and documents, welcomes data in any format, although they are currently working on guidelines for deposit. However, data registries, where metadata about analog data could reside, have not materialized as predicted.<sup id=\"rdp-ebb-cite_ref-77\" class=\"reference\"><a href=\"#cite_note-77\">[77]<\/a><\/sup>\n<\/p><p>There are also numerous challenges as researchers bring together data gathered years apart. First, combining old and new data sets can be complex.<sup id=\"rdp-ebb-cite_ref-:4_11-2\" class=\"reference\"><a href=\"#cite_note-:4-11\">[11]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-78\" class=\"reference\"><a href=\"#cite_note-78\">[78]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-79\" class=\"reference\"><a href=\"#cite_note-79\">[79]<\/a><\/sup> Metadata is also a concern, as the original description may lack elements and they may have been defined differently in the earlier work.<sup id=\"rdp-ebb-cite_ref-:7_18-3\" class=\"reference\"><a href=\"#cite_note-:7-18\">[18]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-80\" class=\"reference\"><a href=\"#cite_note-80\">[80]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-81\" class=\"reference\"><a href=\"#cite_note-81\">[81]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-82\" class=\"reference\"><a href=\"#cite_note-82\">[82]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-:12_71-1\" class=\"reference\"><a href=\"#cite_note-:12-71\">[71]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-83\" class=\"reference\"><a href=\"#cite_note-83\">[83]<\/a><\/sup>\n<\/p><p>Finally, interpreting historic data may involve assumptions and comparison methods that need to be selected carefully.<sup id=\"rdp-ebb-cite_ref-84\" class=\"reference\"><a href=\"#cite_note-84\">[84]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-85\" class=\"reference\"><a href=\"#cite_note-85\">[85]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-86\" class=\"reference\"><a href=\"#cite_note-86\">[86]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-87\" class=\"reference\"><a href=\"#cite_note-87\">[87]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-88\" class=\"reference\"><a href=\"#cite_note-88\">[88]<\/a><\/sup> Engelhard <i>et al.<\/i>, studying the distribution of North Sea cod, emphasized \"the well-known problems with fisheries data such as discarding and misreporting practices by fishers.\"<sup id=\"rdp-ebb-cite_ref-89\" class=\"reference\"><a href=\"#cite_note-89\">[89]<\/a><\/sup> Beans<sup id=\"rdp-ebb-cite_ref-:8_20-1\" class=\"reference\"><a href=\"#cite_note-:8-20\">[20]<\/a><\/sup> notes that this underreporting was often due to attempts to minimize taxes on a boat\u2019s catch. Historical records may also have biases that must be dealt with when comparing with current surveys.<sup id=\"rdp-ebb-cite_ref-:11_58-1\" class=\"reference\"><a href=\"#cite_note-:11-58\">[58]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-90\" class=\"reference\"><a href=\"#cite_note-90\">[90]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-91\" class=\"reference\"><a href=\"#cite_note-91\">[91]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-92\" class=\"reference\"><a href=\"#cite_note-92\">[92]<\/a><\/sup>\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Possible_paths_forward\">Possible paths forward<\/span><\/h2>\n<p>While the individuals who are the current stewards of analog data and the organizations where they work have major parts to play in the solution to this issue, other entities can also take a role in developing solutions. Although few professional societies are in a position to host a data repository, there are other important roles that they can play. They could investigate and report on the status of analog data availability, use, and status in their realm, like the ESA. If they publish journals, they could encourage authors to cite data papers and accept data papers where appropriate. Societies could call on their members to describe and preserve their own analog data. They could also endorse standards for metadata. If they have the financial means, they could fund the digitization of selected data.\n<\/p><p>Funding agencies already play a large role in the preservation and reuse of recently-produced electronic data through their mandates, and they could also play a role with older data. Agencies could encourage pre-mandate grant recipients to make their data available or follow the lead of the USDA, which welcomes scanned as well as machine-readable data from pre-mandate grant recipients in its Ag Data Commons repository. Agencies could promote the idea of data papers for material from earlier grants and endorse particular repositories in their subject areas. Funders could also award grants to projects that preserve analog data or make it more easily findable.\n<\/p><p>What can individual researchers do? They can organize, inventory, and describe any analog data in their purview and document details about how it was generated.<sup id=\"rdp-ebb-cite_ref-93\" class=\"reference\"><a href=\"#cite_note-93\">[93]<\/a><\/sup> Many standards exist for doing this with digital data, and those standards can be used for analog data as well. In a survey of those holding analog data, many reported that there was a person who could describe the origins of the data but fewer had documented that information.<sup id=\"rdp-ebb-cite_ref-:0_3-1\" class=\"reference\"><a href=\"#cite_note-:0-3\">[3]<\/a><\/sup> If you have used historic data, think about how you found it and how you wish you might have been able to find it. Explore the concept and content of data papers and think about whether you might have some older data that you could describe in that same way. Talk to others about the topic and look for commonalities, especially across disciplines in your organization. Consult with the science librarians at your institution to see how you might work together. Finally, also think about your professional societies and how they might play a role.\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Conclusions\">Conclusions<\/span><\/h2>\n<p>Researchers across the sciences use older data in analog format, but little is known about how they learn of its existence or locate it. Over the last 50+ years, authors have expressed concern about its fate and noted challenges with its use. With the exception of the community of biodiversity researchers, there have been few large projects to address the preservation and findability of analog data and little interest expressed by government agencies, professional associations, and academic and research institutions that would be in a position to act on a broader scale. Best practices (including selection of metadata schema, developing a data dictionary, describing data collection methods) and policies developed to govern the preservation and dissemination of digital data could serve as an example for developments concerning analog data. In the digital realm, best practices are often developed by professional associations, both disciplinary and data-focused, as well as those who manage data repositories.\n<\/p>\n<h2><span id=\"rdp-ebb-Abbreviations,_acronyms,_and_initialisms\"><\/span><span class=\"mw-headline\" id=\"Abbreviations.2C_acronyms.2C_and_initialisms\">Abbreviations, acronyms, and initialisms<\/span><\/h2>\n<ul><li><b>C3S<\/b>: Copernicus Climate Change Service<\/li>\n<li><b>DiSSCo<\/b>: Distributed System of Scientific Collections<\/li>\n<li><b>ESA<\/b>: Ecological Society of America<\/li>\n<li><b>GBIF<\/b>: Global Biodiversity Information Facility<\/li>\n<li><b>I-DARE<\/b>: International Data Rescue Portal<\/li>\n<li><b>iDigBio<\/b>: Integrated Digitized Biocollections<\/li>\n<li><b>USDA<\/b>: U.S. Department of Agriculture<\/li><\/ul>\n<h2><span class=\"mw-headline\" id=\"Acknowledgements\">Acknowledgements<\/span><\/h2>\n<h3><span class=\"mw-headline\" id=\"Author_contributions\">Author contributions<\/span><\/h3>\n<p>All authors made significant contributions to the design of this review as well as drafting and revising the manuscript. All have approved this final version, agreed to be accountable, and have approved of the inclusion of those in the list of authors.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Competing_interests\">Competing interests<\/span><\/h3>\n<p>The authors have no competing interests to declare.\n<\/p>\n<h2><span class=\"mw-headline\" id=\"References\">References<\/span><\/h2>\n<div class=\"reflist references-column-width\" style=\"-moz-column-width: 30em; -webkit-column-width: 30em; column-width: 30em; list-style-type: decimal;\">\n<div class=\"mw-references-wrap mw-references-columns\"><ol class=\"references\">\n<li id=\"cite_note-UPDataRefuge-1\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-UPDataRefuge_1-0\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.datarefuge.org\/\" target=\"_blank\">\"Data Refuge\"<\/a>. University of Pennsylvania. 2022<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.datarefuge.org\/\" target=\"_blank\">https:\/\/www.datarefuge.org\/<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Data+Refuge&rft.atitle=&rft.date=2022&rft.pub=University+of+Pennsylvania&rft_id=https%3A%2F%2Fwww.datarefuge.org%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-2\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-2\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Farrell, Shannon L.; Hendrickson, Lois G.; Mastel, Kristen L.; Allen, Katherine Adina; Kelly, Julia A. (18 December 2019). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/publishing.escholarship.umassmed.edu\/jeslib\/article\/id\/476\/\" target=\"_blank\">\"Resurfacing Historical Scientific Data: A Case Study Involving Fruit Breeding Data\"<\/a>. <i>Journal of eScience Librarianship<\/i> <b>8<\/b> (2): e1171. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.7191%2Fjeslib.2019.1171\" target=\"_blank\">10.7191\/jeslib.2019.1171<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/publishing.escholarship.umassmed.edu\/jeslib\/article\/id\/476\/\" target=\"_blank\">https:\/\/publishing.escholarship.umassmed.edu\/jeslib\/article\/id\/476\/<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Resurfacing+Historical+Scientific+Data%3A+A+Case+Study+Involving+Fruit+Breeding+Data&rft.jtitle=Journal+of+eScience+Librarianship&rft.aulast=Farrell&rft.aufirst=Shannon+L.&rft.au=Farrell%2C%26%2332%3BShannon+L.&rft.au=Hendrickson%2C%26%2332%3BLois+G.&rft.au=Mastel%2C%26%2332%3BKristen+L.&rft.au=Allen%2C%26%2332%3BKatherine+Adina&rft.au=Kelly%2C%26%2332%3BJulia+A.&rft.date=18+December+2019&rft.volume=8&rft.issue=2&rft.pages=e1171&rft_id=info:doi\/10.7191%2Fjeslib.2019.1171&rft_id=https%3A%2F%2Fpublishing.escholarship.umassmed.edu%2Fjeslib%2Farticle%2Fid%2F476%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:0-3\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:0_3-0\">3.0<\/a><\/sup> <sup><a href=\"#cite_ref-:0_3-1\">3.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Farrell, Shannon L.; Hendrickson, Lois G.; Mastel, Kristen L.; Kelly, Julia A. (15 December 2020). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/datascience.codata.org\/article\/10.5334\/dsj-2020-051\/\" target=\"_blank\">\"Historical Scientific Analog Data: Life Sciences Faculty\u2019s Perspectives on Management, Reuse and Preservation\"<\/a>. <i>Data Science Journal<\/i> <b>19<\/b> (1): 51. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.5334%2Fdsj-2020-051\" target=\"_blank\">10.5334\/dsj-2020-051<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1683-1470\" target=\"_blank\">1683-1470<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/datascience.codata.org\/article\/10.5334\/dsj-2020-051\/\" target=\"_blank\">https:\/\/datascience.codata.org\/article\/10.5334\/dsj-2020-051\/<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Historical+Scientific+Analog+Data%3A+Life+Sciences+Faculty%E2%80%99s+Perspectives+on+Management%2C+Reuse+and+Preservation&rft.jtitle=Data+Science+Journal&rft.aulast=Farrell&rft.aufirst=Shannon+L.&rft.au=Farrell%2C%26%2332%3BShannon+L.&rft.au=Hendrickson%2C%26%2332%3BLois+G.&rft.au=Mastel%2C%26%2332%3BKristen+L.&rft.au=Kelly%2C%26%2332%3BJulia+A.&rft.date=15+December+2020&rft.volume=19&rft.issue=1&rft.pages=51&rft_id=info:doi\/10.5334%2Fdsj-2020-051&rft.issn=1683-1470&rft_id=https%3A%2F%2Fdatascience.codata.org%2Farticle%2F10.5334%2Fdsj-2020-051%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-4\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-4\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Johnson, Richard W. (1 May 1964). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/doi.apa.org\/getdoi.cfm?doi=10.1037\/h0039238\" target=\"_blank\">\"Retain the Original Data! Comment.\"<\/a> (in en). <i>American Psychologist<\/i> <b>19<\/b> (5): 350\u2013351. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1037%2Fh0039238\" target=\"_blank\">10.1037\/h0039238<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1935-990X\" target=\"_blank\">1935-990X<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/doi.apa.org\/getdoi.cfm?doi=10.1037\/h0039238\" target=\"_blank\">http:\/\/doi.apa.org\/getdoi.cfm?doi=10.1037\/h0039238<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Retain+the+Original+Data%21+Comment.&rft.jtitle=American+Psychologist&rft.aulast=Johnson&rft.aufirst=Richard+W.&rft.au=Johnson%2C%26%2332%3BRichard+W.&rft.date=1+May+1964&rft.volume=19&rft.issue=5&rft.pages=350%E2%80%93351&rft_id=info:doi\/10.1037%2Fh0039238&rft.issn=1935-990X&rft_id=http%3A%2F%2Fdoi.apa.org%2Fgetdoi.cfm%3Fdoi%3D10.1037%2Fh0039238&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:1-5\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:1_5-0\">5.0<\/a><\/sup> <sup><a href=\"#cite_ref-:1_5-1\">5.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Craig, James R.; Reese, Sandra C. (1 August 1973). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/doi.apa.org\/getdoi.cfm?doi=10.1037\/h0035667\" target=\"_blank\">\"Retention of raw data: A problem revisited.\"<\/a> (in en). <i>American Psychologist<\/i> <b>28<\/b> (8): 723\u2013723. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1037%2Fh0035667\" target=\"_blank\">10.1037\/h0035667<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1935-990X\" target=\"_blank\">1935-990X<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/doi.apa.org\/getdoi.cfm?doi=10.1037\/h0035667\" target=\"_blank\">http:\/\/doi.apa.org\/getdoi.cfm?doi=10.1037\/h0035667<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Retention+of+raw+data%3A+A+problem+revisited.&rft.jtitle=American+Psychologist&rft.aulast=Craig&rft.aufirst=James+R.&rft.au=Craig%2C%26%2332%3BJames+R.&rft.au=Reese%2C%26%2332%3BSandra+C.&rft.date=1+August+1973&rft.volume=28&rft.issue=8&rft.pages=723%E2%80%93723&rft_id=info:doi\/10.1037%2Fh0035667&rft.issn=1935-990X&rft_id=http%3A%2F%2Fdoi.apa.org%2Fgetdoi.cfm%3Fdoi%3D10.1037%2Fh0035667&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-6\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-6\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Wolins, Leroy (1 September 1962). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/doi.apa.org\/getdoi.cfm?doi=10.1037\/h0038819\" target=\"_blank\">\"Responsibility for Raw Data.\"<\/a> (in en). <i>American Psychologist<\/i> <b>17<\/b> (9): 657\u2013658. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1037%2Fh0038819\" target=\"_blank\">10.1037\/h0038819<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1935-990X\" target=\"_blank\">1935-990X<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/doi.apa.org\/getdoi.cfm?doi=10.1037\/h0038819\" target=\"_blank\">http:\/\/doi.apa.org\/getdoi.cfm?doi=10.1037\/h0038819<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Responsibility+for+Raw+Data.&rft.jtitle=American+Psychologist&rft.aulast=Wolins&rft.aufirst=Leroy&rft.au=Wolins%2C%26%2332%3BLeroy&rft.date=1+September+1962&rft.volume=17&rft.issue=9&rft.pages=657%E2%80%93658&rft_id=info:doi\/10.1037%2Fh0038819&rft.issn=1935-990X&rft_id=http%3A%2F%2Fdoi.apa.org%2Fgetdoi.cfm%3Fdoi%3D10.1037%2Fh0038819&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-7\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-7\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Buma, Brian (11 May 2018). Sills, Jennifer. ed. <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.science.org\/doi\/10.1126\/science.aat5382\" target=\"_blank\">\"The hidden value of paper records\"<\/a> (in en). <i>Science<\/i> <b>360<\/b> (6389): 613\u2013613. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1126%2Fscience.aat5382\" target=\"_blank\">10.1126\/science.aat5382<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0036-8075\" target=\"_blank\">0036-8075<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.science.org\/doi\/10.1126\/science.aat5382\" target=\"_blank\">https:\/\/www.science.org\/doi\/10.1126\/science.aat5382<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=The+hidden+value+of+paper+records&rft.jtitle=Science&rft.aulast=Buma&rft.aufirst=Brian&rft.au=Buma%2C%26%2332%3BBrian&rft.date=11+May+2018&rft.volume=360&rft.issue=6389&rft.pages=613%E2%80%93613&rft_id=info:doi\/10.1126%2Fscience.aat5382&rft.issn=0036-8075&rft_id=https%3A%2F%2Fwww.science.org%2Fdoi%2F10.1126%2Fscience.aat5382&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-8\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-8\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Buma, B.; Bisbing, S. M.; Wiles, G.; Bidlack, A. L. (1 December 2019). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/ecy.2885\" target=\"_blank\">\"100 yr of primary succession highlights stochasticity and competition driving community establishment and stability\"<\/a> (in en). <i>Ecology<\/i> <b>100<\/b> (12). <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1002%2Fecy.2885\" target=\"_blank\">10.1002\/ecy.2885<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0012-9658\" target=\"_blank\">0012-9658<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/ecy.2885\" target=\"_blank\">https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/ecy.2885<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=100+yr+of+primary+succession+highlights+stochasticity+and+competition+driving+community+establishment+and+stability&rft.jtitle=Ecology&rft.aulast=Buma&rft.aufirst=B.&rft.au=Buma%2C%26%2332%3BB.&rft.au=Bisbing%2C%26%2332%3BS.+M.&rft.au=Wiles%2C%26%2332%3BG.&rft.au=Bidlack%2C%26%2332%3BA.+L.&rft.date=1+December+2019&rft.volume=100&rft.issue=12&rft_id=info:doi\/10.1002%2Fecy.2885&rft.issn=0012-9658&rft_id=https%3A%2F%2Fonlinelibrary.wiley.com%2Fdoi%2F10.1002%2Fecy.2885&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:2-9\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:2_9-0\">9.0<\/a><\/sup> <sup><a href=\"#cite_ref-:2_9-1\">9.1<\/a><\/sup> <sup><a href=\"#cite_ref-:2_9-2\">9.2<\/a><\/sup> <sup><a href=\"#cite_ref-:2_9-3\">9.3<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation web\">Gross, K.L.; Pake, C.E. (1995). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/andrewsforest.oregonstate.edu\/publications\/2562\" target=\"_blank\">\"Final report of the Ecological Society of America committee on the future of Long-term Ecological Data (FLED): Volume I: text of the report\"<\/a>. The Ecological Society of America. pp. 122<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/andrewsforest.oregonstate.edu\/publications\/2562\" target=\"_blank\">https:\/\/andrewsforest.oregonstate.edu\/publications\/2562<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Final+report+of+the+Ecological+Society+of+America+committee+on+the+future+of+Long-term+Ecological+Data+%28FLED%29%3A+Volume+I%3A+text+of+the+report&rft.atitle=&rft.aulast=Gross%2C+K.L.%3B+Pake%2C+C.E.&rft.au=Gross%2C+K.L.%3B+Pake%2C+C.E.&rft.date=1995&rft.pages=pp.+122&rft.pub=The+Ecological+Society+of+America&rft_id=https%3A%2F%2Fandrewsforest.oregonstate.edu%2Fpublications%2F2562&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:3-10\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:3_10-0\">10.0<\/a><\/sup> <sup><a href=\"#cite_ref-:3_10-1\">10.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation book\">National Research Council (27 April 1995). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.nap.edu\/catalog\/4896\" target=\"_blank\"><i>Finding the Forest in the Trees: The Challenge of Combining Diverse Environmental Data<\/i><\/a>. Washington, D.C.: National Academies Press. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.17226%2F4896\" target=\"_blank\">10.17226\/4896<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-0-309-05082-1<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/www.nap.edu\/catalog\/4896\" target=\"_blank\">http:\/\/www.nap.edu\/catalog\/4896<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=book&rft.btitle=Finding+the+Forest+in+the+Trees%3A+The+Challenge+of+Combining+Diverse+Environmental+Data&rft.aulast=National+Research+Council&rft.au=National+Research+Council&rft.date=27+April+1995&rft.place=Washington%2C+D.C.&rft.pub=National+Academies+Press&rft_id=info:doi\/10.17226%2F4896&rft.isbn=978-0-309-05082-1&rft_id=http%3A%2F%2Fwww.nap.edu%2Fcatalog%2F4896&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:4-11\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:4_11-0\">11.0<\/a><\/sup> <sup><a href=\"#cite_ref-:4_11-1\">11.1<\/a><\/sup> <sup><a href=\"#cite_ref-:4_11-2\">11.2<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation book\">National Research Council (19 April 1995). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.nap.edu\/catalog\/4871\" target=\"_blank\"><i>Preserving Scientific Data on Our Physical Universe: A New Strategy for Archiving the Nation's Scientific Information Resources<\/i><\/a>. Washington, D.C.: National Academies Press. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.17226%2F4871\" target=\"_blank\">10.17226\/4871<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-0-309-05186-6<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/www.nap.edu\/catalog\/4871\" target=\"_blank\">http:\/\/www.nap.edu\/catalog\/4871<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=book&rft.btitle=Preserving+Scientific+Data+on+Our+Physical+Universe%3A+A+New+Strategy+for+Archiving+the+Nation%27s+Scientific+Information+Resources&rft.aulast=National+Research+Council&rft.au=National+Research+Council&rft.date=19+April+1995&rft.place=Washington%2C+D.C.&rft.pub=National+Academies+Press&rft_id=info:doi\/10.17226%2F4871&rft.isbn=978-0-309-05186-6&rft_id=http%3A%2F%2Fwww.nap.edu%2Fcatalog%2F4871&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:5-12\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:5_12-0\">12.0<\/a><\/sup> <sup><a href=\"#cite_ref-:5_12-1\">12.1<\/a><\/sup> <sup><a href=\"#cite_ref-:5_12-2\">12.2<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Easterday, Kelly; Paulson, Tim; DasMohapatra, Proxima; Alagona, Peter; Feirer, Shane; Kelly, Maggi (1 October 2018). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.frontiersin.org\/article\/10.3389\/fenvs.2018.00088\/full\" target=\"_blank\">\"From the Field to the Cloud: A Review of Three Approaches to Sharing Historical Data From Field Stations Using Principles From Data Science\"<\/a>. <i>Frontiers in Environmental Science<\/i> <b>6<\/b>: 88. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.3389%2Ffenvs.2018.00088\" target=\"_blank\">10.3389\/fenvs.2018.00088<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2296-665X\" target=\"_blank\">2296-665X<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.frontiersin.org\/article\/10.3389\/fenvs.2018.00088\/full\" target=\"_blank\">https:\/\/www.frontiersin.org\/article\/10.3389\/fenvs.2018.00088\/full<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=From+the+Field+to+the+Cloud%3A+A+Review+of+Three+Approaches+to+Sharing+Historical+Data+From+Field+Stations+Using+Principles+From+Data+Science&rft.jtitle=Frontiers+in+Environmental+Science&rft.aulast=Easterday&rft.aufirst=Kelly&rft.au=Easterday%2C%26%2332%3BKelly&rft.au=Paulson%2C%26%2332%3BTim&rft.au=DasMohapatra%2C%26%2332%3BProxima&rft.au=Alagona%2C%26%2332%3BPeter&rft.au=Feirer%2C%26%2332%3BShane&rft.au=Kelly%2C%26%2332%3BMaggi&rft.date=1+October+2018&rft.volume=6&rft.pages=88&rft_id=info:doi\/10.3389%2Ffenvs.2018.00088&rft.issn=2296-665X&rft_id=https%3A%2F%2Fwww.frontiersin.org%2Farticle%2F10.3389%2Ffenvs.2018.00088%2Ffull&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:6-13\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:6_13-0\">13.0<\/a><\/sup> <sup><a href=\"#cite_ref-:6_13-1\">13.1<\/a><\/sup> <sup><a href=\"#cite_ref-:6_13-2\">13.2<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation book\">Berman, J.J. (2015). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/C20140025014\" target=\"_blank\"><i>Repurposing Legacy Data<\/i><\/a>. Elsevier. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fc2014-0-02501-4\" target=\"_blank\">10.1016\/c2014-0-02501-4<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-0-12-802882-7<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/C20140025014\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/C20140025014<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=book&rft.btitle=Repurposing+Legacy+Data&rft.aulast=Berman%2C+J.J.&rft.au=Berman%2C+J.J.&rft.date=2015&rft.pub=Elsevier&rft_id=info:doi\/10.1016%2Fc2014-0-02501-4&rft.isbn=978-0-12-802882-7&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FC20140025014&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-14\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-14\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Elizabeth Griffin, R. (1 June 2015). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2214242815000121\" target=\"_blank\">\"When are Old Data New Data?\"<\/a> (in en). <i>GeoResJ<\/i> <b>6<\/b>: 92\u201397. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.grj.2015.02.004\" target=\"_blank\">10.1016\/j.grj.2015.02.004<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2214242815000121\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2214242815000121<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=When+are+Old+Data+New+Data%3F&rft.jtitle=GeoResJ&rft.aulast=Elizabeth+Griffin&rft.aufirst=R.&rft.au=Elizabeth+Griffin%2C%26%2332%3BR.&rft.date=1+June+2015&rft.volume=6&rft.pages=92%E2%80%9397&rft_id=info:doi\/10.1016%2Fj.grj.2015.02.004&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS2214242815000121&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-GriffinData15-15\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-GriffinData15_15-0\">15.0<\/a><\/sup> <sup><a href=\"#cite_ref-GriffinData15_15-1\">15.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation web\">Griffin, E. (2 July 2015). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/codata.org\/blog\/2015\/07\/02\/data-at-risk-and-data-rescue\/\" target=\"_blank\">\"Data at Risk and Data Rescue\"<\/a>. <i>CODATA Blog<\/i><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/codata.org\/blog\/2015\/07\/02\/data-at-risk-and-data-rescue\/\" target=\"_blank\">https:\/\/codata.org\/blog\/2015\/07\/02\/data-at-risk-and-data-rescue\/<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Data+at+Risk+and+Data+Rescue&rft.atitle=CODATA+Blog&rft.aulast=Griffin%2C+E.&rft.au=Griffin%2C+E.&rft.date=2+July+2015&rft_id=https%3A%2F%2Fcodata.org%2Fblog%2F2015%2F07%2F02%2Fdata-at-risk-and-data-rescue%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-16\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-16\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Patil, Chris; Siegel, Vivian (5 November 2009). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/journals.biologists.com\/dmm\/article\/2\/11-12\/521\/2278\/Shining-a-light-on-dark-data\" target=\"_blank\">\"Shining a light on dark data\"<\/a> (in en). <i>Disease Models & Mechanisms<\/i> <b>2<\/b> (11-12): 521\u2013525. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1242%2Fdmm.004630\" target=\"_blank\">10.1242\/dmm.004630<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1754-8411\" target=\"_blank\">1754-8411<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC2773820\/\" target=\"_blank\">PMC2773820<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/19892880\" target=\"_blank\">19892880<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/journals.biologists.com\/dmm\/article\/2\/11-12\/521\/2278\/Shining-a-light-on-dark-data\" target=\"_blank\">https:\/\/journals.biologists.com\/dmm\/article\/2\/11-12\/521\/2278\/Shining-a-light-on-dark-data<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Shining+a+light+on+dark+data&rft.jtitle=Disease+Models+%26+Mechanisms&rft.aulast=Patil&rft.aufirst=Chris&rft.au=Patil%2C%26%2332%3BChris&rft.au=Siegel%2C%26%2332%3BVivian&rft.date=5+November+2009&rft.volume=2&rft.issue=11-12&rft.pages=521%E2%80%93525&rft_id=info:doi\/10.1242%2Fdmm.004630&rft.issn=1754-8411&rft_id=info:pmc\/PMC2773820&rft_id=info:pmid\/19892880&rft_id=https%3A%2F%2Fjournals.biologists.com%2Fdmm%2Farticle%2F2%2F11-12%2F521%2F2278%2FShining-a-light-on-dark-data&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-17\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-17\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Singer, Randal A.; Ellis, Shari; Page, Lawrence M. (1 February 2020). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/jfb.14167\" target=\"_blank\">\"Awareness and use of biodiversity collections by fish biologists\"<\/a> (in en). <i>Journal of Fish Biology<\/i> <b>96<\/b> (2): 297\u2013306. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1111%2Fjfb.14167\" target=\"_blank\">10.1111\/jfb.14167<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0022-1112\" target=\"_blank\">0022-1112<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/jfb.14167\" target=\"_blank\">https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/jfb.14167<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Awareness+and+use+of+biodiversity+collections+by+fish+biologists&rft.jtitle=Journal+of+Fish+Biology&rft.aulast=Singer&rft.aufirst=Randal+A.&rft.au=Singer%2C%26%2332%3BRandal+A.&rft.au=Ellis%2C%26%2332%3BShari&rft.au=Page%2C%26%2332%3BLawrence+M.&rft.date=1+February+2020&rft.volume=96&rft.issue=2&rft.pages=297%E2%80%93306&rft_id=info:doi\/10.1111%2Fjfb.14167&rft.issn=0022-1112&rft_id=https%3A%2F%2Fonlinelibrary.wiley.com%2Fdoi%2F10.1111%2Fjfb.14167&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:7-18\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:7_18-0\">18.0<\/a><\/sup> <sup><a href=\"#cite_ref-:7_18-1\">18.1<\/a><\/sup> <sup><a href=\"#cite_ref-:7_18-2\">18.2<\/a><\/sup> <sup><a href=\"#cite_ref-:7_18-3\">18.3<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation book\">Bowser, C.J. (1986). \"Historic data sets: Lessons from the past, lessons for the future\". In Michener, William K.; Belle W. Baruch Institute for Marine Biology and Coastal Research. <i>Research data management in the ecological sciences<\/i>. The Belle W. Baruch library in marine science (1st ed ed.). Columbia, S.C: Published for the Belle W. Baruch Institute for Marine Biology and Coastal Research by the University of South Carolina Press. pp. 155\u201379. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-0-87249-476-3.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Historic+data+sets%3A+Lessons+from+the+past%2C+lessons+for+the+future&rft.atitle=Research+data+management+in+the+ecological+sciences&rft.aulast=Bowser%2C+C.J.&rft.au=Bowser%2C+C.J.&rft.date=1986&rft.series=The+Belle+W.+Baruch+library+in+marine+science&rft.pages=pp.%26nbsp%3B155%E2%80%9379&rft.edition=1st+ed&rft.place=Columbia%2C+S.C&rft.pub=Published+for+the+Belle+W.+Baruch+Institute+for+Marine+Biology+and+Coastal+Research+by+the+University+of+South+Carolina+Press&rft.isbn=978-0-87249-476-3&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-19\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-19\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Michener, William K.; Bildstein, Keith L.; McKee, Arthur; Parmenter, Robert R.; Hargrove, William W.; McClearn, Deedra; Stromberg, Mark (1 April 2009). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/academic.oup.com\/bioscience\/article-lookup\/doi\/10.1525\/bio.2009.59.4.8\" target=\"_blank\">\"Biological Field Stations: Research Legacies and Sites for Serendipity\"<\/a> (in en). <i>BioScience<\/i> <b>59<\/b> (4): 300\u2013310. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1525%2Fbio.2009.59.4.8\" target=\"_blank\">10.1525\/bio.2009.59.4.8<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0006-3568\" target=\"_blank\">0006-3568<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/academic.oup.com\/bioscience\/article-lookup\/doi\/10.1525\/bio.2009.59.4.8\" target=\"_blank\">https:\/\/academic.oup.com\/bioscience\/article-lookup\/doi\/10.1525\/bio.2009.59.4.8<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Biological+Field+Stations%3A+Research+Legacies+and+Sites+for+Serendipity&rft.jtitle=BioScience&rft.aulast=Michener&rft.aufirst=William+K.&rft.au=Michener%2C%26%2332%3BWilliam+K.&rft.au=Bildstein%2C%26%2332%3BKeith+L.&rft.au=McKee%2C%26%2332%3BArthur&rft.au=Parmenter%2C%26%2332%3BRobert+R.&rft.au=Hargrove%2C%26%2332%3BWilliam+W.&rft.au=McClearn%2C%26%2332%3BDeedra&rft.au=Stromberg%2C%26%2332%3BMark&rft.date=1+April+2009&rft.volume=59&rft.issue=4&rft.pages=300%E2%80%93310&rft_id=info:doi\/10.1525%2Fbio.2009.59.4.8&rft.issn=0006-3568&rft_id=https%3A%2F%2Facademic.oup.com%2Fbioscience%2Farticle-lookup%2Fdoi%2F10.1525%2Fbio.2009.59.4.8&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:8-20\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:8_20-0\">20.0<\/a><\/sup> <sup><a href=\"#cite_ref-:8_20-1\">20.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Beans, Carolyn (26 December 2018). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/pnas.org\/doi\/full\/10.1073\/pnas.1819526115\" target=\"_blank\">\"Journal entries, maps, and photos help ecologists reconstruct ecosystems of the past\"<\/a> (in en). <i>Proceedings of the National Academy of Sciences<\/i> <b>115<\/b> (52): 13138\u201313141. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1073%2Fpnas.1819526115\" target=\"_blank\">10.1073\/pnas.1819526115<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0027-8424\" target=\"_blank\">0027-8424<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC6310833\/\" target=\"_blank\">PMC6310833<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/30587550\" target=\"_blank\">30587550<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/pnas.org\/doi\/full\/10.1073\/pnas.1819526115\" target=\"_blank\">https:\/\/pnas.org\/doi\/full\/10.1073\/pnas.1819526115<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Journal+entries%2C+maps%2C+and+photos+help+ecologists+reconstruct+ecosystems+of+the+past&rft.jtitle=Proceedings+of+the+National+Academy+of+Sciences&rft.aulast=Beans&rft.aufirst=Carolyn&rft.au=Beans%2C%26%2332%3BCarolyn&rft.date=26+December+2018&rft.volume=115&rft.issue=52&rft.pages=13138%E2%80%9313141&rft_id=info:doi\/10.1073%2Fpnas.1819526115&rft.issn=0027-8424&rft_id=info:pmc\/PMC6310833&rft_id=info:pmid\/30587550&rft_id=https%3A%2F%2Fpnas.org%2Fdoi%2Ffull%2F10.1073%2Fpnas.1819526115&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-21\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-21\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">McCLENACHAN, Loren (1 June 2009). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/j.1523-1739.2008.01152.x\" target=\"_blank\">\"Documenting Loss of Large Trophy Fish from the Florida Keys with Historical Photographs\"<\/a> (in en). <i>Conservation Biology<\/i> <b>23<\/b> (3): 636\u2013643. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1111%2Fj.1523-1739.2008.01152.x\" target=\"_blank\">10.1111\/j.1523-1739.2008.01152.x<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/j.1523-1739.2008.01152.x\" target=\"_blank\">https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/j.1523-1739.2008.01152.x<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Documenting+Loss+of+Large+Trophy+Fish+from+the+Florida+Keys+with+Historical+Photographs&rft.jtitle=Conservation+Biology&rft.aulast=McCLENACHAN&rft.aufirst=Loren&rft.au=McCLENACHAN%2C%26%2332%3BLoren&rft.date=1+June+2009&rft.volume=23&rft.issue=3&rft.pages=636%E2%80%93643&rft_id=info:doi\/10.1111%2Fj.1523-1739.2008.01152.x&rft_id=https%3A%2F%2Fonlinelibrary.wiley.com%2Fdoi%2F10.1111%2Fj.1523-1739.2008.01152.x&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-22\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-22\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">McClenachan, Loren; Ferretti, Francesco; Baum, Julia K. (1 October 2012). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/j.1755-263X.2012.00253.x\" target=\"_blank\">\"From archives to conservation: why historical data are needed to set baselines for marine animals and ecosystems\"<\/a> (in en). <i>Conservation Letters<\/i> <b>5<\/b> (5): 349\u2013359. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1111%2Fj.1755-263X.2012.00253.x\" target=\"_blank\">10.1111\/j.1755-263X.2012.00253.x<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1755-263X\" target=\"_blank\">1755-263X<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/j.1755-263X.2012.00253.x\" target=\"_blank\">https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/j.1755-263X.2012.00253.x<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=From+archives+to+conservation%3A+why+historical+data+are+needed+to+set+baselines+for+marine+animals+and+ecosystems&rft.jtitle=Conservation+Letters&rft.aulast=McClenachan&rft.aufirst=Loren&rft.au=McClenachan%2C%26%2332%3BLoren&rft.au=Ferretti%2C%26%2332%3BFrancesco&rft.au=Baum%2C%26%2332%3BJulia+K.&rft.date=1+October+2012&rft.volume=5&rft.issue=5&rft.pages=349%E2%80%93359&rft_id=info:doi\/10.1111%2Fj.1755-263X.2012.00253.x&rft.issn=1755-263X&rft_id=https%3A%2F%2Fonlinelibrary.wiley.com%2Fdoi%2F10.1111%2Fj.1755-263X.2012.00253.x&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-23\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-23\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">McClenachan, Loren; O\u2019Connor, Grace; Neal, Benjamin P.; Pandolfi, John M.; Jackson, Jeremy B. C. (1 September 2017). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.science.org\/doi\/10.1126\/sciadv.1603155\" target=\"_blank\">\"Ghost reefs: Nautical charts document large spatial scale of coral reef loss over 240 years\"<\/a> (in en). <i>Science Advances<\/i> <b>3<\/b> (9): e1603155. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1126%2Fsciadv.1603155\" target=\"_blank\">10.1126\/sciadv.1603155<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2375-2548\" target=\"_blank\">2375-2548<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC5587093\/\" target=\"_blank\">PMC5587093<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/28913420\" target=\"_blank\">28913420<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.science.org\/doi\/10.1126\/sciadv.1603155\" target=\"_blank\">https:\/\/www.science.org\/doi\/10.1126\/sciadv.1603155<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Ghost+reefs%3A+Nautical+charts+document+large+spatial+scale+of+coral+reef+loss+over+240+years&rft.jtitle=Science+Advances&rft.aulast=McClenachan&rft.aufirst=Loren&rft.au=McClenachan%2C%26%2332%3BLoren&rft.au=O%E2%80%99Connor%2C%26%2332%3BGrace&rft.au=Neal%2C%26%2332%3BBenjamin+P.&rft.au=Pandolfi%2C%26%2332%3BJohn+M.&rft.au=Jackson%2C%26%2332%3BJeremy+B.+C.&rft.date=1+September+2017&rft.volume=3&rft.issue=9&rft.pages=e1603155&rft_id=info:doi\/10.1126%2Fsciadv.1603155&rft.issn=2375-2548&rft_id=info:pmc\/PMC5587093&rft_id=info:pmid\/28913420&rft_id=https%3A%2F%2Fwww.science.org%2Fdoi%2F10.1126%2Fsciadv.1603155&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-24\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-24\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Olson, D.; McCord, R. (August 1997). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.vcrlter.virginia.edu\/dimes\/presentations\/OLSON\/sld001.htm\" target=\"_blank\">\"Data Archival: Sharing Yesterday's Data for Ecology Today and Tomorrow\"<\/a>. <i>Data and Information Management in the Ecological Sciences<\/i>. Oak Ridge National Laboratory. pp. 53\u20138<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.vcrlter.virginia.edu\/dimes\/presentations\/OLSON\/sld001.htm\" target=\"_blank\">https:\/\/www.vcrlter.virginia.edu\/dimes\/presentations\/OLSON\/sld001.htm<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Data+Archival%3A+Sharing+Yesterday%27s+Data+for+Ecology+Today+and+Tomorrow&rft.atitle=Data+and+Information+Management+in+the+Ecological+Sciences&rft.aulast=Olson%2C+D.%3B+McCord%2C+R.&rft.au=Olson%2C+D.%3B+McCord%2C+R.&rft.date=August+1997&rft.pages=pp.+53%E2%80%938&rft.pub=Oak+Ridge+National+Laboratory&rft_id=https%3A%2F%2Fwww.vcrlter.virginia.edu%2Fdimes%2Fpresentations%2FOLSON%2Fsld001.htm&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-25\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-25\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation book\">Olson, R.J.; McCord, R.A. (2000). \"Archiving ecological data and information\". In Michener, William K.; Brunt, James W.. <i>Ecological data: Design, management, and processing<\/i>. Malden, MA: Blackwell Science. pp. 117\u201341. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-0-632-05231-8.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Archiving+ecological+data+and+information&rft.atitle=Ecological+data%3A+Design%2C+management%2C+and+processing&rft.aulast=Olson%2C+R.J.%3B+McCord%2C+R.A.&rft.au=Olson%2C+R.J.%3B+McCord%2C+R.A.&rft.date=2000&rft.pages=pp.%26nbsp%3B117%E2%80%9341&rft.place=Malden%2C+MA&rft.pub=Blackwell+Science&rft.isbn=978-0-632-05231-8&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-26\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-26\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Kwok, Roberta (21 September 2017). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.nature.com\/articles\/nj7672-419\" target=\"_blank\">\"Historical data: Hidden in the past\"<\/a> (in en). <i>Nature<\/i> <b>549<\/b> (7672): 419\u2013421. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1038%2Fnj7672-419\" target=\"_blank\">10.1038\/nj7672-419<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0028-0836\" target=\"_blank\">0028-0836<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/www.nature.com\/articles\/nj7672-419\" target=\"_blank\">http:\/\/www.nature.com\/articles\/nj7672-419<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Historical+data%3A+Hidden+in+the+past&rft.jtitle=Nature&rft.aulast=Kwok&rft.aufirst=Roberta&rft.au=Kwok%2C%26%2332%3BRoberta&rft.date=21+September+2017&rft.volume=549&rft.issue=7672&rft.pages=419%E2%80%93421&rft_id=info:doi\/10.1038%2Fnj7672-419&rft.issn=0028-0836&rft_id=http%3A%2F%2Fwww.nature.com%2Farticles%2Fnj7672-419&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-27\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-27\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Br\u00f6nnimann, Stefan; Brugnara, Yuri; Allan, Rob J.; Brunet, Manola; Compo, Gilbert P.; Crouthamel, Richard I.; Jones, Philip D.; Jourdain, Sylvie <i>et al.<\/i> (1 June 2018). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/gdj3.56\" target=\"_blank\">\"A roadmap to climate data rescue services\"<\/a> (in en). <i>Geoscience Data Journal<\/i> <b>5<\/b> (1): 28\u201339. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1002%2Fgdj3.56\" target=\"_blank\">10.1002\/gdj3.56<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/gdj3.56\" target=\"_blank\">https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/gdj3.56<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=A+roadmap+to+climate+data+rescue+services&rft.jtitle=Geoscience+Data+Journal&rft.aulast=Br%C3%B6nnimann&rft.aufirst=Stefan&rft.au=Br%C3%B6nnimann%2C%26%2332%3BStefan&rft.au=Brugnara%2C%26%2332%3BYuri&rft.au=Allan%2C%26%2332%3BRob+J.&rft.au=Brunet%2C%26%2332%3BManola&rft.au=Compo%2C%26%2332%3BGilbert+P.&rft.au=Crouthamel%2C%26%2332%3BRichard+I.&rft.au=Jones%2C%26%2332%3BPhilip+D.&rft.au=Jourdain%2C%26%2332%3BSylvie&rft.au=Luterbacher%2C%26%2332%3BJ%C3%BCrg&rft.date=1+June+2018&rft.volume=5&rft.issue=1&rft.pages=28%E2%80%9339&rft_id=info:doi\/10.1002%2Fgdj3.56&rft_id=https%3A%2F%2Fonlinelibrary.wiley.com%2Fdoi%2F10.1002%2Fgdj3.56&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-28\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-28\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Diviacco, Paolo; Wardell, Nigel; Forlin, Edy; Sauli, Chiara; Burca, Mihai; Busato, Alessandro; Centonze, Jacques; Pelos, Claudio (1 June 2015). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2214242815000078\" target=\"_blank\">\"Data rescue to extend the value of vintage seismic data: The OGS-SNAP experience\"<\/a> (in en). <i>GeoResJ<\/i> <b>6<\/b>: 44\u201352. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.grj.2015.01.006\" target=\"_blank\">10.1016\/j.grj.2015.01.006<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2214242815000078\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2214242815000078<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Data+rescue+to+extend+the+value+of+vintage+seismic+data%3A+The+OGS-SNAP+experience&rft.jtitle=GeoResJ&rft.aulast=Diviacco&rft.aufirst=Paolo&rft.au=Diviacco%2C%26%2332%3BPaolo&rft.au=Wardell%2C%26%2332%3BNigel&rft.au=Forlin%2C%26%2332%3BEdy&rft.au=Sauli%2C%26%2332%3BChiara&rft.au=Burca%2C%26%2332%3BMihai&rft.au=Busato%2C%26%2332%3BAlessandro&rft.au=Centonze%2C%26%2332%3BJacques&rft.au=Pelos%2C%26%2332%3BClaudio&rft.date=1+June+2015&rft.volume=6&rft.pages=44%E2%80%9352&rft_id=info:doi\/10.1016%2Fj.grj.2015.01.006&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS2214242815000078&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-29\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-29\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Vearncombe, J.; Conner, G.; Bright, S. (1 October 2016). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.tandfonline.com\/doi\/full\/10.1080\/03717453.2016.1190442\" target=\"_blank\">\"Value from legacy data\"<\/a> (in en). <i>Applied Earth Science<\/i> <b>125<\/b> (4): 231\u2013246. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1080%2F03717453.2016.1190442\" target=\"_blank\">10.1080\/03717453.2016.1190442<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0371-7453\" target=\"_blank\">0371-7453<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.tandfonline.com\/doi\/full\/10.1080\/03717453.2016.1190442\" target=\"_blank\">https:\/\/www.tandfonline.com\/doi\/full\/10.1080\/03717453.2016.1190442<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Value+from+legacy+data&rft.jtitle=Applied+Earth+Science&rft.aulast=Vearncombe&rft.aufirst=J.&rft.au=Vearncombe%2C%26%2332%3BJ.&rft.au=Conner%2C%26%2332%3BG.&rft.au=Bright%2C%26%2332%3BS.&rft.date=1+October+2016&rft.volume=125&rft.issue=4&rft.pages=231%E2%80%93246&rft_id=info:doi\/10.1080%2F03717453.2016.1190442&rft.issn=0371-7453&rft_id=https%3A%2F%2Fwww.tandfonline.com%2Fdoi%2Ffull%2F10.1080%2F03717453.2016.1190442&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-30\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-30\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Vearncombe, Julian; Riganti, Angela; Isles, David; Bright, Sian (1 October 2017). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0169136817305243\" target=\"_blank\">\"Data upcycling\"<\/a> (in en). <i>Ore Geology Reviews<\/i> <b>89<\/b>: 887\u2013893. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.oregeorev.2017.07.009\" target=\"_blank\">10.1016\/j.oregeorev.2017.07.009<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0169136817305243\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0169136817305243<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Data+upcycling&rft.jtitle=Ore+Geology+Reviews&rft.aulast=Vearncombe&rft.aufirst=Julian&rft.au=Vearncombe%2C%26%2332%3BJulian&rft.au=Riganti%2C%26%2332%3BAngela&rft.au=Isles%2C%26%2332%3BDavid&rft.au=Bright%2C%26%2332%3BSian&rft.date=1+October+2017&rft.volume=89&rft.pages=887%E2%80%93893&rft_id=info:doi\/10.1016%2Fj.oregeorev.2017.07.009&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS0169136817305243&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-31\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-31\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Clavero, Miguel; Revilla, Eloy (1 June 2014). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.nature.com\/articles\/510035c\" target=\"_blank\">\"Bodiversity data: Mine centuries-old citizen science\"<\/a> (in en). <i>Nature<\/i> <b>510<\/b> (7503): 35\u201335. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1038%2F510035c\" target=\"_blank\">10.1038\/510035c<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0028-0836\" target=\"_blank\">0028-0836<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/www.nature.com\/articles\/510035c\" target=\"_blank\">http:\/\/www.nature.com\/articles\/510035c<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Bodiversity+data%3A+Mine+centuries-old+citizen+science&rft.jtitle=Nature&rft.aulast=Clavero&rft.aufirst=Miguel&rft.au=Clavero%2C%26%2332%3BMiguel&rft.au=Revilla%2C%26%2332%3BEloy&rft.date=1+June+2014&rft.volume=510&rft.issue=7503&rft.pages=35%E2%80%9335&rft_id=info:doi\/10.1038%2F510035c&rft.issn=0028-0836&rft_id=http%3A%2F%2Fwww.nature.com%2Farticles%2F510035c&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-32\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-32\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Clavero, Miguel; Ninyerola, Miquel; Hermoso, Virgilio; Filipe, Ana Filipa; Pla, Magda; Villero, Daniel; Brotons, Llu\u00eds; Delibes, Miguel (11 January 2017). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/royalsocietypublishing.org\/doi\/10.1098\/rspb.2016.1979\" target=\"_blank\">\"Historical citizen science to understand and predict climate-driven trout decline\"<\/a> (in en). <i>Proceedings of the Royal Society B: Biological Sciences<\/i> <b>284<\/b> (1846): 20161979. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1098%2Frspb.2016.1979\" target=\"_blank\">10.1098\/rspb.2016.1979<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0962-8452\" target=\"_blank\">0962-8452<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC5247491\/\" target=\"_blank\">PMC5247491<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/28077766\" target=\"_blank\">28077766<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/royalsocietypublishing.org\/doi\/10.1098\/rspb.2016.1979\" target=\"_blank\">https:\/\/royalsocietypublishing.org\/doi\/10.1098\/rspb.2016.1979<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Historical+citizen+science+to+understand+and+predict+climate-driven+trout+decline&rft.jtitle=Proceedings+of+the+Royal+Society+B%3A+Biological+Sciences&rft.aulast=Clavero&rft.aufirst=Miguel&rft.au=Clavero%2C%26%2332%3BMiguel&rft.au=Ninyerola%2C%26%2332%3BMiquel&rft.au=Hermoso%2C%26%2332%3BVirgilio&rft.au=Filipe%2C%26%2332%3BAna+Filipa&rft.au=Pla%2C%26%2332%3BMagda&rft.au=Villero%2C%26%2332%3BDaniel&rft.au=Brotons%2C%26%2332%3BLlu%C3%ADs&rft.au=Delibes%2C%26%2332%3BMiguel&rft.date=11+January+2017&rft.volume=284&rft.issue=1846&rft.pages=20161979&rft_id=info:doi\/10.1098%2Frspb.2016.1979&rft.issn=0962-8452&rft_id=info:pmc\/PMC5247491&rft_id=info:pmid\/28077766&rft_id=https%3A%2F%2Froyalsocietypublishing.org%2Fdoi%2F10.1098%2Frspb.2016.1979&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:9-33\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:9_33-0\">33.0<\/a><\/sup> <sup><a href=\"#cite_ref-:9_33-1\">33.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Hof, Anouschka R.; Bright, Paul W. (1 August 2016). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/link.springer.com\/10.1007\/s10344-016-1013-1\" target=\"_blank\">\"Quantifying the long-term decline of the West European hedgehog in England by subsampling citizen-science datasets\"<\/a> (in en). <i>European Journal of Wildlife Research<\/i> <b>62<\/b> (4): 407\u2013413. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1007%2Fs10344-016-1013-1\" target=\"_blank\">10.1007\/s10344-016-1013-1<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1612-4642\" target=\"_blank\">1612-4642<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/link.springer.com\/10.1007\/s10344-016-1013-1\" target=\"_blank\">http:\/\/link.springer.com\/10.1007\/s10344-016-1013-1<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Quantifying+the+long-term+decline+of+the+West+European+hedgehog+in+England+by+subsampling+citizen-science+datasets&rft.jtitle=European+Journal+of+Wildlife+Research&rft.aulast=Hof&rft.aufirst=Anouschka+R.&rft.au=Hof%2C%26%2332%3BAnouschka+R.&rft.au=Bright%2C%26%2332%3BPaul+W.&rft.date=1+August+2016&rft.volume=62&rft.issue=4&rft.pages=407%E2%80%93413&rft_id=info:doi\/10.1007%2Fs10344-016-1013-1&rft.issn=1612-4642&rft_id=http%3A%2F%2Flink.springer.com%2F10.1007%2Fs10344-016-1013-1&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-34\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-34\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Sn\u00e4ll, Tord; Kindvall, Oskar; Nilsson, Johan; P\u00e4rt, Tomas (1 February 2011). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0006320710004805\" target=\"_blank\">\"Evaluating citizen-based presence data for bird monitoring\"<\/a> (in en). <i>Biological Conservation<\/i> <b>144<\/b> (2): 804\u2013810. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.biocon.2010.11.010\" target=\"_blank\">10.1016\/j.biocon.2010.11.010<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0006320710004805\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0006320710004805<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Evaluating+citizen-based+presence+data+for+bird+monitoring&rft.jtitle=Biological+Conservation&rft.aulast=Sn%C3%A4ll&rft.aufirst=Tord&rft.au=Sn%C3%A4ll%2C%26%2332%3BTord&rft.au=Kindvall%2C%26%2332%3BOskar&rft.au=Nilsson%2C%26%2332%3BJohan&rft.au=P%C3%A4rt%2C%26%2332%3BTomas&rft.date=1+February+2011&rft.volume=144&rft.issue=2&rft.pages=804%E2%80%93810&rft_id=info:doi\/10.1016%2Fj.biocon.2010.11.010&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS0006320710004805&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-TallantUnearth22-35\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-TallantUnearth22_35-0\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Tallant, J.; Schell, J.; Hovinga, K.; Stuit, M. (2022). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.zooniverse.org\/projects\/jmschell\/unearthing-michigan-ecological-data\/about\/faq\" target=\"_blank\">\"Unearthing Michigan Ecological Data - FAQ\"<\/a>. <i>Zooniverse<\/i><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.zooniverse.org\/projects\/jmschell\/unearthing-michigan-ecological-data\/about\/faq\" target=\"_blank\">https:\/\/www.zooniverse.org\/projects\/jmschell\/unearthing-michigan-ecological-data\/about\/faq<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Unearthing+Michigan+Ecological+Data+-+FAQ&rft.atitle=Zooniverse&rft.aulast=Tallant%2C+J.%3B+Schell%2C+J.%3B+Hovinga%2C+K.%3B+Stuit%2C+M.&rft.au=Tallant%2C+J.%3B+Schell%2C+J.%3B+Hovinga%2C+K.%3B+Stuit%2C+M.&rft.date=2022&rft_id=https%3A%2F%2Fwww.zooniverse.org%2Fprojects%2Fjmschell%2Funearthing-michigan-ecological-data%2Fabout%2Ffaq&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-36\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-36\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Nelson, Gil; Ellis, Shari (7 January 2019). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/royalsocietypublishing.org\/doi\/10.1098\/rstb.2017.0391\" target=\"_blank\">\"The history and impact of digitization and digital data mobilization on biodiversity research\"<\/a> (in en). <i>Philosophical Transactions of the Royal Society B: Biological Sciences<\/i> <b>374<\/b> (1763): 20170391. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1098%2Frstb.2017.0391\" target=\"_blank\">10.1098\/rstb.2017.0391<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0962-8436\" target=\"_blank\">0962-8436<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC6282090\/\" target=\"_blank\">PMC6282090<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/30455209\" target=\"_blank\">30455209<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/royalsocietypublishing.org\/doi\/10.1098\/rstb.2017.0391\" target=\"_blank\">https:\/\/royalsocietypublishing.org\/doi\/10.1098\/rstb.2017.0391<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=The+history+and+impact+of+digitization+and+digital+data+mobilization+on+biodiversity+research&rft.jtitle=Philosophical+Transactions+of+the+Royal+Society+B%3A+Biological+Sciences&rft.aulast=Nelson&rft.aufirst=Gil&rft.au=Nelson%2C%26%2332%3BGil&rft.au=Ellis%2C%26%2332%3BShari&rft.date=7+January+2019&rft.volume=374&rft.issue=1763&rft.pages=20170391&rft_id=info:doi\/10.1098%2Frstb.2017.0391&rft.issn=0962-8436&rft_id=info:pmc\/PMC6282090&rft_id=info:pmid\/30455209&rft_id=https%3A%2F%2Froyalsocietypublishing.org%2Fdoi%2F10.1098%2Frstb.2017.0391&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-37\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-37\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation\" id=\"rdp-ebb-CITEREFPattonNyrenNyrenSedivec\">Patton, Bob; Nyren, Paul; Nyren, Ann; Sedivec, Kevin (2022), <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/data.nal.usda.gov\/node\/86289\" target=\"_blank\">\"27 years of livestock production data under different stocking rate levels at the Central Grasslands Research Extension Center near Streeter, North Dakota\"<\/a>, <i>Ag Data Commons<\/i>, <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.15482%2Fusda.adc%2F1524719\" target=\"_blank\">10.15482\/usda.adc\/1524719<\/a><span class=\"printonly\">, <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/data.nal.usda.gov\/node\/86289\" target=\"_blank\">https:\/\/data.nal.usda.gov\/node\/86289<\/a><\/span><\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=27+years+of+livestock+production+data+under+different+stocking+rate+levels+at+the+Central+Grasslands+Research+Extension+Center+near+Streeter%2C+North+Dakota&rft.jtitle=Ag+Data+Commons&rft.aulast=Patton&rft.aufirst=Bob&rft.au=Patton%2C%26%2332%3BBob&rft.au=Nyren%2C%26%2332%3BPaul&rft.au=Nyren%2C%26%2332%3BAnn&rft.au=Sedivec%2C%26%2332%3BKevin&rft.date=2022&rft_id=info:doi\/10.15482%2Fusda.adc%2F1524719&rft_id=https%3A%2F%2Fdata.nal.usda.gov%2Fnode%2F86289&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-BHLField-38\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-BHLField_38-0\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.biodiversitylibrary.org\/collection\/FieldNotesProject\" target=\"_blank\">\"BHL Field Notes Project\"<\/a>. <i>Biodiversity Heritage Library<\/i>. Smithsonian. 2022<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.biodiversitylibrary.org\/collection\/FieldNotesProject\" target=\"_blank\">https:\/\/www.biodiversitylibrary.org\/collection\/FieldNotesProject<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=BHL+Field+Notes+Project&rft.atitle=Biodiversity+Heritage+Library&rft.date=2022&rft.pub=Smithsonian&rft_id=https%3A%2F%2Fwww.biodiversitylibrary.org%2Fcollection%2FFieldNotesProject&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-TAMWilliam22-39\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-TAMWilliam22_39-0\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/oaktrust.library.tamu.edu\/handle\/1969.1\/129120\" target=\"_blank\">\"William B. Davis Collection\"<\/a>. <i>OAKTrust<\/i>. Texas A&M University Libraries. 2022<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/oaktrust.library.tamu.edu\/handle\/1969.1\/129120\" target=\"_blank\">https:\/\/oaktrust.library.tamu.edu\/handle\/1969.1\/129120<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=William+B.+Davis+Collection&rft.atitle=OAKTrust&rft.date=2022&rft.pub=Texas+A%26M+University+Libraries&rft_id=https%3A%2F%2Foaktrust.library.tamu.edu%2Fhandle%2F1969.1%2F129120&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:10-40\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:10_40-0\">40.0<\/a><\/sup> <sup><a href=\"#cite_ref-:10_40-1\">40.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Thomer, Andrea; Vaidya, Gaurav; Guralnick, Robert; Bloom, David; Russell, Laura (20 July 2012). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/zookeys.pensoft.net\/articles.php?id=2909\" target=\"_blank\">\"From documents to datasets: A MediaWiki-based method of annotating and extracting species observations in century-old field notebooks\"<\/a>. <i>ZooKeys<\/i> <b>209<\/b>: 235\u2013253. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.3897%2Fzookeys.209.3247\" target=\"_blank\">10.3897\/zookeys.209.3247<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1313-2970\" target=\"_blank\">1313-2970<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC3406479\/\" target=\"_blank\">PMC3406479<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/22859891\" target=\"_blank\">22859891<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/zookeys.pensoft.net\/articles.php?id=2909\" target=\"_blank\">http:\/\/zookeys.pensoft.net\/articles.php?id=2909<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=From+documents+to+datasets%3A+A+MediaWiki-based+method+of+annotating+and+extracting+species+observations+in+century-old+field+notebooks&rft.jtitle=ZooKeys&rft.aulast=Thomer&rft.aufirst=Andrea&rft.au=Thomer%2C%26%2332%3BAndrea&rft.au=Vaidya%2C%26%2332%3BGaurav&rft.au=Guralnick%2C%26%2332%3BRobert&rft.au=Bloom%2C%26%2332%3BDavid&rft.au=Russell%2C%26%2332%3BLaura&rft.date=20+July+2012&rft.volume=209&rft.pages=235%E2%80%93253&rft_id=info:doi\/10.3897%2Fzookeys.209.3247&rft.issn=1313-2970&rft_id=info:pmc\/PMC3406479&rft_id=info:pmid\/22859891&rft_id=http%3A%2F%2Fzookeys.pensoft.net%2Farticles.php%3Fid%3D2909&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-41\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-41\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Lannoo, Michael J.; Lang, Kenneth; Waltz, Tim; Phillips, Gary S. (1 April 1994). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.jstor.org\/stable\/2426257?origin=crossref\" target=\"_blank\">\"An Altered Amphibian Assemblage: Dickinson County, Iowa, 70 Years after Frank Blanchard's Survey\"<\/a>. <i>American Midland Naturalist<\/i> <b>131<\/b> (2): 311. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.2307%2F2426257\" target=\"_blank\">10.2307\/2426257<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.jstor.org\/stable\/2426257?origin=crossref\" target=\"_blank\">https:\/\/www.jstor.org\/stable\/2426257?origin=crossref<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=An+Altered+Amphibian+Assemblage%3A+Dickinson+County%2C+Iowa%2C+70+Years+after+Frank+Blanchard%27s+Survey&rft.jtitle=American+Midland+Naturalist&rft.aulast=Lannoo&rft.aufirst=Michael+J.&rft.au=Lannoo%2C%26%2332%3BMichael+J.&rft.au=Lang%2C%26%2332%3BKenneth&rft.au=Waltz%2C%26%2332%3BTim&rft.au=Phillips%2C%26%2332%3BGary+S.&rft.date=1+April+1994&rft.volume=131&rft.issue=2&rft.pages=311&rft_id=info:doi\/10.2307%2F2426257&rft_id=https%3A%2F%2Fwww.jstor.org%2Fstable%2F2426257%3Forigin%3Dcrossref&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-42\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-42\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Gent, Marty L.; Morgan, John W. (1 May 2007). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/j.1442-9993.2007.01667.x\" target=\"_blank\">\"Changes in the stand structure (1975?2000) of coastal Banksia forest in the long absence of fire\"<\/a> (in en). <i>Austral Ecology<\/i> <b>32<\/b> (3): 239\u2013244. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1111%2Fj.1442-9993.2007.01667.x\" target=\"_blank\">10.1111\/j.1442-9993.2007.01667.x<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1442-9985\" target=\"_blank\">1442-9985<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/j.1442-9993.2007.01667.x\" target=\"_blank\">https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/j.1442-9993.2007.01667.x<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Changes+in+the+stand+structure+%281975%3F2000%29+of+coastal+Banksia+forest+in+the+long+absence+of+fire&rft.jtitle=Austral+Ecology&rft.aulast=Gent&rft.aufirst=Marty+L.&rft.au=Gent%2C%26%2332%3BMarty+L.&rft.au=Morgan%2C%26%2332%3BJohn+W.&rft.date=1+May+2007&rft.volume=32&rft.issue=3&rft.pages=239%E2%80%93244&rft_id=info:doi\/10.1111%2Fj.1442-9993.2007.01667.x&rft.issn=1442-9985&rft_id=https%3A%2F%2Fonlinelibrary.wiley.com%2Fdoi%2F10.1111%2Fj.1442-9993.2007.01667.x&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-43\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-43\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">H\u00e9dl, Radim; Pet\u0159\u00edk, Petr; Boubl\u00edk, Karel (1 October 2011). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0269749111003423\" target=\"_blank\">\"Long-term patterns in soil acidification due to pollution in forests of the Eastern Sudetes Mountains\"<\/a> (in en). <i>Environmental Pollution<\/i> <b>159<\/b> (10): 2586\u20132593. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.envpol.2011.06.014\" target=\"_blank\">10.1016\/j.envpol.2011.06.014<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0269749111003423\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0269749111003423<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Long-term+patterns+in+soil+acidification+due+to+pollution+in+forests+of+the+Eastern+Sudetes+Mountains&rft.jtitle=Environmental+Pollution&rft.aulast=H%C3%A9dl&rft.aufirst=Radim&rft.au=H%C3%A9dl%2C%26%2332%3BRadim&rft.au=Pet%C5%99%C3%ADk%2C%26%2332%3BPetr&rft.au=Boubl%C3%ADk%2C%26%2332%3BKarel&rft.date=1+October+2011&rft.volume=159&rft.issue=10&rft.pages=2586%E2%80%932593&rft_id=info:doi\/10.1016%2Fj.envpol.2011.06.014&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS0269749111003423&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-44\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-44\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Riddell, E. A.; Iknayan, K. J.; Hargrove, L.; Tremor, S.; Patton, J. L.; Ramirez, R.; Wolf, B. O.; Beissinger, S. R. (5 February 2021). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.science.org\/doi\/10.1126\/science.abd4605\" target=\"_blank\">\"Exposure to climate change drives stability or collapse of desert mammal and bird communities\"<\/a> (in en). <i>Science<\/i> <b>371<\/b> (6529): 633\u2013636. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1126%2Fscience.abd4605\" target=\"_blank\">10.1126\/science.abd4605<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0036-8075\" target=\"_blank\">0036-8075<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.science.org\/doi\/10.1126\/science.abd4605\" target=\"_blank\">https:\/\/www.science.org\/doi\/10.1126\/science.abd4605<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Exposure+to+climate+change+drives+stability+or+collapse+of+desert+mammal+and+bird+communities&rft.jtitle=Science&rft.aulast=Riddell&rft.aufirst=E.+A.&rft.au=Riddell%2C%26%2332%3BE.+A.&rft.au=Iknayan%2C%26%2332%3BK.+J.&rft.au=Hargrove%2C%26%2332%3BL.&rft.au=Tremor%2C%26%2332%3BS.&rft.au=Patton%2C%26%2332%3BJ.+L.&rft.au=Ramirez%2C%26%2332%3BR.&rft.au=Wolf%2C%26%2332%3BB.+O.&rft.au=Beissinger%2C%26%2332%3BS.+R.&rft.date=5+February+2021&rft.volume=371&rft.issue=6529&rft.pages=633%E2%80%93636&rft_id=info:doi\/10.1126%2Fscience.abd4605&rft.issn=0036-8075&rft_id=https%3A%2F%2Fwww.science.org%2Fdoi%2F10.1126%2Fscience.abd4605&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-45\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-45\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Trisurat, Yongyut; Eiadthong, Wichan; Khunrattanasiri, Weeraphart; Saengnin, Somyot; Chitechote, Auschada; Maneerat, Sompoch (1 September 2020). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/1440-1703.12105\" target=\"_blank\">\"Systematic forest inventory plots and their contribution to plant distribution and climate change impact studies in Thailand\"<\/a> (in en). <i>Ecological Research<\/i> <b>35<\/b> (5): 724\u2013732. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1111%2F1440-1703.12105\" target=\"_blank\">10.1111\/1440-1703.12105<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0912-3814\" target=\"_blank\">0912-3814<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/1440-1703.12105\" target=\"_blank\">https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/1440-1703.12105<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Systematic+forest+inventory+plots+and+their+contribution+to+plant+distribution+and+climate+change+impact+studies+in+Thailand&rft.jtitle=Ecological+Research&rft.aulast=Trisurat&rft.aufirst=Yongyut&rft.au=Trisurat%2C%26%2332%3BYongyut&rft.au=Eiadthong%2C%26%2332%3BWichan&rft.au=Khunrattanasiri%2C%26%2332%3BWeeraphart&rft.au=Saengnin%2C%26%2332%3BSomyot&rft.au=Chitechote%2C%26%2332%3BAuschada&rft.au=Maneerat%2C%26%2332%3BSompoch&rft.date=1+September+2020&rft.volume=35&rft.issue=5&rft.pages=724%E2%80%93732&rft_id=info:doi\/10.1111%2F1440-1703.12105&rft.issn=0912-3814&rft_id=https%3A%2F%2Fonlinelibrary.wiley.com%2Fdoi%2F10.1111%2F1440-1703.12105&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-46\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-46\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Azeria, Ermias T.; Carlson, Allan; P\u00e4rt, Tomas; Wiklund, Christer G. (1 July 2006). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/j.1466-822X.2006.00227.x\" target=\"_blank\">\"Temporal dynamics and nestedness of an oceanic island bird fauna: Temporal dynamics and nestedness\"<\/a> (in en). <i>Global Ecology and Biogeography<\/i> <b>15<\/b> (4): 328\u2013338. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1111%2Fj.1466-822X.2006.00227.x\" target=\"_blank\">10.1111\/j.1466-822X.2006.00227.x<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/j.1466-822X.2006.00227.x\" target=\"_blank\">https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/j.1466-822X.2006.00227.x<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Temporal+dynamics+and+nestedness+of+an+oceanic+island+bird+fauna%3A+Temporal+dynamics+and+nestedness&rft.jtitle=Global+Ecology+and+Biogeography&rft.aulast=Azeria&rft.aufirst=Ermias+T.&rft.au=Azeria%2C%26%2332%3BErmias+T.&rft.au=Carlson%2C%26%2332%3BAllan&rft.au=P%C3%A4rt%2C%26%2332%3BTomas&rft.au=Wiklund%2C%26%2332%3BChrister+G.&rft.date=1+July+2006&rft.volume=15&rft.issue=4&rft.pages=328%E2%80%93338&rft_id=info:doi\/10.1111%2Fj.1466-822X.2006.00227.x&rft_id=https%3A%2F%2Fonlinelibrary.wiley.com%2Fdoi%2F10.1111%2Fj.1466-822X.2006.00227.x&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-47\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-47\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Brodman, Robert; Cortwright, Spencer; Resetar, Alan (1 January 2002). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.bioone.org\/doi\/abs\/10.1674\/0003-0031%282002%29147%5B0135%3AHCORAA%5D2.0.CO%3B2\" target=\"_blank\">\"Historical Changes of Reptiles and Amphibians of Northwest Indiana Fish and Wildlife Properties\"<\/a> (in en). <i>The American Midland Naturalist<\/i> <b>147<\/b> (1): 135\u2013144. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1674%2F0003-0031%282002%29147%5B0135%3AHCORAA%5D2.0.CO%3B2\" target=\"_blank\">10.1674\/0003-0031(2002)147[0135:HCORAA]2.0.CO;2<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0003-0031\" target=\"_blank\">0003-0031<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/www.bioone.org\/doi\/abs\/10.1674\/0003-0031%282002%29147%5B0135%3AHCORAA%5D2.0.CO%3B2\" target=\"_blank\">http:\/\/www.bioone.org\/doi\/abs\/10.1674\/0003-0031%282002%29147%5B0135%3AHCORAA%5D2.0.CO%3B2<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Historical+Changes+of+Reptiles+and+Amphibians+of+Northwest+Indiana+Fish+and+Wildlife+Properties&rft.jtitle=The+American+Midland+Naturalist&rft.aulast=Brodman&rft.aufirst=Robert&rft.au=Brodman%2C%26%2332%3BRobert&rft.au=Cortwright%2C%26%2332%3BSpencer&rft.au=Resetar%2C%26%2332%3BAlan&rft.date=1+January+2002&rft.volume=147&rft.issue=1&rft.pages=135%E2%80%93144&rft_id=info:doi\/10.1674%2F0003-0031%282002%29147%5B0135%3AHCORAA%5D2.0.CO%3B2&rft.issn=0003-0031&rft_id=http%3A%2F%2Fwww.bioone.org%2Fdoi%2Fabs%2F10.1674%2F0003-0031%25282002%2529147%255B0135%253AHCORAA%255D2.0.CO%253B2&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-48\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-48\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Fellers, Gary M.; Drost, Charles A. (1993). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/0006320793904479\" target=\"_blank\">\"Disappearance of the cascades frog Rana cascadae at the southern end of its range, California, USA\"<\/a> (in en). <i>Biological Conservation<\/i> <b>65<\/b> (2): 177\u2013181. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2F0006-3207%2893%2990447-9\" target=\"_blank\">10.1016\/0006-3207(93)90447-9<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/0006320793904479\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/0006320793904479<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Disappearance+of+the+cascades+frog+Rana+cascadae+at+the+southern+end+of+its+range%2C+California%2C+USA&rft.jtitle=Biological+Conservation&rft.aulast=Fellers&rft.aufirst=Gary+M.&rft.au=Fellers%2C%26%2332%3BGary+M.&rft.au=Drost%2C%26%2332%3BCharles+A.&rft.date=1993&rft.volume=65&rft.issue=2&rft.pages=177%E2%80%93181&rft_id=info:doi\/10.1016%2F0006-3207%2893%2990447-9&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2F0006320793904479&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-49\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-49\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Curty, Renata Gon\u00e7alves; Crowston, Kevin; Specht, Alison; Grant, Bruce W.; Dalton, Elizabeth D. (27 December 2017). Sugimoto, Cassidy Rose. ed. <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/dx.plos.org\/10.1371\/journal.pone.0189288\" target=\"_blank\">\"Attitudes and norms affecting scientists\u2019 data reuse\"<\/a> (in en). <i>PLOS ONE<\/i> <b>12<\/b> (12): e0189288. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1371%2Fjournal.pone.0189288\" target=\"_blank\">10.1371\/journal.pone.0189288<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1932-6203\" target=\"_blank\">1932-6203<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC5744933\/\" target=\"_blank\">PMC5744933<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/29281658\" target=\"_blank\">29281658<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/dx.plos.org\/10.1371\/journal.pone.0189288\" target=\"_blank\">https:\/\/dx.plos.org\/10.1371\/journal.pone.0189288<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Attitudes+and+norms+affecting+scientists%E2%80%99+data+reuse&rft.jtitle=PLOS+ONE&rft.aulast=Curty&rft.aufirst=Renata+Gon%C3%A7alves&rft.au=Curty%2C%26%2332%3BRenata+Gon%C3%A7alves&rft.au=Crowston%2C%26%2332%3BKevin&rft.au=Specht%2C%26%2332%3BAlison&rft.au=Grant%2C%26%2332%3BBruce+W.&rft.au=Dalton%2C%26%2332%3BElizabeth+D.&rft.date=27+December+2017&rft.volume=12&rft.issue=12&rft.pages=e0189288&rft_id=info:doi\/10.1371%2Fjournal.pone.0189288&rft.issn=1932-6203&rft_id=info:pmc\/PMC5744933&rft_id=info:pmid\/29281658&rft_id=https%3A%2F%2Fdx.plos.org%2F10.1371%2Fjournal.pone.0189288&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-50\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-50\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Khan, Nushrat; Thelwall, Mike; Kousha, Kayvan (1 April 2021). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/link.springer.com\/10.1007\/s11192-021-03890-6\" target=\"_blank\">\"Measuring the impact of biodiversity datasets: data reuse, citations and altmetrics\"<\/a> (in en). <i>Scientometrics<\/i> <b>126<\/b> (4): 3621\u20133639. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1007%2Fs11192-021-03890-6\" target=\"_blank\">10.1007\/s11192-021-03890-6<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0138-9130\" target=\"_blank\">0138-9130<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/link.springer.com\/10.1007\/s11192-021-03890-6\" target=\"_blank\">https:\/\/link.springer.com\/10.1007\/s11192-021-03890-6<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Measuring+the+impact+of+biodiversity+datasets%3A+data+reuse%2C+citations+and+altmetrics&rft.jtitle=Scientometrics&rft.aulast=Khan&rft.aufirst=Nushrat&rft.au=Khan%2C%26%2332%3BNushrat&rft.au=Thelwall%2C%26%2332%3BMike&rft.au=Kousha%2C%26%2332%3BKayvan&rft.date=1+April+2021&rft.volume=126&rft.issue=4&rft.pages=3621%E2%80%933639&rft_id=info:doi\/10.1007%2Fs11192-021-03890-6&rft.issn=0138-9130&rft_id=https%3A%2F%2Flink.springer.com%2F10.1007%2Fs11192-021-03890-6&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-51\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-51\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Yoon, Ayoung; Kim, Youngseek (1 July 2017). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0740818816302250\" target=\"_blank\">\"Social scientists' data reuse behaviors: Exploring the roles of attitudinal beliefs, attitudes, norms, and data repositories\"<\/a> (in en). <i>Library & Information Science Research<\/i> <b>39<\/b> (3): 224\u2013233. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.lisr.2017.07.008\" target=\"_blank\">10.1016\/j.lisr.2017.07.008<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0740818816302250\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0740818816302250<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Social+scientists%27+data+reuse+behaviors%3A+Exploring+the+roles+of+attitudinal+beliefs%2C+attitudes%2C+norms%2C+and+data+repositories&rft.jtitle=Library+%26+Information+Science+Research&rft.aulast=Yoon&rft.aufirst=Ayoung&rft.au=Yoon%2C%26%2332%3BAyoung&rft.au=Kim%2C%26%2332%3BYoungseek&rft.date=1+July+2017&rft.volume=39&rft.issue=3&rft.pages=224%E2%80%93233&rft_id=info:doi\/10.1016%2Fj.lisr.2017.07.008&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS0740818816302250&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-52\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-52\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Vines, Timothy H.; Albert, Arianne Y.K.; Andrew, Rose L.; D\u00e9barre, Florence; Bock, Dan G.; Franklin, Michelle T.; Gilbert, Kimberly J.; Moore, Jean-S\u00e9bastien <i>et al.<\/i> (1 January 2014). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0960982213014000\" target=\"_blank\">\"The Availability of Research Data Declines Rapidly with Article Age\"<\/a> (in en). <i>Current Biology<\/i> <b>24<\/b> (1): 94\u201397. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.cub.2013.11.014\" target=\"_blank\">10.1016\/j.cub.2013.11.014<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0960982213014000\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0960982213014000<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=The+Availability+of+Research+Data+Declines+Rapidly+with+Article+Age&rft.jtitle=Current+Biology&rft.aulast=Vines&rft.aufirst=Timothy%C2%A0H.&rft.au=Vines%2C%26%2332%3BTimothy%C2%A0H.&rft.au=Albert%2C%26%2332%3BArianne%C2%A0Y.K.&rft.au=Andrew%2C%26%2332%3BRose%C2%A0L.&rft.au=D%C3%A9barre%2C%26%2332%3BFlorence&rft.au=Bock%2C%26%2332%3BDan%C2%A0G.&rft.au=Franklin%2C%26%2332%3BMichelle%C2%A0T.&rft.au=Gilbert%2C%26%2332%3BKimberly%C2%A0J.&rft.au=Moore%2C%26%2332%3BJean-S%C3%A9bastien&rft.au=Renaut%2C%26%2332%3BS%C3%A9bastien&rft.date=1+January+2014&rft.volume=24&rft.issue=1&rft.pages=94%E2%80%9397&rft_id=info:doi\/10.1016%2Fj.cub.2013.11.014&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS0960982213014000&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-53\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-53\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Gabelica, Mirko; Boj\u010di\u0107, Ru\u017eica; Puljak, Livia (1 October 2022). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S089543562200141X\" target=\"_blank\">\"Many researchers were not compliant with their published data sharing statement: a mixed-methods study\"<\/a> (in en). <i>Journal of Clinical Epidemiology<\/i> <b>150<\/b>: 33\u201341. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.jclinepi.2022.05.019\" target=\"_blank\">10.1016\/j.jclinepi.2022.05.019<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S089543562200141X\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S089543562200141X<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Many+researchers+were+not+compliant+with+their+published+data+sharing+statement%3A+a+mixed-methods+study&rft.jtitle=Journal+of+Clinical+Epidemiology&rft.aulast=Gabelica&rft.aufirst=Mirko&rft.au=Gabelica%2C%26%2332%3BMirko&rft.au=Boj%C4%8Di%C4%87%2C%26%2332%3BRu%C5%BEica&rft.au=Puljak%2C%26%2332%3BLivia&rft.date=1+October+2022&rft.volume=150&rft.pages=33%E2%80%9341&rft_id=info:doi\/10.1016%2Fj.jclinepi.2022.05.019&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS089543562200141X&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-54\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-54\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Cardinale, M; Bartolino, V; Sved\u00e4ng, H; Sundel\u00f6f, A; Poulsen, R T; Casini, M (1 September 2015). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/faf.12074\" target=\"_blank\">\"A centurial development of the North Sea fish megafauna as reflected by the historical Swedish longlining fisheries\"<\/a> (in en). <i>Fish and Fisheries<\/i> <b>16<\/b> (3): 522\u2013533. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1111%2Ffaf.12074\" target=\"_blank\">10.1111\/faf.12074<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/faf.12074\" target=\"_blank\">https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/faf.12074<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=A+centurial+development+of+the+North+Sea+fish+megafauna+as+reflected+by+the+historical+Swedish+longlining+fisheries&rft.jtitle=Fish+and+Fisheries&rft.aulast=Cardinale&rft.aufirst=M&rft.au=Cardinale%2C%26%2332%3BM&rft.au=Bartolino%2C%26%2332%3BV&rft.au=Sved%C3%A4ng%2C%26%2332%3BH&rft.au=Sundel%C3%B6f%2C%26%2332%3BA&rft.au=Poulsen%2C%26%2332%3BR+T&rft.au=Casini%2C%26%2332%3BM&rft.date=1+September+2015&rft.volume=16&rft.issue=3&rft.pages=522%E2%80%93533&rft_id=info:doi\/10.1111%2Ffaf.12074&rft_id=https%3A%2F%2Fonlinelibrary.wiley.com%2Fdoi%2F10.1111%2Ffaf.12074&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-55\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-55\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Chauvel, Bruno; Guillemin, Jean-Philippe; Gasquez, Jacques; Gauvrit, Christian (1 December 2012). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0261219412002062\" target=\"_blank\">\"History of chemical weeding from 1944 to 2011 in France: Changes and evolution of herbicide molecules\"<\/a> (in en). <i>Crop Protection<\/i> <b>42<\/b>: 320\u2013326. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.cropro.2012.07.011\" target=\"_blank\">10.1016\/j.cropro.2012.07.011<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0261219412002062\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0261219412002062<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=History+of+chemical+weeding+from+1944+to+2011+in+France%3A+Changes+and+evolution+of+herbicide+molecules&rft.jtitle=Crop+Protection&rft.aulast=Chauvel&rft.aufirst=Bruno&rft.au=Chauvel%2C%26%2332%3BBruno&rft.au=Guillemin%2C%26%2332%3BJean-Philippe&rft.au=Gasquez%2C%26%2332%3BJacques&rft.au=Gauvrit%2C%26%2332%3BChristian&rft.date=1+December+2012&rft.volume=42&rft.pages=320%E2%80%93326&rft_id=info:doi\/10.1016%2Fj.cropro.2012.07.011&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS0261219412002062&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-56\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-56\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Edwards, Robert J.; Contreras-Balderas, Salvador (1 June 1991). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.jstor.org\/stable\/3671922?origin=crossref\" target=\"_blank\">\"Historical Changes in the Ichthyofauna of the Lower Rio Grande (Rio Bravo del Norte), Texas and Mexico\"<\/a>. <i>The Southwestern Naturalist<\/i> <b>36<\/b> (2): 201. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.2307%2F3671922\" target=\"_blank\">10.2307\/3671922<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.jstor.org\/stable\/3671922?origin=crossref\" target=\"_blank\">https:\/\/www.jstor.org\/stable\/3671922?origin=crossref<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Historical+Changes+in+the+Ichthyofauna+of+the+Lower+Rio+Grande+%28Rio+Bravo+del+Norte%29%2C+Texas+and+Mexico&rft.jtitle=The+Southwestern+Naturalist&rft.aulast=Edwards&rft.aufirst=Robert+J.&rft.au=Edwards%2C%26%2332%3BRobert+J.&rft.au=Contreras-Balderas%2C%26%2332%3BSalvador&rft.date=1+June+1991&rft.volume=36&rft.issue=2&rft.pages=201&rft_id=info:doi\/10.2307%2F3671922&rft_id=https%3A%2F%2Fwww.jstor.org%2Fstable%2F3671922%3Forigin%3Dcrossref&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-57\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-57\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Chuine, Isabelle; Yiou, Pascal; Viovy, Nicolas; Seguin, Bernard; Daux, Val\u00e9rie; Ladurie, Emmanuel Le Roy (1 November 2004). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.nature.com\/articles\/432289a\" target=\"_blank\">\"Grape ripening as a past climate indicator\"<\/a> (in en). <i>Nature<\/i> <b>432<\/b> (7015): 289\u2013290. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1038%2F432289a\" target=\"_blank\">10.1038\/432289a<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0028-0836\" target=\"_blank\">0028-0836<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/www.nature.com\/articles\/432289a\" target=\"_blank\">http:\/\/www.nature.com\/articles\/432289a<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Grape+ripening+as+a+past+climate+indicator&rft.jtitle=Nature&rft.aulast=Chuine&rft.aufirst=Isabelle&rft.au=Chuine%2C%26%2332%3BIsabelle&rft.au=Yiou%2C%26%2332%3BPascal&rft.au=Viovy%2C%26%2332%3BNicolas&rft.au=Seguin%2C%26%2332%3BBernard&rft.au=Daux%2C%26%2332%3BVal%C3%A9rie&rft.au=Ladurie%2C%26%2332%3BEmmanuel+Le+Roy&rft.date=1+November+2004&rft.volume=432&rft.issue=7015&rft.pages=289%E2%80%93290&rft_id=info:doi\/10.1038%2F432289a&rft.issn=0028-0836&rft_id=http%3A%2F%2Fwww.nature.com%2Farticles%2F432289a&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:11-58\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:11_58-0\">58.0<\/a><\/sup> <sup><a href=\"#cite_ref-:11_58-1\">58.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Smith, Katherine L.; Jones, Michael L. (9 November 2007). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/link.springer.com\/10.1007\/s10661-007-9650-1\" target=\"_blank\">\"When are historical data sufficient for making watershed-level stream fish management and conservation decisions?\"<\/a> (in en). <i>Environmental Monitoring and Assessment<\/i> <b>135<\/b> (1-3): 291\u2013311. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1007%2Fs10661-007-9650-1\" target=\"_blank\">10.1007\/s10661-007-9650-1<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0167-6369\" target=\"_blank\">0167-6369<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/link.springer.com\/10.1007\/s10661-007-9650-1\" target=\"_blank\">http:\/\/link.springer.com\/10.1007\/s10661-007-9650-1<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=When+are+historical+data+sufficient+for+making+watershed-level+stream+fish+management+and+conservation+decisions%3F&rft.jtitle=Environmental+Monitoring+and+Assessment&rft.aulast=Smith&rft.aufirst=Katherine+L.&rft.au=Smith%2C%26%2332%3BKatherine+L.&rft.au=Jones%2C%26%2332%3BMichael+L.&rft.date=9+November+2007&rft.volume=135&rft.issue=1-3&rft.pages=291%E2%80%93311&rft_id=info:doi\/10.1007%2Fs10661-007-9650-1&rft.issn=0167-6369&rft_id=http%3A%2F%2Flink.springer.com%2F10.1007%2Fs10661-007-9650-1&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-59\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-59\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Llasat, Mar\u00eda-Carmen; Barriendos, Mariano; Barrera, Antonio; Rigo, Tomeu (1 November 2005). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0022169405000272\" target=\"_blank\">\"Floods in Catalonia (NE Spain) since the 14th century. Climatological and meteorological aspects from historical documentary sources and old instrumental records\"<\/a> (in en). <i>Journal of Hydrology<\/i> <b>313<\/b> (1-2): 32\u201347. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.jhydrol.2005.02.004\" target=\"_blank\">10.1016\/j.jhydrol.2005.02.004<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0022169405000272\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0022169405000272<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Floods+in+Catalonia+%28NE+Spain%29+since+the+14th+century.+Climatological+and+meteorological+aspects+from+historical+documentary+sources+and+old+instrumental+records&rft.jtitle=Journal+of+Hydrology&rft.aulast=Llasat&rft.aufirst=Mar%C3%ADa-Carmen&rft.au=Llasat%2C%26%2332%3BMar%C3%ADa-Carmen&rft.au=Barriendos%2C%26%2332%3BMariano&rft.au=Barrera%2C%26%2332%3BAntonio&rft.au=Rigo%2C%26%2332%3BTomeu&rft.date=1+November+2005&rft.volume=313&rft.issue=1-2&rft.pages=32%E2%80%9347&rft_id=info:doi\/10.1016%2Fj.jhydrol.2005.02.004&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS0022169405000272&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-60\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-60\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Ledneva, Anna; Miller-Rushing, Abraham J.; Primack, Richard B.; Imbres, Carolyn (1 September 2004). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.bioone.org\/doi\/abs\/10.1676\/04-016\" target=\"_blank\">\"CLIMATE CHANGE AS REFLECTED IN A NATURALIST'S DIARY, MIDDLEBOROUGH, MASSACHUSETTS\"<\/a> (in en). <i>The Wilson Bulletin<\/i> <b>116<\/b> (3): 224\u2013231. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1676%2F04-016\" target=\"_blank\">10.1676\/04-016<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0043-5643\" target=\"_blank\">0043-5643<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/www.bioone.org\/doi\/abs\/10.1676\/04-016\" target=\"_blank\">http:\/\/www.bioone.org\/doi\/abs\/10.1676\/04-016<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=CLIMATE+CHANGE+AS+REFLECTED+IN+A+NATURALIST%27S+DIARY%2C+MIDDLEBOROUGH%2C+MASSACHUSETTS&rft.jtitle=The+Wilson+Bulletin&rft.aulast=Ledneva&rft.aufirst=Anna&rft.au=Ledneva%2C%26%2332%3BAnna&rft.au=Miller-Rushing%2C%26%2332%3BAbraham+J.&rft.au=Primack%2C%26%2332%3BRichard+B.&rft.au=Imbres%2C%26%2332%3BCarolyn&rft.date=1+September+2004&rft.volume=116&rft.issue=3&rft.pages=224%E2%80%93231&rft_id=info:doi\/10.1676%2F04-016&rft.issn=0043-5643&rft_id=http%3A%2F%2Fwww.bioone.org%2Fdoi%2Fabs%2F10.1676%2F04-016&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-61\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-61\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">U.S. Department of Agriculture (July 1993). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/digitalcommons.usu.edu\/govdocs_forest\/2\" target=\"_blank\">\"Snapshot in Time, Repeat Photography on the Boise National Forest 1870-1992\"<\/a>. U.S. Department of Agriculture<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/digitalcommons.usu.edu\/govdocs_forest\/2\" target=\"_blank\">https:\/\/digitalcommons.usu.edu\/govdocs_forest\/2<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Snapshot+in+Time%2C+Repeat+Photography+on+the+Boise+National+Forest+1870-1992&rft.atitle=&rft.aulast=U.S.+Department+of+Agriculture&rft.au=U.S.+Department+of+Agriculture&rft.date=July+1993&rft.pub=U.S.+Department+of+Agriculture&rft_id=https%3A%2F%2Fdigitalcommons.usu.edu%2Fgovdocs_forest%2F2&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-62\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-62\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation book\">Rogers, Garry F.; Malde, Harold E.; Turner, R. M. (1984). <i>Bibliography of repeat photography for evaluating landscape change<\/i>. Salt Lake City: University of Utah Press. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-0-87480-239-9.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=book&rft.btitle=Bibliography+of+repeat+photography+for+evaluating+landscape+change&rft.aulast=Rogers&rft.aufirst=Garry+F.&rft.au=Rogers%2C%26%2332%3BGarry+F.&rft.au=Malde%2C%26%2332%3BHarold+E.&rft.au=Turner%2C%26%2332%3BR.+M.&rft.date=1984&rft.place=Salt+Lake+City&rft.pub=University+of+Utah+Press&rft.isbn=978-0-87480-239-9&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-63\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-63\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation book\">Webb, Robert H.; Boyer, Diane E.; Turner, R. M., eds. (2010). <i>Repeat photography: methods and applications in the natural sciences<\/i>. Washington: Island Press. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-1-59726-712-0.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=book&rft.btitle=Repeat+photography%3A+methods+and+applications+in+the+natural+sciences&rft.date=2010&rft.place=Washington&rft.pub=Island+Press&rft.isbn=978-1-59726-712-0&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-64\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-64\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Primack, Richard B.; Miller-Rushing, Abraham J. (1 February 2012). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/academic.oup.com\/bioscience\/article-lookup\/doi\/10.1525\/bio.2012.62.2.10\" target=\"_blank\">\"Uncovering, Collecting, and Analyzing Records to Investigate the Ecological Impacts of Climate Change: A Template from Thoreau's Concord\"<\/a> (in en). <i>BioScience<\/i> <b>62<\/b> (2): 170\u2013181. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1525%2Fbio.2012.62.2.10\" target=\"_blank\">10.1525\/bio.2012.62.2.10<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1525-3244\" target=\"_blank\">1525-3244<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/academic.oup.com\/bioscience\/article-lookup\/doi\/10.1525\/bio.2012.62.2.10\" target=\"_blank\">https:\/\/academic.oup.com\/bioscience\/article-lookup\/doi\/10.1525\/bio.2012.62.2.10<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Uncovering%2C+Collecting%2C+and+Analyzing+Records+to+Investigate+the+Ecological+Impacts+of+Climate+Change%3A+A+Template+from+Thoreau%27s+Concord&rft.jtitle=BioScience&rft.aulast=Primack&rft.aufirst=Richard+B.&rft.au=Primack%2C%26%2332%3BRichard+B.&rft.au=Miller-Rushing%2C%26%2332%3BAbraham+J.&rft.date=1+February+2012&rft.volume=62&rft.issue=2&rft.pages=170%E2%80%93181&rft_id=info:doi\/10.1525%2Fbio.2012.62.2.10&rft.issn=1525-3244&rft_id=https%3A%2F%2Facademic.oup.com%2Fbioscience%2Farticle-lookup%2Fdoi%2F10.1525%2Fbio.2012.62.2.10&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-65\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-65\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation book\">Lescrauwaet, A.-C. (2013). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/hdl.handle.net\/1854\/LU-4143013\" target=\"_blank\"><i>Belgian fisheries: Ten decades, seven seas, forty species: Historical time-series to reconstruct landings, catches, fleet and fishing areas from 1900<\/i><\/a>. Ghent University Faculty of Sciences. pp. 256. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 9789082073119<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/hdl.handle.net\/1854\/LU-4143013\" target=\"_blank\">http:\/\/hdl.handle.net\/1854\/LU-4143013<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=book&rft.btitle=Belgian+fisheries%3A+Ten+decades%2C+seven+seas%2C+forty+species%3A+Historical+time-series+to+reconstruct+landings%2C+catches%2C+fleet+and+fishing+areas+from+1900&rft.aulast=Lescrauwaet%2C+A.-C.&rft.au=Lescrauwaet%2C+A.-C.&rft.date=2013&rft.pages=pp.%26nbsp%3B256&rft.pub=Ghent+University+Faculty+of+Sciences&rft.isbn=9789082073119&rft_id=http%3A%2F%2Fhdl.handle.net%2F1854%2FLU-4143013&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-66\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-66\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Br\u00e1zdil, Rudolf; Chrom\u00e1, Kate\u0159ina; Val\u00e1\u0161ek, Hubert; Dol\u00e1k, Luk\u00e1\u0161; \u0158ezn\u00ed\u010dkov\u00e1, Ladislava (1 January 2016). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/link.springer.com\/10.1007\/s00704-014-1338-1\" target=\"_blank\">\"Damaging hailstorms in South Moravia, Czech Republic, in the seventeenth to twentieth centuries as derived from taxation records\"<\/a> (in en). <i>Theoretical and Applied Climatology<\/i> <b>123<\/b> (1-2): 185\u2013198. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1007%2Fs00704-014-1338-1\" target=\"_blank\">10.1007\/s00704-014-1338-1<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0177-798X\" target=\"_blank\">0177-798X<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/link.springer.com\/10.1007\/s00704-014-1338-1\" target=\"_blank\">http:\/\/link.springer.com\/10.1007\/s00704-014-1338-1<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Damaging+hailstorms+in+South+Moravia%2C+Czech+Republic%2C+in+the+seventeenth+to+twentieth+centuries+as+derived+from+taxation+records&rft.jtitle=Theoretical+and+Applied+Climatology&rft.aulast=Br%C3%A1zdil&rft.aufirst=Rudolf&rft.au=Br%C3%A1zdil%2C%26%2332%3BRudolf&rft.au=Chrom%C3%A1%2C%26%2332%3BKate%C5%99ina&rft.au=Val%C3%A1%C5%A1ek%2C%26%2332%3BHubert&rft.au=Dol%C3%A1k%2C%26%2332%3BLuk%C3%A1%C5%A1&rft.au=%C5%98ezn%C3%AD%C4%8Dkov%C3%A1%2C%26%2332%3BLadislava&rft.date=1+January+2016&rft.volume=123&rft.issue=1-2&rft.pages=185%E2%80%93198&rft_id=info:doi\/10.1007%2Fs00704-014-1338-1&rft.issn=0177-798X&rft_id=http%3A%2F%2Flink.springer.com%2F10.1007%2Fs00704-014-1338-1&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-67\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-67\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Van der Veken, Sebastiaan; Verheyen, Kris; Hermy, Martin (1 January 2004). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0367253005701407\" target=\"_blank\">\"Plant species loss in an urban area (Turnhout, Belgium) from 1880 to 1999 and its environmental determinants\"<\/a> (in en). <i>Flora - Morphology, Distribution, Functional Ecology of Plants<\/i> <b>199<\/b> (6): 516\u2013523. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1078%2F0367-2530-00180\" target=\"_blank\">10.1078\/0367-2530-00180<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0367253005701407\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0367253005701407<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Plant+species+loss+in+an+urban+area+%28Turnhout%2C+Belgium%29+from+1880+to+1999+and+its+environmental+determinants&rft.jtitle=Flora+-+Morphology%2C+Distribution%2C+Functional+Ecology+of+Plants&rft.aulast=Van+der+Veken&rft.aufirst=Sebastiaan&rft.au=Van+der+Veken%2C%26%2332%3BSebastiaan&rft.au=Verheyen%2C%26%2332%3BKris&rft.au=Hermy%2C%26%2332%3BMartin&rft.date=1+January+2004&rft.volume=199&rft.issue=6&rft.pages=516%E2%80%93523&rft_id=info:doi\/10.1078%2F0367-2530-00180&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS0367253005701407&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-68\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-68\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Martin, Kathy; Brown, Graeme A.; Young, Jessica R. (1 July 2004). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.bioone.org\/doi\/abs\/10.1648\/0273-8570-75.3.239\" target=\"_blank\">\"The historic and current distribution of the Vancouver Island White-tailed Ptarmigan (Lagopus leucurus saxatilis)\"<\/a> (in en). <i>Journal of Field Ornithology<\/i> <b>75<\/b> (3): 239\u2013256. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1648%2F0273-8570-75.3.239\" target=\"_blank\">10.1648\/0273-8570-75.3.239<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0273-8570\" target=\"_blank\">0273-8570<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/www.bioone.org\/doi\/abs\/10.1648\/0273-8570-75.3.239\" target=\"_blank\">http:\/\/www.bioone.org\/doi\/abs\/10.1648\/0273-8570-75.3.239<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=The+historic+and+current+distribution+of+the+Vancouver+Island+White-tailed+Ptarmigan+%28Lagopus+leucurus+saxatilis%29&rft.jtitle=Journal+of+Field+Ornithology&rft.aulast=Martin&rft.aufirst=Kathy&rft.au=Martin%2C%26%2332%3BKathy&rft.au=Brown%2C%26%2332%3BGraeme+A.&rft.au=Young%2C%26%2332%3BJessica+R.&rft.date=1+July+2004&rft.volume=75&rft.issue=3&rft.pages=239%E2%80%93256&rft_id=info:doi\/10.1648%2F0273-8570-75.3.239&rft.issn=0273-8570&rft_id=http%3A%2F%2Fwww.bioone.org%2Fdoi%2Fabs%2F10.1648%2F0273-8570-75.3.239&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-69\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-69\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Sharma, Sapna; Magnuson, John J.; Batt, Ryan D.; Winslow, Luke A.; Korhonen, Johanna; Aono, Yasuyuki (26 April 2016). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.nature.com\/articles\/srep25061\" target=\"_blank\">\"Direct observations of ice seasonality reveal changes in climate over the past 320\u2013570 years\"<\/a> (in en). <i>Scientific Reports<\/i> <b>6<\/b> (1): 25061. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1038%2Fsrep25061\" target=\"_blank\">10.1038\/srep25061<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2045-2322\" target=\"_blank\">2045-2322<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC4844970\/\" target=\"_blank\">PMC4844970<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/27113125\" target=\"_blank\">27113125<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.nature.com\/articles\/srep25061\" target=\"_blank\">https:\/\/www.nature.com\/articles\/srep25061<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Direct+observations+of+ice+seasonality+reveal+changes+in+climate+over+the+past+320%E2%80%93570+years&rft.jtitle=Scientific+Reports&rft.aulast=Sharma&rft.aufirst=Sapna&rft.au=Sharma%2C%26%2332%3BSapna&rft.au=Magnuson%2C%26%2332%3BJohn+J.&rft.au=Batt%2C%26%2332%3BRyan+D.&rft.au=Winslow%2C%26%2332%3BLuke+A.&rft.au=Korhonen%2C%26%2332%3BJohanna&rft.au=Aono%2C%26%2332%3BYasuyuki&rft.date=26+April+2016&rft.volume=6&rft.issue=1&rft.pages=25061&rft_id=info:doi\/10.1038%2Fsrep25061&rft.issn=2045-2322&rft_id=info:pmc\/PMC4844970&rft_id=info:pmid\/27113125&rft_id=https%3A%2F%2Fwww.nature.com%2Farticles%2Fsrep25061&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-70\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-70\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Kelso, Clare; Vogel, Coleen (27 June 2007). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/link.springer.com\/10.1007\/s10584-007-9264-1\" target=\"_blank\">\"The climate of Namaqualand in the nineteenth century\"<\/a> (in en). <i>Climatic Change<\/i> <b>83<\/b> (3): 357\u2013380. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1007%2Fs10584-007-9264-1\" target=\"_blank\">10.1007\/s10584-007-9264-1<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0165-0009\" target=\"_blank\">0165-0009<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/link.springer.com\/10.1007\/s10584-007-9264-1\" target=\"_blank\">http:\/\/link.springer.com\/10.1007\/s10584-007-9264-1<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=The+climate+of+Namaqualand+in+the+nineteenth+century&rft.jtitle=Climatic+Change&rft.aulast=Kelso&rft.aufirst=Clare&rft.au=Kelso%2C%26%2332%3BClare&rft.au=Vogel%2C%26%2332%3BColeen&rft.date=27+June+2007&rft.volume=83&rft.issue=3&rft.pages=357%E2%80%93380&rft_id=info:doi\/10.1007%2Fs10584-007-9264-1&rft.issn=0165-0009&rft_id=http%3A%2F%2Flink.springer.com%2F10.1007%2Fs10584-007-9264-1&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:12-71\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:12_71-0\">71.0<\/a><\/sup> <sup><a href=\"#cite_ref-:12_71-1\">71.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Wiebe, Peter H.; Allison, M. Dickson (1 June 2015). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2214242815000273\" target=\"_blank\">\"Bringing dark data into the light: A case study of the recovery of Northwestern Atlantic zooplankton data collected in the 1970s and 1980s\"<\/a> (in en). <i>GeoResJ<\/i> <b>6<\/b>: 195\u2013201. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.grj.2015.03.001\" target=\"_blank\">10.1016\/j.grj.2015.03.001<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2214242815000273\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S2214242815000273<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Bringing+dark+data+into+the+light%3A+A+case+study+of+the+recovery+of+Northwestern+Atlantic+zooplankton+data+collected+in+the+1970s+and+1980s&rft.jtitle=GeoResJ&rft.aulast=Wiebe&rft.aufirst=Peter+H.&rft.au=Wiebe%2C%26%2332%3BPeter+H.&rft.au=Allison%2C%26%2332%3BM.+Dickson&rft.date=1+June+2015&rft.volume=6&rft.pages=195%E2%80%93201&rft_id=info:doi\/10.1016%2Fj.grj.2015.03.001&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS2214242815000273&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-72\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-72\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Pullin, Andrew S.; Salafsky, Nick (19 February 2010). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/j.1523-1739.2010.01537.x\" target=\"_blank\">\"Save the Whales? Save the Rainforest? Save the Data!: Editorial\"<\/a> (in en). <i>Conservation Biology<\/i> <b>24<\/b> (4): 915\u2013917. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1111%2Fj.1523-1739.2010.01537.x\" target=\"_blank\">10.1111\/j.1523-1739.2010.01537.x<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/j.1523-1739.2010.01537.x\" target=\"_blank\">https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/j.1523-1739.2010.01537.x<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Save+the+Whales%3F+Save+the+Rainforest%3F+Save+the+Data%21%3A+Editorial&rft.jtitle=Conservation+Biology&rft.aulast=Pullin&rft.aufirst=Andrew+S.&rft.au=Pullin%2C%26%2332%3BAndrew+S.&rft.au=Salafsky%2C%26%2332%3BNick&rft.date=19+February+2010&rft.volume=24&rft.issue=4&rft.pages=915%E2%80%93917&rft_id=info:doi\/10.1111%2Fj.1523-1739.2010.01537.x&rft_id=https%3A%2F%2Fonlinelibrary.wiley.com%2Fdoi%2F10.1111%2Fj.1523-1739.2010.01537.x&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-73\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-73\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Duckworth, Steve; Mack, Grayce; Thornhill, Kate (30 August 2022). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/osf.io\/ujhn2\/\" target=\"_blank\"><i>The Trouble with Legacy Public Health Data<\/i><\/a>. Open Science Framework. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.17605%2FOSF.IO%2FUJHN2\" target=\"_blank\">10.17605\/OSF.IO\/UJHN2<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/osf.io\/ujhn2\/\" target=\"_blank\">https:\/\/osf.io\/ujhn2\/<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=book&rft.btitle=The+Trouble+with+Legacy+Public+Health+Data&rft.aulast=Duckworth&rft.aufirst=Steve&rft.au=Duckworth%2C%26%2332%3BSteve&rft.au=Mack%2C%26%2332%3BGrayce&rft.au=Thornhill%2C%26%2332%3BKate&rft.date=30+August+2022&rft_id=info:doi\/10.17605%2FOSF.IO%2FUJHN2&rft_id=https%3A%2F%2Fosf.io%2Fujhn2%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-74\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-74\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Curry, Andrew (11 February 2011). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.science.org\/doi\/10.1126\/science.331.6018.694\" target=\"_blank\">\"Rescue of Old Data Offers Lesson for Particle Physicists\"<\/a> (in en). <i>Science<\/i> <b>331<\/b> (6018): 694\u2013695. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1126%2Fscience.331.6018.694\" target=\"_blank\">10.1126\/science.331.6018.694<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0036-8075\" target=\"_blank\">0036-8075<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.science.org\/doi\/10.1126\/science.331.6018.694\" target=\"_blank\">https:\/\/www.science.org\/doi\/10.1126\/science.331.6018.694<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Rescue+of+Old+Data+Offers+Lesson+for+Particle+Physicists&rft.jtitle=Science&rft.aulast=Curry&rft.aufirst=Andrew&rft.au=Curry%2C%26%2332%3BAndrew&rft.date=11+February+2011&rft.volume=331&rft.issue=6018&rft.pages=694%E2%80%93695&rft_id=info:doi\/10.1126%2Fscience.331.6018.694&rft.issn=0036-8075&rft_id=https%3A%2F%2Fwww.science.org%2Fdoi%2F10.1126%2Fscience.331.6018.694&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-75\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-75\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Downs, Robert R.; Chen, Robert S. (2017). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/academiccommons.columbia.edu\/doi\/10.7916\/D8W09BMQ\" target=\"_blank\">\"Curation of Scientific Data at Risk of Loss: Data Rescue and Dissemination\"<\/a>. <i>Curating research data: Volume one: Practical strategies for your digital repository<\/i> (Association of College and Research Libraries): 275\u201394. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.7916%2FD8W09BMQ\" target=\"_blank\">10.7916\/D8W09BMQ<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/academiccommons.columbia.edu\/doi\/10.7916\/D8W09BMQ\" target=\"_blank\">https:\/\/academiccommons.columbia.edu\/doi\/10.7916\/D8W09BMQ<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Curation+of+Scientific+Data+at+Risk+of+Loss%3A+Data+Rescue+and+Dissemination&rft.jtitle=Curating+research+data%3A+Volume+one%3A+Practical+strategies+for+your+digital+repository&rft.aulast=Downs&rft.aufirst=Robert+R.&rft.au=Downs%2C%26%2332%3BRobert+R.&rft.au=Chen%2C%26%2332%3BRobert+S.&rft.date=2017&rft.pages=275%E2%80%9394&rft.pub=Association+of+College+and+Research+Libraries&rft_id=info:doi\/10.7916%2FD8W09BMQ&rft_id=https%3A%2F%2Facademiccommons.columbia.edu%2Fdoi%2F10.7916%2FD8W09BMQ&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-76\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-76\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Wicherts, Jelte M.; Borsboom, Denny; Kats, Judith; Molenaar, Dylan (2006). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/doi.apa.org\/getdoi.cfm?doi=10.1037\/0003-066X.61.7.726\" target=\"_blank\">\"The poor availability of psychological research data for reanalysis.\"<\/a> (in en). <i>American Psychologist<\/i> <b>61<\/b> (7): 726\u2013728. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1037%2F0003-066X.61.7.726\" target=\"_blank\">10.1037\/0003-066X.61.7.726<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1935-990X\" target=\"_blank\">1935-990X<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/doi.apa.org\/getdoi.cfm?doi=10.1037\/0003-066X.61.7.726\" target=\"_blank\">http:\/\/doi.apa.org\/getdoi.cfm?doi=10.1037\/0003-066X.61.7.726<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=The+poor+availability+of+psychological+research+data+for+reanalysis.&rft.jtitle=American+Psychologist&rft.aulast=Wicherts&rft.aufirst=Jelte+M.&rft.au=Wicherts%2C%26%2332%3BJelte+M.&rft.au=Borsboom%2C%26%2332%3BDenny&rft.au=Kats%2C%26%2332%3BJudith&rft.au=Molenaar%2C%26%2332%3BDylan&rft.date=2006&rft.volume=61&rft.issue=7&rft.pages=726%E2%80%93728&rft_id=info:doi\/10.1037%2F0003-066X.61.7.726&rft.issn=1935-990X&rft_id=http%3A%2F%2Fdoi.apa.org%2Fgetdoi.cfm%3Fdoi%3D10.1037%2F0003-066X.61.7.726&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-77\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-77\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Sheffield, C.; Nakasone, S.; Ferrante, R. et al. (2011). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/libreas.eu\/ausgabe18\/texte\/08sheffield.htm\" target=\"_blank\">\"Merging Metadata: Building on Existing Standards to Create a Field Book Registry\"<\/a>. <i>LIBREAS. Library Ideas<\/i> <b>18<\/b><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/libreas.eu\/ausgabe18\/texte\/08sheffield.htm\" target=\"_blank\">https:\/\/libreas.eu\/ausgabe18\/texte\/08sheffield.htm<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Merging+Metadata%3A+Building+on+Existing+Standards+to+Create+a+Field+Book+Registry&rft.jtitle=LIBREAS.+Library+Ideas&rft.aulast=Sheffield%2C+C.%3B+Nakasone%2C+S.%3B+Ferrante%2C+R.+et+al.&rft.au=Sheffield%2C+C.%3B+Nakasone%2C+S.%3B+Ferrante%2C+R.+et+al.&rft.date=2011&rft.volume=18&rft_id=https%3A%2F%2Flibreas.eu%2Fausgabe18%2Ftexte%2F08sheffield.htm&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-78\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-78\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Loehle, Craig; Weatherford, Philip (1 October 2017). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0304380017303794\" target=\"_blank\">\"Detecting population trends with historical data: Contributions of volatility, low detectability, and metapopulation turnover to potential sampling bias\"<\/a> (in en). <i>Ecological Modelling<\/i> <b>362<\/b>: 13\u201318. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.ecolmodel.2017.08.021\" target=\"_blank\">10.1016\/j.ecolmodel.2017.08.021<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0304380017303794\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0304380017303794<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Detecting+population+trends+with+historical+data%3A+Contributions+of+volatility%2C+low+detectability%2C+and+metapopulation+turnover+to+potential+sampling+bias&rft.jtitle=Ecological+Modelling&rft.aulast=Loehle&rft.aufirst=Craig&rft.au=Loehle%2C%26%2332%3BCraig&rft.au=Weatherford%2C%26%2332%3BPhilip&rft.date=1+October+2017&rft.volume=362&rft.pages=13%E2%80%9318&rft_id=info:doi\/10.1016%2Fj.ecolmodel.2017.08.021&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS0304380017303794&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-79\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-79\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Magurran, Anne E.; Baillie, Stephen R.; Buckland, Stephen T.; Dick, Jan McP.; Elston, David A.; Scott, E. Marian; Smith, Rognvald I.; Somerfield, Paul J. <i>et al.<\/i> (1 October 2010). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0169534710001552\" target=\"_blank\">\"Long-term datasets in biodiversity research and monitoring: assessing change in ecological communities through time\"<\/a> (in en). <i>Trends in Ecology & Evolution<\/i> <b>25<\/b> (10): 574\u2013582. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.tree.2010.06.016\" target=\"_blank\">10.1016\/j.tree.2010.06.016<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0169534710001552\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0169534710001552<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Long-term+datasets+in+biodiversity+research+and+monitoring%3A+assessing+change+in+ecological+communities+through+time&rft.jtitle=Trends+in+Ecology+%26+Evolution&rft.aulast=Magurran&rft.aufirst=Anne+E.&rft.au=Magurran%2C%26%2332%3BAnne+E.&rft.au=Baillie%2C%26%2332%3BStephen+R.&rft.au=Buckland%2C%26%2332%3BStephen+T.&rft.au=Dick%2C%26%2332%3BJan+McP.&rft.au=Elston%2C%26%2332%3BDavid+A.&rft.au=Scott%2C%26%2332%3BE.+Marian&rft.au=Smith%2C%26%2332%3BRognvald+I.&rft.au=Somerfield%2C%26%2332%3BPaul+J.&rft.au=Watt%2C%26%2332%3BAllan+D.&rft.date=1+October+2010&rft.volume=25&rft.issue=10&rft.pages=574%E2%80%93582&rft_id=info:doi\/10.1016%2Fj.tree.2010.06.016&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS0169534710001552&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-80\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-80\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Reznick, David; Baxter, Ronald J.; Endler, John (1 June 1994). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/academic.oup.com\/icb\/article-lookup\/doi\/10.1093\/icb\/34.3.452\" target=\"_blank\">\"Long-term Studies of Tropical Stream Fish Communities:The Use of Field Notes and Museum Collections to Reconstruct Communities of the Past\"<\/a> (in en). <i>American Zoologist<\/i> <b>34<\/b> (3): 452\u2013462. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1093%2Ficb%2F34.3.452\" target=\"_blank\">10.1093\/icb\/34.3.452<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0003-1569\" target=\"_blank\">0003-1569<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/academic.oup.com\/icb\/article-lookup\/doi\/10.1093\/icb\/34.3.452\" target=\"_blank\">https:\/\/academic.oup.com\/icb\/article-lookup\/doi\/10.1093\/icb\/34.3.452<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Long-term+Studies+of+Tropical+Stream+Fish+Communities%3AThe+Use+of+Field+Notes+and+Museum+Collections+to+Reconstruct+Communities+of+the+Past&rft.jtitle=American+Zoologist&rft.aulast=Reznick&rft.aufirst=David&rft.au=Reznick%2C%26%2332%3BDavid&rft.au=Baxter%2C%26%2332%3BRonald+J.&rft.au=Endler%2C%26%2332%3BJohn&rft.date=1+June+1994&rft.volume=34&rft.issue=3&rft.pages=452%E2%80%93462&rft_id=info:doi\/10.1093%2Ficb%2F34.3.452&rft.issn=0003-1569&rft_id=https%3A%2F%2Facademic.oup.com%2Ficb%2Farticle-lookup%2Fdoi%2F10.1093%2Ficb%2F34.3.452&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-81\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-81\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Knapp, Kenneth R.; Bates, John J.; Barkstrom, Bruce (1 September 2007). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/journals.ametsoc.org\/doi\/10.1175\/BAMS-88-9-1359\" target=\"_blank\">\"Scientific Data Stewardship: Lessons Learned from a Satallite\u2013Data Rescue Effort\"<\/a> (in en). <i>Bulletin of the American Meteorological Society<\/i> <b>88<\/b> (9): 1359\u20131362. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1175%2FBAMS-88-9-1359\" target=\"_blank\">10.1175\/BAMS-88-9-1359<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0003-0007\" target=\"_blank\">0003-0007<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/journals.ametsoc.org\/doi\/10.1175\/BAMS-88-9-1359\" target=\"_blank\">https:\/\/journals.ametsoc.org\/doi\/10.1175\/BAMS-88-9-1359<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Scientific+Data+Stewardship%3A+Lessons+Learned+from+a+Satallite%E2%80%93Data+Rescue+Effort&rft.jtitle=Bulletin+of+the+American+Meteorological+Society&rft.aulast=Knapp&rft.aufirst=Kenneth+R.&rft.au=Knapp%2C%26%2332%3BKenneth+R.&rft.au=Bates%2C%26%2332%3BJohn+J.&rft.au=Barkstrom%2C%26%2332%3BBruce&rft.date=1+September+2007&rft.volume=88&rft.issue=9&rft.pages=1359%E2%80%931362&rft_id=info:doi\/10.1175%2FBAMS-88-9-1359&rft.issn=0003-0007&rft_id=https%3A%2F%2Fjournals.ametsoc.org%2Fdoi%2F10.1175%2FBAMS-88-9-1359&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-82\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-82\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">L\u00f6ffler, Felicitas; Wesp, Valentin; K\u00f6nig-Ries, Birgitta; Klan, Friederike (24 March 2021). Suleman, Hussein. ed. <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/dx.plos.org\/10.1371\/journal.pone.0246099\" target=\"_blank\">\"Dataset search in biodiversity research: Do metadata in data repositories reflect scholarly information needs?\"<\/a> (in en). <i>PLOS ONE<\/i> <b>16<\/b> (3): e0246099. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1371%2Fjournal.pone.0246099\" target=\"_blank\">10.1371\/journal.pone.0246099<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1932-6203\" target=\"_blank\">1932-6203<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC7990268\/\" target=\"_blank\">PMC7990268<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/33760822\" target=\"_blank\">33760822<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/dx.plos.org\/10.1371\/journal.pone.0246099\" target=\"_blank\">https:\/\/dx.plos.org\/10.1371\/journal.pone.0246099<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Dataset+search+in+biodiversity+research%3A+Do+metadata+in+data+repositories+reflect+scholarly+information+needs%3F&rft.jtitle=PLOS+ONE&rft.aulast=L%C3%B6ffler&rft.aufirst=Felicitas&rft.au=L%C3%B6ffler%2C%26%2332%3BFelicitas&rft.au=Wesp%2C%26%2332%3BValentin&rft.au=K%C3%B6nig-Ries%2C%26%2332%3BBirgitta&rft.au=Klan%2C%26%2332%3BFriederike&rft.date=24+March+2021&rft.volume=16&rft.issue=3&rft.pages=e0246099&rft_id=info:doi\/10.1371%2Fjournal.pone.0246099&rft.issn=1932-6203&rft_id=info:pmc\/PMC7990268&rft_id=info:pmid\/33760822&rft_id=https%3A%2F%2Fdx.plos.org%2F10.1371%2Fjournal.pone.0246099&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-83\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-83\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Sprague, Lori A.; Oelsner, Gretchen P.; Argue, Denise M. (1 March 2017). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0043135416309642\" target=\"_blank\">\"Challenges with secondary use of multi-source water-quality data in the United States\"<\/a> (in en). <i>Water Research<\/i> <b>110<\/b>: 252\u2013261. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.watres.2016.12.024\" target=\"_blank\">10.1016\/j.watres.2016.12.024<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0043135416309642\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0043135416309642<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Challenges+with+secondary+use+of+multi-source+water-quality+data+in+the+United+States&rft.jtitle=Water+Research&rft.aulast=Sprague&rft.aufirst=Lori+A.&rft.au=Sprague%2C%26%2332%3BLori+A.&rft.au=Oelsner%2C%26%2332%3BGretchen+P.&rft.au=Argue%2C%26%2332%3BDenise+M.&rft.date=1+March+2017&rft.volume=110&rft.pages=252%E2%80%93261&rft_id=info:doi\/10.1016%2Fj.watres.2016.12.024&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS0043135416309642&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-84\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-84\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">K\u00e9ry, Marc; Spillmann, John H.; Truong, Camille; Holderegger, Rolf (1 September 2006). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/j.1365-2745.2006.01151.x\" target=\"_blank\">\"How biased are estimates of extinction probability in revisitation studies?\"<\/a> (in en). <i>Journal of Ecology<\/i> <b>94<\/b> (5): 980\u2013986. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1111%2Fj.1365-2745.2006.01151.x\" target=\"_blank\">10.1111\/j.1365-2745.2006.01151.x<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/j.1365-2745.2006.01151.x\" target=\"_blank\">https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/j.1365-2745.2006.01151.x<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=How+biased+are+estimates+of+extinction+probability+in+revisitation+studies%3F&rft.jtitle=Journal+of+Ecology&rft.aulast=K%C3%A9ry&rft.aufirst=Marc&rft.au=K%C3%A9ry%2C%26%2332%3BMarc&rft.au=Spillmann%2C%26%2332%3BJohn+H.&rft.au=Truong%2C%26%2332%3BCamille&rft.au=Holderegger%2C%26%2332%3BRolf&rft.date=1+September+2006&rft.volume=94&rft.issue=5&rft.pages=980%E2%80%93986&rft_id=info:doi\/10.1111%2Fj.1365-2745.2006.01151.x&rft_id=https%3A%2F%2Fonlinelibrary.wiley.com%2Fdoi%2F10.1111%2Fj.1365-2745.2006.01151.x&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-85\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-85\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Pollock, Jacob F. (1 June 2006). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/j.1523-1739.2006.00342.x\" target=\"_blank\">\"Detecting Population Declines over Large Areas with Presence-Absence, Time-to-Encounter, and Count Survey Methods\"<\/a> (in en). <i>Conservation Biology<\/i> <b>20<\/b> (3): 882\u2013892. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1111%2Fj.1523-1739.2006.00342.x\" target=\"_blank\">10.1111\/j.1523-1739.2006.00342.x<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0888-8892\" target=\"_blank\">0888-8892<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/j.1523-1739.2006.00342.x\" target=\"_blank\">https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/j.1523-1739.2006.00342.x<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Detecting+Population+Declines+over+Large+Areas+with+Presence-Absence%2C+Time-to-Encounter%2C+and+Count+Survey+Methods&rft.jtitle=Conservation+Biology&rft.aulast=Pollock&rft.aufirst=Jacob+F.&rft.au=Pollock%2C%26%2332%3BJacob+F.&rft.date=1+June+2006&rft.volume=20&rft.issue=3&rft.pages=882%E2%80%93892&rft_id=info:doi\/10.1111%2Fj.1523-1739.2006.00342.x&rft.issn=0888-8892&rft_id=https%3A%2F%2Fonlinelibrary.wiley.com%2Fdoi%2F10.1111%2Fj.1523-1739.2006.00342.x&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-86\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-86\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Rivadeneira, Marcelo M.; Hunt, Gene; Roy, Kaustuv (1 May 2009). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/doi.wiley.com\/10.1890\/08-0316.1\" target=\"_blank\">\"The use of sighting records to infer species extinctions: an evaluation of different methods\"<\/a> (in en). <i>Ecology<\/i> <b>90<\/b> (5): 1291\u20131300. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1890%2F08-0316.1\" target=\"_blank\">10.1890\/08-0316.1<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0012-9658\" target=\"_blank\">0012-9658<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/doi.wiley.com\/10.1890\/08-0316.1\" target=\"_blank\">http:\/\/doi.wiley.com\/10.1890\/08-0316.1<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=The+use+of+sighting+records+to+infer+species+extinctions%3A+an+evaluation+of+different+methods&rft.jtitle=Ecology&rft.aulast=Rivadeneira&rft.aufirst=Marcelo+M.&rft.au=Rivadeneira%2C%26%2332%3BMarcelo+M.&rft.au=Hunt%2C%26%2332%3BGene&rft.au=Roy%2C%26%2332%3BKaustuv&rft.date=1+May+2009&rft.volume=90&rft.issue=5&rft.pages=1291%E2%80%931300&rft_id=info:doi\/10.1890%2F08-0316.1&rft.issn=0012-9658&rft_id=http%3A%2F%2Fdoi.wiley.com%2F10.1890%2F08-0316.1&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-87\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-87\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Huisman, John M.; Millar, Alan J.K. (1 January 2013). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.tandfonline.com\/doi\/full\/10.2216\/12-089.1\" target=\"_blank\">\"Australian seaweed collections: use and misuse\"<\/a> (in en). <i>Phycologia<\/i> <b>52<\/b> (1): 2\u20135. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.2216%2F12-089.1\" target=\"_blank\">10.2216\/12-089.1<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0031-8884\" target=\"_blank\">0031-8884<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.tandfonline.com\/doi\/full\/10.2216\/12-089.1\" target=\"_blank\">https:\/\/www.tandfonline.com\/doi\/full\/10.2216\/12-089.1<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Australian+seaweed+collections%3A+use+and+misuse&rft.jtitle=Phycologia&rft.aulast=Huisman&rft.aufirst=John+M.&rft.au=Huisman%2C%26%2332%3BJohn+M.&rft.au=Millar%2C%26%2332%3BAlan+J.K.&rft.date=1+January+2013&rft.volume=52&rft.issue=1&rft.pages=2%E2%80%935&rft_id=info:doi\/10.2216%2F12-089.1&rft.issn=0031-8884&rft_id=https%3A%2F%2Fwww.tandfonline.com%2Fdoi%2Ffull%2F10.2216%2F12-089.1&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-88\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-88\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Kullman, Leif (1 August 2010). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/j.1756-1051.2010.00812.x\" target=\"_blank\">\"Alpine flora dynamics - a critical review of responses to climate change in the Swedish Scandes since the early 1950s\"<\/a> (in en). <i>Nordic Journal of Botany<\/i> <b>28<\/b> (4): 398\u2013408. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1111%2Fj.1756-1051.2010.00812.x\" target=\"_blank\">10.1111\/j.1756-1051.2010.00812.x<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/j.1756-1051.2010.00812.x\" target=\"_blank\">https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/j.1756-1051.2010.00812.x<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Alpine+flora+dynamics+-+a+critical+review+of+responses+to+climate+change+in+the+Swedish+Scandes+since+the+early+1950s&rft.jtitle=Nordic+Journal+of+Botany&rft.aulast=Kullman&rft.aufirst=Leif&rft.au=Kullman%2C%26%2332%3BLeif&rft.date=1+August+2010&rft.volume=28&rft.issue=4&rft.pages=398%E2%80%93408&rft_id=info:doi\/10.1111%2Fj.1756-1051.2010.00812.x&rft_id=https%3A%2F%2Fonlinelibrary.wiley.com%2Fdoi%2F10.1111%2Fj.1756-1051.2010.00812.x&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-89\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-89\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Engelhard, Georg H.; Righton, David A.; Pinnegar, John K. (1 August 2014). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/gcb.12513\" target=\"_blank\">\"Climate change and fishing: a century of shifting distribution in North Sea cod\"<\/a> (in en). <i>Global Change Biology<\/i> <b>20<\/b> (8): 2473\u20132483. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1111%2Fgcb.12513\" target=\"_blank\">10.1111\/gcb.12513<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1354-1013\" target=\"_blank\">1354-1013<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC4282283\/\" target=\"_blank\">PMC4282283<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/24375860\" target=\"_blank\">24375860<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/gcb.12513\" target=\"_blank\">https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/gcb.12513<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Climate+change+and+fishing%3A+a+century+of+shifting+distribution+in+North+Sea+cod&rft.jtitle=Global+Change+Biology&rft.aulast=Engelhard&rft.aufirst=Georg+H.&rft.au=Engelhard%2C%26%2332%3BGeorg+H.&rft.au=Righton%2C%26%2332%3BDavid+A.&rft.au=Pinnegar%2C%26%2332%3BJohn+K.&rft.date=1+August+2014&rft.volume=20&rft.issue=8&rft.pages=2473%E2%80%932483&rft_id=info:doi\/10.1111%2Fgcb.12513&rft.issn=1354-1013&rft_id=info:pmc\/PMC4282283&rft_id=info:pmid\/24375860&rft_id=https%3A%2F%2Fonlinelibrary.wiley.com%2Fdoi%2F10.1111%2Fgcb.12513&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-90\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-90\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Schulte, L.A.; Mladenoff, D.J. (2001). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/academic.oup.com\/jof\/article\/99\/10\/5\/4614271\" target=\"_blank\">\"The Original US Public Land Survey Records: Their Use and Limitations in Reconstructing Presettlement Vegetation\"<\/a>. <i>Journal of Forestry<\/i> <b>99<\/b> (10): 5\u201310. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1093%2Fjof%2F99.10.5\" target=\"_blank\">10.1093\/jof\/99.10.5<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/academic.oup.com\/jof\/article\/99\/10\/5\/4614271\" target=\"_blank\">https:\/\/academic.oup.com\/jof\/article\/99\/10\/5\/4614271<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=The+Original+US+Public+Land+Survey+Records%3A+Their+Use+and+Limitations+in+Reconstructing+Presettlement+Vegetation&rft.jtitle=Journal+of+Forestry&rft.aulast=Schulte%2C+L.A.%3B+Mladenoff%2C+D.J.&rft.au=Schulte%2C+L.A.%3B+Mladenoff%2C+D.J.&rft.date=2001&rft.volume=99&rft.issue=10&rft.pages=5%E2%80%9310&rft_id=info:doi\/10.1093%2Fjof%2F99.10.5&rft_id=https%3A%2F%2Facademic.oup.com%2Fjof%2Farticle%2F99%2F10%2F5%2F4614271&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-91\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-91\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Delisle, Fanny; Lavoie, Claude; Jean, Martin; Lachance, Daniel (1 July 2003). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/doi.wiley.com\/10.1046\/j.1365-2699.2003.00897.x\" target=\"_blank\">\"Reconstructing the spread of invasive plants: taking into account biases associated with herbarium specimens: Invasive plants and herbarium specimens\"<\/a> (in en). <i>Journal of Biogeography<\/i> <b>30<\/b> (7): 1033\u20131042. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1046%2Fj.1365-2699.2003.00897.x\" target=\"_blank\">10.1046\/j.1365-2699.2003.00897.x<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/doi.wiley.com\/10.1046\/j.1365-2699.2003.00897.x\" target=\"_blank\">http:\/\/doi.wiley.com\/10.1046\/j.1365-2699.2003.00897.x<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Reconstructing+the+spread+of+invasive+plants%3A+taking+into+account+biases+associated+with+herbarium+specimens%3A+Invasive+plants+and+herbarium+specimens&rft.jtitle=Journal+of+Biogeography&rft.aulast=Delisle&rft.aufirst=Fanny&rft.au=Delisle%2C%26%2332%3BFanny&rft.au=Lavoie%2C%26%2332%3BClaude&rft.au=Jean%2C%26%2332%3BMartin&rft.au=Lachance%2C%26%2332%3BDaniel&rft.date=1+July+2003&rft.volume=30&rft.issue=7&rft.pages=1033%E2%80%931042&rft_id=info:doi\/10.1046%2Fj.1365-2699.2003.00897.x&rft_id=http%3A%2F%2Fdoi.wiley.com%2F10.1046%2Fj.1365-2699.2003.00897.x&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-92\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-92\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Bavel, Bas J. P.; Curtis, Daniel R.; Hannaford, Matthew J.; Moatsos, Michail; Roosen, Joris; Soens, Tim (1 November 2019). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/wcc.611\" target=\"_blank\">\"Climate and society in long\u2010term perspective: Opportunities and pitfalls in the use of historical datasets\"<\/a> (in en). <i>WIREs Climate Change<\/i> <b>10<\/b> (6). <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1002%2Fwcc.611\" target=\"_blank\">10.1002\/wcc.611<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1757-7780\" target=\"_blank\">1757-7780<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC6852122\/\" target=\"_blank\">PMC6852122<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/31762795\" target=\"_blank\">31762795<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/wcc.611\" target=\"_blank\">https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/wcc.611<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Climate+and+society+in+long%E2%80%90term+perspective%3A+Opportunities+and+pitfalls+in+the+use+of+historical+datasets&rft.jtitle=WIREs+Climate+Change&rft.aulast=Bavel&rft.aufirst=Bas+J.+P.&rft.au=Bavel%2C%26%2332%3BBas+J.+P.&rft.au=Curtis%2C%26%2332%3BDaniel+R.&rft.au=Hannaford%2C%26%2332%3BMatthew+J.&rft.au=Moatsos%2C%26%2332%3BMichail&rft.au=Roosen%2C%26%2332%3BJoris&rft.au=Soens%2C%26%2332%3BTim&rft.date=1+November+2019&rft.volume=10&rft.issue=6&rft_id=info:doi\/10.1002%2Fwcc.611&rft.issn=1757-7780&rft_id=info:pmc\/PMC6852122&rft_id=info:pmid\/31762795&rft_id=https%3A%2F%2Fonlinelibrary.wiley.com%2Fdoi%2F10.1002%2Fwcc.611&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-93\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-93\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Faniel, Ixchel M.; Frank, Rebecca D.; Yakel, Elizabeth (26 September 2019). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/JD-08-2018-0133\/full\/html\" target=\"_blank\">\"Context from the data reuser\u2019s point of view\"<\/a> (in en). <i>Journal of Documentation<\/i> <b>75<\/b> (6): 1274\u20131297. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1108%2FJD-08-2018-0133\" target=\"_blank\">10.1108\/JD-08-2018-0133<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0022-0418\" target=\"_blank\">0022-0418<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/JD-08-2018-0133\/full\/html\" target=\"_blank\">https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/JD-08-2018-0133\/full\/html<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Context+from+the+data+reuser%E2%80%99s+point+of+view&rft.jtitle=Journal+of+Documentation&rft.aulast=Faniel&rft.aufirst=Ixchel+M.&rft.au=Faniel%2C%26%2332%3BIxchel+M.&rft.au=Frank%2C%26%2332%3BRebecca+D.&rft.au=Yakel%2C%26%2332%3BElizabeth&rft.date=26+September+2019&rft.volume=75&rft.issue=6&rft.pages=1274%E2%80%931297&rft_id=info:doi\/10.1108%2FJD-08-2018-0133&rft.issn=0022-0418&rft_id=https%3A%2F%2Fwww.emerald.com%2Finsight%2Fcontent%2Fdoi%2F10.1108%2FJD-08-2018-0133%2Ffull%2Fhtml&rfr_id=info:sid\/en.wikipedia.org:Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<\/ol><\/div><\/div>\n<h2><span class=\"mw-headline\" id=\"Notes\">Notes<\/span><\/h2>\n<p>This presentation is faithful to the original, with only a few minor changes to presentation. In some cases important information was missing from the references, and that information was added. The original organizes references in alphabetical order; this version organizes them by order of appearance, by design. Several inline URLs in the original were turned into formal citations for this version.\n<\/p>\n<!-- \nNewPP limit report\nCached time: 20230629230541\nCache expiry: 86400\nDynamic content: false\nComplications: []\nCPU time usage: 1.256 seconds\nReal time usage: 1.311 seconds\nPreprocessor visited node count: 89145\/1000000\nPost\u2010expand include size: 740443\/2097152 bytes\nTemplate argument size: 226499\/2097152 bytes\nHighest expansion depth: 25\/40\nExpensive parser function count: 0\/100\nUnstrip recursion depth: 0\/20\nUnstrip post\u2010expand size: 214259\/5000000 bytes\n-->\n<!--\nTransclusion expansion time report (%,ms,calls,template)\n100.00% 1114.610 1 -total\n 90.95% 1013.792 1 Template:Reflist\n 76.62% 853.991 93 Template:Citation\/core\n 68.66% 765.322 76 Template:Cite_journal\n 14.35% 159.896 90 Template:Date\n 7.67% 85.528 154 Template:Citation\/identifier\n 6.08% 67.791 8 Template:Cite_book\n 6.00% 66.932 8 Template:Cite_web\n 3.00% 33.448 1 Template:Infobox_journal_article\n 2.68% 29.904 308 Template:Hide_in_print\n-->\n\n<!-- Saved in parser cache with key limswiki:pcache:idhash:14116-0!canonical and timestamp 20230629230540 and revision id 51852. Serialized with JSON.\n -->\n<\/div><\/div><div class=\"printfooter\">Source: <a rel=\"external_link\" class=\"external\" href=\"https:\/\/www.limswiki.org\/index.php\/Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges\">https:\/\/www.limswiki.org\/index.php\/Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges<\/a><\/div>\n<!-- end content --><div class=\"visualClear\"><\/div><\/div><\/div><div class=\"visualClear\"><\/div><\/div><!-- end of the left (by default at least) column --><div class=\"visualClear\"><\/div><\/div>\n\n\n\n<\/body>","19be31afe217dcc35a45c9d74f9d4aa9_images":["https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/a\/a5\/Fig1_Kelly_DataSciJourn22_21.png"],"19be31afe217dcc35a45c9d74f9d4aa9_timestamp":1688138449,"558c76387f6f314e1cdfb14c7c293ae7_type":"article","558c76387f6f314e1cdfb14c7c293ae7_title":"Ten simple rules for maximizing the recommendations of the NIH data management and sharing plan (Gonzales et al. 2022)","558c76387f6f314e1cdfb14c7c293ae7_url":"https:\/\/www.limswiki.org\/index.php\/Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan","558c76387f6f314e1cdfb14c7c293ae7_plaintext":"\n\nJournal:Ten simple rules for maximizing the recommendations of the NIH data management and sharing planFrom LIMSWikiJump to navigationJump to searchFull article title\n \nTen simple rules for maximizing the recommendations of the NIH data management and sharing planJournal\n \nPLOS Computational BiologyAuthor(s)\n \nGonzales, Sara; Carson, Matthew B.; Holmes, KristiAuthor affiliation(s)\n \nNorthwestern UniversityPrimary contact\n \nEmail: sara dot gonzales2 at northwestern dot eduEditors\n \nMarkel, ScottYear published\n \n2022Volume and issue\n \n18(8)Article #\n \ne1010397DOI\n \n10.1371\/journal.pcbi.1010397ISSN\n \n1553-7358Distribution license\n \nCreative Commons Attribution 4.0 InternationalWebsite\n \nhttps:\/\/journals.plos.org\/ploscompbiol\/article?id=10.1371\/journal.pcbi.1010397Download\n \nhttps:\/\/journals.plos.org\/ploscompbiol\/article\/file?id=10.1371\/journal.pcbi.1010397&type=printable (PDF)\n\nContents \n\n1 Abstract \n2 Introduction \n3 Rule 1: Describe the data: What is it, how much will be generated, and what is the level of processing? \n4 Rule 2: Choose documentation types from the beginning of the project \n5 Rule 3: Describe the tools and software to be used in the project \n6 Rule 4: Use standard file types, identifiers, and descriptive elements \n7 Rule 5: Understand the options for preserving data \n8 Rule 6: Find a repository \n9 Rule 7: Coordinate timelines for data sharing \n10 Rule 8: Protect privacy and confidentiality prior to access \n11 Rule 9: Know the controls and approvals needed for data accessibility \n12 Rule 10: Plan for and outline oversight of data management and sharing \n13 Conclusion: Considering stakeholder perspectives \n\n13.1 Funders and publishers \n13.2 Researchers and their host institutions \n13.3 Libraries \n13.4 The public \n\n\n14 Abbreviations, acronyms, and initialisms \n15 Acknowledgements \n\n15.1 Funding \n15.2 Competing interests \n\n\n16 References \n17 Notes \n\n\n\nAbstract \nThe National Institutes of Health (NIH) Policy for Data Management and Sharing (DMS Policy) recognizes the NIH\u2019s role as a key steward of the United States' biomedical research and information and seeks to enhance that stewardship through systematic recommendations for the preservation and sharing of research data generated by funded projects. The policy is effective as of January 2023. The recommendations include a requirement for the submission of a data management and sharing plan (DMSP) with funding applications, and while no strict template was provided, the NIH has released supplemental draft guidance on elements to consider when developing such a plan. This article provides 10 key recommendations for creating a DMSP that is both maximally compliant and effective.\nKeywords: data management, data management plan, data management and sharing plan, data sharing, data management best practices, persistent identifiers\n\nIntroduction \nClinical and translational researchers have been aware of the increasing data management requirements of the National Institutes of Health (NIH) since its initial release of policies for data management and sharing in 2003.[1] The initial requirement of submission of a data sharing plan applied to funding applications of $500,000 or more in direct costs per year, and that requirement has evolved over the years in order to accommodate the nuances of managing clinical data, as well as increasing sophistication of research data management. After releasing a new Draft Data Management and Sharing (DMS) Policy and Supplemental Draft Guidance for comment in November 2019[2], the NIH incorporated feedback from the community to produce the Final DMS Policy in October 2020.[3] The Final DMS Policy requires a one- to two-page data management and sharing plan (DMSP) to be submitted with the application for all funded research. The intent of the policy is to encourage data sharing to the extent that it is possible, as the policy states. The NIH expects that \u201cresearchers are prospectively planning for data sharing, which we anticipate will increasingly lead researchers to integrate data sharing into the routine conduct of research.\" The NIH adds that, \"[a]ccordingly, we have included in the final DMS Policy an expectation that researchers will maximize appropriate data sharing when developing plans.\u201d[3]\nSharing research data securely and efficiently is a key step toward supporting and advancing translational science, as it allows for savings in researcher time and effort and greater assurance of reproducibility. Concerns with research replicability and reproducibility lie behind the NIH\u2019s guidelines and have been documented in regards to the larger research community extensively in the literature.[4][5][6] Open science practices, including publication of protocols and sharing of code, go a long way toward enabling research reproducibility. Sharing of the de-identified data from clinical studies, when possible, is also a crucial step.\nData sharing on the level required by the new policy is not new to researchers in certain fields, such as those familiar with the NIH Genomic Data Sharing Policy[7], the Model Organism Sharing Policy[8], and other existing sharing policies in the clinical research sphere where NIH funding is involved.[9] The update to existing practices required by the new policy is the requirement of submission of a DMSP with all NIH-funded research submissions, with an expectation of compliance and adherence to the plan (with allowances made for updates) throughout the lifecycle of funded projects.\nThe 10 simple rules below are intended to assist researchers in both writing a plan that is compliant with the new data management and sharing requirements and that is maximized for incorporating as seamlessly as possible into research workflows. The rules are ordered as they pertain to the sections of the Elements of an NIH Data Management and Sharing Plan (DMSP Elements), the NIH\u2019s supplemental guidance document on creating a data management and sharing plan, to demonstrate practical ways to meet the requirements (Fig. 1).\n\r\n\n\n\n\n\n\n\n\n\n\nFigure 1. \"Ten simple rules for maximizing the recommendations of the NIH data management and sharing plan\" mapped against the Elements of an NIH Data Management and Sharing Plan. This mapping shows how the rules in this article map to the recommended elements of an NIH data management and sharing plan as defined in the Supplemental Information to the NIH Policy for Data Management and Sharing: Elements of an NIH Data Management and Sharing Plan.\n\n\n\n Rule 1: Describe the data: What is it, how much will be generated, and what is the level of processing? \nNOTE: This rule corresponds to DMSP Elements: \u201cData Types,\u201d point 1.\nThe DMSP Elements guidance requires description of the types of data that will be generated in the course of the project, including information about the data\u2019s modality, level of aggregation, and level of processing.[10] Though the project is not yet begun at the time of the DMSP submission (which accompanies the budget justification in the grant application), list the data types the research team anticipates will be created. This can be addressed by the following:\n\nModality (or high-level category): List the overall type of data to be created, such as genomic, imaging, text sequences, modeling data, etc.\nFormats: List the anticipated data formats to be created, such as CSV, TSV, XML, JSON, fMRI files, SAV, SAS, DTA.\nAmount: To the extent possible, list the number of files expected to be generated and\/or their anticipated storage space (terabytes of data, petabytes, etc.).\nAggregation: List whether individual or aggregated data provides insights into the research question(s) and also which type (aggregated or non-aggregated) will be shared.\nProcessing: List the anticipated level of processing that will be pursued in the project and also the processing level of data that will be shared.\nRegarding the portions of project data that may be shared, as referenced above, keep in mind that sharing of all data from the project is not required. Subsets of the full dataset may be shared based on what is legally and ethically permitted for sharing (more on this in rules to follow). Subsets can include portions of the data demonstrating the principles outlined in a resulting publication, small representative de-identified subsets, subsets allowing replication of the study, etc.\n\nRule 2: Choose documentation types from the beginning of the project \nNOTE: This rule corresponds to DMSP Elements: \u201cData Types,\u201d point 2.\nThe NIH\u2019s DMSP Elements requires that, in addition to describing the project data that will be produced, a description of the portion of project data that will be preserved and shared is required.[10] Though the project has yet to formally begin, the research team may already have in mind such categories of data, as well as the metadata descriptions that will accompany data throughout its lifecycle, and the types of documentation that will be employed in the project to keep track of the data. Though detailed documentation examples are not required at the time of submission (and would be too lengthy for a one- to two-page data management and sharing plan), it is a good time to consider the documentation that will be used in the project, which may consist of:\n\nMetadata documentation: Explain whether the project will describe data using metadata such as the NIH Common Data Elements[11], the MIAME or MINSEQE[12] standards, or other metadata vocabularies that can be found through resources such as the Digital Curation Centre (DCC).[13]\nData dictionary: A data dictionary describes aspects of the data at the most granular level. This document is generally maintained in spreadsheet form and outlines details of each variable, including both human readable and \u201ccoded\u201d names, definitions, units of measurement, data types and ranges allowed, and permissible null values.[14]\nREADME files: A README contains detailed information about data file formats, as well as data collection methodology, including details on instruments and software used, explanations of relationships between files, and details on quality control (QC) practices.[15] The format is generally a brief explanatory document outlining dataset structures, terminology, and definitions that make research data files easier to understand for secondary users, regardless of where these files are stored.\nThe abovementioned files will be helpful to have in later stages of the project, enabling compliance when the data-sharing stage nears. For any data that is not planned to be preserved and shared online for legal, ethical, or other reasons, a rationale is requested in the DMSP. Having such descriptive metadata providing general information on the content of the files can assist with reinforcing such rationales. In such cases, the types of descriptive files outlined above can serve to represent sensitive datasets without divulging protected information. Moreover, these descriptive files can be made available and discoverable through an institutional-, generalist-, or discipline-specific repository, with metadata denoting the location of the data and more detailed information about brokering access and use of the data.\n\nRule 3: Describe the tools and software to be used in the project \nNOTE: This rule corresponds to DMSP Elements: \u201cRelated Tools, Software, and\/or Code\u201d.\nThe DMSP Elements recommends providing \u201can indication of whether specialized tools are needed to access or manipulate shared scientific data to support replication or reuse, and name(s) of the needed tool(s) and software.\u201d[10] This requirement accompanies and complements the requirements for sharing information about project data because knowledge of the tools and software used in the project supports reproducibility, which is an underlying motivation of the Final NIH Data Management and Sharing Policy. Reproducibility is \u201cthe ability of a researcher to duplicate the results of a prior study using the same materials as were used by the original investigator. That is, a second researcher might use the same raw data to build the same analysis files and implement the same statistical analysis in an attempt to yield the same results.\u201d[16] Data is just one part of the original materials used in a study; the software and tools used to gather and manipulate the data are equally important. Data scientist and reproducibility expert Victoria Stodden emphasizes the importance of computational reproducibility or providing information about the code, scripts, hardware, software, and implementation details of a study in order to enable full reproducibility, allowing for the integral part that computers and software play in modern science.[17]\nIn a compliant DMSP, describe the following:\n\nDevices that will be used to collect project data;\nSoftware or programming languages that will be used to work with the data (e.g., Python, STATA, R);\nWhether the tools and software are open-source (free) or proprietary (must be purchased); and\nIf known, how long the tools and software will be usable to access the data (e.g., until a software program\u2019s end-of-life date).\n Rule 4: Use standard file types, identifiers, and descriptive elements \nNOTE: This rule corresponds to DMSP Elements: \u201cStandards\u201d.\nThe third section of the DMSP Elements guidance asks the researcher to provide \u201can indication of what standards will be applied to the scientific data and associated metadata (i.e., data formats, data dictionaries, data identifiers, definitions, unique identifiers, and other data documentation),\u201d including explications of any common data standards used.[10] Multiple aspects of data can be described under the topic of standards, and many aspects of data mentioned under standards in the guidance are covered in earlier sections like \u201cData Types.\u201d\nThe standards requirement of the NIH DMSP asks researchers to outline, to the extent possible prior to the start of the project, where standardization will be implemented that will ultimately make the data more accessible for future secondary uses. Firstly, describe whether standardized file types will be generated, such as open-source types (e.g., a CSV file used over a proprietary Excel spreadsheet). In addition, if data dictionaries will be employed to define variables, it would be appropriate to outline briefly the dictionaries\u2019 standard format.\nEmploying unique identifiers is also recommended in the standards section. This refers to online persistent identifiers, or PIDs, which are long-lasting references to a digital resource.[18] These identifiers can be assigned to any person, organization, or concept, and their linkable nature is the foundational concept behind linked open data on the web. PIDs allow machines to identify and gather resources based on semantic concepts, just as human-readable metadata terms allow for human search and retrieval of resources.\nA digital object identifier (DOI) is perhaps the best known and most robust persistent identifier for digital outputs of any kind, including datasets. DOIs for scholarly articles, for example, help to track their impact online. A DOI is a special, long-lasting type of URL (Uniform Resource Locator) that is assigned to a digital resource by an identifier registry such as DataCite or CrossRef. This assignment generally happens automatically when a digital resource is deposited into an institutional or other type of digital repository. Compliance with this aspect of the DMSP requirements can be achieved by noting the intention to preserve data in a repository that assigns DOIs. Alternatively, other PIDs in wide use in biomedical research can also be utilized to identify and locate online datasets, these include NCBI accession numbers, PMCIDs for small datasets submitted as supplementary materials to articles in PubMed Central, and Ensemble or Genome identifiers.\nIf additional standardized documentation, such as controlled vocabularies, are planned to be applied to data from the beginning stages of the project, this can be noted briefly in the DMSP as well. Some standards may be in use as part of daily work, such as an ORCiD (an identification number serving to disambiguate researchers), and others might be encountered occasionally throughout the research process (such as the Medical Subject Headings or MeSH). Identifiers commonly used for outputs, people, and concepts in research workflows, which conveniently also incorporate PIDs, are shown in Table 1. Utilizing these types of identifiers when describing data for sharing helps to make data FAIR (findable, accessible, interoperable, and reusable). Data described and preserved according to the FAIR principles is maximized for interoperability and machine readability, which in the long term enables increased impact, discoverability, and computational access to data.[19]\n\n\n\n\n\n\n\nTable 1. Commonly used PIDs in research workflows.\n\n\nCategory\n\nExample(s)\n\n\nOutputs\n\n\u25aa Digital object identifier (DOI): permanent URL or hyperlink that will always lead users to the resource, even if its home webpage is renamed or changes.\r\n\u25aa NCBI accession numbers: unique identifiers for sequence records.[20]\n\n\nPeople\n\n\u25aa ORCID ID: Per their website, ORCID is \"an international, interdisciplinary, open, non-proprietary, and not-for-profit organization created by the research community for the benefit of all stakeholders, including you and the organizations that support the research ecosystem.\"[21] Individuals who sign up with ORCID receive an http URI (Uniform Resource Identifier) with 16 digits that uniquely identifies them. Appending this URI, or PID, to research outputs will help with citation counts and other metrics.\n\n\nConcepts (examples)\n\n\u25aa Medical Subject Headings (MeSH): subject terms with associated PIDs for biomedical concepts.[22]\r\n\u25aa UniProt names and taxonomy section: provides information about protein and gene names, as well as the organism that is the source of the protein sequence.[23]\r\n\u25aa Other unique persistent identifiers, such as those outlined in the PID Graph.[24]\n\n\n\nKeep in mind that full data description examples employing all the abovementioned standards do not need to be provided along with a compliant DMSP; however, if there is an intention to employ such standards, this may be stated, and further plans to utilize such standards can be incorporated later into an implementation plan.\nIn addition, if no consensus standards exist that can be applied as metadata or descriptors for the project\u2019s data, it is acceptable to note the lack of consensus standards in the DMSP.\n\nRule 5: Understand the options for preserving data \nNOTE: This rule corresponds to DMSP Elements: \u201cData preservation, access, and associated timelines\u201d: Point 1.\nThe fourth section of the DMSP Elements guidance requires the researcher to list \u201cthe name of the repository(ies) where scientific data and metadata arising from the project will be archived.\u201d[10] A repository, or digital online storage system for data, is an important choice, as repositories can differ drastically from each other, and in order to be compliant with the DMS Policy, they must meet certain requirements for the accessibility of the data.\nThe NIH provides an additional guidance document on Selecting a Repository for Data Resulting from NIH-Supported Research to make the process of choosing a repository simpler and more streamlined.[25] In a decision-tree-like manner, repository selection recommendations are presented as follows:\n\n1. If the NIH and\/or Institute, Center, Office (ICO) policy(ies), and Funding Opportunity Announcements (FOAs) require use of particular repositories, as listed in their documentation, use the required repositories.\n2. If there is no NIH ICO-determined repository, use an established repository that is appropriate for the project\u2019s data type(s) and that is vetted within the respective research community.\na. As a subset of the above, preference should be given to domain- and data-type-specific repositories. The NIH lists such repository examples on its Open Domain-Specific Data Sharing Repositories webpage.[26]<\/dd>\n3. If there are no domain- or data-type-specific repositories, the NIH recommends using generalist repositories[27], institutional repositories, or submitting small (less than 2 GB) datasets as supplementary materials, along with a publication contribution to PubMed Central.\nRule 6: Find a repository \nNOTE: This rule corresponds to DMSP Elements: \u201cData preservation, access, and associated timelines\u201d: Point 1.\nIf one has followed the repository selection narrowing process from Rule 5 and has determined that either an institutional or one of the many existing generalist repositories must be utilized for depositing data, it can still be challenging to know whether the repository is appropriate or whether it fulfills the NIH\u2019s requirements for data sharing. The NIH\u2019s Selecting a Repository for Data Resulting from NIH-Supported Research contains recommendations (\u201cDesirable Characteristics for All Data Repositories\u201d) on repository characteristics that can help with this decision.[25] Repositories meeting these criteria simultaneously meet the majority of criteria for making data FAIR, as defined by the international GoFAIR, stakeholder-driven initiative.[19]\nThe \u201cDesirable Characteristics\u201d should be reviewed carefully by the research team, especially members of the team with data management expertise, before a repository is listed in the DMSP. If a more appropriate repository is identified later based on the characteristics, an update to the DMSP is warranted. The \u201cDesirable Characteristics\u201d are detailed, but are summarized here in the following categories:\n\nMetadata and PIDs: A unique identifier such as a DOI is assigned to the data deposit by the repository; in addition, descriptive metadata fields in the repository enable FAIRness, utilize vetted schemas, and enable citation.\nEasy access: Free access for de-identified data records having no pre-existing restrictions; data reuse is enabled through clear licenses; the repository employs common, preferably nonproprietary formats. Guidance on how to use data is clear.\nLong-term sustainability: The repository has a long-term management plan and retention policy.\nCuration\/provenance: The repository either provides or allows access to people providing curation or QC assistance for the creation of data deposit records.\nSecurity\/integrity\/confidentiality: The repository\u2019s levels of security match the sensitivity of the data. There is documentation noting security levels, confidentiality protections, and risk management protections.\nThe NIH\u2019s Selecting a Repository guidance contains further requirements for repositories that store human data, even if it has been de-identified.[25] Review these more stringent requirements as well and make sure they are met, if needed, as part of the repository selection process.\nThe NIH has recognized the role that generalist repositories play in enabling data discovery and reuse[28] and has published a non-exhaustive list of generalist repositories to serve as a guide for repository identification.[27] Institutional repositories (including InvenioRDM and Dataverse) and generalist, publicly available repositories (e.g., Zenodo, Dryad, and others participating in the NIH Generalist Repository Ecosystem Initiative[29]) all serve as support for biomedical data reuse by enabling long-term, discoverable FAIR data deposits.\nInstitutional repositories and generalist, publicly available repositories serve many researchers\u2019 data preservation needs, while simultaneously serving the needs of those seeking datasets for reuse within the prescribed limits and licenses. Institutional repositories are maintained by researchers\u2019 institutions and are often maintained by the institution\u2019s library. Such tools have buy-in from the host organization and generally have plans for long-term support. Institutional repositories also often have the added benefit of the availability of support staff within the institution to help with data ingestion and metadata creation.\nAs an addition to the NIH\u2019s guidance, it is helpful to know of repositories that can support creation of a metadata-only record. This type of record does not require the deposit of a data file. Such records are key to sharing information about human subjects data, since these datasets can be difficult to de-identify and share through a repository. By creating a metadata-only record that represents datasets containing personal health information (PHI) or personally identifiable information (PII), the datasets become discoverable, notifying others to the existence of the data, access to which can be brokered via a \u201cContact the Researcher\u201d feature in the repository or via email contact. Through this method of sharing, sensitive data are maintained by the original researcher and shared on a case-by-case basis after a Data Use Agreement is completed.\n\nRule 7: Coordinate timelines for data sharing \nNOTE: This rule corresponds to DMSP Elements: \u201cData preservation, access, and associated timelines\u201d: Point 3.\nTimeliness of data sharing is specifically addressed in the DMSP Elements guidance. While data sharing is recommended at the release time of an associated publication or at the end of the performance period, whichever comes first[10], there are often additional timelines to consider for data sharing based on additional parties\u2019 interests in the data. Like funders, journals frequently have requirements to share portions or all of the data within specific time frames based on project completion or article publication date. Examples of requirements for data sharing by journals are seen in author guidelines by publishers like Science and PLOS, both of which require sufficient data to allow replication of the experiment or analysis at the time of article publication.[30][31] Other timing factors include: institutional or award-based requirements for records retention or, the long-term preservation of data records of note (check institutional records management policies and the FOA\u2019s retention requirements), patent-able aspects of the data and whether limitations are placed on data due to its support of novel inventions, and time required to adequately de-identify human subjects data. If plans for data preservation and archiving, cleaning for the purposes of sharing, and applicable patents are coordinated, data preservation person-hours can be maximized.\nSuch varying stakeholder timelines have significant effects on the total time frame for data availability. Different subsets of the data may need to be made available at different times; Gantt charts and other project management or scheduling tools can help to manage these timelines at the time of DMSP implementation. Making data available for its expected useful lifespan is another factor to plan for and outline in the DMSP.[10] At the time of submission of the DMSP, list the anticipated times for data sharing based on stakeholder requirements as far as they are known at the time. These timelines can be updated as part of regular updates to the DMSP throughout the project lifecycle. As a best practice, consider the retention guidelines of the federal government (generally three years after the completion of the grant\/submission of the final financial report[32][33]), followed by institutional retention requirements, then those of the funder and potential publishers. Plan to preserve data for at least the length of the longest mandated retention period.\n\nRule 8: Protect privacy and confidentiality prior to access \nNOTE: This rule corresponds to DMSP Elements: \u201cAccess, distribution, or reuse considerations\u201d: Part 1.\nAs an agency funding biomedical research studies, the NIH enumerates in their DMSP Elements guidance the various factors potentially limiting research data availability. While it does promote maximum appropriate sharing of data, it acknowledges that this must be done with strict attention to privacy, security, informed consent, and proprietary concerns.[10] Privacy and security concerns begin at the point of data collection.\nThe human subjects data and specimens collected through clinical research contain a wealth of identifiers, from personal information and vital statistics to tissue samples. In a new DRAFT Supplemental Information to the NIH Policy for Data Management and Sharing: Protecting Privacy When Sharing Human Research Participant Data, the NIH enumerates principles for protecting patient privacy as well as strategies for data de-identification.[34] Consulting the standards of the Common Rule[35] and the Health Insurance Portability and Accountability Act (HIPAA) Privacy Rule[36] is recommended, such as the Safe Harbor (removing all 18 identifier types) and Expert Determination (employing the assistance of a person with sufficient scientific and statistical knowledge to render the data unidentifiable) methods. Either method should be vetted by attempting to re-identify individuals using advanced computational methods. While the primary investigator is responsible for any data de-identification strategies, institutional data security experts should also be consulted to review the de-identification plan and final de-identified datasets before publicly sharing data.\nAny de-identification strategy must also respect federal, tribal, state, and local laws and regulations for maintaining data derived from human subjects. A good place to start to explore state laws is the HealthIT.gov website, which contains listings of state consent and patient permission laws.[37] Likewise, a place to start for information on collaboration with tribal communities with respect to data access is the NIH\u2019s DRAFT Supplemental Information to the NIH Policy for Data Management and Sharing: Responsible Management and Sharing of American Indian\/Alaska Native Participant Data.[38]\nInformed consent of the participants in studies utilizing human subjects data is another factor, with vital implications for data sharing. To help comply with increased funder calls for data sharing, many academic health centers\u2019 institutional review boards (IRBs) are updating their requirements for informed consents to include sections on potential present and future sharing of the collected data. In addition, the NIH has recently published a resource on informed consent language to facilitate future data sharing.[39] It is good practice to outline in consent documents any immediate plans for sharing data related to funders and imminent publications, as well as any plans to deposit datasets to a repository for sharing with collaborators or future, unknown researchers. This disclosure provides the patient the ability to opt out of the study if they are not comfortable with this level of data sharing or with the idea that their data may be aggregated, pooled, or reused on new studies far into the future. The language used in the consent forms should outline clearly the exact levels of data sharing to which the patient agrees upon providing their consent. For instance, if such is the case, it should be clearly stated that patients will not be contacted or re-consented for future sharing or accessing of their data through repositories.\n\nRule 9: Know the controls and approvals needed for data accessibility \nNOTE: This rule corresponds to DMSP Elements: \u201cAccess, distribution, or reuse considerations\u201d: Part 2.\nPer the DMSP Elements guidance, the NIH requires descriptions of how access to the data might be controlled by or dependent on approvals.[10] Data accessed or licensed from other sources, as in the case of secondary and meta-analyses, should only be made available if the original source permits data sharing. Similarly, data use agreements (DUAs), which govern the transfer of data between institutions, can have a wide-ranging effect on individual researchers\u2019 data sharing capabilities. Specifically, DUAs must be in place per the HIPAA Privacy Rule before the collaborators can share limited datasets. Such limited datasets typically have some identifiers removed, but they may contain indirect identifiers such as city or zip code, age in years, and dates such as visit dates, birth date, etc.[40]\nFor the participants in a DUA, the potential restrictions on data sharing in order to protect the privacy of study participants are clear. Data should not be further disclosed beyond the ways permitted by the agreement, and when disclosed via these ways, the data recipient must apply safeguards to prevent unauthorized usage and disclosures. If the DUA allows data sharing, it is key for all participants\u2019 DMSPs to specify the permitted venues for sharing (e.g., institutional repositories), the data\u2019s visibility level (will it be shared only with in-house researchers or with the general public?), and which additional de-identification measures will be taken to ensure that a subset of the limited dataset can be deposited or shared as a truly anonymized dataset.\nAny additional legal, regulatory, or policy-based restrictions imposed on data must be taken into account before data are shared. Consider the variety of restrictions that may exist over the lifecycle of data ownership and processing. Secure the appropriate permissions and maintain them with the project\u2019s documentation.\n\nRule 10: Plan for and outline oversight of data management and sharing \nNOTE: This rule corresponds to DMSP Elements: \u201cOversight of data management and sharing\u201d.\nThe sixth recommended section in the NIH\u2019s DMSP Elements guidance requires researchers to indicate how compliance with the plan will be monitored, with what frequency, and by whom.[10] Since science involves many people on a daily basis\u2014including one or more principal investigators (PIs), co-investigators, post-docs, graduate assistants, and interns who collect data, biostatisticians who help to construct analysis plans and conduct analyses, data analysts who create complex database queries, and more\u2014it may be challenging to imagine coordinated data management and compliance accomplished by only one or a few people.\nWhile PIs are ultimately responsible for data management, PIs are increasingly leveraging the skills and expertise of specialized information professionals to fill a dedicated data manager role. The research team\u2019s data manager is responsible for overseeing data as it moves from collection or querying to analysis, storage, and sharing, all while ensuring data integrity and protection of research subject privacy.\nThe Contributor Role Ontology describes a data manager as \u201ca role that encompasses effective and efficient operation and usage of data, including, but not limited to management, handling, or manipulation.\u201d[41] If the analysis of data management practices resulting from the exercise of writing a DMSP demonstrates that a data manager could be a useful addition to the project team, it may be possible to employ evidence amassed from creating the DMSP to make the case to institutions or funders for data management support. Data manager qualifications will vary based on discipline and the types of data requiring processing and management. Ideally, a project data manager will be responsible for introducing, enforcing, interpreting, and regularly overseeing compliance with an NIH data management plan.\nA data manager can get assistance and a great return on investment (ROI) from the DMSP creation process by making DMSPs machine actionable. The DMPTool, a free online resource providing templates for data management plans for various US-based research funders, allows quick creation of compliant DMSPs.[42] While constantly accessible at the DMPTool website, the DMSP will be more relevant and connected to your study if it is made interoperable through the incorporation of key web-based standards for DMSPs. The first is the Research Data Alliance\u2019s Common Standard for Machine-actionable Data Management Plans, a metadata model outlining several key attributes of research datasets, such as their creators, funders, host, and security and privacy requirements.[43] When included in a DMSP, these attributes can be further enhanced for the web by applying PIDs to as many of them as possible, including identifiers for creators, host organizations, and even methods and materials (by using ORCiDs, Research Organization Registry PIDs[44], and the Resource Identification Portal[45], respectively). The National Science Foundation (NSF) in a recent Dear Colleague letter encouraged such efforts to make DMSPs machine-actionable, noting that machine interpretation of a DMSP can be a time-saver in preparing repositories to receive datasets for ingestion.[46] If your DMSP is deposited in the same repository where your protocol, data files, READMEs, and other relevant study documentation is stored, be it an institutional or generalist repository, you will then have created an interoperable collection of study documentation that allows for maximum accessibility and reproducibility of your research.[47]\nLastly, but not least, the NIH has outlined clearly in their Supplemental Information to the NIH Policy for Data Management and Sharing: Allowable Costs for Data Management and Sharing guidance that the costs associated with data curation, preservation, and management are allowable costs and can be factored into the budget justification.[48] These costs can be put toward dedicated team-based data managers or toward partial full-time equivalent (FTE) time from academic libraries or other institutional departments with data management expertise.\n\nConclusion: Considering stakeholder perspectives \nWhile DMSP work may seem daunting, from the viewpoint of the many stakeholders in the research process, it is clear that the benefits of implementing and following improved data management practices and actively sharing data are worth the additional effort. Good practices can impact and benefit all stakeholders, including the research team, their library and other institutional stakeholders, the publishers who can play a role in dissemination of the work, and funders who support research to better understand ROI and meaningful impact. Good DMSP practices can support better engagement with and accountability to the public who benefit from research.\n\nFunders and publishers \nThough this article specifically addresses the data management and sharing requirements of funded projects of the NIH, this agency is not alone among US federal agencies in seeking to increase data management best practices and sharing among awardees. Funding organizations and agencies in the US have sharpened their focus on data sharing over the past 10 years in response to calls for greater availability of the products of funded research made by their governing bodies. A 2013 memorandum from the White House Office of Science and Technology Policy (OSTP) required federal agencies supporting research to provide plans for increased public access to research data.[49] As each agency has worked to complete their plans, they have released guidelines to funded researchers outlining responsibilities for research data preservation and sharing. The NIH has encouraged some form of data sharing for projects funded at over $500,000 since 2003, or nearly 20 years.\nPublishers require various levels of data sharing in accompaniment to submitted articles, a trend that promises to be on the rise in the future. Science, Springer Nature, Wiley, and Sage all offer guidelines on their websites for data sharing for submitted articles, and Taylor & Francis, Springer Nature, and PLOS require data availability statements, which let readers know where the data accompanying articles can be found if it is not included as supplemental material to the article itself.[50] The reproducibility crisis identified in science in recent years has been an impetus for these requirements, as noted in stories of retractions and the inability to access older research data files to corroborate studies as the media and computing environments on which they were made and stored become obsolete.[6][51] The increase in fully online and open-access journals is also helping to bolster the popularity of shared or repository-deposited data, as such dissemination methods allow for a linked network of digital objects that reinforce and support each other while supporting maximum reproducibility.\n\nResearchers and their host institutions \nThe benefits to the host organizations of researchers that accrue through implementing best practices in research data management and sharing cannot be overestimated. Simultaneously, the benefits of data sharing to individual researchers are continually proven as publication tracking and research impact assessments become more widely available. Researchers such as Piwowar et al.[52] and Colavizza et al.[53] have pointed out a connection between an increase in citation rates and sharing of datasets related to published resources. Researchers\u2019 host organizations also benefit from the accumulated increase in citation counts from all its researchers. Likewise, host organizations' reputation benefits as more of its studies are proven reproducible as a result of effective management of data and code. Fewer retractions of articles are necessary when data has been well-managed, which further increases those institutions\u2019 worldwide standing.\nInstitutions\u2019 awareness of the importance of effective management and use of research data is reflected in the growing number of informatics positions supporting health science research. Advances in technology brought about and fostered by informaticians can lead to more effective tools for researchers, with better interfaces, QC, and organization of terminology. In addition, the scientific methods practiced by informaticians themselves often involve meta-analyses, which require cleaned and normalized data.[54]\n\nLibraries \nLibraries may not be the first stakeholders to come to mind for researchers looking to manage data, as they may think of librarians as those who help gather resources for reviews or for project start-ups, rather than those who provide resources throughout the life of a project or who help plan for data preservation. Yet increasingly, librarians are gaining and offering the skills and services to assist researchers throughout the lifespan of their project, from data management planning and implementation, to training research staff in varying levels of data cleaning and preparation, in addition to support for best practices for long-term preservation. As Garcia et al. point out, \u201cmost biologists receive little or no formal preparation for the increasingly computational aspects of their discipline. In consequence, informal training courses are often needed to plug the gaps.\u201d[55] Librarians are a growing force of professionals currently providing those training courses. Check with your institution\u2019s library to see if they offer courses in basic data management, file organization, data cleansing (using popular platforms such as Excel or OpenRefine), depositing materials to institutional and other repositories, and a wealth of other data management topics. In addition to training events, many librarians can work with researchers to upload their materials to repositories, either through basic assistance or through a service-based, mediated deposit.\nThe NIH DMS Policy presents an excellent opportunity for greater understanding and coordination of resources, stakeholders, and support on campus to meet (and potentially even exceed) the requirements. Researchers\u2019 institutional libraries often provide an excellent starting point for assistance with data management and sharing best practices and can provide referrals to other units for additional support on specific facets of the policy. Colleagues, program and human subjects protection officers, and data-savvy units or cores on campus may also have recommendations to support compliance and help build and support efforts toward standardized data management.\n\nThe public \nData management plans describe the practices around the data generated from research and ultimately how those data are preserved and shared. While DMSPs strengthen researcher workflows and research reproducibility, they also play a role in accountability and engagement with taxpayers who fund that research. Each year, the NIH budget is supported by federal appropriations (topping 41.6 billion dollars in 2020[56]), ultimately made possible by taxpayers. The NIH\u2019s investment of these funds in biomedical research brings significant returns, including catalyzing improved human health, driving the economy, generating new knowledge, advancing technology, and empowering a skilled biomedical workforce.[57] Improved practices to support sharing also support greater access to research data by the public and help enhance scientific accountability to the public, a responsibility of all stakeholders, including researchers, funders, institutions and their library, and publishers. The DMSP can provide a powerful vehicle for public engagement and understanding.\n\n Abbreviations, acronyms, and initialisms \nDCC: Digital Curation Centre\nDMS: data management and sharing\nDMSP: data management and sharing plan\nDMSP Elements: Elements of an NIH Data Management and Sharing Plan\nDOI: digital object identifier\nDUA: data use agreement\nFAIR: findable, accessible, interoperable, reusable\nFOA: Funding Opportunity Announcement\nFTE: full-time equivalent\nHIPAA: Health Insurance Portability and Accountability Act\nICO: Institute, Center, Office\nNIH: National Institutes of Health\nNSF: National Science Foundation\nOSTP: Office of Science and Technology Policy\nPHI: personal\/protected health information\nPID: persistent identifier\nPII: personally identifiable information\nQC: quality control\nROI: return on investment\nURL: Uniform Resource Locator\nAcknowledgements \nWe are grateful to many collaborators for ongoing and influential discussions about research data management and sharing.\nThe content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.\n\nFunding \nThis publication was supported, in part, by the National Institutes of Health's National Center for Advancing Translational Sciences, Grant Number UL1TR001422. https:\/\/www.nih.gov\/. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. Several URLs in the original were broken; archived URLs were found for them.\n\nCompeting interests \nThe authors have declared that no competing interests exist.\n\nReferences \n\n\n\u2191 \"About Data Management & Sharing Policies\". NIH Scientific Data Sharing. National Institutes of Health. https:\/\/sharing.nih.gov\/data-management-and-sharing-policy\/about-data-management-and-sharing-policies . Retrieved 07 July 2021 .   \n \n\n\u2191 \"Draft NIH Policy for Data Management and Sharing and Supplemental Draft Guidance\". Scientific Data Sharing. National Institutes of Health, Office of Science Policy. November 2019. https:\/\/osp.od.nih.gov\/policies\/scientific-data-management-policy\/ . Retrieved 07 July 2021 .   \n \n\n\u2191 3.0 3.1 \"Final NIH Policy for Data Management and Sharing\". National Institutes of Health, Office of the Director. 29 October 2020. https:\/\/grants.nih.gov\/grants\/guide\/notice-files\/NOT-OD-21-013.html . Retrieved 07 July 2021 .   \n \n\n\u2191 Committee on Reproducibility and Replicability in Science; Board on Behavioral, Cognitive, and Sensory Sciences; Committee on National Statistics; Division of Behavioral and Social Sciences and Education; Nuclear and Radiation Studies Board; Division on Earth and Life Studies; Board on Mathematical Sciences and Analytics; Committee on Applied and Theoretical Statistics et al. (20 September 2019). Reproducibility and Replicability in Science. Washington, D.C.: National Academies Press. doi:10.17226\/25303. ISBN 978-0-309-48616-3. https:\/\/www.nap.edu\/catalog\/25303 .   \n \n\n\u2191 Peng, Roger D.; Hicks, Stephanie C. (1 April 2021). \"Reproducible Research: A Retrospective\". Annual Review of Public Health 42: 79\u201393. doi:10.1146\/annurev-publhealth-012420-105110. ISSN 1545-2093. PMID 33467923. https:\/\/pubmed.ncbi.nlm.nih.gov\/33467923 .   \n \n\n\u2191 6.0 6.1 Vines, Timothy H.; Albert, Arianne Y. K.; Andrew, Rose L.; D\u00e9barre, Florence; Bock, Dan G.; Franklin, Michelle T.; Gilbert, Kimberly J.; Moore, Jean-S\u00e9bastien et al. (6 January 2014). \"The availability of research data declines rapidly with article age\". Current biology: CB 24 (1): 94\u201397. doi:10.1016\/j.cub.2013.11.014. ISSN 1879-0445. PMID 24361065. https:\/\/pubmed.ncbi.nlm.nih.gov\/24361065 .   \n \n\n\u2191 \"NIH Genomic Data Sharing\". National Institutes of Health, Office of Science Policy. August 2014. Archived from the original on 25 May 2022. https:\/\/web.archive.org\/web\/20220525172026\/https:\/\/osp.od.nih.gov\/web\/20220525172026\/https:\/\/osp.od.nih.gov\/scientific-sharing\/genomic-data-sharing\/ . Retrieved 01 June 2022 .   \n \n\n\u2191 \"Model Organism Sharing Policy\". Scientific Data Sharing. National Institutes of Health. https:\/\/sharing.nih.gov\/other-sharing-policies\/model-organism-sharing-policy . Retrieved 01 June 2022 .   \n \n\n\u2191 \"Other Sharing Policies\". Scientific Data Sharing. National Institutes of Health. https:\/\/sharing.nih.gov\/other-sharing-policies . Retrieved 01 June 2022 .   \n \n\n\u2191 10.0 10.1 10.2 10.3 10.4 10.5 10.6 10.7 10.8 10.9 \"Supplemental Information to the NIH Policy for Data Management and Sharing: Elements of an NIH Data Management and Sharing Plan\". National Institutes of Health, Office of the Director. 29 October 2020. https:\/\/grants.nih.gov\/grants\/guide\/notice-files\/NOT-OD-21-014.html . Retrieved 07 July 2021 .   \n \n\n\u2191 National Institutes of Health. \"Use Common Data Elements for More FAIR Research Data\". NIH CDE Repository. National Library of Medicine. https:\/\/cde.nlm.nih.gov\/home . Retrieved 01 June 2022 .   \n \n\n\u2191 \"MIAME and MINSEQE guidelines\". Gene Expression Omnibus. National Center for Biotechnology Information. 25 April 2022. https:\/\/www.ncbi.nlm.nih.gov\/geo\/info\/MIAME.html . Retrieved 01 June 2022 .   \n \n\n\u2191 \"Biology - Metadata Standards\". DCC Guidance. Digital Curation Centre. https:\/\/www.dcc.ac.uk\/resources\/subject-areas\/biology . Retrieved 01 June 2022 .   \n \n\n\u2191 Lamar Soutter Library (14 June 2021). \"Data Documentation\". Research Data Management Resources. UMass Chan Medical School. https:\/\/libraryguides.umassmed.edu\/research_data_management_resources\/documentation . Retrieved 09 July 2021 .   \n \n\n\u2191 Research Data Management Service Group. \"Guide to writing \"readme\" style metadata\". Cornell University. https:\/\/data.research.cornell.edu\/content\/readme . Retrieved 09 July 2021 .   \n \n\n\u2191 Bollen, K.; Cacioppo, J.T.; Kaplan. R.M. et al. (May 2015). \"Social, Behavioral, and Economic Sciences Perspectives on Robust and Reliable Science\" (PDF). Subcommittee on Replicability in Science Advisory Committee to the National Science Foundation Directorate for Social, Behavioral, and Economic Sciences. https:\/\/www.nsf.gov\/sbe\/AC_Materials\/SBE_Robust_and_Reliable_Research_Report.pdf .   \n \n\n\u2191 \"2014 : What Scientific Idea Is Ready for Retirement\". Edge. Edge Foundation, Inc. 2014. https:\/\/www.edge.org\/response-detail\/25340 . Retrieved 16 July 2021 .   \n \n\n\u2191 ORCID Support (3 May 2019). \"What are persistent identifiers (PIDs)?\". ORCID Support. https:\/\/support.orcid.org\/hc\/en-us\/articles\/360006971013-What-are-persistent-identifiers-PIDs- . Retrieved 29 July 2021 .   \n \n\n\u2191 19.0 19.1 \"FAIR Principles\". GoFAIR. ZBW \u2013 Leibniz Information Centre for Economics; French Ministery for Higher Education, Research and Innovation; International Support and Coordination Office. https:\/\/www.go-fair.org\/fair-principles\/ . Retrieved 29 July 2021 .   \n \n\n\u2191 National Library of Medicine, National Center for Biotechnology Information. \"Sample GenBank Record\". GenBank. National Institutes of Health. https:\/\/www.ncbi.nlm.nih.gov\/genbank\/samplerecord\/ . Retrieved 01 June 2022 .   \n \n\n\u2191 ORCID Support (19 August 2020). \"What is ORCID?\". https:\/\/support.orcid.org\/hc\/en-us\/articles\/360006973993-What-is-ORCID- . Retrieved 29 July 2021 .   \n \n\n\u2191 National Library of Medicine. \"Medical Subject Headings 2021\". National Institutes of Health. https:\/\/meshb.nlm.nih.gov\/search . Retrieved 29 July 2021 .   \n \n\n\u2191 \"Names and Taxonomy Section\". UniProt Consortium. 2021. https:\/\/www.uniprot.org\/help\/names_and_taxonomy_section . Retrieved 29 July 2021 .   \n \n\n\u2191 Cousijn, Helena; Braukmann, Ricarda; Fenner, Martin; Ferguson, Christine; van Horik, Ren\u00e9; Lammey, Rachael; Meadows, Alice; Lambert, Simon (8 January 2021). \"Connected Research: The Potential of the PID Graph\". Patterns (New York, N.Y.) 2 (1): 100180. doi:10.1016\/j.patter.2020.100180. ISSN 2666-3899. PMC 7815961. PMID 33511369. https:\/\/pubmed.ncbi.nlm.nih.gov\/33511369 .   \n \n\n\u2191 25.0 25.1 25.2 \"Supplemental Information to the NIH Policy for Data Management and Sharing: Selecting a Repository for Data Resulting from NIH-Supported Research\". National Institutes of Health. 29 October 2020. https:\/\/grants.nih.gov\/grants\/guide\/notice-files\/NOT-OD-21-016.html . Retrieved 05 August 2021 .   \n \n\n\u2191 National Library of Medicine. \"NIH-Supported Data Sharing Resources - Domain-Specific Repositories\". Data Sharing Resources. National Institutes of Health. https:\/\/www.nlm.nih.gov\/NIHbmic\/domain_specific_repositories.html . Retrieved 05 August 2021 .   \n \n\n\u2191 27.0 27.1 National Library of Medicine. \"NIH-Supported Data Sharing Resources - Generalist Repositories\". Data Sharing Resources. National Institutes of Health. https:\/\/www.nlm.nih.gov\/NIHbmic\/generalist_repositories.html . Retrieved 07 February 2022 .   \n \n\n\u2191 National Institutes of Health (11 February 2020). \"NIH Workshop on the Role of Generalist Repositories to Enhance Data Discoverability and Reuse\". Establishing a FAIR Biomedical Data Ecosystem: The Role of Generalist and Institutional Repositories to Enhance Data Discoverability and Reuse. The Scientific Consulting Group, Inc. https:\/\/www.scgcorp.com\/repositories2020\/Agenda . Retrieved 05 August 2021 .   \n \n\n\u2191 \"NIH Office of Data Science Strategy Announces New Initiative to Improve Access to NIH-funded Data\". News & Events. National Institutes of Health, Office of Data Science Strategy. 26 January 2022. https:\/\/datascience.nih.gov\/news\/nih-office-of-data-science-strategy-announces-new-initiative-to-improve-data-access . Retrieved 28 March 2022 .   \n \n\n\u2191 \"Science Journals: Editorial Policies\". Science Author Portal. American Association for the Advancement of Science. 2021. https:\/\/www.science.org\/content\/page\/science-journals-editorial-policies . Retrieved 06 August 2021 .   \n \n\n\u2191 \"Data Availability\". PLOS One. 5 December 2019. https:\/\/journals.plos.org\/plosone\/s\/data-availability . Retrieved 06 August 2021 .   \n \n\n\u2191 \"OMB Circular A-133 Compliance Supplement March 2007\". Office of Management and Budget. March 2007. https:\/\/georgewbush-whitehouse.archives.gov\/omb\/circulars\/a133_compliance\/07\/07toc.html . Retrieved 01 June 2022 .   \n \n\n\u2191 \"Federal Acquisition Regulation\". Acquisition.gov. General Services Administration. 10 February 2022. https:\/\/www.acquisition.gov\/browse\/index\/far . Retrieved 01 June 2022 .   \n \n\n\u2191 \"Request for Public Comments on DRAFT Supplemental Information to the NIH Policy for Data Management and Sharing: Protecting Privacy When Sharing Human Research Participant Data\". National Institutes of Health, Office of The Director. 12 May 2022. https:\/\/grants.nih.gov\/grants\/guide\/notice-files\/NOT-OD-22-131.html . Retrieved 01 June 2022 .   \n \n\n\u2191 \"2018 Requirements (2018 Common Rule)\". HHS.gov. Office for Human Research Protections. 10 March 2021. https:\/\/www.hhs.gov\/ohrp\/regulations-and-policy\/regulations\/45-cfr-46\/revised-common-rule-regulatory-text\/index.html . Retrieved 01 June 2022 .   \n \n\n\u2191 \"Guidance Regarding Methods for De-identification of Protected Health Information in Accordance with the Health Insurance Portability and Accountability Act (HIPAA) Privacy Rule\". Health Information Privacy. U.S. Department of Health & Human Services. 2021. https:\/\/www.hhs.gov\/hipaa\/for-professionals\/privacy\/special-topics\/de-identification\/index.html . Retrieved 05 August 2021 .   \n \n\n\u2191 \"HIPAA versus State Laws\". HealthIT.gov. U.S. Department of Health & Human Services. 5 September 2017. https:\/\/www.healthit.gov\/topic\/hipaa-versus-state-laws . Retrieved 06 August 2021 .   \n \n\n\u2191 \"Request for Public Comments on DRAFT Supplemental Information to the NIH Policy for Data Management and Sharing: Responsible Management and Sharing of American Indian\/ Alaska Native Participant Data\". National Institutes of Health, Office of the Director. 25 January 2022. https:\/\/grants.nih.gov\/grants\/guide\/notice-files\/NOT-OD-22-064.html . Retrieved 02 June 2022 .   \n \n\n\u2191 Office of Science Policy; Office of Extramural Research (May 2022). \"Informed Consent for Secondary Research with Data and Biospecimens\" (PDF). National Institutes of Health. https:\/\/osp.od.nih.gov\/wp-content\/uploads\/Informed-Consent-Resource-for-Secondary-Research-with-Data-and-Biospecimens.pdf . Retrieved 02 June 2022 .   \n \n\n\u2191 Health Care Systems Research Network (24 February 2020). \"DUA Toolkit: A Guide to Data Use Agreements\" (PDF). Archived from the original on 06 October 2022. https:\/\/web.archive.org\/web\/20221006203224\/https:\/\/www.hcsrn.org\/en\/Tools%20&%20Materials\/GrantsContracting\/HCSRN_DUAToolkit.pdf .   \n \n\n\u2191 Vasilevsky, Nicole; Marijane White; Holmes, Kristi; Brush, Matthew; Haendel, Melissa (11 December 2019), \"data2health\/contributor-role-ontology: 2019-12-11 Release\", Zenodo, doi:10.5281\/zenodo.3570089, https:\/\/zenodo.org\/record\/3570089 . Retrieved 2023-03-24   \n \n\n\u2191 California Digital Library. \"DMPTool\". The Regents of the University of California. https:\/\/dmptool.org\/ . Retrieved 07 February 2022 .   \n \n\n\u2191 Walk, Paul; Miksa, Tomasz; Neish, Peter (2019). \"RDA DMP Common Standard for Machine-actionable Data Management Plans\". Zenodo. doi:10.15497\/RDA00039. https:\/\/zenodo.org\/record\/4036060#.X4VMvWgzY2w .   \n \n\n\u2191 California Digital Library. \"ROR\". https:\/\/ror.org\/ . Retrieved 29 July 2021 .   \n \n\n\u2191 \"RRID Portal\". SciCrunch. https:\/\/scicrunch.org\/resources . Retrieved 07 February 2022 .   \n \n\n\u2191 Tornow, J.S.; Kurose, J.; Marrongelle, K. et al. (20 May 2019). \"Dear Colleague Letter: Effective Practices for Data\". National Science Foundation. https:\/\/www.nsf.gov\/pubs\/2019\/nsf19069\/nsf19069.jsp . Retrieved 07 February 2022 .   \n \n\n\u2191 \"Data Management and Sharing\". Subject Guides. Brown University Library. 19 April 2021. https:\/\/libguides.brown.edu\/data_management\/dmp . Retrieved 07 February 2022 .   \n \n\n\u2191 \"Supplemental Information to the NIH Policy for Data Management and Sharing: Allowable Costs for Data Management and Sharing\". National Institutes of Health, Office of the Director. 29 October 2020. https:\/\/grants.nih.gov\/grants\/guide\/notice-files\/NOT-OD-21-015.html . Retrieved 02 June 2022 .   \n \n\n\u2191 Holdren, J.P. (22 February 2013). \"Increasing Access to the Results of Federally Funded Scientific Research\" (PDF). Office of Science and Technology Policy. https:\/\/www.science.gov\/docs\/ostp_public_access_memo_2013.pdf . Retrieved 12 August 2021 .   \n \n\n\u2191 \"Journal Requirements\". Data Management. MIT Libraries. https:\/\/libraries.mit.edu\/data-management\/share\/journal-requirements\/ . Retrieved 12 August 2021 .   \n \n\n\u2191 Baker, Monya (27 August 2015). \"Over half of psychology studies fail reproducibility test\" (in en). Nature: nature.2015.18248. doi:10.1038\/nature.2015.18248. ISSN 0028-0836. http:\/\/www.nature.com\/articles\/nature.2015.18248 .   \n \n\n\u2191 Piwowar, Heather A.; Day, Roger S.; Fridsma, Douglas B. (21 March 2007). \"Sharing detailed research data is associated with increased citation rate\". PloS One 2 (3): e308. doi:10.1371\/journal.pone.0000308. ISSN 1932-6203. PMC 1817752. PMID 17375194. https:\/\/pubmed.ncbi.nlm.nih.gov\/17375194 .   \n \n\n\u2191 Colavizza, Giovanni; Hrynaszkiewicz, Iain; Staden, Isla; Whitaker, Kirstie; McGillivray, Barbara (2020). \"The citation advantage of linking publications to research data\". PloS One 15 (4): e0230416. doi:10.1371\/journal.pone.0230416. ISSN 1932-6203. PMC 7176083. PMID 32320428. https:\/\/pubmed.ncbi.nlm.nih.gov\/32320428 .   \n \n\n\u2191 Callahan, Alison; Anderson, Kim D.; Beattie, Michael S.; Bixby, John L.; Ferguson, Adam R.; Fouad, Karim; Jakeman, Lyn B.; Nielson, Jessica L. et al. (1 September 2017). \"Developing a data sharing community for spinal cord injury research\". Experimental Neurology 295: 135\u2013143. doi:10.1016\/j.expneurol.2017.05.012. ISSN 1090-2430. PMC 6448396. PMID 28576567. https:\/\/pubmed.ncbi.nlm.nih.gov\/28576567 .   \n \n\n\u2191 Garcia, Leyla; Batut, B\u00e9r\u00e9nice; Burke, Melissa L.; Kuzak, Mateusz; Psomopoulos, Fotis; Arcila, Ricardo; Attwood, Teresa K.; Beard, Niall et al. (1 May 2020). \"Ten simple rules for making training materials FAIR\". PLoS computational biology 16 (5): e1007854. doi:10.1371\/journal.pcbi.1007854. ISSN 1553-7358. PMC 7241697. PMID 32437350. https:\/\/pubmed.ncbi.nlm.nih.gov\/32437350 .   \n \n\n\u2191 \"Appropriations (Section 2)\". The NIH Almanac. U.S. Department of Health and Human Services. 3 March 2020. https:\/\/www.nih.gov\/about-nih\/what-we-do\/nih-almanac\/appropriations-section-2 . Retrieved 16 February 2022 .   \n \n\n\u2191 \"Impact of NIH Research\". National Institutes of Health. 2022. https:\/\/www.nih.gov\/about-nih\/what-we-do\/impact-nih-research . Retrieved 16 February 2022 .   \n \n\n\nNotes \nThis presentation is faithful to the original, with only a few minor changes to presentation, grammar, and punctuation. In some cases important information was missing from the references, and that information was added.\n\n\n\n\n\nSource: <a rel=\"external_link\" class=\"external\" href=\"https:\/\/www.limswiki.org\/index.php\/Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\">https:\/\/www.limswiki.org\/index.php\/Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan<\/a>\nCategories: LIMSwiki journal articles (added in 2023)LIMSwiki journal articles (all)LIMSwiki journal articles on bioinformaticsLIMSwiki journal articles on data management and sharingNavigation menuPage actionsJournalDiscussionView sourceHistoryPage actionsJournalDiscussionMoreToolsIn other languagesPersonal toolsLog inNavigationMain pageEncyclopedic articlesRecent changesRandom pageHelp about MediaWikiSearch\u00a0 ToolsWhat links hereRelated changesSpecial pagesPermanent linkPage informationPopular publications\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\nPrint\/exportCreate a bookDownload as PDFDownload as PDFDownload as Plain textPrintable version This page was last edited on 24 March 2023, at 18:00.Content is available under a Creative Commons Attribution-ShareAlike 4.0 International License unless otherwise noted.This page has been accessed 226 times.Privacy policyAbout LIMSWikiDisclaimers\n\n\n\n","558c76387f6f314e1cdfb14c7c293ae7_html":"<body class=\"mediawiki ltr sitedir-ltr mw-hide-empty-elt ns-206 ns-subject page-Journal_Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan rootpage-Journal_Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan skin-monobook action-view skin--responsive\"><div id=\"rdp-ebb-globalWrapper\"><div id=\"rdp-ebb-column-content\"><div id=\"rdp-ebb-content\" class=\"mw-body\" role=\"main\"><a id=\"rdp-ebb-top\"><\/a>\n<h1 id=\"rdp-ebb-firstHeading\" class=\"firstHeading\" lang=\"en\">Journal:Ten simple rules for maximizing the recommendations of the NIH data management and sharing plan<\/h1><div id=\"rdp-ebb-bodyContent\" class=\"mw-body-content\"><!-- start content --><div id=\"rdp-ebb-mw-content-text\" lang=\"en\" dir=\"ltr\" class=\"mw-content-ltr\"><div class=\"mw-parser-output\">\n\n\n<h2><span class=\"mw-headline\" id=\"Abstract\">Abstract<\/span><\/h2>\n<p>The <a href=\"https:\/\/www.limswiki.org\/index.php\/National_Institutes_of_Health\" title=\"National Institutes of Health\" class=\"wiki-link\" data-key=\"e5c215c48e73ae58b0695dc2af951cd0\">National Institutes of Health<\/a> (NIH) Policy for Data Management and Sharing (DMS Policy) recognizes the NIH\u2019s role as a key steward of the United States' biomedical research and information and seeks to enhance that stewardship through systematic recommendations for the preservation and <a href=\"https:\/\/www.limswiki.org\/index.php\/Data_sharing\" title=\"Data sharing\" class=\"wiki-link\" data-key=\"a99d5fda27f755c693c65864d9286130\">sharing<\/a> of research data generated by funded projects. The policy is effective as of January 2023. The recommendations include a requirement for the submission of a data management and sharing plan (DMSP) with funding applications, and while no strict template was provided, the NIH has released supplemental draft guidance on elements to consider when developing such a plan. This article provides 10 key recommendations for creating a DMSP that is both maximally compliant and effective.\n<\/p><p><b>Keywords<\/b>: data management, data management plan, data management and sharing plan, data sharing, data management best practices, persistent identifiers\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Introduction\">Introduction<\/span><\/h2>\n<p>Clinical and <a href=\"https:\/\/www.limswiki.org\/index.php\/Translational_research\" title=\"Translational research\" class=\"wiki-link\" data-key=\"b5462c2278492de7f21a60e40299b634\">translational researchers<\/a> have been aware of the increasing <a href=\"https:\/\/www.limswiki.org\/index.php\/Information_management\" title=\"Information management\" class=\"wiki-link\" data-key=\"f8672d270c0750a858ed940158ca0a73\">data management<\/a> requirements of the <a href=\"https:\/\/www.limswiki.org\/index.php\/National_Institutes_of_Health\" title=\"National Institutes of Health\" class=\"wiki-link\" data-key=\"e5c215c48e73ae58b0695dc2af951cd0\">National Institutes of Health<\/a> (NIH) since its initial release of policies for data management and <a href=\"https:\/\/www.limswiki.org\/index.php\/Data_sharing\" title=\"Data sharing\" class=\"wiki-link\" data-key=\"a99d5fda27f755c693c65864d9286130\">sharing<\/a> in 2003.<sup id=\"rdp-ebb-cite_ref-1\" class=\"reference\"><a href=\"#cite_note-1\">[1]<\/a><\/sup> The initial requirement of submission of a data sharing plan applied to funding applications of $500,000 or more in direct costs per year, and that requirement has evolved over the years in order to accommodate the nuances of managing clinical data, as well as increasing sophistication of research data management. After releasing a new Draft Data Management and Sharing (DMS) Policy and Supplemental Draft Guidance for comment in November 2019<sup id=\"rdp-ebb-cite_ref-2\" class=\"reference\"><a href=\"#cite_note-2\">[2]<\/a><\/sup>, the NIH incorporated feedback from the community to produce the Final DMS Policy in October 2020.<sup id=\"rdp-ebb-cite_ref-:0_3-0\" class=\"reference\"><a href=\"#cite_note-:0-3\">[3]<\/a><\/sup> The Final DMS Policy requires a one- to two-page data management and sharing plan (DMSP) to be submitted with the application for all funded research. The intent of the policy is to encourage data sharing to the extent that it is possible, as the policy states. The NIH expects that \u201cresearchers are prospectively planning for data sharing, which we anticipate will increasingly lead researchers to integrate data sharing into the routine conduct of research.\" The NIH adds that, \"[a]ccordingly, we have included in the final DMS Policy an expectation that researchers will maximize appropriate data sharing when developing plans.\u201d<sup id=\"rdp-ebb-cite_ref-:0_3-1\" class=\"reference\"><a href=\"#cite_note-:0-3\">[3]<\/a><\/sup>\n<\/p><p>Sharing research data securely and efficiently is a key step toward supporting and advancing translational science, as it allows for savings in researcher time and effort and greater assurance of reproducibility. Concerns with research replicability and reproducibility lie behind the NIH\u2019s guidelines and have been documented in regards to the larger research community extensively in the literature.<sup id=\"rdp-ebb-cite_ref-4\" class=\"reference\"><a href=\"#cite_note-4\">[4]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-5\" class=\"reference\"><a href=\"#cite_note-5\">[5]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-:5_6-0\" class=\"reference\"><a href=\"#cite_note-:5-6\">[6]<\/a><\/sup> Open science practices, including publication of protocols and sharing of code, go a long way toward enabling research reproducibility. Sharing of the de-identified data from clinical studies, when possible, is also a crucial step.\n<\/p><p>Data sharing on the level required by the new policy is not new to researchers in certain fields, such as those familiar with the NIH Genomic Data Sharing Policy<sup id=\"rdp-ebb-cite_ref-7\" class=\"reference\"><a href=\"#cite_note-7\">[7]<\/a><\/sup>, the Model Organism Sharing Policy<sup id=\"rdp-ebb-cite_ref-8\" class=\"reference\"><a href=\"#cite_note-8\">[8]<\/a><\/sup>, and other existing sharing policies in the clinical research sphere where NIH funding is involved.<sup id=\"rdp-ebb-cite_ref-9\" class=\"reference\"><a href=\"#cite_note-9\">[9]<\/a><\/sup> The update to existing practices required by the new policy is the requirement of submission of a DMSP with all NIH-funded research submissions, with an expectation of compliance and adherence to the plan (with allowances made for updates) throughout the lifecycle of funded projects.\n<\/p><p>The 10 simple rules below are intended to assist researchers in both writing a plan that is compliant with the new data management and sharing requirements and that is maximized for incorporating as seamlessly as possible into research <a href=\"https:\/\/www.limswiki.org\/index.php\/Workflow\" title=\"Workflow\" class=\"wiki-link\" data-key=\"92bd8748272e20d891008dcb8243e8a8\">workflows<\/a>. The rules are ordered as they pertain to the sections of the <i>Elements of an NIH Data Management and Sharing Plan<\/i> (DMSP Elements), the NIH\u2019s supplemental guidance document on creating a data management and sharing plan, to demonstrate practical ways to meet the requirements (Fig. 1).\n<\/p><p><br \/>\n<a href=\"https:\/\/www.limswiki.org\/index.php\/File:Fig1_Gonzales_PLOSComBio22_18-8.png\" class=\"image wiki-link\" data-key=\"e878ccc6fb0405aae96f04cc3dd9482d\"><img alt=\"Fig1 Gonzales PLOSComBio22 18-8.png\" src=\"https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/8\/86\/Fig1_Gonzales_PLOSComBio22_18-8.png\" decoding=\"async\" style=\"width: 100%;max-width: 400px;height: auto;\" \/><\/a>\n<\/p>\n<div style=\"clear:both;\"><\/div>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table border=\"0\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><blockquote><p><b>Figure 1.<\/b> \"Ten simple rules for maximizing the recommendations of the NIH data management and sharing plan\" mapped against the <i>Elements of an NIH Data Management and Sharing Plan<\/i>. This mapping shows how the rules in this article map to the recommended elements of an NIH data management and sharing plan as defined in the <i>Supplemental Information to the NIH Policy for Data Management and Sharing: Elements of an NIH Data Management and Sharing Plan<\/i>.<\/p><\/blockquote>\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<h2><span id=\"rdp-ebb-Rule_1:_Describe_the_data:_What_is_it,_how_much_will_be_generated,_and_what_is_the_level_of_processing?\"><\/span><span class=\"mw-headline\" id=\"Rule_1:_Describe_the_data:_What_is_it.2C_how_much_will_be_generated.2C_and_what_is_the_level_of_processing.3F\">Rule 1: Describe the data: What is it, how much will be generated, and what is the level of processing?<\/span><\/h2>\n<p><b>NOTE<\/b>: This rule corresponds to DMSP Elements: \u201cData Types,\u201d point 1.\n<\/p><p>The DMSP Elements guidance requires description of the types of data that will be generated in the course of the project, including information about the data\u2019s modality, level of aggregation, and level of processing.<sup id=\"rdp-ebb-cite_ref-:1_10-0\" class=\"reference\"><a href=\"#cite_note-:1-10\">[10]<\/a><\/sup> Though the project is not yet begun at the time of the DMSP submission (which accompanies the budget justification in the grant application), list the data types the research team anticipates will be created. This can be addressed by the following:\n<\/p>\n<ul><li><b>Modality (or high-level category)<\/b>: List the overall type of data to be created, such as <a href=\"https:\/\/www.limswiki.org\/index.php\/Genomics\" title=\"Genomics\" class=\"wiki-link\" data-key=\"96a82dabf51cf9510dd00c5a03396c44\">genomic<\/a>, <a href=\"https:\/\/www.limswiki.org\/index.php\/Imaging\" class=\"mw-disambig wiki-link\" title=\"Imaging\" data-key=\"c99dd47b045eb67ecc822556afcbda57\">imaging<\/a>, text sequences, modeling data, etc.<\/li>\n<li><b>Formats<\/b>: List the anticipated data formats to be created, such as CSV, TSV, XML, JSON, fMRI files, SAV, SAS, DTA.<\/li>\n<li><b>Amount<\/b>: To the extent possible, list the number of files expected to be generated and\/or their anticipated storage space (terabytes of data, petabytes, etc.).<\/li>\n<li><b>Aggregation<\/b>: List whether individual or aggregated data provides insights into the research question(s) and also which type (aggregated or non-aggregated) will be shared.<\/li>\n<li><b>Processing<\/b>: List the anticipated level of processing that will be pursued in the project and also the processing level of data that will be shared.<\/li><\/ul>\n<p>Regarding the portions of project data that may be shared, as referenced above, keep in mind that sharing of all data from the project is not required. Subsets of the full dataset may be shared based on what is legally and ethically permitted for sharing (more on this in rules to follow). Subsets can include portions of the data demonstrating the principles outlined in a resulting publication, small representative de-identified subsets, subsets allowing replication of the study, etc.\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Rule_2:_Choose_documentation_types_from_the_beginning_of_the_project\">Rule 2: Choose documentation types from the beginning of the project<\/span><\/h2>\n<p><b>NOTE<\/b>: This rule corresponds to DMSP Elements: \u201cData Types,\u201d point 2.\n<\/p><p>The NIH\u2019s DMSP Elements requires that, in addition to describing the project data that will be produced, a description of the portion of project data that will be preserved and shared is required.<sup id=\"rdp-ebb-cite_ref-:1_10-1\" class=\"reference\"><a href=\"#cite_note-:1-10\">[10]<\/a><\/sup> Though the project has yet to formally begin, the research team may already have in mind such categories of data, as well as the <a href=\"https:\/\/www.limswiki.org\/index.php\/Metadata\" title=\"Metadata\" class=\"wiki-link\" data-key=\"f872d4d6272811392bafe802f3edf2d8\">metadata<\/a> descriptions that will accompany data throughout its lifecycle, and the types of documentation that will be employed in the project to keep track of the data. Though detailed documentation examples are not required at the time of submission (and would be too lengthy for a one- to two-page data management and sharing plan), it is a good time to consider the documentation that will be used in the project, which may consist of:\n<\/p>\n<ul><li><b>Metadata documentation<\/b>: Explain whether the project will describe data using metadata such as the NIH Common Data Elements<sup id=\"rdp-ebb-cite_ref-11\" class=\"reference\"><a href=\"#cite_note-11\">[11]<\/a><\/sup>, the MIAME or MINSEQE<sup id=\"rdp-ebb-cite_ref-12\" class=\"reference\"><a href=\"#cite_note-12\">[12]<\/a><\/sup> standards, or other metadata vocabularies that can be found through resources such as the Digital Curation Centre (DCC).<sup id=\"rdp-ebb-cite_ref-13\" class=\"reference\"><a href=\"#cite_note-13\">[13]<\/a><\/sup><\/li>\n<li><b>Data dictionary<\/b>: A data dictionary describes aspects of the data at the most granular level. This document is generally maintained in spreadsheet form and outlines details of each variable, including both human readable and \u201ccoded\u201d names, definitions, units of measurement, data types and ranges allowed, and permissible null values.<sup id=\"rdp-ebb-cite_ref-14\" class=\"reference\"><a href=\"#cite_note-14\">[14]<\/a><\/sup><\/li>\n<li><b>README files<\/b>: A README contains detailed information about data file formats, as well as data collection methodology, including details on instruments and software used, explanations of relationships between files, and details on <a href=\"https:\/\/www.limswiki.org\/index.php\/Quality_control\" title=\"Quality control\" class=\"wiki-link\" data-key=\"1e0e0c2eb3e45aff02f5d61799821f0f\">quality control<\/a> (QC) practices.<sup id=\"rdp-ebb-cite_ref-15\" class=\"reference\"><a href=\"#cite_note-15\">[15]<\/a><\/sup> The format is generally a brief explanatory document outlining dataset structures, terminology, and definitions that make research data files easier to understand for secondary users, regardless of where these files are stored.<\/li><\/ul>\n<p>The abovementioned files will be helpful to have in later stages of the project, enabling compliance when the data-sharing stage nears. For any data that is not planned to be preserved and shared online for legal, ethical, or other reasons, a rationale is requested in the DMSP. Having such descriptive metadata providing general information on the content of the files can assist with reinforcing such rationales. In such cases, the types of descriptive files outlined above can serve to represent sensitive datasets without divulging protected information. Moreover, these descriptive files can be made available and discoverable through an institutional-, generalist-, or discipline-specific repository, with metadata denoting the location of the data and more detailed <a href=\"https:\/\/www.limswiki.org\/index.php\/Information\" title=\"Information\" class=\"wiki-link\" data-key=\"6300a14d9c2776dcca0999b5ed940e7d\">information<\/a> about brokering access and use of the data.\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Rule_3:_Describe_the_tools_and_software_to_be_used_in_the_project\">Rule 3: Describe the tools and software to be used in the project<\/span><\/h2>\n<p><b>NOTE<\/b>: This rule corresponds to DMSP Elements: \u201cRelated Tools, Software, and\/or Code\u201d.\n<\/p><p>The DMSP Elements recommends providing \u201can indication of whether specialized tools are needed to access or manipulate shared scientific data to support replication or reuse, and name(s) of the needed tool(s) and software.\u201d<sup id=\"rdp-ebb-cite_ref-:1_10-2\" class=\"reference\"><a href=\"#cite_note-:1-10\">[10]<\/a><\/sup> This requirement accompanies and complements the requirements for sharing information about project data because knowledge of the tools and software used in the project supports reproducibility, which is an underlying motivation of the Final NIH Data Management and Sharing Policy. Reproducibility is \u201cthe ability of a researcher to duplicate the results of a prior study using the same materials as were used by the original investigator. That is, a second researcher might use the same raw data to build the same analysis files and implement the same statistical analysis in an attempt to yield the same results.\u201d<sup id=\"rdp-ebb-cite_ref-16\" class=\"reference\"><a href=\"#cite_note-16\">[16]<\/a><\/sup> Data is just one part of the original materials used in a study; the software and tools used to gather and manipulate the data are equally important. Data scientist and reproducibility expert Victoria Stodden emphasizes the importance of computational reproducibility or providing information about the code, scripts, hardware, software, and implementation details of a study in order to enable full reproducibility, allowing for the integral part that computers and software play in modern science.<sup id=\"rdp-ebb-cite_ref-17\" class=\"reference\"><a href=\"#cite_note-17\">[17]<\/a><\/sup>\n<\/p><p>In a compliant DMSP, describe the following:\n<\/p>\n<ul><li>Devices that will be used to collect project data;<\/li>\n<li>Software or programming languages that will be used to work with the data (e.g., <a href=\"https:\/\/www.limswiki.org\/index.php\/Python_(programming_language)\" title=\"Python (programming language)\" class=\"wiki-link\" data-key=\"ef6905a29cbb75d3c71e6bdf6e2915dd\">Python<\/a>, STATA, <a href=\"https:\/\/www.limswiki.org\/index.php\/R_(programming_language)\" title=\"R (programming language)\" class=\"wiki-link\" data-key=\"1b0aa598f071aca4c5b4ee08d8bb2bde\">R<\/a>);<\/li>\n<li>Whether the tools and software are open-source (free) or proprietary (must be purchased); and<\/li>\n<li>If known, how long the tools and software will be usable to access the data (e.g., until a software program\u2019s end-of-life date).<\/li><\/ul>\n<h2><span id=\"rdp-ebb-Rule_4:_Use_standard_file_types,_identifiers,_and_descriptive_elements\"><\/span><span class=\"mw-headline\" id=\"Rule_4:_Use_standard_file_types.2C_identifiers.2C_and_descriptive_elements\">Rule 4: Use standard file types, identifiers, and descriptive elements<\/span><\/h2>\n<p><b>NOTE<\/b>: This rule corresponds to DMSP Elements: \u201cStandards\u201d.\n<\/p><p>The third section of the DMSP Elements guidance asks the researcher to provide \u201can indication of what standards will be applied to the scientific data and associated metadata (i.e., data formats, data dictionaries, data identifiers, definitions, unique identifiers, and other data documentation),\u201d including explications of any common data standards used.<sup id=\"rdp-ebb-cite_ref-:1_10-3\" class=\"reference\"><a href=\"#cite_note-:1-10\">[10]<\/a><\/sup> Multiple aspects of data can be described under the topic of standards, and many aspects of data mentioned under standards in the guidance are covered in earlier sections like \u201cData Types.\u201d\n<\/p><p>The standards requirement of the NIH DMSP asks researchers to outline, to the extent possible prior to the start of the project, where standardization will be implemented that will ultimately make the data more accessible for future secondary uses. Firstly, describe whether standardized file types will be generated, such as open-source types (e.g., a CSV file used over a proprietary Excel spreadsheet). In addition, if data dictionaries will be employed to define variables, it would be appropriate to outline briefly the dictionaries\u2019 standard format.\n<\/p><p>Employing unique identifiers is also recommended in the standards section. This refers to online persistent identifiers, or PIDs, which are long-lasting references to a digital resource.<sup id=\"rdp-ebb-cite_ref-18\" class=\"reference\"><a href=\"#cite_note-18\">[18]<\/a><\/sup> These identifiers can be assigned to any person, organization, or concept, and their linkable nature is the foundational concept behind linked open data on the web. PIDs allow machines to identify and gather resources based on semantic concepts, just as human-readable metadata terms allow for human search and retrieval of resources.\n<\/p><p>A digital object identifier (DOI) is perhaps the best known and most robust persistent identifier for digital outputs of any kind, including datasets. DOIs for scholarly articles, for example, help to track their impact online. A DOI is a special, long-lasting type of URL (Uniform Resource Locator) that is assigned to a digital resource by an identifier registry such as DataCite or CrossRef. This assignment generally happens automatically when a digital resource is deposited into an institutional or other type of digital repository. Compliance with this aspect of the DMSP requirements can be achieved by noting the intention to preserve data in a repository that assigns DOIs. Alternatively, other PIDs in wide use in biomedical research can also be utilized to identify and locate online datasets, these include NCBI accession numbers, PMCIDs for small datasets submitted as supplementary materials to articles in <a href=\"https:\/\/www.limswiki.org\/index.php\/PubMed_Central\" title=\"PubMed Central\" class=\"wiki-link\" data-key=\"b01a151daea339def7efe3e1d7326367\">PubMed Central<\/a>, and Ensemble or Genome identifiers.\n<\/p><p>If additional standardized documentation, such as controlled vocabularies, are planned to be applied to data from the beginning stages of the project, this can be noted briefly in the DMSP as well. Some standards may be in use as part of daily work, such as an ORCiD (an identification number serving to disambiguate researchers), and others might be encountered occasionally throughout the research process (such as the Medical Subject Headings or MeSH). Identifiers commonly used for outputs, people, and concepts in research workflows, which conveniently also incorporate PIDs, are shown in Table 1. Utilizing these types of identifiers when describing data for sharing helps to make data <a href=\"https:\/\/www.limswiki.org\/index.php\/Journal:The_FAIR_Guiding_Principles_for_scientific_data_management_and_stewardship\" title=\"Journal:The FAIR Guiding Principles for scientific data management and stewardship\" class=\"wiki-link\" data-key=\"e5903ddcc7734415af1d91fcd258da90\">FAIR<\/a> (findable, accessible, interoperable, and reusable). Data described and preserved according to the FAIR principles is maximized for interoperability and machine readability, which in the long term enables increased impact, discoverability, and computational access to data.<sup id=\"rdp-ebb-cite_ref-:2_19-0\" class=\"reference\"><a href=\"#cite_note-:2-19\">[19]<\/a><\/sup>\n<\/p>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table class=\"wikitable\" border=\"1\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td colspan=\"2\" style=\"background-color:white; padding-left:10px; padding-right:10px;\"><b>Table 1.<\/b> Commonly used PIDs in research workflows.\n<\/td><\/tr>\n<tr>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Category\n<\/th>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Example(s)\n<\/th><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Outputs\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\u25aa Digital object identifier (DOI): permanent URL or hyperlink that will always lead users to the resource, even if its home webpage is renamed or changes.<br \/>\u25aa NCBI accession numbers: unique identifiers for sequence records.<sup id=\"rdp-ebb-cite_ref-20\" class=\"reference\"><a href=\"#cite_note-20\">[20]<\/a><\/sup>\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">People\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\u25aa ORCID ID: Per their website, ORCID is \"an international, interdisciplinary, open, non-proprietary, and not-for-profit organization created by the research community for the benefit of all stakeholders, including you and the organizations that support the research ecosystem.\"<sup id=\"rdp-ebb-cite_ref-21\" class=\"reference\"><a href=\"#cite_note-21\">[21]<\/a><\/sup> Individuals who sign up with ORCID receive an http URI (Uniform Resource Identifier) with 16 digits that uniquely identifies them. Appending this URI, or PID, to research outputs will help with citation counts and other metrics.\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Concepts (examples)\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\u25aa Medical Subject Headings (MeSH): subject terms with associated PIDs for biomedical concepts.<sup id=\"rdp-ebb-cite_ref-22\" class=\"reference\"><a href=\"#cite_note-22\">[22]<\/a><\/sup><br \/>\u25aa UniProt names and taxonomy section: provides information about protein and gene names, as well as the organism that is the source of the protein sequence.<sup id=\"rdp-ebb-cite_ref-23\" class=\"reference\"><a href=\"#cite_note-23\">[23]<\/a><\/sup><br \/>\u25aa Other unique persistent identifiers, such as those outlined in the PID Graph.<sup id=\"rdp-ebb-cite_ref-24\" class=\"reference\"><a href=\"#cite_note-24\">[24]<\/a><\/sup>\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<p>Keep in mind that full data description examples employing all the abovementioned standards do not need to be provided along with a compliant DMSP; however, if there is an intention to employ such standards, this may be stated, and further plans to utilize such standards can be incorporated later into an implementation plan.\n<\/p><p>In addition, if no consensus standards exist that can be applied as metadata or descriptors for the project\u2019s data, it is acceptable to note the lack of consensus standards in the DMSP.\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Rule_5:_Understand_the_options_for_preserving_data\">Rule 5: Understand the options for preserving data<\/span><\/h2>\n<p><b>NOTE<\/b>: This rule corresponds to DMSP Elements: \u201cData preservation, access, and associated timelines\u201d: Point 1.\n<\/p><p>The fourth section of the DMSP Elements guidance requires the researcher to list \u201cthe name of the repository(ies) where scientific data and metadata arising from the project will be archived.\u201d<sup id=\"rdp-ebb-cite_ref-:1_10-4\" class=\"reference\"><a href=\"#cite_note-:1-10\">[10]<\/a><\/sup> A repository, or digital online storage system for data, is an important choice, as repositories can differ drastically from each other, and in order to be compliant with the DMS Policy, they must meet certain requirements for the accessibility of the data.\n<\/p><p>The NIH provides an additional guidance document on <i>Selecting a Repository for Data Resulting from NIH-Supported Research<\/i> to make the process of choosing a repository simpler and more streamlined.<sup id=\"rdp-ebb-cite_ref-:3_25-0\" class=\"reference\"><a href=\"#cite_note-:3-25\">[25]<\/a><\/sup> In a decision-tree-like manner, repository selection recommendations are presented as follows:\n<\/p>\n<dl><dd>1. If the NIH and\/or Institute, Center, Office (ICO) policy(ies), and Funding Opportunity Announcements (FOAs) require use of particular repositories, as listed in their documentation, use the required repositories.<\/dd>\n<dd>2. If there is no NIH ICO-determined repository, use an established repository that is appropriate for the project\u2019s data type(s) and that is vetted within the respective research community.\n<dl><dd>a. As a subset of the above, preference should be given to domain- and data-type-specific repositories. The NIH lists such repository examples on its Open Domain-Specific Data Sharing Repositories webpage.<sup id=\"rdp-ebb-cite_ref-26\" class=\"reference\"><a href=\"#cite_note-26\">[26]<\/a><\/sup><\/dd><\/dl><\/dd>\n<dd>3. If there are no domain- or data-type-specific repositories, the NIH recommends using generalist repositories<sup id=\"rdp-ebb-cite_ref-:4_27-0\" class=\"reference\"><a href=\"#cite_note-:4-27\">[27]<\/a><\/sup>, institutional repositories, or submitting small (less than 2 GB) datasets as supplementary materials, along with a publication contribution to PubMed Central.<\/dd><\/dl>\n<h2><span class=\"mw-headline\" id=\"Rule_6:_Find_a_repository\">Rule 6: Find a repository<\/span><\/h2>\n<p><b>NOTE<\/b>: This rule corresponds to DMSP Elements: \u201cData preservation, access, and associated timelines\u201d: Point 1.\n<\/p><p>If one has followed the repository selection narrowing process from Rule 5 and has determined that either an institutional or one of the many existing generalist repositories must be utilized for depositing data, it can still be challenging to know whether the repository is appropriate or whether it fulfills the NIH\u2019s requirements for data sharing. The NIH\u2019s <i>Selecting a Repository for Data Resulting from NIH-Supported Research<\/i> contains recommendations (\u201cDesirable Characteristics for All Data Repositories\u201d) on repository characteristics that can help with this decision.<sup id=\"rdp-ebb-cite_ref-:3_25-1\" class=\"reference\"><a href=\"#cite_note-:3-25\">[25]<\/a><\/sup> Repositories meeting these criteria simultaneously meet the majority of criteria for making data FAIR, as defined by the international GoFAIR, stakeholder-driven initiative.<sup id=\"rdp-ebb-cite_ref-:2_19-1\" class=\"reference\"><a href=\"#cite_note-:2-19\">[19]<\/a><\/sup>\n<\/p><p>The \u201cDesirable Characteristics\u201d should be reviewed carefully by the research team, especially members of the team with data management expertise, before a repository is listed in the DMSP. If a more appropriate repository is identified later based on the characteristics, an update to the DMSP is warranted. The \u201cDesirable Characteristics\u201d are detailed, but are summarized here in the following categories:\n<\/p>\n<ul><li><b>Metadata and PIDs<\/b>: A unique identifier such as a DOI is assigned to the data deposit by the repository; in addition, descriptive metadata fields in the repository enable FAIRness, utilize vetted schemas, and enable citation.<\/li>\n<li><b>Easy access<\/b>: Free access for de-identified data records having no pre-existing restrictions; data reuse is enabled through clear licenses; the repository employs common, preferably nonproprietary formats. Guidance on how to use data is clear.<\/li>\n<li><b>Long-term sustainability<\/b>: The repository has a long-term management plan and <a href=\"https:\/\/www.limswiki.org\/index.php\/Retention_period\" title=\"Retention period\" class=\"wiki-link\" data-key=\"c86c284ee804b9cc2dc5743b9e706120\">retention policy<\/a>.<\/li>\n<li><b>Curation\/provenance<\/b>: The repository either provides or allows access to people providing curation or QC assistance for the creation of data deposit records.<\/li>\n<li><b>Security\/integrity\/confidentiality<\/b>: The repository\u2019s levels of security match the sensitivity of the data. There is documentation noting security levels, confidentiality protections, and <a href=\"https:\/\/www.limswiki.org\/index.php\/Risk_management\" title=\"Risk management\" class=\"wiki-link\" data-key=\"ecfbfb2550c23f053bd1aa0d9ea63e4e\">risk management<\/a> protections.<\/li><\/ul>\n<p>The NIH\u2019s <i>Selecting a Repository<\/i> guidance contains further requirements for repositories that store human data, even if it has been de-identified.<sup id=\"rdp-ebb-cite_ref-:3_25-2\" class=\"reference\"><a href=\"#cite_note-:3-25\">[25]<\/a><\/sup> Review these more stringent requirements as well and make sure they are met, if needed, as part of the repository selection process.\n<\/p><p>The NIH has recognized the role that generalist repositories play in enabling data discovery and reuse<sup id=\"rdp-ebb-cite_ref-28\" class=\"reference\"><a href=\"#cite_note-28\">[28]<\/a><\/sup> and has published a non-exhaustive list of generalist repositories to serve as a guide for repository identification.<sup id=\"rdp-ebb-cite_ref-:4_27-1\" class=\"reference\"><a href=\"#cite_note-:4-27\">[27]<\/a><\/sup> Institutional repositories (including InvenioRDM and Dataverse) and generalist, publicly available repositories (e.g., Zenodo, Dryad, and others participating in the NIH Generalist Repository Ecosystem Initiative<sup id=\"rdp-ebb-cite_ref-29\" class=\"reference\"><a href=\"#cite_note-29\">[29]<\/a><\/sup>) all serve as support for biomedical data reuse by enabling long-term, discoverable FAIR data deposits.\n<\/p><p>Institutional repositories and generalist, publicly available repositories serve many researchers\u2019 data preservation needs, while simultaneously serving the needs of those seeking datasets for reuse within the prescribed limits and licenses. Institutional repositories are maintained by researchers\u2019 institutions and are often maintained by the institution\u2019s library. Such tools have buy-in from the host organization and generally have plans for long-term support. Institutional repositories also often have the added benefit of the availability of support staff within the institution to help with data ingestion and metadata creation.\n<\/p><p>As an addition to the NIH\u2019s guidance, it is helpful to know of repositories that can support creation of a metadata-only record. This type of record does not require the deposit of a data file. Such records are key to sharing information about human subjects data, since these datasets can be difficult to de-identify and share through a repository. By creating a metadata-only record that represents datasets containing <a href=\"https:\/\/www.limswiki.org\/index.php\/Protected_health_information\" title=\"Protected health information\" class=\"wiki-link\" data-key=\"eca2f6661b6896668bd523e640e12499\">personal health information<\/a> (PHI) or personally identifiable information (PII), the datasets become discoverable, notifying others to the existence of the data, access to which can be brokered via a \u201cContact the Researcher\u201d feature in the repository or via email contact. Through this method of sharing, sensitive data are maintained by the original researcher and shared on a case-by-case basis after a Data Use Agreement is completed.\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Rule_7:_Coordinate_timelines_for_data_sharing\">Rule 7: Coordinate timelines for data sharing<\/span><\/h2>\n<p><b>NOTE<\/b>: This rule corresponds to DMSP Elements: \u201cData preservation, access, and associated timelines\u201d: Point 3.\n<\/p><p>Timeliness of data sharing is specifically addressed in the DMSP Elements guidance. While data sharing is recommended at the release time of an associated publication or at the end of the performance period, whichever comes first<sup id=\"rdp-ebb-cite_ref-:1_10-5\" class=\"reference\"><a href=\"#cite_note-:1-10\">[10]<\/a><\/sup>, there are often additional timelines to consider for data sharing based on additional parties\u2019 interests in the data. Like funders, journals frequently have requirements to share portions or all of the data within specific time frames based on project completion or article publication date. Examples of requirements for data sharing by journals are seen in author guidelines by publishers like Science and PLOS, both of which require sufficient data to allow replication of the experiment or analysis at the time of article publication.<sup id=\"rdp-ebb-cite_ref-30\" class=\"reference\"><a href=\"#cite_note-30\">[30]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-31\" class=\"reference\"><a href=\"#cite_note-31\">[31]<\/a><\/sup> Other timing factors include: institutional or award-based requirements for records retention or, the long-term preservation of data records of note (check institutional records management policies and the FOA\u2019s retention requirements), patent-able aspects of the data and whether limitations are placed on data due to its support of novel inventions, and time required to adequately de-identify human subjects data. If plans for data preservation and archiving, cleaning for the purposes of sharing, and applicable patents are coordinated, data preservation person-hours can be maximized.\n<\/p><p>Such varying stakeholder timelines have significant effects on the total time frame for data availability. Different subsets of the data may need to be made available at different times; Gantt charts and other project management or scheduling tools can help to manage these timelines at the time of DMSP implementation. Making data available for its expected useful lifespan is another factor to plan for and outline in the DMSP.<sup id=\"rdp-ebb-cite_ref-:1_10-6\" class=\"reference\"><a href=\"#cite_note-:1-10\">[10]<\/a><\/sup> At the time of submission of the DMSP, list the anticipated times for data sharing based on stakeholder requirements as far as they are known at the time. These timelines can be updated as part of regular updates to the DMSP throughout the project lifecycle. As a best practice, consider the retention guidelines of the federal government (generally three years after the completion of the grant\/submission of the final financial report<sup id=\"rdp-ebb-cite_ref-32\" class=\"reference\"><a href=\"#cite_note-32\">[32]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-33\" class=\"reference\"><a href=\"#cite_note-33\">[33]<\/a><\/sup>), followed by institutional retention requirements, then those of the funder and potential publishers. Plan to preserve data for at least the length of the longest mandated retention period.\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Rule_8:_Protect_privacy_and_confidentiality_prior_to_access\">Rule 8: Protect privacy and confidentiality prior to access<\/span><\/h2>\n<p><b>NOTE<\/b>: This rule corresponds to DMSP Elements: \u201cAccess, distribution, or reuse considerations\u201d: Part 1.\n<\/p><p>As an agency funding biomedical research studies, the NIH enumerates in their DMSP Elements guidance the various factors potentially limiting research data availability. While it does promote maximum appropriate sharing of data, it acknowledges that this must be done with strict attention to privacy, security, informed consent, and proprietary concerns.<sup id=\"rdp-ebb-cite_ref-:1_10-7\" class=\"reference\"><a href=\"#cite_note-:1-10\">[10]<\/a><\/sup> Privacy and security concerns begin at the point of data collection.\n<\/p><p>The human subjects data and specimens collected through clinical research contain a wealth of identifiers, from personal information and vital statistics to tissue samples. In a new <i>DRAFT Supplemental Information to the NIH Policy for Data Management and Sharing: Protecting Privacy When Sharing Human Research Participant Data<\/i>, the NIH enumerates principles for protecting patient privacy as well as strategies for data de-identification.<sup id=\"rdp-ebb-cite_ref-34\" class=\"reference\"><a href=\"#cite_note-34\">[34]<\/a><\/sup> Consulting the standards of the Common Rule<sup id=\"rdp-ebb-cite_ref-35\" class=\"reference\"><a href=\"#cite_note-35\">[35]<\/a><\/sup> and the <a href=\"https:\/\/www.limswiki.org\/index.php\/Health_Insurance_Portability_and_Accountability_Act\" title=\"Health Insurance Portability and Accountability Act\" class=\"wiki-link\" data-key=\"b70673a0117c21576016cb7498867153\">Health Insurance Portability and Accountability Act<\/a> (HIPAA) Privacy Rule<sup id=\"rdp-ebb-cite_ref-36\" class=\"reference\"><a href=\"#cite_note-36\">[36]<\/a><\/sup> is recommended, such as the Safe Harbor (removing all 18 identifier types) and Expert Determination (employing the assistance of a person with sufficient scientific and statistical knowledge to render the data unidentifiable) methods. Either method should be vetted by attempting to re-identify individuals using advanced computational methods. While the primary investigator is responsible for any data de-identification strategies, institutional data security experts should also be consulted to review the de-identification plan and final de-identified datasets before publicly sharing data.\n<\/p><p>Any de-identification strategy must also respect federal, tribal, state, and local laws and regulations for maintaining data derived from human subjects. A good place to start to explore state laws is the <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.healthit.gov\/\" target=\"_blank\">HealthIT.gov<\/a> website, which contains listings of state consent and patient permission laws.<sup id=\"rdp-ebb-cite_ref-37\" class=\"reference\"><a href=\"#cite_note-37\">[37]<\/a><\/sup> Likewise, a place to start for information on collaboration with tribal communities with respect to data access is the NIH\u2019s <i>DRAFT Supplemental Information to the NIH Policy for Data Management and Sharing: Responsible Management and Sharing of American Indian\/Alaska Native Participant Data<\/i>.<sup id=\"rdp-ebb-cite_ref-38\" class=\"reference\"><a href=\"#cite_note-38\">[38]<\/a><\/sup>\n<\/p><p>Informed consent of the participants in studies utilizing human subjects data is another factor, with vital implications for data sharing. To help comply with increased funder calls for data sharing, many academic health centers\u2019 institutional review boards (IRBs) are updating their requirements for informed consents to include sections on potential present and future sharing of the collected data. In addition, the NIH has recently published a resource on informed consent language to facilitate future data sharing.<sup id=\"rdp-ebb-cite_ref-39\" class=\"reference\"><a href=\"#cite_note-39\">[39]<\/a><\/sup> It is good practice to outline in consent documents any immediate plans for sharing data related to funders and imminent publications, as well as any plans to deposit datasets to a repository for sharing with collaborators or future, unknown researchers. This disclosure provides the patient the ability to opt out of the study if they are not comfortable with this level of data sharing or with the idea that their data may be aggregated, pooled, or reused on new studies far into the future. The language used in the consent forms should outline clearly the exact levels of data sharing to which the patient agrees upon providing their consent. For instance, if such is the case, it should be clearly stated that patients will not be contacted or re-consented for future sharing or accessing of their data through repositories.\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Rule_9:_Know_the_controls_and_approvals_needed_for_data_accessibility\">Rule 9: Know the controls and approvals needed for data accessibility<\/span><\/h2>\n<p><b>NOTE<\/b>: This rule corresponds to DMSP Elements: \u201cAccess, distribution, or reuse considerations\u201d: Part 2.\n<\/p><p>Per the DMSP Elements guidance, the NIH requires descriptions of how access to the data might be controlled by or dependent on approvals.<sup id=\"rdp-ebb-cite_ref-:1_10-8\" class=\"reference\"><a href=\"#cite_note-:1-10\">[10]<\/a><\/sup> Data accessed or licensed from other sources, as in the case of secondary and meta-analyses, should only be made available if the original source permits data sharing. Similarly, data use agreements (DUAs), which govern the transfer of data between institutions, can have a wide-ranging effect on individual researchers\u2019 data sharing capabilities. Specifically, DUAs must be in place per the HIPAA Privacy Rule before the collaborators can share limited datasets. Such limited datasets typically have some identifiers removed, but they may contain indirect identifiers such as city or zip code, age in years, and dates such as visit dates, birth date, etc.<sup id=\"rdp-ebb-cite_ref-40\" class=\"reference\"><a href=\"#cite_note-40\">[40]<\/a><\/sup>\n<\/p><p>For the participants in a DUA, the potential restrictions on data sharing in order to protect the privacy of study participants are clear. Data should not be further disclosed beyond the ways permitted by the agreement, and when disclosed via these ways, the data recipient must apply safeguards to prevent unauthorized usage and disclosures. If the DUA allows data sharing, it is key for all participants\u2019 DMSPs to specify the permitted venues for sharing (e.g., institutional repositories), the data\u2019s visibility level (will it be shared only with in-house researchers or with the general public?), and which additional de-identification measures will be taken to ensure that a subset of the limited dataset can be deposited or shared as a truly anonymized dataset.\n<\/p><p>Any additional legal, regulatory, or policy-based restrictions imposed on data must be taken into account before data are shared. Consider the variety of restrictions that may exist over the lifecycle of data ownership and processing. Secure the appropriate permissions and maintain them with the project\u2019s documentation.\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Rule_10:_Plan_for_and_outline_oversight_of_data_management_and_sharing\">Rule 10: Plan for and outline oversight of data management and sharing<\/span><\/h2>\n<p><b>NOTE<\/b>: This rule corresponds to DMSP Elements: \u201cOversight of data management and sharing\u201d.\n<\/p><p>The sixth recommended section in the NIH\u2019s DMSP Elements guidance requires researchers to indicate how compliance with the plan will be monitored, with what frequency, and by whom.<sup id=\"rdp-ebb-cite_ref-:1_10-9\" class=\"reference\"><a href=\"#cite_note-:1-10\">[10]<\/a><\/sup> Since science involves many people on a daily basis\u2014including one or more principal investigators (PIs), co-investigators, post-docs, graduate assistants, and interns who collect data, biostatisticians who help to construct analysis plans and conduct analyses, data analysts who create complex database queries, and more\u2014it may be challenging to imagine coordinated data management and compliance accomplished by only one or a few people.\n<\/p><p>While PIs are ultimately responsible for data management, PIs are increasingly leveraging the skills and expertise of specialized information professionals to fill a dedicated data manager role. The research team\u2019s data manager is responsible for overseeing data as it moves from collection or querying to <a href=\"https:\/\/www.limswiki.org\/index.php\/Data_analysis\" title=\"Data analysis\" class=\"wiki-link\" data-key=\"545c95e40ca67c9e63cd0a16042a5bd1\">analysis<\/a>, storage, and sharing, all while ensuring <a href=\"https:\/\/www.limswiki.org\/index.php\/Data_integrity\" title=\"Data integrity\" class=\"wiki-link\" data-key=\"382a9bb77ee3e36bb3b37c79ed813167\">data integrity<\/a> and protection of research subject privacy.\n<\/p><p>The Contributor Role Ontology describes a data manager as \u201ca role that encompasses effective and efficient operation and usage of data, including, but not limited to management, handling, or manipulation.\u201d<sup id=\"rdp-ebb-cite_ref-41\" class=\"reference\"><a href=\"#cite_note-41\">[41]<\/a><\/sup> If the analysis of data management practices resulting from the exercise of writing a DMSP demonstrates that a data manager could be a useful addition to the project team, it may be possible to employ evidence amassed from creating the DMSP to make the case to institutions or funders for data management support. Data manager qualifications will vary based on discipline and the types of data requiring processing and management. Ideally, a project data manager will be responsible for introducing, enforcing, interpreting, and regularly overseeing compliance with an NIH data management plan.\n<\/p><p>A data manager can get assistance and a great return on investment (ROI) from the DMSP creation process by making DMSPs machine actionable. The DMPTool, a free online resource providing templates for data management plans for various US-based research funders, allows quick creation of compliant DMSPs.<sup id=\"rdp-ebb-cite_ref-42\" class=\"reference\"><a href=\"#cite_note-42\">[42]<\/a><\/sup> While constantly accessible at the DMPTool website, the DMSP will be more relevant and connected to your study if it is made interoperable through the incorporation of key web-based standards for DMSPs. The first is the Research Data Alliance\u2019s Common Standard for Machine-actionable Data Management Plans, a metadata model outlining several key attributes of research datasets, such as their creators, funders, host, and security and privacy requirements.<sup id=\"rdp-ebb-cite_ref-43\" class=\"reference\"><a href=\"#cite_note-43\">[43]<\/a><\/sup> When included in a DMSP, these attributes can be further enhanced for the web by applying PIDs to as many of them as possible, including identifiers for creators, host organizations, and even methods and materials (by using ORCiDs, Research Organization Registry PIDs<sup id=\"rdp-ebb-cite_ref-44\" class=\"reference\"><a href=\"#cite_note-44\">[44]<\/a><\/sup>, and the Resource Identification Portal<sup id=\"rdp-ebb-cite_ref-45\" class=\"reference\"><a href=\"#cite_note-45\">[45]<\/a><\/sup>, respectively). The National Science Foundation (NSF) in a recent Dear Colleague letter encouraged such efforts to make DMSPs machine-actionable, noting that machine interpretation of a DMSP can be a time-saver in preparing repositories to receive datasets for ingestion.<sup id=\"rdp-ebb-cite_ref-46\" class=\"reference\"><a href=\"#cite_note-46\">[46]<\/a><\/sup> If your DMSP is deposited in the same repository where your protocol, data files, READMEs, and other relevant study documentation is stored, be it an institutional or generalist repository, you will then have created an interoperable collection of study documentation that allows for maximum accessibility and reproducibility of your research.<sup id=\"rdp-ebb-cite_ref-47\" class=\"reference\"><a href=\"#cite_note-47\">[47]<\/a><\/sup>\n<\/p><p>Lastly, but not least, the NIH has outlined clearly in their <i>Supplemental Information to the NIH Policy for Data Management and Sharing: Allowable Costs for Data Management and Sharing<\/i> guidance that the costs associated with data curation, preservation, and management are allowable costs and can be factored into the budget justification.<sup id=\"rdp-ebb-cite_ref-48\" class=\"reference\"><a href=\"#cite_note-48\">[48]<\/a><\/sup> These costs can be put toward dedicated team-based data managers or toward partial full-time equivalent (FTE) time from academic libraries or other institutional departments with data management expertise.\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Conclusion:_Considering_stakeholder_perspectives\">Conclusion: Considering stakeholder perspectives<\/span><\/h2>\n<p>While DMSP work may seem daunting, from the viewpoint of the many stakeholders in the research process, it is clear that the benefits of implementing and following improved data management practices and actively sharing data are worth the additional effort. Good practices can impact and benefit all stakeholders, including the research team, their library and other institutional stakeholders, the publishers who can play a role in dissemination of the work, and funders who support research to better understand ROI and meaningful impact. Good DMSP practices can support better engagement with and accountability to the public who benefit from research.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Funders_and_publishers\">Funders and publishers<\/span><\/h3>\n<p>Though this article specifically addresses the data management and sharing requirements of funded projects of the NIH, this agency is not alone among US federal agencies in seeking to increase data management best practices and sharing among awardees. Funding organizations and agencies in the US have sharpened their focus on data sharing over the past 10 years in response to calls for greater availability of the products of funded research made by their governing bodies. A 2013 memorandum from the White House Office of Science and Technology Policy (OSTP) required federal agencies supporting research to provide plans for increased public access to research data.<sup id=\"rdp-ebb-cite_ref-49\" class=\"reference\"><a href=\"#cite_note-49\">[49]<\/a><\/sup> As each agency has worked to complete their plans, they have released guidelines to funded researchers outlining responsibilities for research data preservation and sharing. The NIH has encouraged some form of data sharing for projects funded at over $500,000 since 2003, or nearly 20 years.\n<\/p><p>Publishers require various levels of data sharing in accompaniment to submitted articles, a trend that promises to be on the rise in the future. Science, Springer Nature, Wiley, and Sage all offer guidelines on their websites for data sharing for submitted articles, and Taylor & Francis, Springer Nature, and PLOS require data availability statements, which let readers know where the data accompanying articles can be found if it is not included as supplemental material to the article itself.<sup id=\"rdp-ebb-cite_ref-50\" class=\"reference\"><a href=\"#cite_note-50\">[50]<\/a><\/sup> The reproducibility crisis identified in science in recent years has been an impetus for these requirements, as noted in stories of retractions and the inability to access older research data files to corroborate studies as the media and computing environments on which they were made and stored become obsolete.<sup id=\"rdp-ebb-cite_ref-:5_6-1\" class=\"reference\"><a href=\"#cite_note-:5-6\">[6]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-51\" class=\"reference\"><a href=\"#cite_note-51\">[51]<\/a><\/sup> The increase in fully online and open-access journals is also helping to bolster the popularity of shared or repository-deposited data, as such dissemination methods allow for a linked network of digital objects that reinforce and support each other while supporting maximum reproducibility.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Researchers_and_their_host_institutions\">Researchers and their host institutions<\/span><\/h3>\n<p>The benefits to the host organizations of researchers that accrue through implementing best practices in research data management and sharing cannot be overestimated. Simultaneously, the benefits of data sharing to individual researchers are continually proven as publication tracking and research impact assessments become more widely available. Researchers such as Piwowar <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-52\" class=\"reference\"><a href=\"#cite_note-52\">[52]<\/a><\/sup> and Colavizza <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-53\" class=\"reference\"><a href=\"#cite_note-53\">[53]<\/a><\/sup> have pointed out a connection between an increase in citation rates and sharing of datasets related to published resources. Researchers\u2019 host organizations also benefit from the accumulated increase in citation counts from all its researchers. Likewise, host organizations' reputation benefits as more of its studies are proven reproducible as a result of effective management of data and code. Fewer retractions of articles are necessary when data has been well-managed, which further increases those institutions\u2019 worldwide standing.\n<\/p><p>Institutions\u2019 awareness of the importance of effective management and use of research data is reflected in the growing number of <a href=\"https:\/\/www.limswiki.org\/index.php\/Informatics_(academic_field)\" title=\"Informatics (academic field)\" class=\"wiki-link\" data-key=\"0391318826a5d9f9a1a1bcc88394739f\">informatics<\/a> positions supporting health science research. Advances in technology brought about and fostered by informaticians can lead to more effective tools for researchers, with better interfaces, QC, and organization of terminology. In addition, the scientific methods practiced by informaticians themselves often involve meta-analyses, which require <a href=\"https:\/\/www.limswiki.org\/index.php\/Data_cleansing\" title=\"Data cleansing\" class=\"wiki-link\" data-key=\"c0cec85355e07dc9cbfe96983a4e27a2\">cleaned<\/a> and normalized data.<sup id=\"rdp-ebb-cite_ref-54\" class=\"reference\"><a href=\"#cite_note-54\">[54]<\/a><\/sup>\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Libraries\">Libraries<\/span><\/h3>\n<p>Libraries may not be the first stakeholders to come to mind for researchers looking to manage data, as they may think of librarians as those who help gather resources for reviews or for project start-ups, rather than those who provide resources throughout the life of a project or who help plan for data preservation. Yet increasingly, librarians are gaining and offering the skills and services to assist researchers throughout the lifespan of their project, from data management planning and implementation, to training research staff in varying levels of data cleaning and preparation, in addition to support for best practices for long-term preservation. As Garcia <i>et al.<\/i> point out, \u201cmost biologists receive little or no formal preparation for the increasingly computational aspects of their discipline. In consequence, informal training courses are often needed to plug the gaps.\u201d<sup id=\"rdp-ebb-cite_ref-55\" class=\"reference\"><a href=\"#cite_note-55\">[55]<\/a><\/sup> Librarians are a growing force of professionals currently providing those training courses. Check with your institution\u2019s library to see if they offer courses in basic data management, file organization, data cleansing (using popular platforms such as Excel or OpenRefine), depositing materials to institutional and other repositories, and a wealth of other data management topics. In addition to training events, many librarians can work with researchers to upload their materials to repositories, either through basic assistance or through a service-based, mediated deposit.\n<\/p><p>The NIH DMS Policy presents an excellent opportunity for greater understanding and coordination of resources, stakeholders, and support on campus to meet (and potentially even exceed) the requirements. Researchers\u2019 institutional libraries often provide an excellent starting point for assistance with data management and sharing best practices and can provide referrals to other units for additional support on specific facets of the policy. Colleagues, program and human subjects protection officers, and data-savvy units or cores on campus may also have recommendations to support compliance and help build and support efforts toward standardized data management.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"The_public\">The public<\/span><\/h3>\n<p>Data management plans describe the practices around the data generated from research and ultimately how those data are preserved and shared. While DMSPs strengthen researcher workflows and research reproducibility, they also play a role in accountability and engagement with taxpayers who fund that research. Each year, the NIH budget is supported by federal appropriations (topping 41.6 billion dollars in 2020<sup id=\"rdp-ebb-cite_ref-56\" class=\"reference\"><a href=\"#cite_note-56\">[56]<\/a><\/sup>), ultimately made possible by taxpayers. The NIH\u2019s investment of these funds in biomedical research brings significant returns, including catalyzing improved human health, driving the economy, generating new knowledge, advancing technology, and empowering a skilled biomedical workforce.<sup id=\"rdp-ebb-cite_ref-57\" class=\"reference\"><a href=\"#cite_note-57\">[57]<\/a><\/sup> Improved practices to support sharing also support greater access to research data by the public and help enhance scientific accountability to the public, a responsibility of all stakeholders, including researchers, funders, institutions and their library, and publishers. The DMSP can provide a powerful vehicle for public engagement and understanding.\n<\/p>\n<h2><span id=\"rdp-ebb-Abbreviations,_acronyms,_and_initialisms\"><\/span><span class=\"mw-headline\" id=\"Abbreviations.2C_acronyms.2C_and_initialisms\">Abbreviations, acronyms, and initialisms<\/span><\/h2>\n<ul><li><b>DCC<\/b>: Digital Curation Centre<\/li>\n<li><b>DMS<\/b>: data management and sharing<\/li>\n<li><b>DMSP<\/b>: data management and sharing plan<\/li>\n<li><b>DMSP Elements<\/b>: <i>Elements of an NIH Data Management and Sharing Plan<\/i><\/li>\n<li><b>DOI<\/b>: digital object identifier<\/li>\n<li><b>DUA<\/b>: data use agreement<\/li>\n<li><b>FAIR<\/b>: findable, accessible, interoperable, reusable<\/li>\n<li><b>FOA<\/b>: Funding Opportunity Announcement<\/li>\n<li><b>FTE<\/b>: full-time equivalent<\/li>\n<li><b>HIPAA<\/b>: Health Insurance Portability and Accountability Act<\/li>\n<li><b>ICO<\/b>: Institute, Center, Office<\/li>\n<li><b>NIH<\/b>: National Institutes of Health<\/li>\n<li><b>NSF<\/b>: National Science Foundation<\/li>\n<li><b>OSTP<\/b>: Office of Science and Technology Policy<\/li>\n<li><b>PHI<\/b>: personal\/protected health information<\/li>\n<li><b>PID<\/b>: persistent identifier<\/li>\n<li><b>PII<\/b>: personally identifiable information<\/li>\n<li><b>QC<\/b>: quality control<\/li>\n<li><b>ROI<\/b>: return on investment<\/li>\n<li><b>URL<\/b>: Uniform Resource Locator<\/li><\/ul>\n<h2><span class=\"mw-headline\" id=\"Acknowledgements\">Acknowledgements<\/span><\/h2>\n<p>We are grateful to many collaborators for ongoing and influential discussions about research data management and sharing.\n<\/p><p>The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Funding\">Funding<\/span><\/h3>\n<p>This publication was supported, in part, by the National Institutes of Health's National Center for Advancing Translational Sciences, Grant Number UL1TR001422. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.nih.gov\/\" target=\"_blank\">https:\/\/www.nih.gov\/<\/a>. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. Several URLs in the original were broken; archived URLs were found for them.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Competing_interests\">Competing interests<\/span><\/h3>\n<p>The authors have declared that no competing interests exist.\n<\/p>\n<h2><span class=\"mw-headline\" id=\"References\">References<\/span><\/h2>\n<div class=\"reflist references-column-width\" style=\"-moz-column-width: 30em; -webkit-column-width: 30em; column-width: 30em; list-style-type: decimal;\">\n<div class=\"mw-references-wrap mw-references-columns\"><ol class=\"references\">\n<li id=\"cite_note-1\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-1\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/sharing.nih.gov\/data-management-and-sharing-policy\/about-data-management-and-sharing-policies\" target=\"_blank\">\"About Data Management & Sharing Policies\"<\/a>. <i>NIH Scientific Data Sharing<\/i>. National Institutes of Health<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/sharing.nih.gov\/data-management-and-sharing-policy\/about-data-management-and-sharing-policies\" target=\"_blank\">https:\/\/sharing.nih.gov\/data-management-and-sharing-policy\/about-data-management-and-sharing-policies<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 07 July 2021<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=About+Data+Management+%26+Sharing+Policies&rft.atitle=NIH+Scientific+Data+Sharing&rft.pub=National+Institutes+of+Health&rft_id=https%3A%2F%2Fsharing.nih.gov%2Fdata-management-and-sharing-policy%2Fabout-data-management-and-sharing-policies&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-2\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-2\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/osp.od.nih.gov\/policies\/scientific-data-management-policy\/\" target=\"_blank\">\"Draft NIH Policy for Data Management and Sharing and Supplemental Draft Guidance\"<\/a>. <i>Scientific Data Sharing<\/i>. National Institutes of Health, Office of Science Policy. November 2019<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/osp.od.nih.gov\/policies\/scientific-data-management-policy\/\" target=\"_blank\">https:\/\/osp.od.nih.gov\/policies\/scientific-data-management-policy\/<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 07 July 2021<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Draft+NIH+Policy+for+Data+Management+and+Sharing+and+Supplemental+Draft+Guidance&rft.atitle=Scientific+Data+Sharing&rft.date=November+2019&rft.pub=National+Institutes+of+Health%2C+Office+of+Science+Policy&rft_id=https%3A%2F%2Fosp.od.nih.gov%2Fpolicies%2Fscientific-data-management-policy%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:0-3\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:0_3-0\">3.0<\/a><\/sup> <sup><a href=\"#cite_ref-:0_3-1\">3.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/grants.nih.gov\/grants\/guide\/notice-files\/NOT-OD-21-013.html\" target=\"_blank\">\"Final NIH Policy for Data Management and Sharing\"<\/a>. National Institutes of Health, Office of the Director. 29 October 2020<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/grants.nih.gov\/grants\/guide\/notice-files\/NOT-OD-21-013.html\" target=\"_blank\">https:\/\/grants.nih.gov\/grants\/guide\/notice-files\/NOT-OD-21-013.html<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 07 July 2021<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Final+NIH+Policy+for+Data+Management+and+Sharing&rft.atitle=&rft.date=29+October+2020&rft.pub=National+Institutes+of+Health%2C+Office+of+the+Director&rft_id=https%3A%2F%2Fgrants.nih.gov%2Fgrants%2Fguide%2Fnotice-files%2FNOT-OD-21-013.html&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-4\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-4\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation book\">Committee on Reproducibility and Replicability in Science; Board on Behavioral, Cognitive, and Sensory Sciences; Committee on National Statistics; Division of Behavioral and Social Sciences and Education; Nuclear and Radiation Studies Board; Division on Earth and Life Studies; Board on Mathematical Sciences and Analytics; Committee on Applied and Theoretical Statistics <i>et al.<\/i> (20 September 2019). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.nap.edu\/catalog\/25303\" target=\"_blank\"><i>Reproducibility and Replicability in Science<\/i><\/a>. Washington, D.C.: National Academies Press. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.17226%2F25303\" target=\"_blank\">10.17226\/25303<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-0-309-48616-3<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.nap.edu\/catalog\/25303\" target=\"_blank\">https:\/\/www.nap.edu\/catalog\/25303<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=book&rft.btitle=Reproducibility+and+Replicability+in+Science&rft.aulast=Committee+on+Reproducibility+and+Replicability+in+Science&rft.au=Committee+on+Reproducibility+and+Replicability+in+Science&rft.au=Board+on+Behavioral%2C+Cognitive%2C+and+Sensory+Sciences&rft.au=Committee+on+National+Statistics&rft.au=Division+of+Behavioral+and+Social+Sciences+and+Education&rft.au=Nuclear+and+Radiation+Studies+Board&rft.au=Division+on+Earth+and+Life+Studies&rft.au=Board+on+Mathematical+Sciences+and+Analytics&rft.au=Committee+on+Applied+and+Theoretical+Statistics&rft.au=Division+on+Engineering+and+Physical+Sciences&rft.date=20+September+2019&rft.place=Washington%2C+D.C.&rft.pub=National+Academies+Press&rft_id=info:doi\/10.17226%2F25303&rft.isbn=978-0-309-48616-3&rft_id=https%3A%2F%2Fwww.nap.edu%2Fcatalog%2F25303&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-5\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-5\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Peng, Roger D.; Hicks, Stephanie C. (1 April 2021). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/pubmed.ncbi.nlm.nih.gov\/33467923\" target=\"_blank\">\"Reproducible Research: A Retrospective\"<\/a>. <i>Annual Review of Public Health<\/i> <b>42<\/b>: 79\u201393. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1146%2Fannurev-publhealth-012420-105110\" target=\"_blank\">10.1146\/annurev-publhealth-012420-105110<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1545-2093\" target=\"_blank\">1545-2093<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/33467923\" target=\"_blank\">33467923<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/pubmed.ncbi.nlm.nih.gov\/33467923\" target=\"_blank\">https:\/\/pubmed.ncbi.nlm.nih.gov\/33467923<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Reproducible+Research%3A+A+Retrospective&rft.jtitle=Annual+Review+of+Public+Health&rft.aulast=Peng&rft.aufirst=Roger+D.&rft.au=Peng%2C%26%2332%3BRoger+D.&rft.au=Hicks%2C%26%2332%3BStephanie+C.&rft.date=1+April+2021&rft.volume=42&rft.pages=79%E2%80%9393&rft_id=info:doi\/10.1146%2Fannurev-publhealth-012420-105110&rft.issn=1545-2093&rft_id=info:pmid\/33467923&rft_id=https%3A%2F%2Fpubmed.ncbi.nlm.nih.gov%2F33467923&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:5-6\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:5_6-0\">6.0<\/a><\/sup> <sup><a href=\"#cite_ref-:5_6-1\">6.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Vines, Timothy H.; Albert, Arianne Y. K.; Andrew, Rose L.; D\u00e9barre, Florence; Bock, Dan G.; Franklin, Michelle T.; Gilbert, Kimberly J.; Moore, Jean-S\u00e9bastien <i>et al.<\/i> (6 January 2014). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/pubmed.ncbi.nlm.nih.gov\/24361065\" target=\"_blank\">\"The availability of research data declines rapidly with article age\"<\/a>. <i>Current biology: CB<\/i> <b>24<\/b> (1): 94\u201397. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.cub.2013.11.014\" target=\"_blank\">10.1016\/j.cub.2013.11.014<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1879-0445\" target=\"_blank\">1879-0445<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/24361065\" target=\"_blank\">24361065<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/pubmed.ncbi.nlm.nih.gov\/24361065\" target=\"_blank\">https:\/\/pubmed.ncbi.nlm.nih.gov\/24361065<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=The+availability+of+research+data+declines+rapidly+with+article+age&rft.jtitle=Current+biology%3A+CB&rft.aulast=Vines&rft.aufirst=Timothy+H.&rft.au=Vines%2C%26%2332%3BTimothy+H.&rft.au=Albert%2C%26%2332%3BArianne+Y.+K.&rft.au=Andrew%2C%26%2332%3BRose+L.&rft.au=D%C3%A9barre%2C%26%2332%3BFlorence&rft.au=Bock%2C%26%2332%3BDan+G.&rft.au=Franklin%2C%26%2332%3BMichelle+T.&rft.au=Gilbert%2C%26%2332%3BKimberly+J.&rft.au=Moore%2C%26%2332%3BJean-S%C3%A9bastien&rft.au=Renaut%2C%26%2332%3BS%C3%A9bastien&rft.date=6+January+2014&rft.volume=24&rft.issue=1&rft.pages=94%E2%80%9397&rft_id=info:doi\/10.1016%2Fj.cub.2013.11.014&rft.issn=1879-0445&rft_id=info:pmid\/24361065&rft_id=https%3A%2F%2Fpubmed.ncbi.nlm.nih.gov%2F24361065&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-7\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-7\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/web.archive.org\/web\/20220525172026\/https:\/\/osp.od.nih.gov\/web\/20220525172026\/https:\/\/osp.od.nih.gov\/scientific-sharing\/genomic-data-sharing\/\" target=\"_blank\">\"NIH Genomic Data Sharing\"<\/a>. National Institutes of Health, Office of Science Policy. August 2014. Archived from <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/osp.od.nih.gov\/scientific-sharing\/genomic-data-sharing\/\" target=\"_blank\">the original<\/a> on 25 May 2022<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/web.archive.org\/web\/20220525172026\/https:\/\/osp.od.nih.gov\/web\/20220525172026\/https:\/\/osp.od.nih.gov\/scientific-sharing\/genomic-data-sharing\/\" target=\"_blank\">https:\/\/web.archive.org\/web\/20220525172026\/https:\/\/osp.od.nih.gov\/web\/20220525172026\/https:\/\/osp.od.nih.gov\/scientific-sharing\/genomic-data-sharing\/<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 01 June 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=NIH+Genomic+Data+Sharing&rft.atitle=&rft.date=August+2014&rft.pub=National+Institutes+of+Health%2C+Office+of+Science+Policy&rft_id=https%3A%2F%2Fweb.archive.org%2Fweb%2F20220525172026%2Fhttps%3A%2F%2Fosp.od.nih.gov%2Fweb%2F20220525172026%2Fhttps%3A%2F%2Fosp.od.nih.gov%2Fscientific-sharing%2Fgenomic-data-sharing%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-8\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-8\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/sharing.nih.gov\/other-sharing-policies\/model-organism-sharing-policy\" target=\"_blank\">\"Model Organism Sharing Policy\"<\/a>. <i>Scientific Data Sharing<\/i>. National Institutes of Health<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/sharing.nih.gov\/other-sharing-policies\/model-organism-sharing-policy\" target=\"_blank\">https:\/\/sharing.nih.gov\/other-sharing-policies\/model-organism-sharing-policy<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 01 June 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Model+Organism+Sharing+Policy&rft.atitle=Scientific+Data+Sharing&rft.pub=National+Institutes+of+Health&rft_id=https%3A%2F%2Fsharing.nih.gov%2Fother-sharing-policies%2Fmodel-organism-sharing-policy&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-9\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-9\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/sharing.nih.gov\/other-sharing-policies\" target=\"_blank\">\"Other Sharing Policies\"<\/a>. <i>Scientific Data Sharing<\/i>. National Institutes of Health<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/sharing.nih.gov\/other-sharing-policies\" target=\"_blank\">https:\/\/sharing.nih.gov\/other-sharing-policies<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 01 June 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Other+Sharing+Policies&rft.atitle=Scientific+Data+Sharing&rft.pub=National+Institutes+of+Health&rft_id=https%3A%2F%2Fsharing.nih.gov%2Fother-sharing-policies&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:1-10\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:1_10-0\">10.0<\/a><\/sup> <sup><a href=\"#cite_ref-:1_10-1\">10.1<\/a><\/sup> <sup><a href=\"#cite_ref-:1_10-2\">10.2<\/a><\/sup> <sup><a href=\"#cite_ref-:1_10-3\">10.3<\/a><\/sup> <sup><a href=\"#cite_ref-:1_10-4\">10.4<\/a><\/sup> <sup><a href=\"#cite_ref-:1_10-5\">10.5<\/a><\/sup> <sup><a href=\"#cite_ref-:1_10-6\">10.6<\/a><\/sup> <sup><a href=\"#cite_ref-:1_10-7\">10.7<\/a><\/sup> <sup><a href=\"#cite_ref-:1_10-8\">10.8<\/a><\/sup> <sup><a href=\"#cite_ref-:1_10-9\">10.9<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/grants.nih.gov\/grants\/guide\/notice-files\/NOT-OD-21-014.html\" target=\"_blank\">\"Supplemental Information to the NIH Policy for Data Management and Sharing: Elements of an NIH Data Management and Sharing Plan\"<\/a>. National Institutes of Health, Office of the Director. 29 October 2020<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/grants.nih.gov\/grants\/guide\/notice-files\/NOT-OD-21-014.html\" target=\"_blank\">https:\/\/grants.nih.gov\/grants\/guide\/notice-files\/NOT-OD-21-014.html<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 07 July 2021<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Supplemental+Information+to+the+NIH+Policy+for+Data+Management+and+Sharing%3A+Elements+of+an+NIH+Data+Management+and+Sharing+Plan&rft.atitle=&rft.date=29+October+2020&rft.pub=National+Institutes+of+Health%2C+Office+of+the+Director&rft_id=https%3A%2F%2Fgrants.nih.gov%2Fgrants%2Fguide%2Fnotice-files%2FNOT-OD-21-014.html&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-11\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-11\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">National Institutes of Health. <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/cde.nlm.nih.gov\/home\" target=\"_blank\">\"Use Common Data Elements for More FAIR Research Data\"<\/a>. <i>NIH CDE Repository<\/i>. National Library of Medicine<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/cde.nlm.nih.gov\/home\" target=\"_blank\">https:\/\/cde.nlm.nih.gov\/home<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 01 June 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Use+Common+Data+Elements+for+More+FAIR+Research+Data&rft.atitle=NIH+CDE+Repository&rft.aulast=National+Institutes+of+Health&rft.au=National+Institutes+of+Health&rft.pub=National+Library+of+Medicine&rft_id=https%3A%2F%2Fcde.nlm.nih.gov%2Fhome&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-12\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-12\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.ncbi.nlm.nih.gov\/geo\/info\/MIAME.html\" target=\"_blank\">\"MIAME and MINSEQE guidelines\"<\/a>. <i>Gene Expression Omnibus<\/i>. National Center for Biotechnology Information. 25 April 2022<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.ncbi.nlm.nih.gov\/geo\/info\/MIAME.html\" target=\"_blank\">https:\/\/www.ncbi.nlm.nih.gov\/geo\/info\/MIAME.html<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 01 June 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=MIAME+and+MINSEQE+guidelines&rft.atitle=Gene+Expression+Omnibus&rft.date=25+April+2022&rft.pub=National+Center+for+Biotechnology+Information&rft_id=https%3A%2F%2Fwww.ncbi.nlm.nih.gov%2Fgeo%2Finfo%2FMIAME.html&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-13\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-13\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.dcc.ac.uk\/resources\/subject-areas\/biology\" target=\"_blank\">\"Biology - Metadata Standards\"<\/a>. <i>DCC Guidance<\/i>. Digital Curation Centre<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.dcc.ac.uk\/resources\/subject-areas\/biology\" target=\"_blank\">https:\/\/www.dcc.ac.uk\/resources\/subject-areas\/biology<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 01 June 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Biology+-+Metadata+Standards&rft.atitle=DCC+Guidance&rft.pub=Digital+Curation+Centre&rft_id=https%3A%2F%2Fwww.dcc.ac.uk%2Fresources%2Fsubject-areas%2Fbiology&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-14\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-14\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Lamar Soutter Library (14 June 2021). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/libraryguides.umassmed.edu\/research_data_management_resources\/documentation\" target=\"_blank\">\"Data Documentation\"<\/a>. <i>Research Data Management Resources<\/i>. UMass Chan Medical School<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/libraryguides.umassmed.edu\/research_data_management_resources\/documentation\" target=\"_blank\">https:\/\/libraryguides.umassmed.edu\/research_data_management_resources\/documentation<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 09 July 2021<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Data+Documentation&rft.atitle=Research+Data+Management+Resources&rft.aulast=Lamar+Soutter+Library&rft.au=Lamar+Soutter+Library&rft.date=14+June+2021&rft.pub=UMass+Chan+Medical+School&rft_id=https%3A%2F%2Flibraryguides.umassmed.edu%2Fresearch_data_management_resources%2Fdocumentation&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-15\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-15\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Research Data Management Service Group. <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/data.research.cornell.edu\/content\/readme\" target=\"_blank\">\"Guide to writing \"readme\" style metadata\"<\/a>. Cornell University<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/data.research.cornell.edu\/content\/readme\" target=\"_blank\">https:\/\/data.research.cornell.edu\/content\/readme<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 09 July 2021<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Guide+to+writing+%22readme%22+style+metadata&rft.atitle=&rft.aulast=Research+Data+Management+Service+Group&rft.au=Research+Data+Management+Service+Group&rft.pub=Cornell+University&rft_id=https%3A%2F%2Fdata.research.cornell.edu%2Fcontent%2Freadme&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-16\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-16\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Bollen, K.; Cacioppo, J.T.; Kaplan. R.M. et al. (May 2015). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.nsf.gov\/sbe\/AC_Materials\/SBE_Robust_and_Reliable_Research_Report.pdf\" target=\"_blank\">\"Social, Behavioral, and Economic Sciences Perspectives on Robust and Reliable Science\"<\/a> (PDF). Subcommittee on Replicability in Science Advisory Committee to the National Science Foundation Directorate for Social, Behavioral, and Economic Sciences<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.nsf.gov\/sbe\/AC_Materials\/SBE_Robust_and_Reliable_Research_Report.pdf\" target=\"_blank\">https:\/\/www.nsf.gov\/sbe\/AC_Materials\/SBE_Robust_and_Reliable_Research_Report.pdf<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Social%2C+Behavioral%2C+and+Economic+Sciences+Perspectives+on+Robust+and+Reliable+Science&rft.atitle=&rft.aulast=Bollen%2C+K.%3B+Cacioppo%2C+J.T.%3B+Kaplan.+R.M.+et+al.&rft.au=Bollen%2C+K.%3B+Cacioppo%2C+J.T.%3B+Kaplan.+R.M.+et+al.&rft.date=May+2015&rft.pub=Subcommittee+on+Replicability+in+Science+Advisory+Committee+to+the+National+Science+Foundation+Directorate+for+Social%2C+Behavioral%2C+and+Economic+Sciences&rft_id=https%3A%2F%2Fwww.nsf.gov%2Fsbe%2FAC_Materials%2FSBE_Robust_and_Reliable_Research_Report.pdf&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-17\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-17\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.edge.org\/response-detail\/25340\" target=\"_blank\">\"2014 : What Scientific Idea Is Ready for Retirement\"<\/a>. <i>Edge<\/i>. Edge Foundation, Inc. 2014<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.edge.org\/response-detail\/25340\" target=\"_blank\">https:\/\/www.edge.org\/response-detail\/25340<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 16 July 2021<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=2014+%3A+What+Scientific+Idea+Is+Ready+for+Retirement&rft.atitle=Edge&rft.date=2014&rft.pub=Edge+Foundation%2C+Inc&rft_id=https%3A%2F%2Fwww.edge.org%2Fresponse-detail%2F25340&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-18\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-18\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">ORCID Support (3 May 2019). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/support.orcid.org\/hc\/en-us\/articles\/360006971013-What-are-persistent-identifiers-PIDs-\" target=\"_blank\">\"What are persistent identifiers (PIDs)?\"<\/a>. <i>ORCID Support<\/i><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/support.orcid.org\/hc\/en-us\/articles\/360006971013-What-are-persistent-identifiers-PIDs-\" target=\"_blank\">https:\/\/support.orcid.org\/hc\/en-us\/articles\/360006971013-What-are-persistent-identifiers-PIDs-<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 29 July 2021<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=What+are+persistent+identifiers+%28PIDs%29%3F&rft.atitle=ORCID+Support&rft.aulast=ORCID+Support&rft.au=ORCID+Support&rft.date=3+May+2019&rft_id=https%3A%2F%2Fsupport.orcid.org%2Fhc%2Fen-us%2Farticles%2F360006971013-What-are-persistent-identifiers-PIDs-&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:2-19\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:2_19-0\">19.0<\/a><\/sup> <sup><a href=\"#cite_ref-:2_19-1\">19.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.go-fair.org\/fair-principles\/\" target=\"_blank\">\"FAIR Principles\"<\/a>. <i>GoFAIR<\/i>. ZBW \u2013 Leibniz Information Centre for Economics; French Ministery for Higher Education, Research and Innovation; International Support and Coordination Office<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.go-fair.org\/fair-principles\/\" target=\"_blank\">https:\/\/www.go-fair.org\/fair-principles\/<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 29 July 2021<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=FAIR+Principles&rft.atitle=GoFAIR&rft.pub=ZBW+%E2%80%93+Leibniz+Information+Centre+for+Economics%3B+French+Ministery+for+Higher+Education%2C+Research+and+Innovation%3B+International+Support+and+Coordination+Office&rft_id=https%3A%2F%2Fwww.go-fair.org%2Ffair-principles%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-20\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-20\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">National Library of Medicine, National Center for Biotechnology Information. <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.ncbi.nlm.nih.gov\/genbank\/samplerecord\/\" target=\"_blank\">\"Sample GenBank Record\"<\/a>. <i>GenBank<\/i>. National Institutes of Health<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.ncbi.nlm.nih.gov\/genbank\/samplerecord\/\" target=\"_blank\">https:\/\/www.ncbi.nlm.nih.gov\/genbank\/samplerecord\/<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 01 June 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Sample+GenBank+Record&rft.atitle=GenBank&rft.aulast=National+Library+of+Medicine%2C+National+Center+for+Biotechnology+Information&rft.au=National+Library+of+Medicine%2C+National+Center+for+Biotechnology+Information&rft.pub=National+Institutes+of+Health&rft_id=https%3A%2F%2Fwww.ncbi.nlm.nih.gov%2Fgenbank%2Fsamplerecord%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-21\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-21\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">ORCID Support (19 August 2020). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/support.orcid.org\/hc\/en-us\/articles\/360006973993-What-is-ORCID-\" target=\"_blank\">\"What is ORCID?\"<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/support.orcid.org\/hc\/en-us\/articles\/360006973993-What-is-ORCID-\" target=\"_blank\">https:\/\/support.orcid.org\/hc\/en-us\/articles\/360006973993-What-is-ORCID-<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 29 July 2021<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=What+is+ORCID%3F&rft.atitle=&rft.aulast=ORCID+Support&rft.au=ORCID+Support&rft.date=19+August+2020&rft_id=https%3A%2F%2Fsupport.orcid.org%2Fhc%2Fen-us%2Farticles%2F360006973993-What-is-ORCID-&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-22\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-22\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">National Library of Medicine. <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/meshb.nlm.nih.gov\/search\" target=\"_blank\">\"Medical Subject Headings 2021\"<\/a>. <i>National Institutes of Health<\/i><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/meshb.nlm.nih.gov\/search\" target=\"_blank\">https:\/\/meshb.nlm.nih.gov\/search<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 29 July 2021<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Medical+Subject+Headings+2021&rft.atitle=National+Institutes+of+Health&rft.aulast=National+Library+of+Medicine&rft.au=National+Library+of+Medicine&rft_id=https%3A%2F%2Fmeshb.nlm.nih.gov%2Fsearch&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-23\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-23\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.uniprot.org\/help\/names_and_taxonomy_section\" target=\"_blank\">\"Names and Taxonomy Section\"<\/a>. UniProt Consortium. 2021<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.uniprot.org\/help\/names_and_taxonomy_section\" target=\"_blank\">https:\/\/www.uniprot.org\/help\/names_and_taxonomy_section<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 29 July 2021<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Names+and+Taxonomy+Section&rft.atitle=&rft.date=2021&rft.pub=UniProt+Consortium&rft_id=https%3A%2F%2Fwww.uniprot.org%2Fhelp%2Fnames_and_taxonomy_section&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-24\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-24\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Cousijn, Helena; Braukmann, Ricarda; Fenner, Martin; Ferguson, Christine; van Horik, Ren\u00e9; Lammey, Rachael; Meadows, Alice; Lambert, Simon (8 January 2021). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/pubmed.ncbi.nlm.nih.gov\/33511369\" target=\"_blank\">\"Connected Research: The Potential of the PID Graph\"<\/a>. <i>Patterns (New York, N.Y.)<\/i> <b>2<\/b> (1): 100180. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.patter.2020.100180\" target=\"_blank\">10.1016\/j.patter.2020.100180<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2666-3899\" target=\"_blank\">2666-3899<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/7815961\/\" target=\"_blank\">7815961<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/33511369\" target=\"_blank\">33511369<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/pubmed.ncbi.nlm.nih.gov\/33511369\" target=\"_blank\">https:\/\/pubmed.ncbi.nlm.nih.gov\/33511369<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Connected+Research%3A+The+Potential+of+the+PID+Graph&rft.jtitle=Patterns+%28New+York%2C+N.Y.%29&rft.aulast=Cousijn&rft.aufirst=Helena&rft.au=Cousijn%2C%26%2332%3BHelena&rft.au=Braukmann%2C%26%2332%3BRicarda&rft.au=Fenner%2C%26%2332%3BMartin&rft.au=Ferguson%2C%26%2332%3BChristine&rft.au=van+Horik%2C%26%2332%3BRen%C3%A9&rft.au=Lammey%2C%26%2332%3BRachael&rft.au=Meadows%2C%26%2332%3BAlice&rft.au=Lambert%2C%26%2332%3BSimon&rft.date=8+January+2021&rft.volume=2&rft.issue=1&rft.pages=100180&rft_id=info:doi\/10.1016%2Fj.patter.2020.100180&rft.issn=2666-3899&rft_id=info:pmc\/7815961&rft_id=info:pmid\/33511369&rft_id=https%3A%2F%2Fpubmed.ncbi.nlm.nih.gov%2F33511369&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:3-25\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:3_25-0\">25.0<\/a><\/sup> <sup><a href=\"#cite_ref-:3_25-1\">25.1<\/a><\/sup> <sup><a href=\"#cite_ref-:3_25-2\">25.2<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/grants.nih.gov\/grants\/guide\/notice-files\/NOT-OD-21-016.html\" target=\"_blank\">\"Supplemental Information to the NIH Policy for Data Management and Sharing: Selecting a Repository for Data Resulting from NIH-Supported Research\"<\/a>. National Institutes of Health. 29 October 2020<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/grants.nih.gov\/grants\/guide\/notice-files\/NOT-OD-21-016.html\" target=\"_blank\">https:\/\/grants.nih.gov\/grants\/guide\/notice-files\/NOT-OD-21-016.html<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 05 August 2021<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Supplemental+Information+to+the+NIH+Policy+for+Data+Management+and+Sharing%3A+Selecting+a+Repository+for+Data+Resulting+from+NIH-Supported+Research&rft.atitle=&rft.date=29+October+2020&rft.pub=National+Institutes+of+Health&rft_id=https%3A%2F%2Fgrants.nih.gov%2Fgrants%2Fguide%2Fnotice-files%2FNOT-OD-21-016.html&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-26\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-26\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">National Library of Medicine. <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.nlm.nih.gov\/NIHbmic\/domain_specific_repositories.html\" target=\"_blank\">\"NIH-Supported Data Sharing Resources - Domain-Specific Repositories\"<\/a>. <i>Data Sharing Resources<\/i>. National Institutes of Health<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.nlm.nih.gov\/NIHbmic\/domain_specific_repositories.html\" target=\"_blank\">https:\/\/www.nlm.nih.gov\/NIHbmic\/domain_specific_repositories.html<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 05 August 2021<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=NIH-Supported+Data+Sharing+Resources+-+Domain-Specific+Repositories&rft.atitle=Data+Sharing+Resources&rft.aulast=National+Library+of+Medicine&rft.au=National+Library+of+Medicine&rft.pub=National+Institutes+of+Health&rft_id=https%3A%2F%2Fwww.nlm.nih.gov%2FNIHbmic%2Fdomain_specific_repositories.html&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:4-27\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:4_27-0\">27.0<\/a><\/sup> <sup><a href=\"#cite_ref-:4_27-1\">27.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation web\">National Library of Medicine. <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.nlm.nih.gov\/NIHbmic\/generalist_repositories.html\" target=\"_blank\">\"NIH-Supported Data Sharing Resources - Generalist Repositories\"<\/a>. <i>Data Sharing Resources<\/i>. National Institutes of Health<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.nlm.nih.gov\/NIHbmic\/generalist_repositories.html\" target=\"_blank\">https:\/\/www.nlm.nih.gov\/NIHbmic\/generalist_repositories.html<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 07 February 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=NIH-Supported+Data+Sharing+Resources+-+Generalist+Repositories&rft.atitle=Data+Sharing+Resources&rft.aulast=National+Library+of+Medicine&rft.au=National+Library+of+Medicine&rft.pub=National+Institutes+of+Health&rft_id=https%3A%2F%2Fwww.nlm.nih.gov%2FNIHbmic%2Fgeneralist_repositories.html&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-28\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-28\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">National Institutes of Health (11 February 2020). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.scgcorp.com\/repositories2020\/Agenda\" target=\"_blank\">\"NIH Workshop on the Role of Generalist Repositories to Enhance Data Discoverability and Reuse\"<\/a>. <i>Establishing a FAIR Biomedical Data Ecosystem: The Role of Generalist and Institutional Repositories to Enhance Data Discoverability and Reuse<\/i>. The Scientific Consulting Group, Inc<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.scgcorp.com\/repositories2020\/Agenda\" target=\"_blank\">https:\/\/www.scgcorp.com\/repositories2020\/Agenda<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 05 August 2021<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=NIH+Workshop+on+the+Role+of+Generalist+Repositories+to+Enhance+Data+Discoverability+and+Reuse&rft.atitle=Establishing+a+FAIR+Biomedical+Data+Ecosystem%3A+The+Role+of+Generalist+and+Institutional+Repositories+to+Enhance+Data+Discoverability+and+Reuse&rft.aulast=National+Institutes+of+Health&rft.au=National+Institutes+of+Health&rft.date=11+February+2020&rft.pub=The+Scientific+Consulting+Group%2C+Inc&rft_id=https%3A%2F%2Fwww.scgcorp.com%2Frepositories2020%2FAgenda&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-29\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-29\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/datascience.nih.gov\/news\/nih-office-of-data-science-strategy-announces-new-initiative-to-improve-data-access\" target=\"_blank\">\"NIH Office of Data Science Strategy Announces New Initiative to Improve Access to NIH-funded Data\"<\/a>. <i>News & Events<\/i>. National Institutes of Health, Office of Data Science Strategy. 26 January 2022<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/datascience.nih.gov\/news\/nih-office-of-data-science-strategy-announces-new-initiative-to-improve-data-access\" target=\"_blank\">https:\/\/datascience.nih.gov\/news\/nih-office-of-data-science-strategy-announces-new-initiative-to-improve-data-access<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 28 March 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=NIH+Office+of+Data+Science+Strategy+Announces+New+Initiative+to+Improve+Access+to+NIH-funded+Data&rft.atitle=News+%26+Events&rft.date=26+January+2022&rft.pub=National+Institutes+of+Health%2C+Office+of+Data+Science+Strategy&rft_id=https%3A%2F%2Fdatascience.nih.gov%2Fnews%2Fnih-office-of-data-science-strategy-announces-new-initiative-to-improve-data-access&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-30\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-30\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.science.org\/content\/page\/science-journals-editorial-policies\" target=\"_blank\">\"Science Journals: Editorial Policies\"<\/a>. <i>Science Author Portal<\/i>. American Association for the Advancement of Science. 2021<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.science.org\/content\/page\/science-journals-editorial-policies\" target=\"_blank\">https:\/\/www.science.org\/content\/page\/science-journals-editorial-policies<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 06 August 2021<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Science+Journals%3A+Editorial+Policies&rft.atitle=Science+Author+Portal&rft.date=2021&rft.pub=American+Association+for+the+Advancement+of+Science&rft_id=https%3A%2F%2Fwww.science.org%2Fcontent%2Fpage%2Fscience-journals-editorial-policies&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-31\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-31\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/journals.plos.org\/plosone\/s\/data-availability\" target=\"_blank\">\"Data Availability\"<\/a>. PLOS One. 5 December 2019<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/journals.plos.org\/plosone\/s\/data-availability\" target=\"_blank\">https:\/\/journals.plos.org\/plosone\/s\/data-availability<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 06 August 2021<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Data+Availability&rft.atitle=&rft.date=5+December+2019&rft.pub=PLOS+One&rft_id=https%3A%2F%2Fjournals.plos.org%2Fplosone%2Fs%2Fdata-availability&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-32\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-32\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/georgewbush-whitehouse.archives.gov\/omb\/circulars\/a133_compliance\/07\/07toc.html\" target=\"_blank\">\"OMB Circular A-133 Compliance Supplement March 2007\"<\/a>. Office of Management and Budget. March 2007<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/georgewbush-whitehouse.archives.gov\/omb\/circulars\/a133_compliance\/07\/07toc.html\" target=\"_blank\">https:\/\/georgewbush-whitehouse.archives.gov\/omb\/circulars\/a133_compliance\/07\/07toc.html<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 01 June 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=OMB+Circular+A-133+Compliance+Supplement+March+2007&rft.atitle=&rft.date=March+2007&rft.pub=Office+of+Management+and+Budget&rft_id=https%3A%2F%2Fgeorgewbush-whitehouse.archives.gov%2Fomb%2Fcirculars%2Fa133_compliance%2F07%2F07toc.html&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-33\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-33\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.acquisition.gov\/browse\/index\/far\" target=\"_blank\">\"Federal Acquisition Regulation\"<\/a>. <i>Acquisition.gov<\/i>. General Services Administration. 10 February 2022<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.acquisition.gov\/browse\/index\/far\" target=\"_blank\">https:\/\/www.acquisition.gov\/browse\/index\/far<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 01 June 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Federal+Acquisition+Regulation&rft.atitle=Acquisition.gov&rft.date=10+February+2022&rft.pub=General+Services+Administration&rft_id=https%3A%2F%2Fwww.acquisition.gov%2Fbrowse%2Findex%2Ffar&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-34\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-34\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/grants.nih.gov\/grants\/guide\/notice-files\/NOT-OD-22-131.html\" target=\"_blank\">\"Request for Public Comments on DRAFT Supplemental Information to the NIH Policy for Data Management and Sharing: Protecting Privacy When Sharing Human Research Participant Data\"<\/a>. National Institutes of Health, Office of The Director. 12 May 2022<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/grants.nih.gov\/grants\/guide\/notice-files\/NOT-OD-22-131.html\" target=\"_blank\">https:\/\/grants.nih.gov\/grants\/guide\/notice-files\/NOT-OD-22-131.html<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 01 June 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Request+for+Public+Comments+on+DRAFT+Supplemental+Information+to+the+NIH+Policy+for+Data+Management+and+Sharing%3A+Protecting+Privacy+When+Sharing+Human+Research+Participant+Data&rft.atitle=&rft.date=12+May+2022&rft.pub=National+Institutes+of+Health%2C+Office+of+The+Director&rft_id=https%3A%2F%2Fgrants.nih.gov%2Fgrants%2Fguide%2Fnotice-files%2FNOT-OD-22-131.html&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-35\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-35\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.hhs.gov\/ohrp\/regulations-and-policy\/regulations\/45-cfr-46\/revised-common-rule-regulatory-text\/index.html\" target=\"_blank\">\"2018 Requirements (2018 Common Rule)\"<\/a>. <i>HHS.gov<\/i>. Office for Human Research Protections. 10 March 2021<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.hhs.gov\/ohrp\/regulations-and-policy\/regulations\/45-cfr-46\/revised-common-rule-regulatory-text\/index.html\" target=\"_blank\">https:\/\/www.hhs.gov\/ohrp\/regulations-and-policy\/regulations\/45-cfr-46\/revised-common-rule-regulatory-text\/index.html<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 01 June 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=2018+Requirements+%282018+Common+Rule%29&rft.atitle=HHS.gov&rft.date=10+March+2021&rft.pub=Office+for+Human+Research+Protections&rft_id=https%3A%2F%2Fwww.hhs.gov%2Fohrp%2Fregulations-and-policy%2Fregulations%2F45-cfr-46%2Frevised-common-rule-regulatory-text%2Findex.html&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-36\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-36\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.hhs.gov\/hipaa\/for-professionals\/privacy\/special-topics\/de-identification\/index.html\" target=\"_blank\">\"Guidance Regarding Methods for De-identification of Protected Health Information in Accordance with the Health Insurance Portability and Accountability Act (HIPAA) Privacy Rule\"<\/a>. <i>Health Information Privacy<\/i>. U.S. Department of Health & Human Services. 2021<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.hhs.gov\/hipaa\/for-professionals\/privacy\/special-topics\/de-identification\/index.html\" target=\"_blank\">https:\/\/www.hhs.gov\/hipaa\/for-professionals\/privacy\/special-topics\/de-identification\/index.html<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 05 August 2021<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Guidance+Regarding+Methods+for+De-identification+of+Protected+Health+Information+in+Accordance+with+the+Health+Insurance+Portability+and+Accountability+Act+%28HIPAA%29+Privacy+Rule&rft.atitle=Health+Information+Privacy&rft.date=2021&rft.pub=U.S.+Department+of+Health+%26+Human+Services&rft_id=https%3A%2F%2Fwww.hhs.gov%2Fhipaa%2Ffor-professionals%2Fprivacy%2Fspecial-topics%2Fde-identification%2Findex.html&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-37\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-37\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.healthit.gov\/topic\/hipaa-versus-state-laws\" target=\"_blank\">\"HIPAA versus State Laws\"<\/a>. <i>HealthIT.gov<\/i>. U.S. Department of Health & Human Services. 5 September 2017<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.healthit.gov\/topic\/hipaa-versus-state-laws\" target=\"_blank\">https:\/\/www.healthit.gov\/topic\/hipaa-versus-state-laws<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 06 August 2021<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=HIPAA+versus+State+Laws&rft.atitle=HealthIT.gov&rft.date=5+September+2017&rft.pub=U.S.+Department+of+Health+%26+Human+Services&rft_id=https%3A%2F%2Fwww.healthit.gov%2Ftopic%2Fhipaa-versus-state-laws&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-38\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-38\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/grants.nih.gov\/grants\/guide\/notice-files\/NOT-OD-22-064.html\" target=\"_blank\">\"Request for Public Comments on DRAFT Supplemental Information to the NIH Policy for Data Management and Sharing: Responsible Management and Sharing of American Indian\/ Alaska Native Participant Data\"<\/a>. National Institutes of Health, Office of the Director. 25 January 2022<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/grants.nih.gov\/grants\/guide\/notice-files\/NOT-OD-22-064.html\" target=\"_blank\">https:\/\/grants.nih.gov\/grants\/guide\/notice-files\/NOT-OD-22-064.html<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 02 June 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Request+for+Public+Comments+on+DRAFT+Supplemental+Information+to+the+NIH+Policy+for+Data+Management+and+Sharing%3A+Responsible+Management+and+Sharing+of+American+Indian%2F+Alaska+Native+Participant+Data&rft.atitle=&rft.date=25+January+2022&rft.pub=National+Institutes+of+Health%2C+Office+of+the+Director&rft_id=https%3A%2F%2Fgrants.nih.gov%2Fgrants%2Fguide%2Fnotice-files%2FNOT-OD-22-064.html&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-39\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-39\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Office of Science Policy; Office of Extramural Research (May 2022). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/osp.od.nih.gov\/wp-content\/uploads\/Informed-Consent-Resource-for-Secondary-Research-with-Data-and-Biospecimens.pdf\" target=\"_blank\">\"Informed Consent for Secondary Research with Data and Biospecimens\"<\/a> (PDF). National Institutes of Health<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/osp.od.nih.gov\/wp-content\/uploads\/Informed-Consent-Resource-for-Secondary-Research-with-Data-and-Biospecimens.pdf\" target=\"_blank\">https:\/\/osp.od.nih.gov\/wp-content\/uploads\/Informed-Consent-Resource-for-Secondary-Research-with-Data-and-Biospecimens.pdf<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 02 June 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Informed+Consent+for+Secondary+Research+with+Data+and+Biospecimens&rft.atitle=&rft.aulast=Office+of+Science+Policy%3B+Office+of+Extramural+Research&rft.au=Office+of+Science+Policy%3B+Office+of+Extramural+Research&rft.date=May+2022&rft.pub=National+Institutes+of+Health&rft_id=https%3A%2F%2Fosp.od.nih.gov%2Fwp-content%2Fuploads%2FInformed-Consent-Resource-for-Secondary-Research-with-Data-and-Biospecimens.pdf&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-40\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-40\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Health Care Systems Research Network (24 February 2020). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/web.archive.org\/web\/20221006203224\/https:\/\/www.hcsrn.org\/en\/Tools%20&%20Materials\/GrantsContracting\/HCSRN_DUAToolkit.pdf\" target=\"_blank\">\"DUA Toolkit: A Guide to Data Use Agreements\"<\/a> (PDF). Archived from <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.hcsrn.org\/en\/Tools%20&%20Materials\/GrantsContracting\/HCSRN_DUAToolkit.pdf\" target=\"_blank\">the original<\/a> on 06 October 2022<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/web.archive.org\/web\/20221006203224\/https:\/\/www.hcsrn.org\/en\/Tools%20&%20Materials\/GrantsContracting\/HCSRN_DUAToolkit.pdf\" target=\"_blank\">https:\/\/web.archive.org\/web\/20221006203224\/https:\/\/www.hcsrn.org\/en\/Tools%20&%20Materials\/GrantsContracting\/HCSRN_DUAToolkit.pdf<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=DUA+Toolkit%3A+A+Guide+to+Data+Use+Agreements&rft.atitle=&rft.aulast=Health+Care+Systems+Research+Network&rft.au=Health+Care+Systems+Research+Network&rft.date=24+February+2020&rft_id=https%3A%2F%2Fweb.archive.org%2Fweb%2F20221006203224%2Fhttps%3A%2F%2Fwww.hcsrn.org%2Fen%2FTools%2520%26%2520Materials%2FGrantsContracting%2FHCSRN_DUAToolkit.pdf&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-41\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-41\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation\" id=\"rdp-ebb-CITEREFVasilevskyMarijane_WhiteHolmesBrush2019\">Vasilevsky, Nicole; Marijane White; Holmes, Kristi; Brush, Matthew; Haendel, Melissa (11 December 2019), <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/zenodo.org\/record\/3570089\" target=\"_blank\">\"data2health\/contributor-role-ontology: 2019-12-11 Release\"<\/a>, <i>Zenodo<\/i>, <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.5281%2Fzenodo.3570089\" target=\"_blank\">10.5281\/zenodo.3570089<\/a><span class=\"printonly\">, <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/zenodo.org\/record\/3570089\" target=\"_blank\">https:\/\/zenodo.org\/record\/3570089<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 2023-03-24<\/span><\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=data2health%2Fcontributor-role-ontology%3A+2019-12-11+Release&rft.jtitle=Zenodo&rft.aulast=Vasilevsky&rft.aufirst=Nicole&rft.au=Vasilevsky%2C%26%2332%3BNicole&rft.au=Marijane+White&rft.au=Holmes%2C%26%2332%3BKristi&rft.au=Brush%2C%26%2332%3BMatthew&rft.au=Haendel%2C%26%2332%3BMelissa&rft.date=11+December+2019&rft_id=info:doi\/10.5281%2Fzenodo.3570089&rft_id=https%3A%2F%2Fzenodo.org%2Frecord%2F3570089&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-42\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-42\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">California Digital Library. <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/dmptool.org\/\" target=\"_blank\">\"DMPTool\"<\/a>. The Regents of the University of California<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/dmptool.org\/\" target=\"_blank\">https:\/\/dmptool.org\/<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 07 February 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=DMPTool&rft.atitle=&rft.aulast=California+Digital+Library&rft.au=California+Digital+Library&rft.pub=The+Regents+of+the+University+of+California&rft_id=https%3A%2F%2Fdmptool.org%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-43\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-43\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Walk, Paul; Miksa, Tomasz; Neish, Peter (2019). <a rel=\"nofollow\" class=\"external text\" href=\"#.X4VMvWgzY2w\">\"RDA DMP Common Standard for Machine-actionable Data Management Plans\"<\/a>. <i>Zenodo<\/i>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.15497%2FRDA00039\" target=\"_blank\">10.15497\/RDA00039<\/a><span class=\"printonly\">. <a rel=\"nofollow\" class=\"external free\" href=\"#.X4VMvWgzY2w\">https:\/\/zenodo.org\/record\/4036060#.X4VMvWgzY2w<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=RDA+DMP+Common+Standard+for+Machine-actionable+Data+Management+Plans&rft.jtitle=Zenodo&rft.aulast=Walk&rft.aufirst=Paul&rft.au=Walk%2C%26%2332%3BPaul&rft.au=Miksa%2C%26%2332%3BTomasz&rft.au=Neish%2C%26%2332%3BPeter&rft.date=2019&rft_id=info:doi\/10.15497%2FRDA00039&rft_id=https%3A%2F%2Fzenodo.org%2Frecord%2F4036060%23.X4VMvWgzY2w&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-44\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-44\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">California Digital Library. <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/ror.org\/\" target=\"_blank\">\"ROR\"<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/ror.org\/\" target=\"_blank\">https:\/\/ror.org\/<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 29 July 2021<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=ROR&rft.atitle=&rft.aulast=California+Digital+Library&rft.au=California+Digital+Library&rft_id=https%3A%2F%2Fror.org%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-45\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-45\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/scicrunch.org\/resources\" target=\"_blank\">\"RRID Portal\"<\/a>. SciCrunch<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/scicrunch.org\/resources\" target=\"_blank\">https:\/\/scicrunch.org\/resources<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 07 February 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=RRID+Portal&rft.atitle=&rft.pub=SciCrunch&rft_id=https%3A%2F%2Fscicrunch.org%2Fresources&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-46\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-46\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Tornow, J.S.; Kurose, J.; Marrongelle, K. et al. (20 May 2019). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.nsf.gov\/pubs\/2019\/nsf19069\/nsf19069.jsp\" target=\"_blank\">\"Dear Colleague Letter: Effective Practices for Data\"<\/a>. National Science Foundation<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.nsf.gov\/pubs\/2019\/nsf19069\/nsf19069.jsp\" target=\"_blank\">https:\/\/www.nsf.gov\/pubs\/2019\/nsf19069\/nsf19069.jsp<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 07 February 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Dear+Colleague+Letter%3A+Effective+Practices+for+Data&rft.atitle=&rft.aulast=Tornow%2C+J.S.%3B+Kurose%2C+J.%3B+Marrongelle%2C+K.+et+al.&rft.au=Tornow%2C+J.S.%3B+Kurose%2C+J.%3B+Marrongelle%2C+K.+et+al.&rft.date=20+May+2019&rft.pub=National+Science+Foundation&rft_id=https%3A%2F%2Fwww.nsf.gov%2Fpubs%2F2019%2Fnsf19069%2Fnsf19069.jsp&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-47\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-47\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/libguides.brown.edu\/data_management\/dmp\" target=\"_blank\">\"Data Management and Sharing\"<\/a>. <i>Subject Guides<\/i>. Brown University Library. 19 April 2021<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/libguides.brown.edu\/data_management\/dmp\" target=\"_blank\">https:\/\/libguides.brown.edu\/data_management\/dmp<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 07 February 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Data+Management+and+Sharing&rft.atitle=Subject+Guides&rft.date=19+April+2021&rft.pub=Brown+University+Library&rft_id=https%3A%2F%2Flibguides.brown.edu%2Fdata_management%2Fdmp&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-48\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-48\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/grants.nih.gov\/grants\/guide\/notice-files\/NOT-OD-21-015.html\" target=\"_blank\">\"Supplemental Information to the NIH Policy for Data Management and Sharing: Allowable Costs for Data Management and Sharing\"<\/a>. National Institutes of Health, Office of the Director. 29 October 2020<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/grants.nih.gov\/grants\/guide\/notice-files\/NOT-OD-21-015.html\" target=\"_blank\">https:\/\/grants.nih.gov\/grants\/guide\/notice-files\/NOT-OD-21-015.html<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 02 June 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Supplemental+Information+to+the+NIH+Policy+for+Data+Management+and+Sharing%3A+Allowable+Costs+for+Data+Management+and+Sharing&rft.atitle=&rft.date=29+October+2020&rft.pub=National+Institutes+of+Health%2C+Office+of+the+Director&rft_id=https%3A%2F%2Fgrants.nih.gov%2Fgrants%2Fguide%2Fnotice-files%2FNOT-OD-21-015.html&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-49\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-49\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Holdren, J.P. (22 February 2013). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.science.gov\/docs\/ostp_public_access_memo_2013.pdf\" target=\"_blank\">\"Increasing Access to the Results of Federally Funded Scientific Research\"<\/a> (PDF). Office of Science and Technology Policy<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.science.gov\/docs\/ostp_public_access_memo_2013.pdf\" target=\"_blank\">https:\/\/www.science.gov\/docs\/ostp_public_access_memo_2013.pdf<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 12 August 2021<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Increasing+Access+to+the+Results+of+Federally+Funded+Scientific+Research&rft.atitle=&rft.aulast=Holdren%2C+J.P.&rft.au=Holdren%2C+J.P.&rft.date=22+February+2013&rft.pub=Office+of+Science+and+Technology+Policy&rft_id=https%3A%2F%2Fwww.science.gov%2Fdocs%2Fostp_public_access_memo_2013.pdf&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-50\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-50\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/libraries.mit.edu\/data-management\/share\/journal-requirements\/\" target=\"_blank\">\"Journal Requirements\"<\/a>. <i>Data Management<\/i>. MIT Libraries<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/libraries.mit.edu\/data-management\/share\/journal-requirements\/\" target=\"_blank\">https:\/\/libraries.mit.edu\/data-management\/share\/journal-requirements\/<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 12 August 2021<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Journal+Requirements&rft.atitle=Data+Management&rft.pub=MIT+Libraries&rft_id=https%3A%2F%2Flibraries.mit.edu%2Fdata-management%2Fshare%2Fjournal-requirements%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-51\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-51\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Baker, Monya (27 August 2015). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.nature.com\/articles\/nature.2015.18248\" target=\"_blank\">\"Over half of psychology studies fail reproducibility test\"<\/a> (in en). <i>Nature<\/i>: nature.2015.18248. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1038%2Fnature.2015.18248\" target=\"_blank\">10.1038\/nature.2015.18248<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0028-0836\" target=\"_blank\">0028-0836<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/www.nature.com\/articles\/nature.2015.18248\" target=\"_blank\">http:\/\/www.nature.com\/articles\/nature.2015.18248<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Over+half+of+psychology+studies+fail+reproducibility+test&rft.jtitle=Nature&rft.aulast=Baker&rft.aufirst=Monya&rft.au=Baker%2C%26%2332%3BMonya&rft.date=27+August+2015&rft.pages=nature.2015.18248&rft_id=info:doi\/10.1038%2Fnature.2015.18248&rft.issn=0028-0836&rft_id=http%3A%2F%2Fwww.nature.com%2Farticles%2Fnature.2015.18248&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-52\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-52\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Piwowar, Heather A.; Day, Roger S.; Fridsma, Douglas B. (21 March 2007). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/pubmed.ncbi.nlm.nih.gov\/17375194\" target=\"_blank\">\"Sharing detailed research data is associated with increased citation rate\"<\/a>. <i>PloS One<\/i> <b>2<\/b> (3): e308. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1371%2Fjournal.pone.0000308\" target=\"_blank\">10.1371\/journal.pone.0000308<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1932-6203\" target=\"_blank\">1932-6203<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/1817752\/\" target=\"_blank\">1817752<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/17375194\" target=\"_blank\">17375194<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/pubmed.ncbi.nlm.nih.gov\/17375194\" target=\"_blank\">https:\/\/pubmed.ncbi.nlm.nih.gov\/17375194<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Sharing+detailed+research+data+is+associated+with+increased+citation+rate&rft.jtitle=PloS+One&rft.aulast=Piwowar&rft.aufirst=Heather+A.&rft.au=Piwowar%2C%26%2332%3BHeather+A.&rft.au=Day%2C%26%2332%3BRoger+S.&rft.au=Fridsma%2C%26%2332%3BDouglas+B.&rft.date=21+March+2007&rft.volume=2&rft.issue=3&rft.pages=e308&rft_id=info:doi\/10.1371%2Fjournal.pone.0000308&rft.issn=1932-6203&rft_id=info:pmc\/1817752&rft_id=info:pmid\/17375194&rft_id=https%3A%2F%2Fpubmed.ncbi.nlm.nih.gov%2F17375194&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-53\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-53\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Colavizza, Giovanni; Hrynaszkiewicz, Iain; Staden, Isla; Whitaker, Kirstie; McGillivray, Barbara (2020). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/pubmed.ncbi.nlm.nih.gov\/32320428\" target=\"_blank\">\"The citation advantage of linking publications to research data\"<\/a>. <i>PloS One<\/i> <b>15<\/b> (4): e0230416. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1371%2Fjournal.pone.0230416\" target=\"_blank\">10.1371\/journal.pone.0230416<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1932-6203\" target=\"_blank\">1932-6203<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/7176083\/\" target=\"_blank\">7176083<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/32320428\" target=\"_blank\">32320428<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/pubmed.ncbi.nlm.nih.gov\/32320428\" target=\"_blank\">https:\/\/pubmed.ncbi.nlm.nih.gov\/32320428<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=The+citation+advantage+of+linking+publications+to+research+data&rft.jtitle=PloS+One&rft.aulast=Colavizza&rft.aufirst=Giovanni&rft.au=Colavizza%2C%26%2332%3BGiovanni&rft.au=Hrynaszkiewicz%2C%26%2332%3BIain&rft.au=Staden%2C%26%2332%3BIsla&rft.au=Whitaker%2C%26%2332%3BKirstie&rft.au=McGillivray%2C%26%2332%3BBarbara&rft.date=2020&rft.volume=15&rft.issue=4&rft.pages=e0230416&rft_id=info:doi\/10.1371%2Fjournal.pone.0230416&rft.issn=1932-6203&rft_id=info:pmc\/7176083&rft_id=info:pmid\/32320428&rft_id=https%3A%2F%2Fpubmed.ncbi.nlm.nih.gov%2F32320428&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-54\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-54\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Callahan, Alison; Anderson, Kim D.; Beattie, Michael S.; Bixby, John L.; Ferguson, Adam R.; Fouad, Karim; Jakeman, Lyn B.; Nielson, Jessica L. <i>et al.<\/i> (1 September 2017). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/pubmed.ncbi.nlm.nih.gov\/28576567\" target=\"_blank\">\"Developing a data sharing community for spinal cord injury research\"<\/a>. <i>Experimental Neurology<\/i> <b>295<\/b>: 135\u2013143. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.expneurol.2017.05.012\" target=\"_blank\">10.1016\/j.expneurol.2017.05.012<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1090-2430\" target=\"_blank\">1090-2430<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/6448396\/\" target=\"_blank\">6448396<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/28576567\" target=\"_blank\">28576567<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/pubmed.ncbi.nlm.nih.gov\/28576567\" target=\"_blank\">https:\/\/pubmed.ncbi.nlm.nih.gov\/28576567<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Developing+a+data+sharing+community+for+spinal+cord+injury+research&rft.jtitle=Experimental+Neurology&rft.aulast=Callahan&rft.aufirst=Alison&rft.au=Callahan%2C%26%2332%3BAlison&rft.au=Anderson%2C%26%2332%3BKim+D.&rft.au=Beattie%2C%26%2332%3BMichael+S.&rft.au=Bixby%2C%26%2332%3BJohn+L.&rft.au=Ferguson%2C%26%2332%3BAdam+R.&rft.au=Fouad%2C%26%2332%3BKarim&rft.au=Jakeman%2C%26%2332%3BLyn+B.&rft.au=Nielson%2C%26%2332%3BJessica+L.&rft.au=Popovich%2C%26%2332%3BPhillip+G.&rft.date=1+September+2017&rft.volume=295&rft.pages=135%E2%80%93143&rft_id=info:doi\/10.1016%2Fj.expneurol.2017.05.012&rft.issn=1090-2430&rft_id=info:pmc\/6448396&rft_id=info:pmid\/28576567&rft_id=https%3A%2F%2Fpubmed.ncbi.nlm.nih.gov%2F28576567&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-55\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-55\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Garcia, Leyla; Batut, B\u00e9r\u00e9nice; Burke, Melissa L.; Kuzak, Mateusz; Psomopoulos, Fotis; Arcila, Ricardo; Attwood, Teresa K.; Beard, Niall <i>et al.<\/i> (1 May 2020). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/pubmed.ncbi.nlm.nih.gov\/32437350\" target=\"_blank\">\"Ten simple rules for making training materials FAIR\"<\/a>. <i>PLoS computational biology<\/i> <b>16<\/b> (5): e1007854. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1371%2Fjournal.pcbi.1007854\" target=\"_blank\">10.1371\/journal.pcbi.1007854<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1553-7358\" target=\"_blank\">1553-7358<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/7241697\/\" target=\"_blank\">7241697<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/32437350\" target=\"_blank\">32437350<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/pubmed.ncbi.nlm.nih.gov\/32437350\" target=\"_blank\">https:\/\/pubmed.ncbi.nlm.nih.gov\/32437350<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Ten+simple+rules+for+making+training+materials+FAIR&rft.jtitle=PLoS+computational+biology&rft.aulast=Garcia&rft.aufirst=Leyla&rft.au=Garcia%2C%26%2332%3BLeyla&rft.au=Batut%2C%26%2332%3BB%C3%A9r%C3%A9nice&rft.au=Burke%2C%26%2332%3BMelissa+L.&rft.au=Kuzak%2C%26%2332%3BMateusz&rft.au=Psomopoulos%2C%26%2332%3BFotis&rft.au=Arcila%2C%26%2332%3BRicardo&rft.au=Attwood%2C%26%2332%3BTeresa+K.&rft.au=Beard%2C%26%2332%3BNiall&rft.au=Carvalho-Silva%2C%26%2332%3BDenise&rft.date=1+May+2020&rft.volume=16&rft.issue=5&rft.pages=e1007854&rft_id=info:doi\/10.1371%2Fjournal.pcbi.1007854&rft.issn=1553-7358&rft_id=info:pmc\/7241697&rft_id=info:pmid\/32437350&rft_id=https%3A%2F%2Fpubmed.ncbi.nlm.nih.gov%2F32437350&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-56\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-56\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.nih.gov\/about-nih\/what-we-do\/nih-almanac\/appropriations-section-2\" target=\"_blank\">\"Appropriations (Section 2)\"<\/a>. <i>The NIH Almanac<\/i>. U.S. Department of Health and Human Services. 3 March 2020<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.nih.gov\/about-nih\/what-we-do\/nih-almanac\/appropriations-section-2\" target=\"_blank\">https:\/\/www.nih.gov\/about-nih\/what-we-do\/nih-almanac\/appropriations-section-2<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 16 February 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Appropriations+%28Section+2%29&rft.atitle=The+NIH+Almanac&rft.date=3+March+2020&rft.pub=U.S.+Department+of+Health+and+Human+Services&rft_id=https%3A%2F%2Fwww.nih.gov%2Fabout-nih%2Fwhat-we-do%2Fnih-almanac%2Fappropriations-section-2&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-57\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-57\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.nih.gov\/about-nih\/what-we-do\/impact-nih-research\" target=\"_blank\">\"Impact of NIH Research\"<\/a>. National Institutes of Health. 2022<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.nih.gov\/about-nih\/what-we-do\/impact-nih-research\" target=\"_blank\">https:\/\/www.nih.gov\/about-nih\/what-we-do\/impact-nih-research<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 16 February 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Impact+of+NIH+Research&rft.atitle=&rft.date=2022&rft.pub=National+Institutes+of+Health&rft_id=https%3A%2F%2Fwww.nih.gov%2Fabout-nih%2Fwhat-we-do%2Fimpact-nih-research&rfr_id=info:sid\/en.wikipedia.org:Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<\/ol><\/div><\/div>\n<h2><span class=\"mw-headline\" id=\"Notes\">Notes<\/span><\/h2>\n<p>This presentation is faithful to the original, with only a few minor changes to presentation, grammar, and punctuation. In some cases important information was missing from the references, and that information was added.\n<\/p>\n<!-- \nNewPP limit report\nCached time: 20230630145628\nCache expiry: 86400\nDynamic content: false\nComplications: []\nCPU time usage: 0.846 seconds\nReal time usage: 0.925 seconds\nPreprocessor visited node count: 44686\/1000000\nPost\u2010expand include size: 333448\/2097152 bytes\nTemplate argument size: 119076\/2097152 bytes\nHighest expansion depth: 25\/40\nExpensive parser function count: 0\/100\nUnstrip recursion depth: 0\/20\nUnstrip post\u2010expand size: 99114\/5000000 bytes\n-->\n<!--\nTransclusion expansion time report (%,ms,calls,template)\n100.00% 662.086 1 -total\n 89.33% 591.447 1 Template:Reflist\n 71.44% 472.972 57 Template:Citation\/core\n 51.01% 337.714 46 Template:Cite_web\n 20.30% 134.395 9 Template:Cite_journal\n 12.72% 84.205 42 Template:Date\n 5.47% 36.243 1 Template:Infobox_journal_article\n 5.03% 33.313 32 Template:Citation\/identifier\n 4.66% 30.884 1 Template:Infobox\n 4.57% 30.275 1 Template:Cite_book\n-->\n\n<!-- Saved in parser cache with key limswiki:pcache:idhash:14098-0!canonical and timestamp 20230630145627 and revision id 51724. Serialized with JSON.\n -->\n<\/div><\/div><div class=\"printfooter\">Source: <a rel=\"external_link\" class=\"external\" href=\"https:\/\/www.limswiki.org\/index.php\/Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan\">https:\/\/www.limswiki.org\/index.php\/Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan<\/a><\/div>\n<!-- end content --><div class=\"visualClear\"><\/div><\/div><\/div><div class=\"visualClear\"><\/div><\/div><!-- end of the left (by default at least) column --><div class=\"visualClear\"><\/div><\/div>\n\n\n\n<\/body>","558c76387f6f314e1cdfb14c7c293ae7_images":["https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/8\/86\/Fig1_Gonzales_PLOSComBio22_18-8.png"],"558c76387f6f314e1cdfb14c7c293ae7_timestamp":1688138449,"3684f315d0144c04cd2ba3828134fad3_type":"article","3684f315d0144c04cd2ba3828134fad3_title":"Data management of microscale reaction calorimeter using a modular open-source IoT platform (Frede et al. 2023)","3684f315d0144c04cd2ba3828134fad3_url":"https:\/\/www.limswiki.org\/index.php\/Journal:Data_management_of_microscale_reaction_calorimeter_using_a_modular_open-source_IoT_platform","3684f315d0144c04cd2ba3828134fad3_plaintext":"\n\nJournal:Data management of microscale reaction calorimeter using a modular open-source IoT platformFrom LIMSWikiJump to navigationJump to searchFull article title\n \nData management of microscale reaction calorimeter using a modular open-source IoT platformJournal\n \nProcessesAuthor(s)\n \nFrede, Timothy A.; Weber, Constantin; Brockhoff, Tobias; Christ, Tassilo; Ludwig, Denis; Kockmann, NorbertAuthor affiliation(s)\n \nTU Dortmund University, d-fine GmbHPrimary contact\n \nEmail: timothy dot frede at tu dash dortmund dot de; tassilo dot christ at d dash fine dot deYear published\n \n2023Volume and issue\n \n11(1)Article #\n \n279DOI\n \n10.3390\/pr11010279ISSN\n \n2227-9717Distribution license\n \nCreative Commons Attribution 4.0 InternationalWebsite\n \nhttps:\/\/www.mdpi.com\/2227-9717\/11\/1\/279Download\n \nhttps:\/\/www.mdpi.com\/2227-9717\/11\/1\/279\/pdf (PDF)\n\n\n\n\n \n This article contains rendered mathematical formulae. You may require the TeX All the Things plugin for Chrome or the Native MathML add-on and fonts for Firefox if they don't render properly for you. \n\n\nContents \n\n1 Abstract \n2 Introduction \n3 Materials and methods \n\n3.1 Open-source IoT platform \n3.2 Microscale flow reaction calorimeter \n\n3.2.1 Experimental setup and data acquisition \n3.2.2 Process and calorimetric data \n\n\n3.3 Case study: Hydrolysis of acetic anhydride \n3.4 Experimental procedure \n\n\n4 Results \n\n4.1 Acquisition and monitoring of the microscale calorimeter\u2019s process data using d-scover@ \n4.2 Calorimetric data management using d-scover@ \n\n\n5 Conclusions and outlook \n6 Abbreviations, acronyms, and initialisms \n7 Acknowledgments \n\n7.1 Author contributions \n7.2 Funding \n7.3 Conflicts of interest \n\n\n8 References \n9 Notes \n\n\n\nAbstract \nUnifying research data collection methods and capturing data streams in an organized and standardized manner are becoming increasingly important in laboratories as digital processes and automation progressively shape the laboratory workflows. In this context, the internet of things (IoT) not only offers the opportunity to minimize time-consuming and repetitive tasks by delegating them to machines, but it also supports scientists in curating data. As a contribution to the establishment of IoT tools in academic research laboratories, a microscale reaction calorimeter is exemplarily connected to a modular open-source IoT-platform. The microscale calorimeter\u2019s process data is streamed to the data platform for storage and analysis. Advantages of the platform from academia\u2019s point of view are presented. Finally, the application of the platform was successfully tested with the hydrolysis of acetic anhydride. The data were accessed and analyzed exclusively via the IoT-platform, which provided important advantages for the operator in terms of standardized evaluation in just a few steps.\nKeywords: data curation, data management, flow calorimetry, internet of things, open-source software\nGraphic abstract: \n\n\nIntroduction \nThe internet of things (IoT) enables a technical world in which most any device can be connected to the internet and provide real-time data to both other devices and central control systems.[1] Thus, processes and workflows can be automated for many applications. Focusing specifically on chemical laboratories, IoT systems allow chemists, for example, to monitor their reactions in real-time and view the data as needed. In this context, automated, continuously operated, small-scale apparatuses\u2014in research laboratories in particular\u2014represent data factories whose data must be managed accordingly.[2] With such apparatuses, input parameters such as flow rate, temperature, and stirrer speed can be changed quickly. The system also adapts quickly to changing conditions due to the instruments' small size. This allows sequential experiments to be performed in rapid succession, often in a semi-automated way, minimizing time-consuming and repetitive tasks for researchers and enabling them to focus more on interpreting results. In addition, data, and thus also research data, must be stored, processed, and interpreted in a meaningful way. In 2016, Wilkinson et al.[3] proposed the FAIR Data Principles, which formulate principles that sustainable and reusable research data must fulfil and that data infrastructures should implement accordingly as part of the services they offer. According to the principles, data should be findable, accessible, interoperable, and re-usable (FAIR).[3]\nMany different platforms have been presented to realize automated processes in academic research laboratories and to monitor them. Since we perform research in the field of chemical engineering, the following overview of platforms presented in literature is limited to research groups in the same field. In the past, most autonomous platforms made use of LabVIEW[4] and Matlab[5] for automation of equipment control and data management. However, open-source alternatives and cloud-based systems that enable remote control and monitoring are currently trending at the university level.[6][7] (For example, Cherkasov et al.[8] have developed OpenFlowChem, based on the proprietary LabVIEW.) The advantage of open-source software lies in reduced costs, since no licenses are required; the low entry barrier to programming through support from other researchers; and the community and forums; as well as simple access to tutorials on the internet. Moreover, rapid transfer and adaptation is possible. Here, the developments of O\u2019Brien et al.[9], Ingham et al.[10], and Steiner et al.[11] can be mentioned. Recently, van der Westhuizen et al.[12] presented an approach to monitor and control flow chemistry reactors using open-source software. They used the Node-RED platform[13] to develop dashboards, which are similar to LabVIEW. All the mentioned platforms still require different applications to be installed individually by the user and lack the possibility of accessing the various applications centrally at different locations by different users with individual rights, which supports the operator and data scientists in data processing and evaluation.\nTo standardize data management within our laboratory, we have teamed up with d-fine (Frankfurt a.M., Germany), a European consulting firm providing innovative and future-proof solutions through sustainable technological implementation to establish \u201cd-fine\u2019s smart containerized versatile analytics toolbox\u201d (d-scover@)[14] for our experimental workflows. The open-source IoT-platform d-scover@ allows for the quick setup of a sophisticated but robust data supply and analysis tool chain at TU Dortmund University's Laboratory of Equipment Design. Figure 1 shows how different smart devices can be connected to the d-scover@ platform.\n\r\n\n\n\n\n\n\n\n\n\n\nFigure 1. Overview of the connection of the d-scover@ platform to existing smart equipment in laboratories..\n\n\n\nSince our equipment is in most cases already connected to a programmable logic controller (PLC) such as LabManager (HiTec Zang, Herzogenrath, Germany), Controller PFC200 (WAGO GmbH & Co., Minden, Germany) and single-board computers, e.g., Raspberry Pi 4B (Raspberry Pi Foundation, Cambridge, England), existing interfaces can be used for data transfer. Within our research group, the interface of Open Platform Communications Unified Architecture (OPC UA) is established as the standard for data exchange.\nBy establishing the modular data stream platform, the following FAIR Guiding Principles, according to Wilkinson et al.[3], are specifically addressed:\n\ndata are assigned a globally unique and persistent identifier (F1);\nthe protocol is open, free, and universally implementable (A1.1);\nthe protocol allows for an authentication and authorization procedure where necessary (A1.2);\ndata use vocabularies that follow FAIR principles (I2);\ndata are released with a clear and accessible data usage license (R1.1); and\ndata meet domain-relevant community standards (R1.3).\nIn this work, the d-scover@ platform from d-fine is used for data management of an automated microfluidic reaction calorimeter. For this, the IoT platform and its tools are presented first. Subsequently, the microscale calorimeter and its measurement data are described. Finally, the benefits of using the IoT platform for the microscale calorimeter are demonstrated and discussed with the investigation of the hydrolysis of acetic anhydride.\n\nMaterials and methods \nOpen-source IoT platform \nIndustrial corporates increasingly strive to automate as much of their value creation as possible to increase productivity, react faster to changing market conditions and disrupted supply chains, and to cope with a lack of qualified workforce. A digital representation of all inbound, in-house, and outbound processes is mandatory for this.\nAcquiring the necessary process data from machines and sensors, storing them in a consistent manner, and analyzing and sharing them\u2014frequently not only across corporate divisions but also with suppliers and customers\u2014requires a fully integrated end-to-end data platform. However, competing IT standards and protocols, and the need to integrate external and \u201clegacy\u201d systems, make this a daunting task. The same is true\u2014albeit on a smaller scale\u2014for scientific laboratory equipment, in particular if heterogeneous devices need to be managed. To facilitate quick operational wins and ensure a steep learning curve at virtually no cost, we use a modular open-source platform in our laboratory. d-fine\u2019s IoT suite d-scover@ is available under a permissive open-source license and is used in industry and science to build reliable and secure data pipelines with minimal investment. It comprises open-source data storage backends and an extract, transform, load (ETL) stack for extracting data from different sources, transforming them into the desired target format and loading the results into the storage systems. Modelling and data analysis capabilities are provided via a secure execution environment for Python notebooks. A reverse proxy, a web portal and tools for user management, logging, and network setup complement the system. In Figure 2, an overview of the underlying open-source tech-stack is provided.\n\r\n\n\n\n\n\n\n\n\n\n\nFigure 2. d-scover@\u2019s underlying open-source tech-stack.\n\n\n\nd-scover@ provides for container-based deployment, ready-to-use network configuration, and continuous integration support. It can be easily extended and allows for standalone user management or integration with active directory.\nThe suite was installed on the Department of Biochemical and Chemical Engineering's intranet and connected to the laboratory equipment\u2014described in the Results section\u2014by members of the Laboratory of Equipment Design and the d-fine industrial internet of things (IIoT) division. Analyses\u2014also discussed in the Results section\u2014were performed with the Python analytics backend of d-scover@. For details about the platform, installation support, and functional extensions, please contact the corresponding author from d-fine.\n\nMicroscale flow reaction calorimeter \nExperimental setup and data acquisition \nThe open-source IoT platform d-scover@ is used for the setup of a microscale flow reaction calorimeter employed in our laboratory. The continuously operated, microfluidic reaction calorimeter measures the temporal and spatial heat release of chemical processes using Seebeck elements (SEs), and thus enables the determination of thermokinetic data. The whole setup for calorimetric measurements is shown schematically in Figure 3.\n\r\n\n\n\n\n\n\n\n\n\n\nFigure 3. Complete experimental setup used for calorimetric measurements, including data flows.\n\n\n\nAs centerpiece of the setup, the microscale calorimeter consists of a commercially available microreactor (LTF-MS, Little Things Factory, Elsoff, Germany) and twelve Seebeck elements (SEs) (QC-31-1.0\u20133.0M, Quick-Ohm K\u00fcpper & Co., Wuppertal, Germany) to measure the heat flux along the reaction channel. The calorimeter is placed in a closed, temperature-controlled box made of aluminum profiles with transparent poly(methyl methacrylate) walls to minimize external influences on the measurements, in particular environmental temperature fluctuations. The reactants are fed into the reactor via syringe pumps (VIT-FIT, Lambda Instruments, Baar, Switzerland). The reactants\u2019 inlet temperatures are controlled using preheating loops, which are also located in the closed box. The individual components such as pumps, SEs, and temperature sensors are connected to a laboratory automation system (LabManager, HiTec Zang, Herzogenrath, Germany) enabling automated experimentation. A graphical user interface (GUI) is generated using the proprietary visualization and automation software LabVision. Additionally, the operator is assisted by a self-developed software-guided workflow. First, a sequence of experiments is determined by the operator, in which the flow rates and temperature can be varied. Next, the measured process data are imported by LabManager and the experiments are performed automatically in the specified order with the specified parameters.\n\nProcess and calorimetric data \nDuring the performance of calorimetric measurements, measured process data are collected, which are subsequently used to determine calorimetric data such as the reaction enthalpy. The determination of the thermokinetic data is based on balancing of the energy of the entire system or the individual reactor sections above the SEs. Here, only a brief introduction of the energy balance is given. More details can be found in previous works.[15][16] The general energy balance equation that applies to both methods is:\n\n\n \n \n \n \n \n \n d\n Q\n \n \n d\n t\n \n \n \n =\n \n \n \n \n Q\n ˙\n \n \n \n \n c\n o\n n\n v\n ,\n i\n n\n \n \n −\n \n \n \n \n Q\n ˙\n \n \n \n \n c\n o\n n\n v\n ,\n o\n u\n t\n \n \n −\n \n \n \n \n Q\n ˙\n \n \n \n \n S\n E\n ,\n i\n \n \n −\n \n \n \n \n Q\n ˙\n \n \n \n \n l\n o\n s\n s\n ,\n i\n \n \n +\n \n \n \n \n Q\n ˙\n \n \n \n \n r\n \n \n \n \n {\\displaystyle {\\frac {dQ}{dt}}={\\dot {Q}}_{conv,in}-{\\dot {Q}}_{conv,out}-{\\dot {Q}}_{SE,i}-{\\dot {Q}}_{loss,i}+{\\dot {Q}}_{r}}\n \n \nThe heat fluxes that must be considered in the balance are the convective heat flux through the flow fluid \n \n \n \n Δ\n \n \n \n \n Q\n ˙\n \n \n \n \n c\n o\n n\n v\n \n \n \n \n {\\displaystyle \\Delta {\\dot {Q}}_{conv}}\n \n , the measured heat flux of the SEs \n \n \n \n \n \n \n \n Q\n ˙\n \n \n \n \n S\n E\n ,\n i\n \n \n \n \n {\\displaystyle {\\dot {Q}}_{SE,i}}\n \n , the heat loss \n \n \n \n \n \n \n \n Q\n ˙\n \n \n \n \n l\n o\n s\n s\n ,\n i\n \n \n \n \n {\\displaystyle {\\dot {Q}}_{loss,i}}\n \n not measured by the SEs, and the energy brought into the system by the reaction \n \n \n \n \n \n \n \n Q\n ˙\n \n \n \n \n r\n \n \n \n \n {\\displaystyle {\\dot {Q}}_{r}}\n \n . Since the experiments are evaluated in steady-state, the previous equation can be solved for the reaction enthalpy \n \n \n \n Δ\n \n H\n \n r\n \n \n \n \n {\\displaystyle \\Delta H_{r}}\n \n as such:\n\n\n \n \n \n Δ\n \n H\n \n r\n \n \n =\n \n \n \n Δ\n \n \n \n \n Q\n ˙\n \n \n \n \n c\n o\n n\n v\n \n \n +\n \n \n \n \n Q\n ˙\n \n \n \n \n S\n E\n \n \n +\n \n \n \n \n Q\n ˙\n \n \n \n \n l\n o\n s\n s\n \n \n \n \n \n \n \n V\n ˙\n \n \n \n \n c\n \n i\n ,\n 0\n \n \n X\n \n \n \n \n \n {\\displaystyle \\Delta H_{r}={\\frac {\\Delta {\\dot {Q}}_{conv}+{\\dot {Q}}_{SE}+{\\dot {Q}}_{loss}}{{\\dot {V}}c_{i,0}X}}}\n \n \nHence, the reaction enthalpy can be determined directly from measured process data once steady-state is reached. In Table 1, the process data measured by the calorimeter setup and the determined thermokinetic data using the calorimetric measurement method are listed.\n\n\n\n\n\n\n\nTable 1. Process data measured by microscale flow reaction calorimeter and thermokinetic data determined via calorimetric measurement methods.\n\n\nType\n\nParameter\n\nSymbol\n\nUnit\n\n\nProcess data\n\nInlet temperature of feed 1\n\n\n \n \n \n \n \n T\n \n \n r\n ,\n i\n n\n ,\n 1\n \n \n \n \n {\\displaystyle {T}_{r,in,1}}\n \n \n\n\u00b0C\n\n\nProcess data\n\nInlet temperature of feed 2\n\n\n \n \n \n \n \n T\n \n \n r\n ,\n i\n n\n ,\n 2\n \n \n \n \n {\\displaystyle {T}_{r,in,2}}\n \n \n\n\u00b0C\n\n\nProcess data\n\nVolumetric flow rate of feed 1\n\n\n \n \n \n \n \n \n \n V\n ˙\n \n \n \n \n i\n n\n ,\n 1\n \n \n \n \n {\\displaystyle {\\dot {V}}_{in,1}}\n \n \n\n\u00b5L min\u22121\n\n\nProcess data\n\nVolumetric flow rate of feed 2\n\n\n \n \n \n \n \n \n \n V\n ˙\n \n \n \n \n i\n n\n ,\n 2\n \n \n \n \n {\\displaystyle {\\dot {V}}_{in,2}}\n \n \n\n\u00b5L min\u22121\n\n\nProcess data\n\nConcentration in feed 1\n\n\n \n \n \n \n \n c\n \n \n 1\n ,\n i\n \n \n \n \n {\\displaystyle {c}_{1,i}}\n \n \n\nmol L\u22121\n\n\nProcess data\n\nConcentration in feed 2\n\n\n \n \n \n \n \n c\n \n \n 2\n ,\n i\n \n \n \n \n {\\displaystyle {c}_{2,i}}\n \n \n\nmol L\u22121\n\n\nProcess data\n\nOutlet temperature of product stream\n\n\n \n \n \n \n \n T\n \n \n r\n ,\n o\n u\n t\n \n \n \n \n {\\displaystyle {T}_{r,out}}\n \n \n\n\u00b0C\n\n\nProcess data\n\nAmbient temperature within the closed box\n\n\n \n \n \n \n \n T\n \n \n a\n m\n b\n i\n e\n n\n t\n \n \n \n \n {\\displaystyle {T}_{ambient}}\n \n \n\n\u00b0C\n\n\nProcess data\n\nMeasured thermoelectric voltages of SEs along the reaction channel\n\n\n \n \n \n \n \n U\n \n \n S\n E\n ,\n i\n \n \n \n \n {\\displaystyle {U}_{SE,i}}\n \n \n\nV\n\n\nProcess data\n\nHeat loss over the top of the reactor\n\n\n \n \n \n \n \n \n \n Q\n ˙\n \n \n \n \n l\n o\n s\n s\n ,\n i\n \n \n \n \n {\\displaystyle {\\dot {Q}}_{loss,i}}\n \n \n\nW\n\n\nThermokinetic data\n\nReaction enthalpy\n\n\n \n \n \n Δ\n \n H\n \n r\n \n \n \n \n {\\displaystyle \\Delta H_{r}}\n \n \n\nkJ mol\u22121\n\n\nThermokinetic data\n\nActivation energy\n\n\n \n \n \n \n \n E\n \n \n A\n \n \n \n \n {\\displaystyle {E}_{A}}\n \n \n\nkJ mol\u22121\n\n\nThermokinetic data\n\nPre-exponential factor\n\n\n \n \n \n \n \n k\n \n \n 0\n \n \n \n \n {\\displaystyle {k}_{0}}\n \n \n\n[(m3 mol\u22121)n\u22121 s\u22121]\n\n\n\nCase study: Hydrolysis of acetic anhydride \nThe acid-catalyzed hydrolysis of acetic anhydride (Ac2O) was chosen as a test reaction to establish the interaction between the calorimeter setup and d-scover@. The reaction often serves as a model reaction in calorimetry. In addition, the reaction was also recently studied in flow calorimeters, which allows a comparison.[17][18][19] Ac2O is split into two molecules of acetic acid (AcOH) under the consumption of water. The reaction scheme is as follows:\n\n\n \n \n \n A\n \n c\n \n 2\n \n \n O\n +\n \n H\n \n 2\n \n \n O\n \n \n →\n \n H\n \n +\n \n \n \n \n 2\n A\n c\n O\n H\n \n \n {\\displaystyle Ac_{2}O+H_{2}O{\\overset {H^{+}}{\\rightarrow }}2AcOH}\n \n \nSince Ac2O is partially miscible with water, the reaction can be carried out as single- or two-phase reaction. The reaction follows a pseudo first-order kinetics when a large excess of water is used. Literature values for its thermokinetic data are given in Table 2.\n\n\n\n\n\n\n\nTable 2. Thermokinetic parameter of the hydrolysis of acetic anhydride.\n\n\nAuthor\n\n\n \n \n \n Δ\n \n H\n \n r\n \n \n \n \n {\\displaystyle \\Delta H_{r}}\n \n (kJ mol\u22121)\n\n\n \n \n \n Δ\n \n H\n \n m\n i\n x\n \n \n \n \n {\\displaystyle \\Delta H_{mix}}\n \n (kJ mol\u22121)\n\n\nMartin[20]\n\n\u221261 to \u221259\n\nnot stated\n\n\nZogg, Fischer, and Hungerb\u00fchler[21]\n\n\u221262 to \u221257\n\n\u22123 to +3\n\n\n\u0141adosz, Kuhnle, and Jensen[17]\n\n\u221263\n\n+9\n\n\nSteinemann et al.[18]\n\n\u221262\n\n+7\n\n\n\nExperimental procedure \nIn this study, the reaction enthalpy for the hydrolysis of acetic anhydride is determined. Two solutions are prepared for the experiments: an aqueous solution and a solution containing acetic anhydride. The aqueous solution consists of nitric acid, water, and acetic acid. Acetic acid is added to improve the mixing behavior, since acetic anhydride does not dissolve in water at the concentrations used. The concentrations of the solutions used are listed in Table 3.\n\n\n\n\n\n\n\nTable 3. Substances and concentrations used for hydrolysis of acetic anhydride.\n\n\nSubstance\n\nSupplier\n\nSpecification\n\nConcentration (mol L\u22121)\n\n\nAcetic anhydride\n\nMerck\n\n\u226598.0%\n\n10.52 (neat)\n\n\nAcetic acid\n\nMerck\n\n\u226599.0%\n\n5.54\n\n\nNitric acid\n\nMerck\n\n\u226598.5%\n\n5.32\n\n\nDeionized water\n\nTU Dortmund University\n\n\u03c3 \u22645 \u00d7 10\u22124 S m\u22121\n\n28.6\n\n\n\nThe hydrolysis reaction was investigated at three temperature levels: 30, 40, and 50 \u00b0C. The total volumetric flow rates were set to 58, 147, 325, 504, 682, and 861 \u03bcL min\u22121. A flow rate ratio of aqueous solution to acetic anhydride of 1:1 was used.\nFor the experiments, all desired temperature and flow rates are automatically set by the PLC, with certain waiting times to allow for heating, cooling, and temperature adaption of the whole system. Steadystate measurements of the respective experimental settings are performed, and every measurement point is recorded in triplets. Prior to the experiments, the SEs have been calibrated and baseline signal of the SEs have been recorded. The data streams from these two steps are currently not yet acquired via d-scover@, however this would be conceivable in the future. Further and more detailed information on the experimental procedure and the calorimetric measurement method itself can be found in 2022 research by Frede, Greive, and Kockmann.[16]\n\nResults \n Acquisition and monitoring of the microscale calorimeter\u2019s process data using d-scover@ \nAs a first step in the d-scover@ application, we decided to stream only sensor and actuator data as raw data. This decision was triggered among others because the calculation of the heat fluxes measured via the SEs requires further calibration data, which change over time due to recalibration. Accordingly, the measured thermoelectric voltages of the SEs are transferred as raw data to enable a subsequent recalculation of heat fluxes with more up-to-date calibration data. The data flow to the d-scover@ platform is started only as soon as calorimetric measurements on the microscale calorimeter are initiated, whereby a new value is sent every second. The frequency can be adjusted, but is sufficient for our application. Hence, unnecessary streaming and irrelevant data is avoided. In addition to the data listed in Table 1, other data are streamed that are set by the operator. The operator\u2019s acronym, the name of the reaction being investigated, and the concentrations of the reactants used are provided by the operator. The last, but for continuously operated reactors crucial information, whether steady-state has already been reached, is also transmitted. Thus, a variable is set from 0 to 1 by the lab automation system when steady-state is reached.\nAll data to be streamed to the d-scover@ platform are generated as a node on the OPC UA server, which is provided by LabManager. The OPC UA server data are accessed via Apache Nifi, the software integrated in d-scover@ for defining data streams and interfaces. Once this data flow is generated, the data already stream into the PostgreSQL database. The database can be accessed via the integrated software pgAdmin. Finally, the data are visualized using Grafana. To prevent data streams from being edited or deleted by another user, different users with different rights were assigned via Keycloak, which is also integrated in d-scover@.\nOnce the data streams were set up in NiFi, a dashboard was generated using Grafana. This shows the essential experimental data that are important for both the operator of the calorimeter and the supervisor, for example. The final dashboard is shown in Figure 4.\n\r\n\n\n\n\n\n\n\n\n\n\nFigure 4. Dashboard for visualization of experimental data during calorimetric measurements such as volumetric flow rates and temperatures.\n\n\n\nThe left side of the dashboard displays data from sensors and actuators and whether the system is in steady-state (1) or not (0) as time series, whereas the right side provides details of the reaction currently under investigation in the form of the name and concentration in the respective feeds. A key benefit of d-scover@ for scientist working in labs is that the dashboard and all other tools can be accessed via the web browser on all workstations within our network. This allows the \u201csupervisor in the office\u201d not only to look up which reaction is currently being investigated, but also enables a much better and also more quantitative discussion of the results with the operator during online meeting through screen sharing, for example. In addition, the editable dashboard enables the time series of the data to be arranged as desired and thus to be arranged in relation to each other. It was only through this feature that we realized we needed to adapt the steady-state criterion. Previously, the steady-state criterion referred only to the change in the measured thermoelectric voltage of the SEs and required a change of less than 0.5% in a time span of 10 seconds. Therefore, Figure 5 shows exemplarily an excerpt from the dashboard during the investigation of the oxidation of sodium thiosulfate with hydrogen peroxide. This reaction is described in more detail in a previous work by Frede, Greive, and Kockmann.[16]\n\r\n\n\n\n\n\n\n\n\n\n\nFigure 5. Excerpt from the dashboard during the investigation of the oxidation of thiosulfate with hydrogen peroxide.\n\n\n\nOn one hand, it was observed that the measured thermoelectric voltages of the SEs fluctuate more at higher temperature levels. This behavior was particularly evident for the oxidation of sodium thiosulfate, which was presented in a previous work by Frede, Greive, and Kockmann.[16] On the other hand, it was observed that in some experiments the temperature at the reactor outlet was not yet completely in steady-state. Even though the temperature change was already minimal, some fluctuations could still be seen by comparing thermoelectric voltages and temperatures over time. The parametric sensitivity of this reaction and the influence of pH fluctuation on the reaction explain the dynamic reaction behavior even in steady-state. This was already observed by Gelhausen et al.[22] and is here well shown in the measured signals of the SEs. Hence, the steady-state criterion was adapted for the study of the hydrolysis of acetic anhydride. \nThe following two conditions must be met for a measurement to be considered in steady-state:\n\nThe voltage of the SEs must not fluctuate more than 0.25 mV for \n \n \n \n \n \n T\n \n \n r\n \n \n \n \n {\\displaystyle {T}_{r}}\n \n = 30, 40 \u00b0C; 0.50 mV for \n \n \n \n \n \n E\n \n \n A\n \n \n \n \n {\\displaystyle {E}_{A}}\n \n = 50 \u00b0C; and 0.75 mV for \n \n \n \n \n \n E\n \n \n A\n \n \n \n \n {\\displaystyle {E}_{A}}\n \n = 60 \u00b0C, in the last 30 seconds.\nThe temperature at the reactor outlet \n \n \n \n \n \n T\n \n \n r\n ,\n o\n u\n t\n \n \n \n \n {\\displaystyle {T}_{r,out}}\n \n must not fluctuate more than 0.5 \u00b0C in the last 180 seconds due to the delayed behavior.\nHere, fluctuation refers to the difference of maximum and minimum value in the respective time span.\n\n Calorimetric data management using d-scover@ \nThe application of d-scover@ to the microscale calorimeter for data analysis was tested for the hydrolysis of acetic anhydride. The entire evaluation was performed using JupyterHub, which runs directly on the server where the data are also located. At first, we wrote a script that outputs which reactions were studied, and at what temperatures, concentrations, and volumetric flow rates each reaction was performed. There, the user gets to know which data can be selected in the next step for the evaluation of the reaction. As mentioned in the previous section, not all data needed for the determination of thermokinetics are streamed to the platform by measurements. For the evaluation of calorimetric measurements, the calibration factors of the SEs and the base line signals are loaded and stored via JupyterHub in the database. With this completed, the script for the evaluation can be executed with the respective input data from the user.\nThe determined heat of reaction is shown in Figure 6 for the different temperature level of the hydrolysis of acetic anhydride.\n\r\n\n\n\n\n\n\n\n\n\n\nFigure 6. Heat of reaction of hydrolysis of acetic anhydride at different temperature and volumetric flow rate. Literature value by \u0141adosz et al.[17] is indicated by dashed black line.\n\n\n\nFor \n \n \n \n \n T\n \n \n \n {\\displaystyle {T}}\n \n = 30 \u00b0C, an increase is observed in the heat of reaction up to \n \n \n \n \n \n \n V\n ˙\n \n \n \n \n \n {\\displaystyle {\\dot {V}}}\n \n = 325 \u00b5L min\u22121. After that, the determined heat of reaction decreases. For the two lowest volumetric flow rates, the heat of reaction is in very good agreement with the literature value, from which the relative deviation is 0.47%. The decrease in heat of reaction for higher volumetric flow rates is probably due to incomplete conversion within the microreactor as the residence time decreases. According to the Van\u2019t Hoff rule[23], an increasing heat of reaction profile and better agreement with literature data are expected for higher temperatures.\nFor both \n \n \n \n \n T\n \n \n \n {\\displaystyle {T}}\n \n = 40 and 50 \u00b0C, the determined heat of reaction increases with increasing flow rate matching the previously mentioned expectation. For further confirmation of incomplete conversion, the heat flux profiles are investigated. Therefore, the specific heat flux profile at a temperature level of 30 \u00b0C is shown in Figure 7.\n\r\n\n\n\n\n\n\n\n\n\n\nFigure 7. Specific heat flux profile of the SEs for the hydrolysis of acetic anhydride for varying volumetric flow rate and \n \n \n \n \n \n T\n \n \n i\n n\n \n \n \n \n {\\displaystyle {T}_{in}}\n \n = \n \n \n \n \n \n T\n \n \n a\n m\n b\n i\n e\n n\n t\n \n \n \n \n {\\displaystyle {T}_{ambient}}\n \n = 30 \u00b0C.\n\n\n\nFor the lowest flow rate, the highest specific heat flux is present at SE 2. For the second-lowest flow rate, the highest specific heat flux is present at SE 4. This shift of the maximal specific heat flux to later reactor segments with increasing flow rates is consistent as residence time decreases and the reaction is kinetically, and not mixing-, controlled. For the two lowest volumetric flow rates, a peak of the heat flux profile is observed within the first four SEs. Additionally, comparatively low heat fluxes are detected close to the reactor outlet. Hence, complete conversion is assumed for these flow rates, supporting the agreement of the heat of reaction with the literature value, too. An analysis of the heat flux profiles at higher temperatures with these requirements for complete conversion shows that complete conversion can be assumed at the three lowest flow rates for \n \n \n \n \n T\n \n \n \n {\\displaystyle {T}}\n \n = 40 and at all flow rates, except the highest one for \n \n \n \n \n T\n \n \n \n {\\displaystyle {T}}\n \n = 50 \u00b0C.\nThe reaction enthalpy is calculated based on the respective calorimetric measurement and calculated heat fluxes, shown in Figure 8.\n\r\n\n\n\n\n\n\n\n\n\n\nFigure 8. Determined reaction enthalpy for hydrolysis of acetic anhydride from the experiments for the respective volumetric flow rates and temperatures in comparison with literature value by \u0141adosz et al.[17], which is indicated by a dashed black line.\n\n\n\nSince the calculation of the reaction enthalpy is based on the determined heat of reaction, the same behavior is observed for the respective temperatures and volumetric flow rates in Figure 6. In addition, it can be seen there that the heat of reaction, and thus also the reaction enthalpy, are overestimated in some cases. This is due to the determination of the heat loss, as this is the only term in the energy balance that is not directly measured but determined numerically. Combining the determined reaction enthalpy of the flow rates, with complete conversion at the respective temperature level, yields a reaction enthalpy of \u221265.9 \u00b1 3.1 kJ mol\u22121. This is a relative deviation to the literature value of 4.6%.[17] Hence, good agreement with literature is obtained.\n\nConclusions and outlook \nIn this study, a microscale flow calorimeter was connected to the modular open-source IoT-platform d-scover@ from d-fine. The existing OPC UA server was used to stream data into the platform allowing for data visualization, storage, and analysis. The platform was established successfully in a few days with the support of d-fine and a dedicated student assistant. By displaying the data in a dashboard, the need for an additional steady-state criterion became apparent, which was implemented directly. Additionally, the application and the benefit of the IoT-platform were evaluated with the hydrolysis of acetic anhydride and thiosulfate oxidation as test reactions, which allow for using standardized evaluation of the calorimetric measurements on different working stations within the local computer network. The facilitated data analysis led to a new consideration of steady-state status, enabling fast and semi-automated experimentation. The reaction enthalpy of the test reaction obtained was in good agreement with literature data.\nHowever, the low entry hurdle for operators with little to no programming experience should be emphasized as a key point here. All the essential tools a researcher needs in the laboratory to store, visualize, and evaluate his measured values are provided without the researcher having to install them. In addition, the use of an open-source solution allows a quick exchange of programs between researchers and the community or forums for help with issues.\nAs a current limitation, it should be mentioned here that only monitoring and no equipment control is possible with the current version of d-scover@. Remote control of equipment can be quite useful for some applications, such as analytical equipment, but such remote control should be implemented sensibly with the appropriate security precautions, as it is associated with security risks such as intentional or accidental sabotage of experiments or equipment. In addition, we used a separate workstation for the IoT-platform, since Docker requires at least 8GB of RAM and we wanted to exclude a shutdown due to automated updates by our IT infrastructure.\nThe modular data platform complements the reaction calorimeter very well with additional functionalities. In future work, we want to connect further smart equipment in our laboratory such as a small-scale extraction column and a setup for optical detection of emulsions with the data platform. This approach will further harmonize data management within our laboratory while better applying FAIR Guiding Principles.\n\n Abbreviations, acronyms, and initialisms \nAcOH: acetic acid\nAc2O: acetic anhydride\nBCI: Department of Biochemical and Chemical Engineering, TU Dortmund University\nETL: extract, transform, load\nFAIR: findable, accessible, interoperable, and re-usable\nGUI: graphical user interface\nIoT: internet of things\nIIoT: industrial internet of things\nOPC UA: Open Platform Communications Unified Architecture\nPLC: programmable logic controller\nSE: Seebeck element\nAcknowledgments \nThe laboratory of Equipment Design thanks d-fine GmbH for providing the IoT-platform dscover@ and especially Alexey Fofonov, Christoph Charlet, and Tassilo Christ for their support in establishing it. T.A.F. thanks the networking program \u2018Sustainable Chemical Synthesis 2.0\u2032 (SusChemSys 2.0) for the support and fruitful discussions across disciplines.\n\nAuthor contributions \nConceptualization, T.C., D.L. and T.A.F.; methodology, T.A.F., C.W. and N.K.; software, T.C., C.W. and T.B.; validation, C.W. and T.B.; formal analysis, T.A.F. and T.B.; investigation, T.B.; resources, T.C. and D.L.; data curation, C.W., T.B. and T.A.F.; writing\u2014original draft preparation, T.A.F. and T.C.; writing\u2014review and editing, N.K. and T.C.; visualization, T.B. and T.A.F.; supervision, T.A.F. and N.K.; project administration, N.K.; funding acquisition, N.K. All authors have read and agreed to the published version of the manuscript.\n\nFunding \nThis research of the Forschungsvereinigung Forschungs-Gesellschaft Verfahrens-Technik e.V. (GVT) was funded by the German Federal Ministry of Economic Affairs and Climate Action via the Arbeitsgemeinschaft Industrieller Forschungsvereinigungen (AiF) within the framework of the program for the promotion of the Industrielle Gemeinschaftsforschung (IGF), grant number IGF no. 20819 N.\n\nConflicts of interest \nThe authors declare no conflict of interest.\n\r\n\n\nReferences \n\n\n\u2191 R\u00fcckert, T. (2018). \"The IoT Paves the Way for a Networked Economy\". In Sendler, Ulrich. The Internet of Things: Industrie 4.0 Unleashed (1st ed. 2018 ed.). Berlin, Heidelberg: Springer Berlin Heidelberg : Imprint: Springer Vieweg. pp. 221\u201332. ISBN 978-3-662-54904-9.   \n \n\n\u2191 Knoll, Sebastian; Jusner, Clemens E.; Sagmeister, Peter; Williams, Jason D.; Hone, Christopher A.; Horn, Martin; Kappe, C. Oliver (2022). \"Autonomous model-based experimental design for rapid reaction development\" (in en). Reaction Chemistry & Engineering 7 (11): 2375\u20132384. doi:10.1039\/D2RE00208F. ISSN 2058-9883. http:\/\/xlink.rsc.org\/?DOI=D2RE00208F .   \n \n\n\u2191 3.0 3.1 3.2 Wilkinson, Mark D.; Dumontier, Michel; Aalbersberg, IJsbrand Jan; Appleton, Gabrielle; Axton, Myles; Baak, Arie; Blomberg, Niklas; Boiten, Jan-Willem et al. (15 March 2016). \"The FAIR Guiding Principles for scientific data management and stewardship\" (in en). Scientific Data 3 (1): 160018. doi:10.1038\/sdata.2016.18. ISSN 2052-4463. PMC PMC4792175. PMID 26978244. https:\/\/www.nature.com\/articles\/sdata201618 .   \n \n\n\u2191 Elliott, Chance; Vijayakumar, Vipin; Zink, Wesley; Hansen, Richard (1 February 2007). \"National Instruments LabVIEW: A Programming Environment for Laboratory Automation and Measurement\" (in en). JALA: Journal of the Association for Laboratory Automation 12 (1): 17\u201324. doi:10.1016\/j.jala.2006.07.012. ISSN 1535-5535. http:\/\/journals.sagepub.com\/doi\/10.1016\/j.jala.2006.07.012 .   \n \n\n\u2191 \"MATLAB\". The MathWorks, Inc.. https:\/\/www.mathworks.com\/products\/matlab.html . Retrieved 01 December 2022 .   \n \n\n\u2191 Mateos, Carlos; Nieves-Remacha, Mar\u00eda Jos\u00e9; Rinc\u00f3n, Juan A. (2019). \"Automated platforms for reaction self-optimization in flow\" (in en). Reaction Chemistry & Engineering 4 (9): 1536\u20131544. doi:10.1039\/C9RE00116F. ISSN 2058-9883. http:\/\/xlink.rsc.org\/?DOI=C9RE00116F .   \n \n\n\u2191 Mateos, Carlos; Nieves-Remacha, Mar\u00eda Jos\u00e9; Rinc\u00f3n, Juan A. (2019). \"Automated platforms for reaction self-optimization in flow\" (in en). Reaction Chemistry & Engineering 4 (9): 1536\u20131544. doi:10.1039\/C9RE00116F. ISSN 2058-9883. http:\/\/xlink.rsc.org\/?DOI=C9RE00116F .   \n \n\n\u2191 Cherkasov, Nikolay; Bai, Yang; Exp\u00f3sito, Antonio Jos\u00e9; Rebrov, Evgeny V. (2018). \"OpenFlowChem \u2013 a platform for quick, robust and flexible automation and self-optimisation of flow chemistry\" (in en). Reaction Chemistry & Engineering 3 (5): 769\u2013780. doi:10.1039\/C8RE00046H. ISSN 2058-9883. http:\/\/xlink.rsc.org\/?DOI=C8RE00046H .   \n \n\n\u2191 O'Brien, Matthew; Hall, April; Schrauwen, John; van der Made, Joyce (1 June 2018). \"An open-source approach to automation in organic synthesis: The flow chemical formation of benzamides using an inline liquid-liquid extraction system and a homemade 3-axis autosampling\/product-collection device\" (in en). Tetrahedron 74 (25): 3152\u20133157. doi:10.1016\/j.tet.2018.02.043. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0040402018301881 .   \n \n\n\u2191 Ingham, Richard J.; Battilocchio, Claudio; Hawkins, Joel M.; Ley, Steven V. (2014). \"Integration of enabling methods for the automated flow preparation of piperazine-2-carboxamide\". Beilstein Journal of Organic Chemistry 10: 641\u2013652. doi:10.3762\/bjoc.10.56. ISSN 1860-5397. PMC 3999859. PMID 24778715. https:\/\/pubmed.ncbi.nlm.nih.gov\/24778715 .   \n \n\n\u2191 Steiner, Sebastian; Wolf, Jakob; Glatzel, Stefan; Andreou, Anna; Granda, Jaros\u0142aw M.; Keenan, Graham; Hinkley, Trevor; Aragon-Camarasa, Gerardo et al. (11 January 2019). \"Organic synthesis in a modular robotic system driven by a chemical programming language\" (in en). Science 363 (6423): eaav2211. doi:10.1126\/science.aav2211. ISSN 0036-8075. https:\/\/www.science.org\/doi\/10.1126\/science.aav2211 .   \n \n\n\u2191 van der Westhuizen, C. Johan; du Toit, Jurie; Neyt, Nicole; Riley, Darren; Panayides, Jenny-Lee (2022). \"Use of open-source software platform to develop dashboards for control and automation of flow chemistry equipment\" (in en). Digital Discovery 1 (5): 596\u2013604. doi:10.1039\/D2DD00036A. ISSN 2635-098X. http:\/\/xlink.rsc.org\/?DOI=D2DD00036A .   \n \n\n\u2191 \"Category: Node-RED\". OpenJS Foundation. https:\/\/openjsf.org\/category\/node-red\/ . Retrieved 03 January 2023 .   \n \n\n\u2191 Charlet, C.; Christ, T. (July 2022). \"Open source IoT data pipelines\". d-fine GmbH. https:\/\/www.d-fine.com\/news\/open-source-iot-data-pipelines\/ .   \n \n\n\u2191 Reichmann, Felix; Millhoff, Stefan; Jirmann, Yannick; Kockmann, Norbert (1 November 2017). \"Reaction Calorimetry for Exothermic Reactions in Plate-Type Microreactors Using Seebeck Elements\" (in en). Chemical Engineering & Technology 40 (11): 2144\u20132154. doi:10.1002\/ceat.201700419. https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/ceat.201700419 .   \n \n\n\u2191 16.0 16.1 16.2 16.3 Frede, Timothy Aljoscha; Greive, Moritz; Kockmann, Norbert (12 October 2022). \"Measuring Kinetics in Flow Using Isoperibolic Flow Calorimetry\" (in en). Reactions 3 (4): 525\u2013536. doi:10.3390\/reactions3040035. ISSN 2624-781X. https:\/\/www.mdpi.com\/2624-781X\/3\/4\/35 .   \n \n\n\u2191 17.0 17.1 17.2 17.3 17.4 \u0141adosz, Agnieszka; Kuhnle, Christina; Jensen, Klavs F. (2020). \"Characterization of reaction enthalpy and kinetics in a microscale flow platform\" (in en). Reaction Chemistry & Engineering 5 (11): 2115\u20132122. doi:10.1039\/D0RE00304B. ISSN 2058-9883. http:\/\/xlink.rsc.org\/?DOI=D0RE00304B .   \n \n\n\u2191 18.0 18.1 Steinemann, Finn L.; R\u00fctti, David P.; Moser, Marlies; Georg, Alain G.; Meier, Daniel M. (1 December 2022). \"Simultaneous determination of enthalpy of mixing and reaction using milli-scale continuous flow calorimetry\" (in en). Journal of Flow Chemistry 12 (4): 389\u2013396. doi:10.1007\/s41981-022-00237-x. ISSN 2062-249X. https:\/\/link.springer.com\/10.1007\/s41981-022-00237-x .   \n \n\n\u2191 Glotz, Gabriel; Knoechel, Donald J.; Podmore, Philip; Gruber-Woelfler, Heidrun; Kappe, C. Oliver (19 May 2017). \"Reaction Calorimetry in Microreactor Environments\u2014Measuring Heat of Reaction by Isothermal Heat Flux Calorimetry\" (in en). Organic Process Research & Development 21 (5): 763\u2013770. doi:10.1021\/acs.oprd.7b00092. ISSN 1083-6160. https:\/\/pubs.acs.org\/doi\/10.1021\/acs.oprd.7b00092 .   \n \n\n\u2191 Martin, H. (1975). \"W\u00e4rmeflusskalorimetrie Unter Pr\u00e4parativen Bedingungen Und Ihre Anwendung Zur Verfolgung Der Isomerisierungskinetik von Trimethylphosphit\". Universit\u00e4t Basel. https:\/\/infozentrum.ethz.ch\/katalog\/werke\/374\/780 .   \n \n\n\u2191 Zogg, Andreas; Fischer, Ulrich; Hungerb\u00fchler, Konrad (1 February 2003). \"A New Small-Scale Reaction Calorimeter That Combines the Principles of Power Compensation and Heat Balance\" (in en). Industrial & Engineering Chemistry Research 42 (4): 767\u2013776. doi:10.1021\/ie0201258. ISSN 0888-5885. https:\/\/pubs.acs.org\/doi\/10.1021\/ie0201258 .   \n \n\n\u2191 Gelhausen, Marius Gerrit; Kurt, Safa Kutup; Kockmann, Norbert (1 June 2015). \"Parametrische Empfindlichkeit einer stark exothermen Reaktion im Kapillarwendelreaktor\" (in en). Chemie Ingenieur Technik 87 (6): 781\u2013790. doi:10.1002\/cite.201400141. https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/cite.201400141 .   \n \n\n\u2191 Baerns, Manfred; Behr, Arno; Brehm, Axel; Gmehling, J\u00fcrgen; Hinrichsen, Kai-Olaf; Hofmann, Hanns; Palkovits, Regina; Onken, Ulfert et al. (2013). Technische Chemie (Zweite, erweiterte Auflage ed.). Weinheim: Wiley-VCH. ISBN 978-3-527-67409-1.   \n \n\n\nNotes \nThis presentation is faithful to the original, with only a few minor changes to presentation. In some cases important information was missing from the references, and that information was added.\n\n\n\n\n\nSource: <a rel=\"external_link\" class=\"external\" href=\"https:\/\/www.limswiki.org\/index.php\/Journal:Data_management_of_microscale_reaction_calorimeter_using_a_modular_open-source_IoT_platform\">https:\/\/www.limswiki.org\/index.php\/Journal:Data_management_of_microscale_reaction_calorimeter_using_a_modular_open-source_IoT_platform<\/a>\nCategories: LIMSwiki journal articles (added in 2023)LIMSwiki journal articles (all)LIMSwiki journal articles on data management and sharingLIMSwiki journal articles on internet of thingsLIMSwiki journal articles on laboratory informaticsNavigation menuPage actionsJournalDiscussionView sourceHistoryPage actionsJournalDiscussionMoreToolsIn other languagesPersonal toolsLog inNavigationMain pageEncyclopedic articlesRecent changesRandom pageHelp about MediaWikiSearch\u00a0 ToolsWhat links hereRelated changesSpecial pagesPermanent linkPage informationPopular publications\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\n\n\t\r\nPrint\/exportCreate a bookDownload as PDFDownload as PDFDownload as Plain textPrintable version This page was last edited on 19 April 2023, at 22:04.Content is available under a Creative Commons Attribution-ShareAlike 4.0 International License unless otherwise noted.This page has been accessed 299 times.Privacy policyAbout LIMSWikiDisclaimers\n\n\n\n","3684f315d0144c04cd2ba3828134fad3_html":"<body class=\"mediawiki ltr sitedir-ltr mw-hide-empty-elt ns-206 ns-subject page-Journal_Data_management_of_microscale_reaction_calorimeter_using_a_modular_open-source_IoT_platform rootpage-Journal_Data_management_of_microscale_reaction_calorimeter_using_a_modular_open-source_IoT_platform skin-monobook action-view skin--responsive\"><div id=\"rdp-ebb-globalWrapper\"><div id=\"rdp-ebb-column-content\"><div id=\"rdp-ebb-content\" class=\"mw-body\" role=\"main\"><a id=\"rdp-ebb-top\"><\/a>\n<h1 id=\"rdp-ebb-firstHeading\" class=\"firstHeading\" lang=\"en\">Journal:Data management of microscale reaction calorimeter using a modular open-source IoT platform<\/h1><div id=\"rdp-ebb-bodyContent\" class=\"mw-body-content\"><!-- start content --><div id=\"rdp-ebb-mw-content-text\" lang=\"en\" dir=\"ltr\" class=\"mw-content-ltr\"><div class=\"mw-parser-output\">\n\n\n\n<h2><span class=\"mw-headline\" id=\"Abstract\">Abstract<\/span><\/h2>\n<p>Unifying research data collection methods and capturing data streams in an organized and standardized manner are becoming increasingly important in <a href=\"https:\/\/www.limswiki.org\/index.php\/Laboratory\" title=\"Laboratory\" class=\"wiki-link\" data-key=\"c57fc5aac9e4abf31dccae81df664c33\">laboratories<\/a> as digital processes and <a href=\"https:\/\/www.limswiki.org\/index.php\/Laboratory_automation\" title=\"Laboratory automation\" class=\"wiki-link\" data-key=\"0061880849aeaca05f8aa27ae171f331\">automation<\/a> progressively shape the laboratory <a href=\"https:\/\/www.limswiki.org\/index.php\/Workflow\" title=\"Workflow\" class=\"wiki-link\" data-key=\"92bd8748272e20d891008dcb8243e8a8\">workflows<\/a>. In this context, the <a href=\"https:\/\/www.limswiki.org\/index.php\/Internet_of_things\" title=\"Internet of things\" class=\"wiki-link\" data-key=\"13e0b826fa1770fe4bea72e3cb942f0f\">internet of things<\/a> (IoT) not only offers the opportunity to minimize time-consuming and repetitive tasks by delegating them to machines, but it also supports scientists in curating data. As a contribution to the establishment of IoT tools in academic research laboratories, a microscale reaction <a href=\"https:\/\/www.limswiki.org\/index.php\/Calorimeter\" title=\"Calorimeter\" class=\"wiki-link\" data-key=\"af2c641f435c259a996f13fc0c612eed\">calorimeter<\/a> is exemplarily connected to a modular open-source IoT-platform. The microscale calorimeter\u2019s process data is streamed to the data platform for storage and <a href=\"https:\/\/www.limswiki.org\/index.php\/Data_analysis\" title=\"Data analysis\" class=\"wiki-link\" data-key=\"545c95e40ca67c9e63cd0a16042a5bd1\">analysis<\/a>. Advantages of the platform from academia\u2019s point of view are presented. Finally, the application of the platform was successfully tested with the hydrolysis of acetic anhydride. The data were accessed and analyzed exclusively via the IoT-platform, which provided important advantages for the operator in terms of standardized evaluation in just a few steps.\n<\/p><p><b>Keywords<\/b>: data curation, data management, flow calorimetry, internet of things, open-source software\n<\/p><p><b>Graphic abstract<\/b>: <a href=\"https:\/\/www.limswiki.org\/index.php\/File:GA1_Frede_Processes23_11-1.png\" class=\"image wiki-link\" data-key=\"34d72b6d12788c462d86e8dbf2c68f39\"><img alt=\"GA1 Frede Processes23 11-1.png\" src=\"https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/1\/12\/GA1_Frede_Processes23_11-1.png\" decoding=\"async\" style=\"width: 100%;max-width: 400px;height: auto;\" \/><\/a>\n<\/p>\n<div style=\"clear:both;\"><\/div>\n<h2><span class=\"mw-headline\" id=\"Introduction\">Introduction<\/span><\/h2>\n<p>The <a href=\"https:\/\/www.limswiki.org\/index.php\/Internet_of_things\" title=\"Internet of things\" class=\"wiki-link\" data-key=\"13e0b826fa1770fe4bea72e3cb942f0f\">internet of things<\/a> (IoT) enables a technical world in which most any device can be connected to the internet and provide real-time data to both other devices and central control systems.<sup id=\"rdp-ebb-cite_ref-1\" class=\"reference\"><a href=\"#cite_note-1\">[1]<\/a><\/sup> Thus, processes and <a href=\"https:\/\/www.limswiki.org\/index.php\/Workflow\" title=\"Workflow\" class=\"wiki-link\" data-key=\"92bd8748272e20d891008dcb8243e8a8\">workflows<\/a> can be automated for many applications. Focusing specifically on chemical <a href=\"https:\/\/www.limswiki.org\/index.php\/Laboratory\" title=\"Laboratory\" class=\"wiki-link\" data-key=\"c57fc5aac9e4abf31dccae81df664c33\">laboratories<\/a>, IoT systems allow chemists, for example, to monitor their reactions in real-time and view the data as needed. In this context, automated, continuously operated, small-scale apparatuses\u2014in research laboratories in particular\u2014represent data factories whose <a href=\"https:\/\/www.limswiki.org\/index.php\/Information_management\" title=\"Information management\" class=\"wiki-link\" data-key=\"f8672d270c0750a858ed940158ca0a73\">data must be managed<\/a> accordingly.<sup id=\"rdp-ebb-cite_ref-2\" class=\"reference\"><a href=\"#cite_note-2\">[2]<\/a><\/sup> With such apparatuses, input parameters such as flow rate, temperature, and stirrer speed can be changed quickly. The system also adapts quickly to changing conditions due to the instruments' small size. This allows sequential experiments to be performed in rapid succession, often in a semi-automated way, minimizing time-consuming and repetitive tasks for researchers and enabling them to focus more on interpreting results. In addition, data, and thus also research data, must be stored, processed, and interpreted in a meaningful way. In 2016, Wilkinson <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-:0_3-0\" class=\"reference\"><a href=\"#cite_note-:0-3\">[3]<\/a><\/sup> proposed the FAIR Data Principles, which formulate principles that sustainable and reusable research data must fulfil and that data infrastructures should implement accordingly as part of the services they offer. According to the principles, data should be findable, accessible, interoperable, and re-usable (FAIR).<sup id=\"rdp-ebb-cite_ref-:0_3-1\" class=\"reference\"><a href=\"#cite_note-:0-3\">[3]<\/a><\/sup>\n<\/p><p>Many different platforms have been presented to realize automated processes in academic research laboratories and to monitor them. Since we perform research in the field of chemical engineering, the following overview of platforms presented in literature is limited to research groups in the same field. In the past, most autonomous platforms made use of LabVIEW<sup id=\"rdp-ebb-cite_ref-4\" class=\"reference\"><a href=\"#cite_note-4\">[4]<\/a><\/sup> and Matlab<sup id=\"rdp-ebb-cite_ref-5\" class=\"reference\"><a href=\"#cite_note-5\">[5]<\/a><\/sup> for <a href=\"https:\/\/www.limswiki.org\/index.php\/Laboratory_automation\" title=\"Laboratory automation\" class=\"wiki-link\" data-key=\"0061880849aeaca05f8aa27ae171f331\">automation<\/a> of equipment control and data management. However, open-source alternatives and <a href=\"https:\/\/www.limswiki.org\/index.php\/Cloud_computing\" title=\"Cloud computing\" class=\"wiki-link\" data-key=\"fcfe5882eaa018d920cedb88398b604f\">cloud-based<\/a> systems that enable remote control and monitoring are currently trending at the university level.<sup id=\"rdp-ebb-cite_ref-6\" class=\"reference\"><a href=\"#cite_note-6\">[6]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-7\" class=\"reference\"><a href=\"#cite_note-7\">[7]<\/a><\/sup> (For example, Cherkasov <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-8\" class=\"reference\"><a href=\"#cite_note-8\">[8]<\/a><\/sup> have developed OpenFlowChem, based on the proprietary LabVIEW.) The advantage of <a href=\"https:\/\/www.limswiki.org\/index.php\/Free_and_open-source_software\" title=\"Free and open-source software\" class=\"wiki-link\" data-key=\"688dbf2b7fb58c69c6ad476828ee2c6a\">open-source software<\/a> lies in reduced costs, since no licenses are required; the low entry barrier to programming through support from other researchers; and the community and forums; as well as simple access to tutorials on the internet. Moreover, rapid transfer and adaptation is possible. Here, the developments of O\u2019Brien <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-9\" class=\"reference\"><a href=\"#cite_note-9\">[9]<\/a><\/sup>, Ingham <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-10\" class=\"reference\"><a href=\"#cite_note-10\">[10]<\/a><\/sup>, and Steiner <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-11\" class=\"reference\"><a href=\"#cite_note-11\">[11]<\/a><\/sup> can be mentioned. Recently, van der Westhuizen <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-12\" class=\"reference\"><a href=\"#cite_note-12\">[12]<\/a><\/sup> presented an approach to monitor and control flow chemistry reactors using open-source software. They used the Node-RED platform<sup id=\"rdp-ebb-cite_ref-13\" class=\"reference\"><a href=\"#cite_note-13\">[13]<\/a><\/sup> to develop <a href=\"https:\/\/www.limswiki.org\/index.php\/Dashboard_(business)\" title=\"Dashboard (business)\" class=\"wiki-link\" data-key=\"84b2a149a60f68dc381c65b85e5bad62\">dashboards<\/a>, which are similar to LabVIEW. All the mentioned platforms still require different applications to be installed individually by the user and lack the possibility of accessing the various applications centrally at different locations by different users with individual rights, which supports the operator and data scientists in data processing and evaluation.\n<\/p><p>To standardize data management within our laboratory, we have teamed up with d-fine (Frankfurt a.M., Germany), a European consulting firm providing innovative and future-proof solutions through sustainable technological implementation to establish \u201cd-fine\u2019s smart containerized versatile analytics toolbox\u201d (d-scover@)<sup id=\"rdp-ebb-cite_ref-14\" class=\"reference\"><a href=\"#cite_note-14\">[14]<\/a><\/sup> for our experimental workflows. The open-source IoT-platform d-scover@ allows for the quick setup of a sophisticated but robust data supply and analysis tool chain at TU Dortmund University's Laboratory of Equipment Design. Figure 1 shows how different smart devices can be connected to the d-scover@ platform.\n<\/p><p><br \/>\n<a href=\"https:\/\/www.limswiki.org\/index.php\/File:Fig1_Frede_Processes23_11-1.png\" class=\"image wiki-link\" data-key=\"830b73f26a211414686e49d0b6e7e718\"><img alt=\"Fig1 Frede Processes23 11-1.png\" src=\"https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/0\/00\/Fig1_Frede_Processes23_11-1.png\" decoding=\"async\" style=\"width: 100%;max-width: 400px;height: auto;\" \/><\/a>\n<\/p>\n<div style=\"clear:both;\"><\/div>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table border=\"0\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><blockquote><p><b>Figure 1.<\/b> Overview of the connection of the d-scover@ platform to existing smart equipment in laboratories..<\/p><\/blockquote>\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<p>Since our equipment is in most cases already connected to a programmable logic controller (PLC) such as LabManager (<a href=\"https:\/\/www.limswiki.org\/index.php\/HiTec_Zang_GmbH\" title=\"HiTec Zang GmbH\" class=\"wiki-link\" data-key=\"6b60549f5ac6952e758298e6729fc0d7\">HiTec Zang<\/a>, Herzogenrath, Germany), Controller PFC200 (WAGO GmbH & Co., Minden, Germany) and single-board computers, e.g., Raspberry Pi 4B (Raspberry Pi Foundation, Cambridge, England), existing interfaces can be used for data transfer. Within our research group, the interface of Open Platform Communications Unified Architecture (OPC UA) is established as the standard for data exchange.\n<\/p><p>By establishing the modular data stream platform, the following FAIR Guiding Principles, according to Wilkinson <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-:0_3-2\" class=\"reference\"><a href=\"#cite_note-:0-3\">[3]<\/a><\/sup>, are specifically addressed:\n<\/p>\n<ul><li>data are assigned a globally unique and persistent identifier (F1);<\/li>\n<li>the protocol is open, free, and universally implementable (A1.1);<\/li>\n<li>the protocol allows for an authentication and authorization procedure where necessary (A1.2);<\/li>\n<li>data use vocabularies that follow FAIR principles (I2);<\/li>\n<li>data are released with a clear and accessible data usage license (R1.1); and<\/li>\n<li>data meet domain-relevant community standards (R1.3).<\/li><\/ul>\n<p>In this work, the d-scover@ platform from d-fine is used for data management of an automated microfluidic reaction calorimeter. For this, the IoT platform and its tools are presented first. Subsequently, the microscale calorimeter and its measurement data are described. Finally, the benefits of using the IoT platform for the microscale calorimeter are demonstrated and discussed with the investigation of the hydrolysis of acetic anhydride.\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Materials_and_methods\">Materials and methods<\/span><\/h2>\n<h3><span class=\"mw-headline\" id=\"Open-source_IoT_platform\">Open-source IoT platform<\/span><\/h3>\n<p>Industrial corporates increasingly strive to automate as much of their value creation as possible to increase productivity, react faster to changing market conditions and disrupted supply chains, and to cope with a lack of qualified workforce. A digital representation of all inbound, in-house, and outbound processes is mandatory for this.\n<\/p><p>Acquiring the necessary process data from machines and sensors, storing them in a consistent manner, and analyzing and sharing them\u2014frequently not only across corporate divisions but also with suppliers and customers\u2014requires a fully integrated end-to-end data platform. However, competing IT standards and protocols, and the need to integrate external and \u201clegacy\u201d systems, make this a daunting task. The same is true\u2014albeit on a smaller scale\u2014for scientific laboratory equipment, in particular if heterogeneous devices need to be managed. To facilitate quick operational wins and ensure a steep learning curve at virtually no cost, we use a modular open-source platform in our laboratory. d-fine\u2019s IoT suite d-scover@ is available under a permissive open-source license and is used in industry and science to build reliable and secure data pipelines with minimal investment. It comprises open-source data storage backends and an extract, transform, load (ETL) stack for extracting data from different sources, transforming them into the desired target format and loading the results into the storage systems. Modelling and data analysis capabilities are provided via a secure execution environment for <a href=\"https:\/\/www.limswiki.org\/index.php\/Python_(programming_language)\" title=\"Python (programming language)\" class=\"wiki-link\" data-key=\"ef6905a29cbb75d3c71e6bdf6e2915dd\">Python<\/a> notebooks. A reverse proxy, a web portal and tools for user management, logging, and network setup complement the system. In Figure 2, an overview of the underlying open-source tech-stack is provided.\n<\/p><p><br \/>\n<a href=\"https:\/\/www.limswiki.org\/index.php\/File:Fig2_Frede_Processes23_11-1.png\" class=\"image wiki-link\" data-key=\"e7209401ef086f1a03eff2b54cb553e8\"><img alt=\"Fig2 Frede Processes23 11-1.png\" src=\"https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/f\/f3\/Fig2_Frede_Processes23_11-1.png\" decoding=\"async\" style=\"width: 100%;max-width: 400px;height: auto;\" \/><\/a>\n<\/p>\n<div style=\"clear:both;\"><\/div>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table border=\"0\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><blockquote><p><b>Figure 2.<\/b> d-scover@\u2019s underlying open-source tech-stack.<\/p><\/blockquote>\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<p>d-scover@ provides for container-based deployment, ready-to-use network configuration, and continuous integration support. It can be easily extended and allows for standalone user management or integration with active directory.\n<\/p><p>The suite was installed on the Department of Biochemical and Chemical Engineering's intranet and connected to the laboratory equipment\u2014described in the Results section\u2014by members of the Laboratory of Equipment Design and the d-fine industrial internet of things (IIoT) division. Analyses\u2014also discussed in the Results section\u2014were performed with the Python analytics backend of d-scover@. For details about the platform, installation support, and functional extensions, please contact the corresponding author from d-fine.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Microscale_flow_reaction_calorimeter\">Microscale flow reaction calorimeter<\/span><\/h3>\n<h4><span class=\"mw-headline\" id=\"Experimental_setup_and_data_acquisition\">Experimental setup and data acquisition<\/span><\/h4>\n<p>The open-source IoT platform d-scover@ is used for the setup of a microscale flow reaction calorimeter employed in our laboratory. The continuously operated, microfluidic reaction calorimeter measures the temporal and spatial heat release of chemical processes using Seebeck elements (SEs), and thus enables the determination of thermokinetic data. The whole setup for calorimetric measurements is shown schematically in Figure 3.\n<\/p><p><br \/>\n<a href=\"https:\/\/www.limswiki.org\/index.php\/File:Fig3_Frede_Processes23_11-1.png\" class=\"image wiki-link\" data-key=\"dc093fc151820ff2512a511fbe64fc41\"><img alt=\"Fig3 Frede Processes23 11-1.png\" src=\"https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/5\/52\/Fig3_Frede_Processes23_11-1.png\" decoding=\"async\" style=\"width: 100%;max-width: 400px;height: auto;\" \/><\/a>\n<\/p>\n<div style=\"clear:both;\"><\/div>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table border=\"0\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><blockquote><p><b>Figure 3.<\/b> Complete experimental setup used for calorimetric measurements, including data flows.<\/p><\/blockquote>\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<p>As centerpiece of the setup, the microscale calorimeter consists of a commercially available microreactor (LTF-MS, Little Things Factory, Elsoff, Germany) and twelve Seebeck elements (SEs) (QC-31-1.0\u20133.0M, Quick-Ohm K\u00fcpper & Co., Wuppertal, Germany) to measure the heat flux along the reaction channel. The calorimeter is placed in a closed, temperature-controlled box made of aluminum profiles with transparent poly(methyl methacrylate) walls to minimize external influences on the measurements, in particular environmental temperature fluctuations. The reactants are fed into the reactor via syringe pumps (VIT-FIT, Lambda Instruments, Baar, Switzerland). The reactants\u2019 inlet temperatures are controlled using preheating loops, which are also located in the closed box. The individual components such as pumps, SEs, and temperature sensors are connected to a laboratory automation system (LabManager, HiTec Zang, Herzogenrath, Germany) enabling automated experimentation. A graphical user interface (GUI) is generated using the proprietary <a href=\"https:\/\/www.limswiki.org\/index.php\/Data_visualization\" title=\"Data visualization\" class=\"wiki-link\" data-key=\"4a3b86cba74bc7bb7471aa3fc2fcccc3\">visualization<\/a> and automation software LabVision. Additionally, the operator is assisted by a self-developed software-guided workflow. First, a sequence of experiments is determined by the operator, in which the flow rates and temperature can be varied. Next, the measured process data are imported by LabManager and the experiments are performed automatically in the specified order with the specified parameters.\n<\/p>\n<h4><span class=\"mw-headline\" id=\"Process_and_calorimetric_data\">Process and calorimetric data<\/span><\/h4>\n<p>During the performance of calorimetric measurements, measured process data are collected, which are subsequently used to determine calorimetric data such as the reaction enthalpy. The determination of the thermokinetic data is based on balancing of the energy of the entire system or the individual reactor sections above the SEs. Here, only a brief introduction of the energy balance is given. More details can be found in previous works.<sup id=\"rdp-ebb-cite_ref-15\" class=\"reference\"><a href=\"#cite_note-15\">[15]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-:1_16-0\" class=\"reference\"><a href=\"#cite_note-:1-16\">[16]<\/a><\/sup> The general energy balance equation that applies to both methods is:\n<\/p>\n<dl><dd><span class=\"mwe-math-element\"><span class=\"mwe-math-mathml-inline mwe-math-mathml-a11y\" style=\"display: none;\"><\/span><img src=\"https:\/\/en.wikipedia.org\/api\/rest_v1\/media\/math\/render\/svg\/a499d97ef3f69a4445cfd378b08f4370739078bf\" class=\"mwe-math-fallback-image-inline\" aria-hidden=\"true\" style=\"vertical-align: -2.005ex; width:48.025ex; height:5.509ex;\" alt=\"{\\displaystyle {\\frac {dQ}{dt}}={\\dot {Q}}_{conv,in}-{\\dot {Q}}_{conv,out}-{\\dot {Q}}_{SE,i}-{\\dot {Q}}_{loss,i}+{\\dot {Q}}_{r}}\"\/><\/span><\/dd><\/dl>\n<p>The heat fluxes that must be considered in the balance are the convective heat flux through the flow fluid <span class=\"mwe-math-element\"><span class=\"mwe-math-mathml-inline mwe-math-mathml-a11y\" style=\"display: none;\"><\/span><img src=\"https:\/\/en.wikipedia.org\/api\/rest_v1\/media\/math\/render\/svg\/6bb26dfcd0e8e0530426a12b997a4c2a9af34557\" class=\"mwe-math-fallback-image-inline\" aria-hidden=\"true\" style=\"vertical-align: -0.838ex; width:7.299ex; height:3.343ex;\" alt=\"{\\displaystyle \\Delta {\\dot {Q}}_{conv}}\"\/><\/span>, the measured heat flux of the SEs <span class=\"mwe-math-element\"><span class=\"mwe-math-mathml-inline mwe-math-mathml-a11y\" style=\"display: none;\"><\/span><img src=\"https:\/\/en.wikipedia.org\/api\/rest_v1\/media\/math\/render\/svg\/68caeda235184a48961340171f0a028127e0c299\" class=\"mwe-math-fallback-image-inline\" aria-hidden=\"true\" style=\"vertical-align: -1.171ex; width:5.411ex; height:3.676ex;\" alt=\"{\\displaystyle {\\dot {Q}}_{SE,i}}\"\/><\/span>, the heat loss <span class=\"mwe-math-element\"><span class=\"mwe-math-mathml-inline mwe-math-mathml-a11y\" style=\"display: none;\"><\/span><img src=\"https:\/\/en.wikipedia.org\/api\/rest_v1\/media\/math\/render\/svg\/2f990453a697bacb5446c0674eeb4a682ba87d36\" class=\"mwe-math-fallback-image-inline\" aria-hidden=\"true\" style=\"vertical-align: -1.171ex; width:5.925ex; height:3.676ex;\" alt=\"{\\displaystyle {\\dot {Q}}_{loss,i}}\"\/><\/span> not measured by the SEs, and the energy brought into the system by the reaction <span class=\"mwe-math-element\"><span class=\"mwe-math-mathml-inline mwe-math-mathml-a11y\" style=\"display: none;\"><\/span><img src=\"https:\/\/en.wikipedia.org\/api\/rest_v1\/media\/math\/render\/svg\/b348e8ffc457426ac46c97ca611309bfa0bd1c98\" class=\"mwe-math-fallback-image-inline\" aria-hidden=\"true\" style=\"vertical-align: -0.838ex; width:2.812ex; height:3.343ex;\" alt=\"{\\displaystyle {\\dot {Q}}_{r}}\"\/><\/span>. Since the experiments are evaluated in steady-state, the previous equation can be solved for the reaction enthalpy <span class=\"mwe-math-element\"><span class=\"mwe-math-mathml-inline mwe-math-mathml-a11y\" style=\"display: none;\"><\/span><img src=\"https:\/\/en.wikipedia.org\/api\/rest_v1\/media\/math\/render\/svg\/1880681383b519e7e220605419e0cb0729d958d0\" class=\"mwe-math-fallback-image-inline\" aria-hidden=\"true\" style=\"vertical-align: -0.671ex; width:4.841ex; height:2.509ex;\" alt=\"{\\displaystyle \\Delta H_{r}}\"\/><\/span> as such:\n<\/p>\n<dl><dd><span class=\"mwe-math-element\"><span class=\"mwe-math-mathml-inline mwe-math-mathml-a11y\" style=\"display: none;\"><\/span><img src=\"https:\/\/en.wikipedia.org\/api\/rest_v1\/media\/math\/render\/svg\/8548d1fe3fd15d85bed11f9f235c617a3a2d7659\" class=\"mwe-math-fallback-image-inline\" aria-hidden=\"true\" style=\"vertical-align: -3.171ex; width:31.042ex; height:7.343ex;\" alt=\"{\\displaystyle \\Delta H_{r}={\\frac {\\Delta {\\dot {Q}}_{conv}+{\\dot {Q}}_{SE}+{\\dot {Q}}_{loss}}{{\\dot {V}}c_{i,0}X}}}\"\/><\/span><\/dd><\/dl>\n<p>Hence, the reaction enthalpy can be determined directly from measured process data once steady-state is reached. In Table 1, the process data measured by the calorimeter setup and the determined thermokinetic data using the calorimetric measurement method are listed.\n<\/p>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table class=\"wikitable\" border=\"1\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td colspan=\"4\" style=\"background-color:white; padding-left:10px; padding-right:10px;\"><b>Table 1.<\/b> Process data measured by microscale flow reaction calorimeter and thermokinetic data determined via calorimetric measurement methods.\n<\/td><\/tr>\n<tr>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Type\n<\/th>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Parameter\n<\/th>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Symbol\n<\/th>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Unit\n<\/th><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Process data\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Inlet temperature of feed 1\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><span class=\"mwe-math-element\"><span class=\"mwe-math-mathml-inline mwe-math-mathml-a11y\" style=\"display: none;\"><\/span><img src=\"https:\/\/en.wikipedia.org\/api\/rest_v1\/media\/math\/render\/svg\/c70325050f8dfff70d3769a26b42c85f84d35b3f\" class=\"mwe-math-fallback-image-inline\" aria-hidden=\"true\" style=\"vertical-align: -1.005ex; width:5.622ex; height:2.843ex;\" alt=\"{\\displaystyle {T}_{r,in,1}}\"\/><\/span>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\u00b0C\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Process data\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Inlet temperature of feed 2\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><span class=\"mwe-math-element\"><span class=\"mwe-math-mathml-inline mwe-math-mathml-a11y\" style=\"display: none;\"><\/span><img src=\"https:\/\/en.wikipedia.org\/api\/rest_v1\/media\/math\/render\/svg\/54480f1011026d02c6329eeefa7ace629b326efd\" class=\"mwe-math-fallback-image-inline\" aria-hidden=\"true\" style=\"vertical-align: -1.005ex; width:5.622ex; height:2.843ex;\" alt=\"{\\displaystyle {T}_{r,in,2}}\"\/><\/span>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\u00b0C\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Process data\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Volumetric flow rate of feed 1\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><span class=\"mwe-math-element\"><span class=\"mwe-math-mathml-inline mwe-math-mathml-a11y\" style=\"display: none;\"><\/span><img src=\"https:\/\/en.wikipedia.org\/api\/rest_v1\/media\/math\/render\/svg\/c314b21e3cccc8e6beb4ed20eff233043763938d\" class=\"mwe-math-fallback-image-inline\" aria-hidden=\"true\" style=\"vertical-align: -1.005ex; width:4.852ex; height:3.343ex;\" alt=\"{\\displaystyle {\\dot {V}}_{in,1}}\"\/><\/span>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\u00b5L min<sup>\u22121<\/sup>\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Process data\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Volumetric flow rate of feed 2\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><span class=\"mwe-math-element\"><span class=\"mwe-math-mathml-inline mwe-math-mathml-a11y\" style=\"display: none;\"><\/span><img src=\"https:\/\/en.wikipedia.org\/api\/rest_v1\/media\/math\/render\/svg\/14199e08f3de4050207b82a8f8f1bd69a142c06c\" class=\"mwe-math-fallback-image-inline\" aria-hidden=\"true\" style=\"vertical-align: -1.005ex; width:4.852ex; height:3.343ex;\" alt=\"{\\displaystyle {\\dot {V}}_{in,2}}\"\/><\/span>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\u00b5L min<sup>\u22121<\/sup>\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Process data\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Concentration in feed 1\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><span class=\"mwe-math-element\"><span class=\"mwe-math-mathml-inline mwe-math-mathml-a11y\" style=\"display: none;\"><\/span><img src=\"https:\/\/en.wikipedia.org\/api\/rest_v1\/media\/math\/render\/svg\/ee715bed46289f7e17d7daebb951a65de917ec2d\" class=\"mwe-math-fallback-image-inline\" aria-hidden=\"true\" style=\"vertical-align: -1.005ex; width:3.086ex; height:2.343ex;\" alt=\"{\\displaystyle {c}_{1,i}}\"\/><\/span>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">mol L<sup>\u22121<\/sup>\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Process data\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Concentration in feed 2\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><span class=\"mwe-math-element\"><span class=\"mwe-math-mathml-inline mwe-math-mathml-a11y\" style=\"display: none;\"><\/span><img src=\"https:\/\/en.wikipedia.org\/api\/rest_v1\/media\/math\/render\/svg\/f579c13e64a5a291517f56fb0376e502dadcabef\" class=\"mwe-math-fallback-image-inline\" aria-hidden=\"true\" style=\"vertical-align: -1.005ex; width:3.086ex; height:2.343ex;\" alt=\"{\\displaystyle {c}_{2,i}}\"\/><\/span>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">mol L<sup>\u22121<\/sup>\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Process data\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Outlet temperature of product stream\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><span class=\"mwe-math-element\"><span class=\"mwe-math-mathml-inline mwe-math-mathml-a11y\" style=\"display: none;\"><\/span><img src=\"https:\/\/en.wikipedia.org\/api\/rest_v1\/media\/math\/render\/svg\/ab2a324bd27ba6c99beb649e82a1f4f08ccf646b\" class=\"mwe-math-fallback-image-inline\" aria-hidden=\"true\" style=\"vertical-align: -1.005ex; width:5.12ex; height:2.843ex;\" alt=\"{\\displaystyle {T}_{r,out}}\"\/><\/span>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\u00b0C\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Process data\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Ambient temperature within the closed box\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><span class=\"mwe-math-element\"><span class=\"mwe-math-mathml-inline mwe-math-mathml-a11y\" style=\"display: none;\"><\/span><img src=\"https:\/\/en.wikipedia.org\/api\/rest_v1\/media\/math\/render\/svg\/32fa82563efe92fdb562daef206a9368c11384ad\" class=\"mwe-math-fallback-image-inline\" aria-hidden=\"true\" style=\"vertical-align: -0.671ex; width:7.521ex; height:2.509ex;\" alt=\"{\\displaystyle {T}_{ambient}}\"\/><\/span>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\u00b0C\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Process data\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Measured thermoelectric voltages of SEs along the reaction channel\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><span class=\"mwe-math-element\"><span class=\"mwe-math-mathml-inline mwe-math-mathml-a11y\" style=\"display: none;\"><\/span><img src=\"https:\/\/en.wikipedia.org\/api\/rest_v1\/media\/math\/render\/svg\/53cf63938c92d2fde07053cc1cf3463dd08a5a0c\" class=\"mwe-math-fallback-image-inline\" aria-hidden=\"true\" style=\"vertical-align: -1.005ex; width:5.16ex; height:2.843ex;\" alt=\"{\\displaystyle {U}_{SE,i}}\"\/><\/span>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">V\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Process data\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Heat loss over the top of the reactor\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><span class=\"mwe-math-element\"><span class=\"mwe-math-mathml-inline mwe-math-mathml-a11y\" style=\"display: none;\"><\/span><img src=\"https:\/\/en.wikipedia.org\/api\/rest_v1\/media\/math\/render\/svg\/2f990453a697bacb5446c0674eeb4a682ba87d36\" class=\"mwe-math-fallback-image-inline\" aria-hidden=\"true\" style=\"vertical-align: -1.171ex; width:5.925ex; height:3.676ex;\" alt=\"{\\displaystyle {\\dot {Q}}_{loss,i}}\"\/><\/span>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">W\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Thermokinetic data\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Reaction enthalpy\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><span class=\"mwe-math-element\"><span class=\"mwe-math-mathml-inline mwe-math-mathml-a11y\" style=\"display: none;\"><\/span><img src=\"https:\/\/en.wikipedia.org\/api\/rest_v1\/media\/math\/render\/svg\/1880681383b519e7e220605419e0cb0729d958d0\" class=\"mwe-math-fallback-image-inline\" aria-hidden=\"true\" style=\"vertical-align: -0.671ex; width:4.841ex; height:2.509ex;\" alt=\"{\\displaystyle \\Delta H_{r}}\"\/><\/span>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">kJ mol<sup>\u22121<\/sup>\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Thermokinetic data\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Activation energy\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><span class=\"mwe-math-element\"><span class=\"mwe-math-mathml-inline mwe-math-mathml-a11y\" style=\"display: none;\"><\/span><img src=\"https:\/\/en.wikipedia.org\/api\/rest_v1\/media\/math\/render\/svg\/124538ff5ef7da1c856bb16636440a3e1fcb8273\" class=\"mwe-math-fallback-image-inline\" aria-hidden=\"true\" style=\"vertical-align: -0.671ex; width:3.18ex; height:2.509ex;\" alt=\"{\\displaystyle {E}_{A}}\"\/><\/span>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">kJ mol<sup>\u22121<\/sup>\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Thermokinetic data\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Pre-exponential factor\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><span class=\"mwe-math-element\"><span class=\"mwe-math-mathml-inline mwe-math-mathml-a11y\" style=\"display: none;\"><\/span><img src=\"https:\/\/en.wikipedia.org\/api\/rest_v1\/media\/math\/render\/svg\/bc43a4191e2c8b8869a084c4b0e18572834a67ec\" class=\"mwe-math-fallback-image-inline\" aria-hidden=\"true\" style=\"vertical-align: -0.671ex; width:2.265ex; height:2.509ex;\" alt=\"{\\displaystyle {k}_{0}}\"\/><\/span>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">[(m<sup>3<\/sup> mol<sup>\u22121<\/sup>)<sup>n\u22121<\/sup> s<sup>\u22121<\/sup>]\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<h3><span class=\"mw-headline\" id=\"Case_study:_Hydrolysis_of_acetic_anhydride\">Case study: Hydrolysis of acetic anhydride<\/span><\/h3>\n<p>The acid-catalyzed hydrolysis of acetic anhydride (Ac<sub>2<\/sub>O) was chosen as a test reaction to establish the interaction between the calorimeter setup and d-scover@. The reaction often serves as a model reaction in calorimetry. In addition, the reaction was also recently studied in flow calorimeters, which allows a comparison.<sup id=\"rdp-ebb-cite_ref-:2_17-0\" class=\"reference\"><a href=\"#cite_note-:2-17\">[17]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-:3_18-0\" class=\"reference\"><a href=\"#cite_note-:3-18\">[18]<\/a><\/sup><sup id=\"rdp-ebb-cite_ref-19\" class=\"reference\"><a href=\"#cite_note-19\">[19]<\/a><\/sup> Ac<sub>2<\/sub>O is split into two molecules of acetic acid (AcOH) under the consumption of water. The reaction scheme is as follows:\n<\/p>\n<dl><dd><span class=\"mwe-math-element\"><span class=\"mwe-math-mathml-inline mwe-math-mathml-a11y\" style=\"display: none;\"><\/span><img src=\"https:\/\/en.wikipedia.org\/api\/rest_v1\/media\/math\/render\/svg\/12e145fe66dbff03f65e9905c635148be9f78386\" class=\"mwe-math-fallback-image-inline\" aria-hidden=\"true\" style=\"vertical-align: -0.671ex; width:23.616ex; height:4.176ex;\" alt=\"{\\displaystyle Ac_{2}O+H_{2}O{\\overset {H^{+}}{\\rightarrow }}2AcOH}\"\/><\/span><\/dd><\/dl>\n<p>Since Ac<sub>2<\/sub>O is partially miscible with water, the reaction can be carried out as single- or two-phase reaction. The reaction follows a pseudo first-order kinetics when a large excess of water is used. Literature values for its thermokinetic data are given in Table 2.\n<\/p>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table class=\"wikitable\" border=\"1\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td colspan=\"3\" style=\"background-color:white; padding-left:10px; padding-right:10px;\"><b>Table 2.<\/b> Thermokinetic parameter of the hydrolysis of acetic anhydride.\n<\/td><\/tr>\n<tr>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Author\n<\/th>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\"><span class=\"mwe-math-element\"><span class=\"mwe-math-mathml-inline mwe-math-mathml-a11y\" style=\"display: none;\"><\/span><img src=\"https:\/\/en.wikipedia.org\/api\/rest_v1\/media\/math\/render\/svg\/1880681383b519e7e220605419e0cb0729d958d0\" class=\"mwe-math-fallback-image-inline\" aria-hidden=\"true\" style=\"vertical-align: -0.671ex; width:4.841ex; height:2.509ex;\" alt=\"{\\displaystyle \\Delta H_{r}}\"\/><\/span> (kJ mol<sup>\u22121<\/sup>)\n<\/th>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\"><span class=\"mwe-math-element\"><span class=\"mwe-math-mathml-inline mwe-math-mathml-a11y\" style=\"display: none;\"><\/span><img src=\"https:\/\/en.wikipedia.org\/api\/rest_v1\/media\/math\/render\/svg\/82ce3b8b3345b674fd7bfae037d37db7afa79ca0\" class=\"mwe-math-fallback-image-inline\" aria-hidden=\"true\" style=\"vertical-align: -0.671ex; width:7.05ex; height:2.509ex;\" alt=\"{\\displaystyle \\Delta H_{mix}}\"\/><\/span> (kJ mol<sup>\u22121<\/sup>)\n<\/th><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Martin<sup id=\"rdp-ebb-cite_ref-20\" class=\"reference\"><a href=\"#cite_note-20\">[20]<\/a><\/sup>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\u221261 to \u221259\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">not stated\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Zogg, Fischer, and Hungerb\u00fchler<sup id=\"rdp-ebb-cite_ref-21\" class=\"reference\"><a href=\"#cite_note-21\">[21]<\/a><\/sup>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\u221262 to \u221257\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\u22123 to +3\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\u0141adosz, Kuhnle, and Jensen<sup id=\"rdp-ebb-cite_ref-:2_17-1\" class=\"reference\"><a href=\"#cite_note-:2-17\">[17]<\/a><\/sup>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\u221263\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">+9\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Steinemann <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-:3_18-1\" class=\"reference\"><a href=\"#cite_note-:3-18\">[18]<\/a><\/sup>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\u221262\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">+7\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<h3><span class=\"mw-headline\" id=\"Experimental_procedure\">Experimental procedure<\/span><\/h3>\n<p>In this study, the reaction enthalpy for the hydrolysis of acetic anhydride is determined. Two solutions are prepared for the experiments: an aqueous solution and a solution containing acetic anhydride. The aqueous solution consists of nitric acid, water, and acetic acid. Acetic acid is added to improve the mixing behavior, since acetic anhydride does not dissolve in water at the concentrations used. The concentrations of the solutions used are listed in Table 3.\n<\/p>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table class=\"wikitable\" border=\"1\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td colspan=\"4\" style=\"background-color:white; padding-left:10px; padding-right:10px;\"><b>Table 3.<\/b> Substances and concentrations used for hydrolysis of acetic anhydride.\n<\/td><\/tr>\n<tr>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Substance\n<\/th>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Supplier\n<\/th>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Specification\n<\/th>\n<th style=\"background-color:#dddddd; padding-left:10px; padding-right:10px;\">Concentration (mol L<sup>\u22121<\/sup>)\n<\/th><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Acetic anhydride\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Merck\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\u226598.0%\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">10.52 (neat)\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Acetic acid\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Merck\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\u226599.0%\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">5.54\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Nitric acid\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Merck\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\u226598.5%\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">5.32\n<\/td><\/tr>\n<tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">Deionized water\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">TU Dortmund University\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">\u03c3 \u22645 \u00d7 10<sup>\u22124<\/sup> S m<sup>\u22121<\/sup>\n<\/td>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\">28.6\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<p>The hydrolysis reaction was investigated at three temperature levels: 30, 40, and 50 \u00b0C. The total volumetric flow rates were set to 58, 147, 325, 504, 682, and 861 \u03bcL min<sup>\u22121<\/sup>. A flow rate ratio of aqueous solution to acetic anhydride of 1:1 was used.\n<\/p><p>For the experiments, all desired temperature and flow rates are automatically set by the PLC, with certain waiting times to allow for heating, cooling, and temperature adaption of the whole system. Steadystate measurements of the respective experimental settings are performed, and every measurement point is recorded in triplets. Prior to the experiments, the SEs have been calibrated and baseline signal of the SEs have been recorded. The data streams from these two steps are currently not yet acquired via d-scover@, however this would be conceivable in the future. Further and more detailed information on the experimental procedure and the calorimetric measurement method itself can be found in 2022 research by Frede, Greive, and Kockmann.<sup id=\"rdp-ebb-cite_ref-:1_16-1\" class=\"reference\"><a href=\"#cite_note-:1-16\">[16]<\/a><\/sup>\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Results\">Results<\/span><\/h2>\n<h3><span id=\"rdp-ebb-Acquisition_and_monitoring_of_the_microscale_calorimeter\u2019s_process_data_using_d-scover@\"><\/span><span class=\"mw-headline\" id=\"Acquisition_and_monitoring_of_the_microscale_calorimeter.E2.80.99s_process_data_using_d-scover.40\">Acquisition and monitoring of the microscale calorimeter\u2019s process data using d-scover@<\/span><\/h3>\n<p>As a first step in the d-scover@ application, we decided to stream only sensor and actuator data as raw data. This decision was triggered among others because the calculation of the heat fluxes measured via the SEs requires further calibration data, which change over time due to recalibration. Accordingly, the measured thermoelectric voltages of the SEs are transferred as raw data to enable a subsequent recalculation of heat fluxes with more up-to-date calibration data. The data flow to the d-scover@ platform is started only as soon as calorimetric measurements on the microscale calorimeter are initiated, whereby a new value is sent every second. The frequency can be adjusted, but is sufficient for our application. Hence, unnecessary streaming and irrelevant data is avoided. In addition to the data listed in Table 1, other data are streamed that are set by the operator. The operator\u2019s acronym, the name of the reaction being investigated, and the concentrations of the reactants used are provided by the operator. The last, but for continuously operated reactors crucial information, whether steady-state has already been reached, is also transmitted. Thus, a variable is set from 0 to 1 by the lab automation system when steady-state is reached.\n<\/p><p>All data to be streamed to the d-scover@ platform are generated as a node on the OPC UA server, which is provided by LabManager. The OPC UA server data are accessed via Apache Nifi, the software integrated in d-scover@ for defining data streams and interfaces. Once this data flow is generated, the data already stream into the <a href=\"https:\/\/www.limswiki.org\/index.php\/PostgreSQL\" title=\"PostgreSQL\" class=\"wiki-link\" data-key=\"a5dd945cdcb63e2d8f7a5edb3a896d82\">PostgreSQL<\/a> database. The database can be accessed via the integrated software pgAdmin. Finally, the data are visualized using Grafana. To prevent data streams from being edited or deleted by another user, different users with different rights were assigned via Keycloak, which is also integrated in d-scover@.\n<\/p><p>Once the data streams were set up in NiFi, a dashboard was generated using Grafana. This shows the essential experimental data that are important for both the operator of the calorimeter and the supervisor, for example. The final dashboard is shown in Figure 4.\n<\/p><p><br \/>\n<a href=\"https:\/\/www.limswiki.org\/index.php\/File:Fig4_Frede_Processes23_11-1.png\" class=\"image wiki-link\" data-key=\"4dfd8fccd9b4d4bcc7845ae96260d313\"><img alt=\"Fig4 Frede Processes23 11-1.png\" src=\"https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/d\/d8\/Fig4_Frede_Processes23_11-1.png\" decoding=\"async\" style=\"width: 100%;max-width: 400px;height: auto;\" \/><\/a>\n<\/p>\n<div style=\"clear:both;\"><\/div>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table border=\"0\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><blockquote><p><b>Figure 4.<\/b> Dashboard for visualization of experimental data during calorimetric measurements such as volumetric flow rates and temperatures.<\/p><\/blockquote>\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<p>The left side of the dashboard displays data from sensors and actuators and whether the system is in steady-state (1) or not (0) as time series, whereas the right side provides details of the reaction currently under investigation in the form of the name and concentration in the respective feeds. A key benefit of d-scover@ for scientist working in labs is that the dashboard and all other tools can be accessed via the web browser on all workstations within our network. This allows the \u201csupervisor in the office\u201d not only to look up which reaction is currently being investigated, but also enables a much better and also more quantitative discussion of the results with the operator during online meeting through screen sharing, for example. In addition, the editable dashboard enables the time series of the data to be arranged as desired and thus to be arranged in relation to each other. It was only through this feature that we realized we needed to adapt the steady-state criterion. Previously, the steady-state criterion referred only to the change in the measured thermoelectric voltage of the SEs and required a change of less than 0.5% in a time span of 10 seconds. Therefore, Figure 5 shows exemplarily an excerpt from the dashboard during the investigation of the oxidation of sodium thiosulfate with hydrogen peroxide. This reaction is described in more detail in a previous work by Frede, Greive, and Kockmann.<sup id=\"rdp-ebb-cite_ref-:1_16-2\" class=\"reference\"><a href=\"#cite_note-:1-16\">[16]<\/a><\/sup>\n<\/p><p><br \/>\n<a href=\"https:\/\/www.limswiki.org\/index.php\/File:Fig5_Frede_Processes23_11-1.png\" class=\"image wiki-link\" data-key=\"b9bed3bf69bdce4a8ee5f73eb345977a\"><img alt=\"Fig5 Frede Processes23 11-1.png\" src=\"https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/a\/af\/Fig5_Frede_Processes23_11-1.png\" decoding=\"async\" style=\"width: 100%;max-width: 400px;height: auto;\" \/><\/a>\n<\/p>\n<div style=\"clear:both;\"><\/div>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table border=\"0\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><blockquote><p><b>Figure 5.<\/b> Excerpt from the dashboard during the investigation of the oxidation of thiosulfate with hydrogen peroxide.<\/p><\/blockquote>\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<p>On one hand, it was observed that the measured thermoelectric voltages of the SEs fluctuate more at higher temperature levels. This behavior was particularly evident for the oxidation of sodium thiosulfate, which was presented in a previous work by Frede, Greive, and Kockmann.<sup id=\"rdp-ebb-cite_ref-:1_16-3\" class=\"reference\"><a href=\"#cite_note-:1-16\">[16]<\/a><\/sup> On the other hand, it was observed that in some experiments the temperature at the reactor outlet was not yet completely in steady-state. Even though the temperature change was already minimal, some fluctuations could still be seen by comparing thermoelectric voltages and temperatures over time. The parametric sensitivity of this reaction and the influence of pH fluctuation on the reaction explain the dynamic reaction behavior even in steady-state. This was already observed by Gelhausen <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-22\" class=\"reference\"><a href=\"#cite_note-22\">[22]<\/a><\/sup> and is here well shown in the measured signals of the SEs. Hence, the steady-state criterion was adapted for the study of the hydrolysis of acetic anhydride. \n<\/p><p>The following two conditions must be met for a measurement to be considered in steady-state:\n<\/p>\n<ol><li>The voltage of the SEs must not fluctuate more than 0.25 mV for <span class=\"mwe-math-element\"><span class=\"mwe-math-mathml-inline mwe-math-mathml-a11y\" style=\"display: none;\"><\/span><img src=\"https:\/\/en.wikipedia.org\/api\/rest_v1\/media\/math\/render\/svg\/2b9226d1b3ee9833a4194188005820d0a1d05370\" class=\"mwe-math-fallback-image-inline\" aria-hidden=\"true\" style=\"vertical-align: -0.671ex; width:2.331ex; height:2.509ex;\" alt=\"{\\displaystyle {T}_{r}}\"\/><\/span> = 30, 40 \u00b0C; 0.50 mV for <span class=\"mwe-math-element\"><span class=\"mwe-math-mathml-inline mwe-math-mathml-a11y\" style=\"display: none;\"><\/span><img src=\"https:\/\/en.wikipedia.org\/api\/rest_v1\/media\/math\/render\/svg\/124538ff5ef7da1c856bb16636440a3e1fcb8273\" class=\"mwe-math-fallback-image-inline\" aria-hidden=\"true\" style=\"vertical-align: -0.671ex; width:3.18ex; height:2.509ex;\" alt=\"{\\displaystyle {E}_{A}}\"\/><\/span> = 50 \u00b0C; and 0.75 mV for <span class=\"mwe-math-element\"><span class=\"mwe-math-mathml-inline mwe-math-mathml-a11y\" style=\"display: none;\"><\/span><img src=\"https:\/\/en.wikipedia.org\/api\/rest_v1\/media\/math\/render\/svg\/124538ff5ef7da1c856bb16636440a3e1fcb8273\" class=\"mwe-math-fallback-image-inline\" aria-hidden=\"true\" style=\"vertical-align: -0.671ex; width:3.18ex; height:2.509ex;\" alt=\"{\\displaystyle {E}_{A}}\"\/><\/span> = 60 \u00b0C, in the last 30 seconds.<\/li>\n<li>The temperature at the reactor outlet <span class=\"mwe-math-element\"><span class=\"mwe-math-mathml-inline mwe-math-mathml-a11y\" style=\"display: none;\"><\/span><img src=\"https:\/\/en.wikipedia.org\/api\/rest_v1\/media\/math\/render\/svg\/ab2a324bd27ba6c99beb649e82a1f4f08ccf646b\" class=\"mwe-math-fallback-image-inline\" aria-hidden=\"true\" style=\"vertical-align: -1.005ex; width:5.12ex; height:2.843ex;\" alt=\"{\\displaystyle {T}_{r,out}}\"\/><\/span> must not fluctuate more than 0.5 \u00b0C in the last 180 seconds due to the delayed behavior.<\/li><\/ol>\n<p>Here, fluctuation refers to the difference of maximum and minimum value in the respective time span.\n<\/p>\n<h3><span id=\"rdp-ebb-Calorimetric_data_management_using_d-scover@\"><\/span><span class=\"mw-headline\" id=\"Calorimetric_data_management_using_d-scover.40\">Calorimetric data management using d-scover@<\/span><\/h3>\n<p>The application of d-scover@ to the microscale calorimeter for data analysis was tested for the hydrolysis of acetic anhydride. The entire evaluation was performed using JupyterHub, which runs directly on the server where the data are also located. At first, we wrote a script that outputs which reactions were studied, and at what temperatures, concentrations, and volumetric flow rates each reaction was performed. There, the user gets to know which data can be selected in the next step for the evaluation of the reaction. As mentioned in the previous section, not all data needed for the determination of thermokinetics are streamed to the platform by measurements. For the evaluation of calorimetric measurements, the calibration factors of the SEs and the base line signals are loaded and stored via JupyterHub in the database. With this completed, the script for the evaluation can be executed with the respective input data from the user.\n<\/p><p>The determined heat of reaction is shown in Figure 6 for the different temperature level of the hydrolysis of acetic anhydride.\n<\/p><p><br \/>\n<a href=\"https:\/\/www.limswiki.org\/index.php\/File:Fig6_Frede_Processes23_11-1.png\" class=\"image wiki-link\" data-key=\"81d1a390960483bea78167239c8700ab\"><img alt=\"Fig6 Frede Processes23 11-1.png\" src=\"https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/0\/0f\/Fig6_Frede_Processes23_11-1.png\" decoding=\"async\" style=\"width: 100%;max-width: 400px;height: auto;\" \/><\/a>\n<\/p>\n<div style=\"clear:both;\"><\/div>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table border=\"0\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><blockquote><p><b>Figure 6.<\/b> Heat of reaction of hydrolysis of acetic anhydride at different temperature and volumetric flow rate. Literature value by \u0141adosz <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-:2_17-2\" class=\"reference\"><a href=\"#cite_note-:2-17\">[17]<\/a><\/sup> is indicated by dashed black line.<\/p><\/blockquote>\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<p>For <span class=\"mwe-math-element\"><span class=\"mwe-math-mathml-inline mwe-math-mathml-a11y\" style=\"display: none;\"><\/span><img src=\"https:\/\/en.wikipedia.org\/api\/rest_v1\/media\/math\/render\/svg\/c9ffc98a039ed280ea6420a0f53758bddef8d9a0\" class=\"mwe-math-fallback-image-inline\" aria-hidden=\"true\" style=\"vertical-align: -0.338ex; width:1.636ex; height:2.176ex;\" alt=\"{\\displaystyle {T}}\"\/><\/span> = 30 \u00b0C, an increase is observed in the heat of reaction up to <span class=\"mwe-math-element\"><span class=\"mwe-math-mathml-inline mwe-math-mathml-a11y\" style=\"display: none;\"><\/span><img src=\"https:\/\/en.wikipedia.org\/api\/rest_v1\/media\/math\/render\/svg\/49ef9fa9f410331b94e4578bab90e9edda5c919b\" class=\"mwe-math-fallback-image-inline\" aria-hidden=\"true\" style=\"vertical-align: -0.338ex; width:1.787ex; height:2.676ex;\" alt=\"{\\displaystyle {\\dot {V}}}\"\/><\/span> = 325 \u00b5L min<sup>\u22121<\/sup>. After that, the determined heat of reaction decreases. For the two lowest volumetric flow rates, the heat of reaction is in very good agreement with the literature value, from which the relative deviation is 0.47%. The decrease in heat of reaction for higher volumetric flow rates is probably due to incomplete conversion within the microreactor as the residence time decreases. According to the Van\u2019t Hoff rule<sup id=\"rdp-ebb-cite_ref-23\" class=\"reference\"><a href=\"#cite_note-23\">[23]<\/a><\/sup>, an increasing heat of reaction profile and better agreement with literature data are expected for higher temperatures.\n<\/p><p>For both <span class=\"mwe-math-element\"><span class=\"mwe-math-mathml-inline mwe-math-mathml-a11y\" style=\"display: none;\"><\/span><img src=\"https:\/\/en.wikipedia.org\/api\/rest_v1\/media\/math\/render\/svg\/c9ffc98a039ed280ea6420a0f53758bddef8d9a0\" class=\"mwe-math-fallback-image-inline\" aria-hidden=\"true\" style=\"vertical-align: -0.338ex; width:1.636ex; height:2.176ex;\" alt=\"{\\displaystyle {T}}\"\/><\/span> = 40 and 50 \u00b0C, the determined heat of reaction increases with increasing flow rate matching the previously mentioned expectation. For further confirmation of incomplete conversion, the heat flux profiles are investigated. Therefore, the specific heat flux profile at a temperature level of 30 \u00b0C is shown in Figure 7.\n<\/p><p><br \/>\n<a href=\"https:\/\/www.limswiki.org\/index.php\/File:Fig7_Frede_Processes23_11-1.png\" class=\"image wiki-link\" data-key=\"f41f71f7ff3e0137f58860f6eff71c4d\"><img alt=\"Fig7 Frede Processes23 11-1.png\" src=\"https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/9\/90\/Fig7_Frede_Processes23_11-1.png\" decoding=\"async\" style=\"width: 100%;max-width: 400px;height: auto;\" \/><\/a>\n<\/p>\n<div style=\"clear:both;\"><\/div>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table border=\"0\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><blockquote><p><b>Figure 7.<\/b> Specific heat flux profile of the SEs for the hydrolysis of acetic anhydride for varying volumetric flow rate and <span class=\"mwe-math-element\"><span class=\"mwe-math-mathml-inline mwe-math-mathml-a11y\" style=\"display: none;\"><\/span><img src=\"https:\/\/en.wikipedia.org\/api\/rest_v1\/media\/math\/render\/svg\/dcc66a87c7b319250d9b2bd632dfb8102fe6dc26\" class=\"mwe-math-fallback-image-inline\" aria-hidden=\"true\" style=\"vertical-align: -0.671ex; width:3.143ex; height:2.509ex;\" alt=\"{\\displaystyle {T}_{in}}\"\/><\/span> = <span class=\"mwe-math-element\"><span class=\"mwe-math-mathml-inline mwe-math-mathml-a11y\" style=\"display: none;\"><\/span><img src=\"https:\/\/en.wikipedia.org\/api\/rest_v1\/media\/math\/render\/svg\/32fa82563efe92fdb562daef206a9368c11384ad\" class=\"mwe-math-fallback-image-inline\" aria-hidden=\"true\" style=\"vertical-align: -0.671ex; width:7.521ex; height:2.509ex;\" alt=\"{\\displaystyle {T}_{ambient}}\"\/><\/span> = 30 \u00b0C.<\/p><\/blockquote>\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<p>For the lowest flow rate, the highest specific heat flux is present at SE 2. For the second-lowest flow rate, the highest specific heat flux is present at SE 4. This shift of the maximal specific heat flux to later reactor segments with increasing flow rates is consistent as residence time decreases and the reaction is kinetically, and not mixing-, controlled. For the two lowest volumetric flow rates, a peak of the heat flux profile is observed within the first four SEs. Additionally, comparatively low heat fluxes are detected close to the reactor outlet. Hence, complete conversion is assumed for these flow rates, supporting the agreement of the heat of reaction with the literature value, too. An analysis of the heat flux profiles at higher temperatures with these requirements for complete conversion shows that complete conversion can be assumed at the three lowest flow rates for <span class=\"mwe-math-element\"><span class=\"mwe-math-mathml-inline mwe-math-mathml-a11y\" style=\"display: none;\"><\/span><img src=\"https:\/\/en.wikipedia.org\/api\/rest_v1\/media\/math\/render\/svg\/c9ffc98a039ed280ea6420a0f53758bddef8d9a0\" class=\"mwe-math-fallback-image-inline\" aria-hidden=\"true\" style=\"vertical-align: -0.338ex; width:1.636ex; height:2.176ex;\" alt=\"{\\displaystyle {T}}\"\/><\/span> = 40 and at all flow rates, except the highest one for <span class=\"mwe-math-element\"><span class=\"mwe-math-mathml-inline mwe-math-mathml-a11y\" style=\"display: none;\"><\/span><img src=\"https:\/\/en.wikipedia.org\/api\/rest_v1\/media\/math\/render\/svg\/c9ffc98a039ed280ea6420a0f53758bddef8d9a0\" class=\"mwe-math-fallback-image-inline\" aria-hidden=\"true\" style=\"vertical-align: -0.338ex; width:1.636ex; height:2.176ex;\" alt=\"{\\displaystyle {T}}\"\/><\/span> = 50 \u00b0C.\n<\/p><p>The reaction enthalpy is calculated based on the respective calorimetric measurement and calculated heat fluxes, shown in Figure 8.\n<\/p><p><br \/>\n<a href=\"https:\/\/www.limswiki.org\/index.php\/File:Fig8_Frede_Processes23_11-1.png\" class=\"image wiki-link\" data-key=\"a2596e13d809d71d7124d7f287db11fc\"><img alt=\"Fig8 Frede Processes23 11-1.png\" src=\"https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/1\/18\/Fig8_Frede_Processes23_11-1.png\" decoding=\"async\" style=\"width: 100%;max-width: 400px;height: auto;\" \/><\/a>\n<\/p>\n<div style=\"clear:both;\"><\/div>\n<table style=\"\">\n<tbody><tr>\n<td style=\"vertical-align:top;\">\n<table border=\"0\" cellpadding=\"5\" cellspacing=\"0\" style=\"\">\n\n<tbody><tr>\n<td style=\"background-color:white; padding-left:10px; padding-right:10px;\"><blockquote><p><b>Figure 8.<\/b> Determined reaction enthalpy for hydrolysis of acetic anhydride from the experiments for the respective volumetric flow rates and temperatures in comparison with literature value by \u0141adosz <i>et al.<\/i><sup id=\"rdp-ebb-cite_ref-:2_17-3\" class=\"reference\"><a href=\"#cite_note-:2-17\">[17]<\/a><\/sup>, which is indicated by a dashed black line.<\/p><\/blockquote>\n<\/td><\/tr>\n<\/tbody><\/table>\n<\/td><\/tr><\/tbody><\/table>\n<p>Since the calculation of the reaction enthalpy is based on the determined heat of reaction, the same behavior is observed for the respective temperatures and volumetric flow rates in Figure 6. In addition, it can be seen there that the heat of reaction, and thus also the reaction enthalpy, are overestimated in some cases. This is due to the determination of the heat loss, as this is the only term in the energy balance that is not directly measured but determined numerically. Combining the determined reaction enthalpy of the flow rates, with complete conversion at the respective temperature level, yields a reaction enthalpy of \u221265.9 \u00b1 3.1 kJ mol<sup>\u22121<\/sup>. This is a relative deviation to the literature value of 4.6%.<sup id=\"rdp-ebb-cite_ref-:2_17-4\" class=\"reference\"><a href=\"#cite_note-:2-17\">[17]<\/a><\/sup> Hence, good agreement with literature is obtained.\n<\/p>\n<h2><span class=\"mw-headline\" id=\"Conclusions_and_outlook\">Conclusions and outlook<\/span><\/h2>\n<p>In this study, a microscale flow calorimeter was connected to the modular open-source IoT-platform d-scover@ from d-fine. The existing OPC UA server was used to stream data into the platform allowing for data visualization, storage, and analysis. The platform was established successfully in a few days with the support of d-fine and a dedicated student assistant. By displaying the data in a dashboard, the need for an additional steady-state criterion became apparent, which was implemented directly. Additionally, the application and the benefit of the IoT-platform were evaluated with the hydrolysis of acetic anhydride and thiosulfate oxidation as test reactions, which allow for using standardized evaluation of the calorimetric measurements on different working stations within the local computer network. The facilitated data analysis led to a new consideration of steady-state status, enabling fast and semi-automated experimentation. The reaction enthalpy of the test reaction obtained was in good agreement with literature data.\n<\/p><p>However, the low entry hurdle for operators with little to no programming experience should be emphasized as a key point here. All the essential tools a researcher needs in the laboratory to store, visualize, and evaluate his measured values are provided without the researcher having to install them. In addition, the use of an open-source solution allows a quick exchange of programs between researchers and the community or forums for help with issues.\n<\/p><p>As a current limitation, it should be mentioned here that only monitoring and no equipment control is possible with the current version of d-scover@. Remote control of equipment can be quite useful for some applications, such as analytical equipment, but such remote control should be implemented sensibly with the appropriate security precautions, as it is associated with security risks such as intentional or accidental sabotage of experiments or equipment. In addition, we used a separate workstation for the IoT-platform, since Docker requires at least 8GB of RAM and we wanted to exclude a shutdown due to automated updates by our IT infrastructure.\n<\/p><p>The modular data platform complements the reaction calorimeter very well with additional functionalities. In future work, we want to connect further smart equipment in our laboratory such as a small-scale extraction column and a setup for optical detection of emulsions with the data platform. This approach will further harmonize data management within our laboratory while better applying FAIR Guiding Principles.\n<\/p>\n<h2><span id=\"rdp-ebb-Abbreviations,_acronyms,_and_initialisms\"><\/span><span class=\"mw-headline\" id=\"Abbreviations.2C_acronyms.2C_and_initialisms\">Abbreviations, acronyms, and initialisms<\/span><\/h2>\n<ul><li><b>AcOH<\/b>: acetic acid<\/li>\n<li><b>Ac<sub>2<\/sub>O<\/b>: acetic anhydride<\/li>\n<li><b>BCI<\/b>: Department of Biochemical and Chemical Engineering, TU Dortmund University<\/li>\n<li><b>ETL<\/b>: extract, transform, load<\/li>\n<li><b>FAIR<\/b>: findable, accessible, interoperable, and re-usable<\/li>\n<li><b>GUI<\/b>: graphical user interface<\/li>\n<li><b>IoT<\/b>: internet of things<\/li>\n<li><b>IIoT<\/b>: industrial internet of things<\/li>\n<li><b>OPC UA<\/b>: Open Platform Communications Unified Architecture<\/li>\n<li><b>PLC<\/b>: programmable logic controller<\/li>\n<li><b>SE<\/b>: Seebeck element<\/li><\/ul>\n<h2><span class=\"mw-headline\" id=\"Acknowledgments\">Acknowledgments<\/span><\/h2>\n<p>The laboratory of Equipment Design thanks d-fine GmbH for providing the IoT-platform dscover@ and especially Alexey Fofonov, Christoph Charlet, and Tassilo Christ for their support in establishing it. T.A.F. thanks the networking program \u2018Sustainable Chemical Synthesis 2.0\u2032 (SusChemSys 2.0) for the support and fruitful discussions across disciplines.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Author_contributions\">Author contributions<\/span><\/h3>\n<p>Conceptualization, T.C., D.L. and T.A.F.; methodology, T.A.F., C.W. and N.K.; software, T.C., C.W. and T.B.; validation, C.W. and T.B.; formal analysis, T.A.F. and T.B.; investigation, T.B.; resources, T.C. and D.L.; data curation, C.W., T.B. and T.A.F.; writing\u2014original draft preparation, T.A.F. and T.C.; writing\u2014review and editing, N.K. and T.C.; visualization, T.B. and T.A.F.; supervision, T.A.F. and N.K.; project administration, N.K.; funding acquisition, N.K. All authors have read and agreed to the published version of the manuscript.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Funding\">Funding<\/span><\/h3>\n<p>This research of the Forschungsvereinigung Forschungs-Gesellschaft Verfahrens-Technik e.V. (GVT) was funded by the German Federal Ministry of Economic Affairs and Climate Action via the Arbeitsgemeinschaft Industrieller Forschungsvereinigungen (AiF) within the framework of the program for the promotion of the Industrielle Gemeinschaftsforschung (IGF), grant number IGF no. 20819 N.\n<\/p>\n<h3><span class=\"mw-headline\" id=\"Conflicts_of_interest\">Conflicts of interest<\/span><\/h3>\n<p>The authors declare no conflict of interest.\n<\/p><p><br \/>\n<\/p>\n<h2><span class=\"mw-headline\" id=\"References\">References<\/span><\/h2>\n<div class=\"reflist references-column-width\" style=\"-moz-column-width: 30em; -webkit-column-width: 30em; column-width: 30em; list-style-type: decimal;\">\n<div class=\"mw-references-wrap mw-references-columns\"><ol class=\"references\">\n<li id=\"cite_note-1\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-1\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation book\">R\u00fcckert, T. (2018). \"The IoT Paves the Way for a Networked Economy\". In Sendler, Ulrich. <i>The Internet of Things: Industrie 4.0 Unleashed<\/i> (1st ed. 2018 ed.). Berlin, Heidelberg: Springer Berlin Heidelberg : Imprint: Springer Vieweg. pp. 221\u201332. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-3-662-54904-9.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=The+IoT+Paves+the+Way+for+a+Networked+Economy&rft.atitle=The+Internet+of+Things%3A+Industrie+4.0+Unleashed&rft.aulast=R%C3%BCckert%2C+T.&rft.au=R%C3%BCckert%2C+T.&rft.date=2018&rft.pages=pp.%26nbsp%3B221%E2%80%9332&rft.edition=1st+ed.+2018&rft.place=Berlin%2C+Heidelberg&rft.pub=Springer+Berlin+Heidelberg+%3A+Imprint%3A+Springer+Vieweg&rft.isbn=978-3-662-54904-9&rfr_id=info:sid\/en.wikipedia.org:Journal:Data_management_of_microscale_reaction_calorimeter_using_a_modular_open-source_IoT_platform\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-2\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-2\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Knoll, Sebastian; Jusner, Clemens E.; Sagmeister, Peter; Williams, Jason D.; Hone, Christopher A.; Horn, Martin; Kappe, C. Oliver (2022). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/xlink.rsc.org\/?DOI=D2RE00208F\" target=\"_blank\">\"Autonomous model-based experimental design for rapid reaction development\"<\/a> (in en). <i>Reaction Chemistry & Engineering<\/i> <b>7<\/b> (11): 2375\u20132384. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1039%2FD2RE00208F\" target=\"_blank\">10.1039\/D2RE00208F<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2058-9883\" target=\"_blank\">2058-9883<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/xlink.rsc.org\/?DOI=D2RE00208F\" target=\"_blank\">http:\/\/xlink.rsc.org\/?DOI=D2RE00208F<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Autonomous+model-based+experimental+design+for+rapid+reaction+development&rft.jtitle=Reaction+Chemistry+%26+Engineering&rft.aulast=Knoll&rft.aufirst=Sebastian&rft.au=Knoll%2C%26%2332%3BSebastian&rft.au=Jusner%2C%26%2332%3BClemens+E.&rft.au=Sagmeister%2C%26%2332%3BPeter&rft.au=Williams%2C%26%2332%3BJason+D.&rft.au=Hone%2C%26%2332%3BChristopher+A.&rft.au=Horn%2C%26%2332%3BMartin&rft.au=Kappe%2C%26%2332%3BC.+Oliver&rft.date=2022&rft.volume=7&rft.issue=11&rft.pages=2375%E2%80%932384&rft_id=info:doi\/10.1039%2FD2RE00208F&rft.issn=2058-9883&rft_id=http%3A%2F%2Fxlink.rsc.org%2F%3FDOI%3DD2RE00208F&rfr_id=info:sid\/en.wikipedia.org:Journal:Data_management_of_microscale_reaction_calorimeter_using_a_modular_open-source_IoT_platform\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:0-3\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:0_3-0\">3.0<\/a><\/sup> <sup><a href=\"#cite_ref-:0_3-1\">3.1<\/a><\/sup> <sup><a href=\"#cite_ref-:0_3-2\">3.2<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Wilkinson, Mark D.; Dumontier, Michel; Aalbersberg, IJsbrand Jan; Appleton, Gabrielle; Axton, Myles; Baak, Arie; Blomberg, Niklas; Boiten, Jan-Willem <i>et al.<\/i> (15 March 2016). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.nature.com\/articles\/sdata201618\" target=\"_blank\">\"The FAIR Guiding Principles for scientific data management and stewardship\"<\/a> (in en). <i>Scientific Data<\/i> <b>3<\/b> (1): 160018. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1038%2Fsdata.2016.18\" target=\"_blank\">10.1038\/sdata.2016.18<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2052-4463\" target=\"_blank\">2052-4463<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC4792175\/\" target=\"_blank\">PMC4792175<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/26978244\" target=\"_blank\">26978244<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.nature.com\/articles\/sdata201618\" target=\"_blank\">https:\/\/www.nature.com\/articles\/sdata201618<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=The+FAIR+Guiding+Principles+for+scientific+data+management+and+stewardship&rft.jtitle=Scientific+Data&rft.aulast=Wilkinson&rft.aufirst=Mark+D.&rft.au=Wilkinson%2C%26%2332%3BMark+D.&rft.au=Dumontier%2C%26%2332%3BMichel&rft.au=Aalbersberg%2C%26%2332%3BIJsbrand+Jan&rft.au=Appleton%2C%26%2332%3BGabrielle&rft.au=Axton%2C%26%2332%3BMyles&rft.au=Baak%2C%26%2332%3BArie&rft.au=Blomberg%2C%26%2332%3BNiklas&rft.au=Boiten%2C%26%2332%3BJan-Willem&rft.au=da+Silva+Santos%2C%26%2332%3BLuiz+Bonino&rft.date=15+March+2016&rft.volume=3&rft.issue=1&rft.pages=160018&rft_id=info:doi\/10.1038%2Fsdata.2016.18&rft.issn=2052-4463&rft_id=info:pmc\/PMC4792175&rft_id=info:pmid\/26978244&rft_id=https%3A%2F%2Fwww.nature.com%2Farticles%2Fsdata201618&rfr_id=info:sid\/en.wikipedia.org:Journal:Data_management_of_microscale_reaction_calorimeter_using_a_modular_open-source_IoT_platform\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-4\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-4\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Elliott, Chance; Vijayakumar, Vipin; Zink, Wesley; Hansen, Richard (1 February 2007). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/journals.sagepub.com\/doi\/10.1016\/j.jala.2006.07.012\" target=\"_blank\">\"National Instruments LabVIEW: A Programming Environment for Laboratory Automation and Measurement\"<\/a> (in en). <i>JALA: Journal of the Association for Laboratory Automation<\/i> <b>12<\/b> (1): 17\u201324. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.jala.2006.07.012\" target=\"_blank\">10.1016\/j.jala.2006.07.012<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1535-5535\" target=\"_blank\">1535-5535<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/journals.sagepub.com\/doi\/10.1016\/j.jala.2006.07.012\" target=\"_blank\">http:\/\/journals.sagepub.com\/doi\/10.1016\/j.jala.2006.07.012<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=National+Instruments+LabVIEW%3A+A+Programming+Environment+for+Laboratory+Automation+and+Measurement&rft.jtitle=JALA%3A+Journal+of+the+Association+for+Laboratory+Automation&rft.aulast=Elliott&rft.aufirst=Chance&rft.au=Elliott%2C%26%2332%3BChance&rft.au=Vijayakumar%2C%26%2332%3BVipin&rft.au=Zink%2C%26%2332%3BWesley&rft.au=Hansen%2C%26%2332%3BRichard&rft.date=1+February+2007&rft.volume=12&rft.issue=1&rft.pages=17%E2%80%9324&rft_id=info:doi\/10.1016%2Fj.jala.2006.07.012&rft.issn=1535-5535&rft_id=http%3A%2F%2Fjournals.sagepub.com%2Fdoi%2F10.1016%2Fj.jala.2006.07.012&rfr_id=info:sid\/en.wikipedia.org:Journal:Data_management_of_microscale_reaction_calorimeter_using_a_modular_open-source_IoT_platform\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-5\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-5\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.mathworks.com\/products\/matlab.html\" target=\"_blank\">\"MATLAB\"<\/a>. The MathWorks, Inc.<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.mathworks.com\/products\/matlab.html\" target=\"_blank\">https:\/\/www.mathworks.com\/products\/matlab.html<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 01 December 2022<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=MATLAB&rft.atitle=&rft.pub=The+MathWorks%2C+Inc.&rft_id=https%3A%2F%2Fwww.mathworks.com%2Fproducts%2Fmatlab.html&rfr_id=info:sid\/en.wikipedia.org:Journal:Data_management_of_microscale_reaction_calorimeter_using_a_modular_open-source_IoT_platform\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-6\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-6\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Mateos, Carlos; Nieves-Remacha, Mar\u00eda Jos\u00e9; Rinc\u00f3n, Juan A. (2019). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/xlink.rsc.org\/?DOI=C9RE00116F\" target=\"_blank\">\"Automated platforms for reaction self-optimization in flow\"<\/a> (in en). <i>Reaction Chemistry & Engineering<\/i> <b>4<\/b> (9): 1536\u20131544. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1039%2FC9RE00116F\" target=\"_blank\">10.1039\/C9RE00116F<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2058-9883\" target=\"_blank\">2058-9883<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/xlink.rsc.org\/?DOI=C9RE00116F\" target=\"_blank\">http:\/\/xlink.rsc.org\/?DOI=C9RE00116F<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Automated+platforms+for+reaction+self-optimization+in+flow&rft.jtitle=Reaction+Chemistry+%26+Engineering&rft.aulast=Mateos&rft.aufirst=Carlos&rft.au=Mateos%2C%26%2332%3BCarlos&rft.au=Nieves-Remacha%2C%26%2332%3BMar%C3%ADa+Jos%C3%A9&rft.au=Rinc%C3%B3n%2C%26%2332%3BJuan+A.&rft.date=2019&rft.volume=4&rft.issue=9&rft.pages=1536%E2%80%931544&rft_id=info:doi\/10.1039%2FC9RE00116F&rft.issn=2058-9883&rft_id=http%3A%2F%2Fxlink.rsc.org%2F%3FDOI%3DC9RE00116F&rfr_id=info:sid\/en.wikipedia.org:Journal:Data_management_of_microscale_reaction_calorimeter_using_a_modular_open-source_IoT_platform\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-7\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-7\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Mateos, Carlos; Nieves-Remacha, Mar\u00eda Jos\u00e9; Rinc\u00f3n, Juan A. (2019). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/xlink.rsc.org\/?DOI=C9RE00116F\" target=\"_blank\">\"Automated platforms for reaction self-optimization in flow\"<\/a> (in en). <i>Reaction Chemistry & Engineering<\/i> <b>4<\/b> (9): 1536\u20131544. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1039%2FC9RE00116F\" target=\"_blank\">10.1039\/C9RE00116F<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2058-9883\" target=\"_blank\">2058-9883<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/xlink.rsc.org\/?DOI=C9RE00116F\" target=\"_blank\">http:\/\/xlink.rsc.org\/?DOI=C9RE00116F<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Automated+platforms+for+reaction+self-optimization+in+flow&rft.jtitle=Reaction+Chemistry+%26+Engineering&rft.aulast=Mateos&rft.aufirst=Carlos&rft.au=Mateos%2C%26%2332%3BCarlos&rft.au=Nieves-Remacha%2C%26%2332%3BMar%C3%ADa+Jos%C3%A9&rft.au=Rinc%C3%B3n%2C%26%2332%3BJuan+A.&rft.date=2019&rft.volume=4&rft.issue=9&rft.pages=1536%E2%80%931544&rft_id=info:doi\/10.1039%2FC9RE00116F&rft.issn=2058-9883&rft_id=http%3A%2F%2Fxlink.rsc.org%2F%3FDOI%3DC9RE00116F&rfr_id=info:sid\/en.wikipedia.org:Journal:Data_management_of_microscale_reaction_calorimeter_using_a_modular_open-source_IoT_platform\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-8\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-8\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Cherkasov, Nikolay; Bai, Yang; Exp\u00f3sito, Antonio Jos\u00e9; Rebrov, Evgeny V. (2018). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/xlink.rsc.org\/?DOI=C8RE00046H\" target=\"_blank\">\"OpenFlowChem \u2013 a platform for quick, robust and flexible automation and self-optimisation of flow chemistry\"<\/a> (in en). <i>Reaction Chemistry & Engineering<\/i> <b>3<\/b> (5): 769\u2013780. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1039%2FC8RE00046H\" target=\"_blank\">10.1039\/C8RE00046H<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2058-9883\" target=\"_blank\">2058-9883<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/xlink.rsc.org\/?DOI=C8RE00046H\" target=\"_blank\">http:\/\/xlink.rsc.org\/?DOI=C8RE00046H<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=OpenFlowChem+%E2%80%93+a+platform+for+quick%2C+robust+and+flexible+automation+and+self-optimisation+of+flow+chemistry&rft.jtitle=Reaction+Chemistry+%26+Engineering&rft.aulast=Cherkasov&rft.aufirst=Nikolay&rft.au=Cherkasov%2C%26%2332%3BNikolay&rft.au=Bai%2C%26%2332%3BYang&rft.au=Exp%C3%B3sito%2C%26%2332%3BAntonio+Jos%C3%A9&rft.au=Rebrov%2C%26%2332%3BEvgeny+V.&rft.date=2018&rft.volume=3&rft.issue=5&rft.pages=769%E2%80%93780&rft_id=info:doi\/10.1039%2FC8RE00046H&rft.issn=2058-9883&rft_id=http%3A%2F%2Fxlink.rsc.org%2F%3FDOI%3DC8RE00046H&rfr_id=info:sid\/en.wikipedia.org:Journal:Data_management_of_microscale_reaction_calorimeter_using_a_modular_open-source_IoT_platform\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-9\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-9\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">O'Brien, Matthew; Hall, April; Schrauwen, John; van der Made, Joyce (1 June 2018). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0040402018301881\" target=\"_blank\">\"An open-source approach to automation in organic synthesis: The flow chemical formation of benzamides using an inline liquid-liquid extraction system and a homemade 3-axis autosampling\/product-collection device\"<\/a> (in en). <i>Tetrahedron<\/i> <b>74<\/b> (25): 3152\u20133157. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1016%2Fj.tet.2018.02.043\" target=\"_blank\">10.1016\/j.tet.2018.02.043<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0040402018301881\" target=\"_blank\">https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0040402018301881<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=An+open-source+approach+to+automation+in+organic+synthesis%3A+The+flow+chemical+formation+of+benzamides+using+an+inline+liquid-liquid+extraction+system+and+a+homemade+3-axis+autosampling%2Fproduct-collection+device&rft.jtitle=Tetrahedron&rft.aulast=O%27Brien&rft.aufirst=Matthew&rft.au=O%27Brien%2C%26%2332%3BMatthew&rft.au=Hall%2C%26%2332%3BApril&rft.au=Schrauwen%2C%26%2332%3BJohn&rft.au=van+der+Made%2C%26%2332%3BJoyce&rft.date=1+June+2018&rft.volume=74&rft.issue=25&rft.pages=3152%E2%80%933157&rft_id=info:doi\/10.1016%2Fj.tet.2018.02.043&rft_id=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS0040402018301881&rfr_id=info:sid\/en.wikipedia.org:Journal:Data_management_of_microscale_reaction_calorimeter_using_a_modular_open-source_IoT_platform\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-10\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-10\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Ingham, Richard J.; Battilocchio, Claudio; Hawkins, Joel M.; Ley, Steven V. (2014). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/pubmed.ncbi.nlm.nih.gov\/24778715\" target=\"_blank\">\"Integration of enabling methods for the automated flow preparation of piperazine-2-carboxamide\"<\/a>. <i>Beilstein Journal of Organic Chemistry<\/i> <b>10<\/b>: 641\u2013652. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.3762%2Fbjoc.10.56\" target=\"_blank\">10.3762\/bjoc.10.56<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1860-5397\" target=\"_blank\">1860-5397<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Central\" data-key=\"c85bdffd69dd30e02024b9cc3d7679e2\">PMC<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/3999859\/\" target=\"_blank\">3999859<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/PubMed_Identifier\" data-key=\"1d34e999f13d8801964a6b3e9d7b4e30\">PMID<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/24778715\" target=\"_blank\">24778715<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/pubmed.ncbi.nlm.nih.gov\/24778715\" target=\"_blank\">https:\/\/pubmed.ncbi.nlm.nih.gov\/24778715<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Integration+of+enabling+methods+for+the+automated+flow+preparation+of+piperazine-2-carboxamide&rft.jtitle=Beilstein+Journal+of+Organic+Chemistry&rft.aulast=Ingham&rft.aufirst=Richard+J.&rft.au=Ingham%2C%26%2332%3BRichard+J.&rft.au=Battilocchio%2C%26%2332%3BClaudio&rft.au=Hawkins%2C%26%2332%3BJoel+M.&rft.au=Ley%2C%26%2332%3BSteven+V.&rft.date=2014&rft.volume=10&rft.pages=641%E2%80%93652&rft_id=info:doi\/10.3762%2Fbjoc.10.56&rft.issn=1860-5397&rft_id=info:pmc\/3999859&rft_id=info:pmid\/24778715&rft_id=https%3A%2F%2Fpubmed.ncbi.nlm.nih.gov%2F24778715&rfr_id=info:sid\/en.wikipedia.org:Journal:Data_management_of_microscale_reaction_calorimeter_using_a_modular_open-source_IoT_platform\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-11\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-11\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Steiner, Sebastian; Wolf, Jakob; Glatzel, Stefan; Andreou, Anna; Granda, Jaros\u0142aw M.; Keenan, Graham; Hinkley, Trevor; Aragon-Camarasa, Gerardo <i>et al.<\/i> (11 January 2019). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.science.org\/doi\/10.1126\/science.aav2211\" target=\"_blank\">\"Organic synthesis in a modular robotic system driven by a chemical programming language\"<\/a> (in en). <i>Science<\/i> <b>363<\/b> (6423): eaav2211. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1126%2Fscience.aav2211\" target=\"_blank\">10.1126\/science.aav2211<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0036-8075\" target=\"_blank\">0036-8075<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.science.org\/doi\/10.1126\/science.aav2211\" target=\"_blank\">https:\/\/www.science.org\/doi\/10.1126\/science.aav2211<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Organic+synthesis+in+a+modular+robotic+system+driven+by+a+chemical+programming+language&rft.jtitle=Science&rft.aulast=Steiner&rft.aufirst=Sebastian&rft.au=Steiner%2C%26%2332%3BSebastian&rft.au=Wolf%2C%26%2332%3BJakob&rft.au=Glatzel%2C%26%2332%3BStefan&rft.au=Andreou%2C%26%2332%3BAnna&rft.au=Granda%2C%26%2332%3BJaros%C5%82aw+M.&rft.au=Keenan%2C%26%2332%3BGraham&rft.au=Hinkley%2C%26%2332%3BTrevor&rft.au=Aragon-Camarasa%2C%26%2332%3BGerardo&rft.au=Kitson%2C%26%2332%3BPhilip+J.&rft.date=11+January+2019&rft.volume=363&rft.issue=6423&rft.pages=eaav2211&rft_id=info:doi\/10.1126%2Fscience.aav2211&rft.issn=0036-8075&rft_id=https%3A%2F%2Fwww.science.org%2Fdoi%2F10.1126%2Fscience.aav2211&rfr_id=info:sid\/en.wikipedia.org:Journal:Data_management_of_microscale_reaction_calorimeter_using_a_modular_open-source_IoT_platform\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-12\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-12\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">van der Westhuizen, C. Johan; du Toit, Jurie; Neyt, Nicole; Riley, Darren; Panayides, Jenny-Lee (2022). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/xlink.rsc.org\/?DOI=D2DD00036A\" target=\"_blank\">\"Use of open-source software platform to develop dashboards for control and automation of flow chemistry equipment\"<\/a> (in en). <i>Digital Discovery<\/i> <b>1<\/b> (5): 596\u2013604. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1039%2FD2DD00036A\" target=\"_blank\">10.1039\/D2DD00036A<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2635-098X\" target=\"_blank\">2635-098X<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/xlink.rsc.org\/?DOI=D2DD00036A\" target=\"_blank\">http:\/\/xlink.rsc.org\/?DOI=D2DD00036A<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Use+of+open-source+software+platform+to+develop+dashboards+for+control+and+automation+of+flow+chemistry+equipment&rft.jtitle=Digital+Discovery&rft.aulast=van+der+Westhuizen&rft.aufirst=C.+Johan&rft.au=van+der+Westhuizen%2C%26%2332%3BC.+Johan&rft.au=du+Toit%2C%26%2332%3BJurie&rft.au=Neyt%2C%26%2332%3BNicole&rft.au=Riley%2C%26%2332%3BDarren&rft.au=Panayides%2C%26%2332%3BJenny-Lee&rft.date=2022&rft.volume=1&rft.issue=5&rft.pages=596%E2%80%93604&rft_id=info:doi\/10.1039%2FD2DD00036A&rft.issn=2635-098X&rft_id=http%3A%2F%2Fxlink.rsc.org%2F%3FDOI%3DD2DD00036A&rfr_id=info:sid\/en.wikipedia.org:Journal:Data_management_of_microscale_reaction_calorimeter_using_a_modular_open-source_IoT_platform\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-13\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-13\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\"><a rel=\"external_link\" class=\"external text\" href=\"https:\/\/openjsf.org\/category\/node-red\/\" target=\"_blank\">\"Category: Node-RED\"<\/a>. OpenJS Foundation<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/openjsf.org\/category\/node-red\/\" target=\"_blank\">https:\/\/openjsf.org\/category\/node-red\/<\/a><\/span><span class=\"reference-accessdate\">. Retrieved 03 January 2023<\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Category%3A+Node-RED&rft.atitle=&rft.pub=OpenJS+Foundation&rft_id=https%3A%2F%2Fopenjsf.org%2Fcategory%2Fnode-red%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:Data_management_of_microscale_reaction_calorimeter_using_a_modular_open-source_IoT_platform\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-14\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-14\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Charlet, C.; Christ, T. (July 2022). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.d-fine.com\/news\/open-source-iot-data-pipelines\/\" target=\"_blank\">\"Open source IoT data pipelines\"<\/a>. d-fine GmbH<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.d-fine.com\/news\/open-source-iot-data-pipelines\/\" target=\"_blank\">https:\/\/www.d-fine.com\/news\/open-source-iot-data-pipelines\/<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=Open+source+IoT+data+pipelines&rft.atitle=&rft.aulast=Charlet%2C+C.%3B+Christ%2C+T.&rft.au=Charlet%2C+C.%3B+Christ%2C+T.&rft.date=July+2022&rft.pub=d-fine+GmbH&rft_id=https%3A%2F%2Fwww.d-fine.com%2Fnews%2Fopen-source-iot-data-pipelines%2F&rfr_id=info:sid\/en.wikipedia.org:Journal:Data_management_of_microscale_reaction_calorimeter_using_a_modular_open-source_IoT_platform\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-15\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-15\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Reichmann, Felix; Millhoff, Stefan; Jirmann, Yannick; Kockmann, Norbert (1 November 2017). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/ceat.201700419\" target=\"_blank\">\"Reaction Calorimetry for Exothermic Reactions in Plate-Type Microreactors Using Seebeck Elements\"<\/a> (in en). <i>Chemical Engineering & Technology<\/i> <b>40<\/b> (11): 2144\u20132154. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1002%2Fceat.201700419\" target=\"_blank\">10.1002\/ceat.201700419<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/ceat.201700419\" target=\"_blank\">https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/ceat.201700419<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Reaction+Calorimetry+for+Exothermic+Reactions+in+Plate-Type+Microreactors+Using+Seebeck+Elements&rft.jtitle=Chemical+Engineering+%26+Technology&rft.aulast=Reichmann&rft.aufirst=Felix&rft.au=Reichmann%2C%26%2332%3BFelix&rft.au=Millhoff%2C%26%2332%3BStefan&rft.au=Jirmann%2C%26%2332%3BYannick&rft.au=Kockmann%2C%26%2332%3BNorbert&rft.date=1+November+2017&rft.volume=40&rft.issue=11&rft.pages=2144%E2%80%932154&rft_id=info:doi\/10.1002%2Fceat.201700419&rft_id=https%3A%2F%2Fonlinelibrary.wiley.com%2Fdoi%2F10.1002%2Fceat.201700419&rfr_id=info:sid\/en.wikipedia.org:Journal:Data_management_of_microscale_reaction_calorimeter_using_a_modular_open-source_IoT_platform\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:1-16\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:1_16-0\">16.0<\/a><\/sup> <sup><a href=\"#cite_ref-:1_16-1\">16.1<\/a><\/sup> <sup><a href=\"#cite_ref-:1_16-2\">16.2<\/a><\/sup> <sup><a href=\"#cite_ref-:1_16-3\">16.3<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Frede, Timothy Aljoscha; Greive, Moritz; Kockmann, Norbert (12 October 2022). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/www.mdpi.com\/2624-781X\/3\/4\/35\" target=\"_blank\">\"Measuring Kinetics in Flow Using Isoperibolic Flow Calorimetry\"<\/a> (in en). <i>Reactions<\/i> <b>3<\/b> (4): 525\u2013536. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.3390%2Freactions3040035\" target=\"_blank\">10.3390\/reactions3040035<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2624-781X\" target=\"_blank\">2624-781X<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/www.mdpi.com\/2624-781X\/3\/4\/35\" target=\"_blank\">https:\/\/www.mdpi.com\/2624-781X\/3\/4\/35<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Measuring+Kinetics+in+Flow+Using+Isoperibolic+Flow+Calorimetry&rft.jtitle=Reactions&rft.aulast=Frede&rft.aufirst=Timothy+Aljoscha&rft.au=Frede%2C%26%2332%3BTimothy+Aljoscha&rft.au=Greive%2C%26%2332%3BMoritz&rft.au=Kockmann%2C%26%2332%3BNorbert&rft.date=12+October+2022&rft.volume=3&rft.issue=4&rft.pages=525%E2%80%93536&rft_id=info:doi\/10.3390%2Freactions3040035&rft.issn=2624-781X&rft_id=https%3A%2F%2Fwww.mdpi.com%2F2624-781X%2F3%2F4%2F35&rfr_id=info:sid\/en.wikipedia.org:Journal:Data_management_of_microscale_reaction_calorimeter_using_a_modular_open-source_IoT_platform\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:2-17\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:2_17-0\">17.0<\/a><\/sup> <sup><a href=\"#cite_ref-:2_17-1\">17.1<\/a><\/sup> <sup><a href=\"#cite_ref-:2_17-2\">17.2<\/a><\/sup> <sup><a href=\"#cite_ref-:2_17-3\">17.3<\/a><\/sup> <sup><a href=\"#cite_ref-:2_17-4\">17.4<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">\u0141adosz, Agnieszka; Kuhnle, Christina; Jensen, Klavs F. (2020). <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/xlink.rsc.org\/?DOI=D0RE00304B\" target=\"_blank\">\"Characterization of reaction enthalpy and kinetics in a microscale flow platform\"<\/a> (in en). <i>Reaction Chemistry & Engineering<\/i> <b>5<\/b> (11): 2115\u20132122. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1039%2FD0RE00304B\" target=\"_blank\">10.1039\/D0RE00304B<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2058-9883\" target=\"_blank\">2058-9883<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"http:\/\/xlink.rsc.org\/?DOI=D0RE00304B\" target=\"_blank\">http:\/\/xlink.rsc.org\/?DOI=D0RE00304B<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Characterization+of+reaction+enthalpy+and+kinetics+in+a+microscale+flow+platform&rft.jtitle=Reaction+Chemistry+%26+Engineering&rft.aulast=%C5%81adosz&rft.aufirst=Agnieszka&rft.au=%C5%81adosz%2C%26%2332%3BAgnieszka&rft.au=Kuhnle%2C%26%2332%3BChristina&rft.au=Jensen%2C%26%2332%3BKlavs+F.&rft.date=2020&rft.volume=5&rft.issue=11&rft.pages=2115%E2%80%932122&rft_id=info:doi\/10.1039%2FD0RE00304B&rft.issn=2058-9883&rft_id=http%3A%2F%2Fxlink.rsc.org%2F%3FDOI%3DD0RE00304B&rfr_id=info:sid\/en.wikipedia.org:Journal:Data_management_of_microscale_reaction_calorimeter_using_a_modular_open-source_IoT_platform\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-:3-18\"><span class=\"mw-cite-backlink\">\u2191 <sup><a href=\"#cite_ref-:3_18-0\">18.0<\/a><\/sup> <sup><a href=\"#cite_ref-:3_18-1\">18.1<\/a><\/sup><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Steinemann, Finn L.; R\u00fctti, David P.; Moser, Marlies; Georg, Alain G.; Meier, Daniel M. (1 December 2022). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/link.springer.com\/10.1007\/s41981-022-00237-x\" target=\"_blank\">\"Simultaneous determination of enthalpy of mixing and reaction using milli-scale continuous flow calorimetry\"<\/a> (in en). <i>Journal of Flow Chemistry<\/i> <b>12<\/b> (4): 389\u2013396. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1007%2Fs41981-022-00237-x\" target=\"_blank\">10.1007\/s41981-022-00237-x<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/2062-249X\" target=\"_blank\">2062-249X<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/link.springer.com\/10.1007\/s41981-022-00237-x\" target=\"_blank\">https:\/\/link.springer.com\/10.1007\/s41981-022-00237-x<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Simultaneous+determination+of+enthalpy+of+mixing+and+reaction+using+milli-scale+continuous+flow+calorimetry&rft.jtitle=Journal+of+Flow+Chemistry&rft.aulast=Steinemann&rft.aufirst=Finn+L.&rft.au=Steinemann%2C%26%2332%3BFinn+L.&rft.au=R%C3%BCtti%2C%26%2332%3BDavid+P.&rft.au=Moser%2C%26%2332%3BMarlies&rft.au=Georg%2C%26%2332%3BAlain+G.&rft.au=Meier%2C%26%2332%3BDaniel+M.&rft.date=1+December+2022&rft.volume=12&rft.issue=4&rft.pages=389%E2%80%93396&rft_id=info:doi\/10.1007%2Fs41981-022-00237-x&rft.issn=2062-249X&rft_id=https%3A%2F%2Flink.springer.com%2F10.1007%2Fs41981-022-00237-x&rfr_id=info:sid\/en.wikipedia.org:Journal:Data_management_of_microscale_reaction_calorimeter_using_a_modular_open-source_IoT_platform\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-19\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-19\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Glotz, Gabriel; Knoechel, Donald J.; Podmore, Philip; Gruber-Woelfler, Heidrun; Kappe, C. Oliver (19 May 2017). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/pubs.acs.org\/doi\/10.1021\/acs.oprd.7b00092\" target=\"_blank\">\"Reaction Calorimetry in Microreactor Environments\u2014Measuring Heat of Reaction by Isothermal Heat Flux Calorimetry\"<\/a> (in en). <i>Organic Process Research & Development<\/i> <b>21<\/b> (5): 763\u2013770. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1021%2Facs.oprd.7b00092\" target=\"_blank\">10.1021\/acs.oprd.7b00092<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/1083-6160\" target=\"_blank\">1083-6160<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/pubs.acs.org\/doi\/10.1021\/acs.oprd.7b00092\" target=\"_blank\">https:\/\/pubs.acs.org\/doi\/10.1021\/acs.oprd.7b00092<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Reaction+Calorimetry+in+Microreactor+Environments%E2%80%94Measuring+Heat+of+Reaction+by+Isothermal+Heat+Flux+Calorimetry&rft.jtitle=Organic+Process+Research+%26+Development&rft.aulast=Glotz&rft.aufirst=Gabriel&rft.au=Glotz%2C%26%2332%3BGabriel&rft.au=Knoechel%2C%26%2332%3BDonald+J.&rft.au=Podmore%2C%26%2332%3BPhilip&rft.au=Gruber-Woelfler%2C%26%2332%3BHeidrun&rft.au=Kappe%2C%26%2332%3BC.+Oliver&rft.date=19+May+2017&rft.volume=21&rft.issue=5&rft.pages=763%E2%80%93770&rft_id=info:doi\/10.1021%2Facs.oprd.7b00092&rft.issn=1083-6160&rft_id=https%3A%2F%2Fpubs.acs.org%2Fdoi%2F10.1021%2Facs.oprd.7b00092&rfr_id=info:sid\/en.wikipedia.org:Journal:Data_management_of_microscale_reaction_calorimeter_using_a_modular_open-source_IoT_platform\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-20\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-20\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation web\">Martin, H. (1975). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/infozentrum.ethz.ch\/katalog\/werke\/374\/780\" target=\"_blank\">\"W\u00e4rmeflusskalorimetrie Unter Pr\u00e4parativen Bedingungen Und Ihre Anwendung Zur Verfolgung Der Isomerisierungskinetik von Trimethylphosphit\"<\/a>. Universit\u00e4t Basel<span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/infozentrum.ethz.ch\/katalog\/werke\/374\/780\" target=\"_blank\">https:\/\/infozentrum.ethz.ch\/katalog\/werke\/374\/780<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.btitle=W%C3%A4rmeflusskalorimetrie+Unter+Pr%C3%A4parativen+Bedingungen+Und+Ihre+Anwendung+Zur+Verfolgung+Der+Isomerisierungskinetik+von+Trimethylphosphit&rft.atitle=&rft.aulast=Martin%2C+H.&rft.au=Martin%2C+H.&rft.date=1975&rft.pub=Universit%C3%A4t+Basel&rft_id=https%3A%2F%2Finfozentrum.ethz.ch%2Fkatalog%2Fwerke%2F374%2F780&rfr_id=info:sid\/en.wikipedia.org:Journal:Data_management_of_microscale_reaction_calorimeter_using_a_modular_open-source_IoT_platform\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-21\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-21\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Zogg, Andreas; Fischer, Ulrich; Hungerb\u00fchler, Konrad (1 February 2003). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/pubs.acs.org\/doi\/10.1021\/ie0201258\" target=\"_blank\">\"A New Small-Scale Reaction Calorimeter That Combines the Principles of Power Compensation and Heat Balance\"<\/a> (in en). <i>Industrial & Engineering Chemistry Research<\/i> <b>42<\/b> (4): 767\u2013776. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1021%2Fie0201258\" target=\"_blank\">10.1021\/ie0201258<\/a>. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Serial_Number\" data-key=\"a5dec3e4d005e654c29ad167ab53f53a\">ISSN<\/a> <a rel=\"external_link\" class=\"external text\" href=\"http:\/\/www.worldcat.org\/issn\/0888-5885\" target=\"_blank\">0888-5885<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/pubs.acs.org\/doi\/10.1021\/ie0201258\" target=\"_blank\">https:\/\/pubs.acs.org\/doi\/10.1021\/ie0201258<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=A+New+Small-Scale+Reaction+Calorimeter+That+Combines+the+Principles+of+Power+Compensation+and+Heat+Balance&rft.jtitle=Industrial+%26+Engineering+Chemistry+Research&rft.aulast=Zogg&rft.aufirst=Andreas&rft.au=Zogg%2C%26%2332%3BAndreas&rft.au=Fischer%2C%26%2332%3BUlrich&rft.au=Hungerb%C3%BChler%2C%26%2332%3BKonrad&rft.date=1+February+2003&rft.volume=42&rft.issue=4&rft.pages=767%E2%80%93776&rft_id=info:doi\/10.1021%2Fie0201258&rft.issn=0888-5885&rft_id=https%3A%2F%2Fpubs.acs.org%2Fdoi%2F10.1021%2Fie0201258&rfr_id=info:sid\/en.wikipedia.org:Journal:Data_management_of_microscale_reaction_calorimeter_using_a_modular_open-source_IoT_platform\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-22\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-22\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation Journal\">Gelhausen, Marius Gerrit; Kurt, Safa Kutup; Kockmann, Norbert (1 June 2015). <a rel=\"external_link\" class=\"external text\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/cite.201400141\" target=\"_blank\">\"Parametrische Empfindlichkeit einer stark exothermen Reaktion im Kapillarwendelreaktor\"<\/a> (in en). <i>Chemie Ingenieur Technik<\/i> <b>87<\/b> (6): 781\u2013790. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/Digital_object_identifier\" data-key=\"ae6d69c760ab710abc2dd89f3937d2f4\">doi<\/a>:<a rel=\"external_link\" class=\"external text\" href=\"http:\/\/dx.doi.org\/10.1002%2Fcite.201400141\" target=\"_blank\">10.1002\/cite.201400141<\/a><span class=\"printonly\">. <a rel=\"external_link\" class=\"external free\" href=\"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/cite.201400141\" target=\"_blank\">https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/cite.201400141<\/a><\/span>.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Parametrische+Empfindlichkeit+einer+stark+exothermen+Reaktion+im+Kapillarwendelreaktor&rft.jtitle=Chemie+Ingenieur+Technik&rft.aulast=Gelhausen&rft.aufirst=Marius+Gerrit&rft.au=Gelhausen%2C%26%2332%3BMarius+Gerrit&rft.au=Kurt%2C%26%2332%3BSafa+Kutup&rft.au=Kockmann%2C%26%2332%3BNorbert&rft.date=1+June+2015&rft.volume=87&rft.issue=6&rft.pages=781%E2%80%93790&rft_id=info:doi\/10.1002%2Fcite.201400141&rft_id=https%3A%2F%2Fonlinelibrary.wiley.com%2Fdoi%2F10.1002%2Fcite.201400141&rfr_id=info:sid\/en.wikipedia.org:Journal:Data_management_of_microscale_reaction_calorimeter_using_a_modular_open-source_IoT_platform\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<li id=\"cite_note-23\"><span class=\"mw-cite-backlink\"><a href=\"#cite_ref-23\">\u2191<\/a><\/span> <span class=\"reference-text\"><span class=\"citation book\">Baerns, Manfred; Behr, Arno; Brehm, Axel; Gmehling, J\u00fcrgen; Hinrichsen, Kai-Olaf; Hofmann, Hanns; Palkovits, Regina; Onken, Ulfert <i>et al.<\/i> (2013). <i>Technische Chemie<\/i> (Zweite, erweiterte Auflage ed.). Weinheim: Wiley-VCH. <a rel=\"nofollow\" class=\"external text wiki-link\" href=\"http:\/\/en.wikipedia.org\/wiki\/International_Standard_Book_Number\" data-key=\"f64947ba21e884434bd70e8d9e60bae6\">ISBN<\/a> 978-3-527-67409-1.<\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=book&rft.btitle=Technische+Chemie&rft.aulast=Baerns&rft.aufirst=Manfred&rft.au=Baerns%2C%26%2332%3BManfred&rft.au=Behr%2C%26%2332%3BArno&rft.au=Brehm%2C%26%2332%3BAxel&rft.au=Gmehling%2C%26%2332%3BJ%C3%BCrgen&rft.au=Hinrichsen%2C%26%2332%3BKai-Olaf&rft.au=Hofmann%2C%26%2332%3BHanns&rft.au=Palkovits%2C%26%2332%3BRegina&rft.au=Onken%2C%26%2332%3BUlfert&rft.au=Renken%2C%26%2332%3BAlbert&rft.date=2013&rft.edition=Zweite%2C+erweiterte+Auflage&rft.place=Weinheim&rft.pub=Wiley-VCH&rft.isbn=978-3-527-67409-1&rfr_id=info:sid\/en.wikipedia.org:Journal:Data_management_of_microscale_reaction_calorimeter_using_a_modular_open-source_IoT_platform\"><span style=\"display: none;\"> <\/span><\/span>\n<\/span>\n<\/li>\n<\/ol><\/div><\/div>\n<h2><span class=\"mw-headline\" id=\"Notes\">Notes<\/span><\/h2>\n<p>This presentation is faithful to the original, with only a few minor changes to presentation. In some cases important information was missing from the references, and that information was added.\n<\/p>\n<!-- \nNewPP limit report\nCached time: 20230630032231\nCache expiry: 86400\nDynamic content: false\nComplications: []\nCPU time usage: 3.269 seconds\nReal time usage: 3.665 seconds\nPreprocessor visited node count: 24038\/1000000\nPost\u2010expand include size: 194702\/2097152 bytes\nTemplate argument size: 57859\/2097152 bytes\nHighest expansion depth: 25\/40\nExpensive parser function count: 0\/100\nUnstrip recursion depth: 0\/20\nUnstrip post\u2010expand size: 54004\/5000000 bytes\n-->\n<!--\nTransclusion expansion time report (%,ms,calls,template)\n100.00% 371.782 1 -total\n 81.27% 302.148 1 Template:Reflist\n 62.47% 232.248 23 Template:Citation\/core\n 47.98% 178.392 17 Template:Cite_journal\n 13.37% 49.715 2 Template:Cite_book\n 10.19% 37.879 21 Template:Date\n 9.40% 34.940 1 Template:Infobox_journal_article\n 8.31% 30.902 1 Template:Infobox\n 8.29% 30.828 4 Template:Cite_web\n 7.29% 27.104 37 Template:Citation\/identifier\n-->\n\n<!-- Saved in parser cache with key limswiki:pcache:idhash:14107-0!canonical!math=5 and timestamp 20230630032228 and revision id 51818. Serialized with JSON.\n -->\n<\/div><\/div><div class=\"printfooter\">Source: <a rel=\"external_link\" class=\"external\" href=\"https:\/\/www.limswiki.org\/index.php\/Journal:Data_management_of_microscale_reaction_calorimeter_using_a_modular_open-source_IoT_platform\">https:\/\/www.limswiki.org\/index.php\/Journal:Data_management_of_microscale_reaction_calorimeter_using_a_modular_open-source_IoT_platform<\/a><\/div>\n<!-- end content --><div class=\"visualClear\"><\/div><\/div><\/div><div class=\"visualClear\"><\/div><\/div><!-- end of the left (by default at least) column --><div class=\"visualClear\"><\/div><\/div>\n\n\n\n<\/body>","3684f315d0144c04cd2ba3828134fad3_images":["https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/1\/12\/GA1_Frede_Processes23_11-1.png","https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/0\/00\/Fig1_Frede_Processes23_11-1.png","https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/f\/f3\/Fig2_Frede_Processes23_11-1.png","https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/5\/52\/Fig3_Frede_Processes23_11-1.png","https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/d\/d8\/Fig4_Frede_Processes23_11-1.png","https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/a\/af\/Fig5_Frede_Processes23_11-1.png","https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/0\/0f\/Fig6_Frede_Processes23_11-1.png","https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/9\/90\/Fig7_Frede_Processes23_11-1.png","https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/1\/18\/Fig8_Frede_Processes23_11-1.png"],"3684f315d0144c04cd2ba3828134fad3_timestamp":1688138449,"52f5a7f2d92e5b3dfce4b5adb1c3576f_type":"article","52f5a7f2d92e5b3dfce4b5adb1c3576f_title":"Characterization of trichome phenotypes to assess maturation and flower development in Cannabis sativa L. by automatic trichome gland analysis (Sutton et al. 2023)","52f5a7f2d92e5b3dfce4b5adb1c3576f_url":"https:\/\/www.cannaqa.wiki\/index.php?title=Characterization_of_trichome_phenotypes_to_assess_maturation_and_flower_development_in_Cannabis_sativa_L._by_automatic_trichome_gland_analysis","52f5a7f2d92e5b3dfce4b5adb1c3576f_plaintext":"\n\nCharacterization of trichome phenotypes to assess maturation and flower development in Cannabis sativa L. by automatic trichome gland analysisFrom CannaQAWikiJump to navigationJump to search\nThere is currently no text in this page.\nYou can search for this page title in other pages, or search the related logs , but you do not have permission to create this page.\n\nSource: <a rel=\"external_link\" class=\"external\" href=\"https:\/\/www.cannaqa.wiki\/index.php?title=Characterization_of_trichome_phenotypes_to_assess_maturation_and_flower_development_in_Cannabis_sativa_L._by_automatic_trichome_gland_analysis\">https:\/\/www.cannaqa.wiki\/index.php?title=Characterization_of_trichome_phenotypes_to_assess_maturation_and_flower_development_in_Cannabis_sativa_L._by_automatic_trichome_gland_analysis<\/a>\nNavigation menuPage actionsPageDiscussionPage actionsPageDiscussionMoreToolsIn other languagesPersonal toolsLog inNavigationMain pageList of articlesRandom pageRecent changesHelpSearch\u00a0 ToolsWhat links hereSpecial pagesPrintable versionPage informationPrivacy policyAbout CannaQAWikiDisclaimers\n","52f5a7f2d92e5b3dfce4b5adb1c3576f_html":"<body class=\"mediawiki ltr sitedir-ltr mw-hide-empty-elt ns-0 ns-subject page-Characterization_of_trichome_phenotypes_to_assess_maturation_and_flower_development_in_Cannabis_sativa_L_by_automatic_trichome_gland_analysis rootpage-Characterization_of_trichome_phenotypes_to_assess_maturation_and_flower_development_in_Cannabis_sativa_L_by_automatic_trichome_gland_analysis skin-monobook action-view skin--responsive\"><div id=\"rdp-ebb-globalWrapper\"><div id=\"rdp-ebb-column-content\"><div id=\"rdp-ebb-content\" class=\"mw-body\" role=\"main\"><a id=\"rdp-ebb-top\"><\/a>\n<h1 id=\"rdp-ebb-firstHeading\" class=\"firstHeading\" lang=\"en\">Characterization of trichome phenotypes to assess maturation and flower development in Cannabis sativa L. by automatic trichome gland analysis<\/h1><div id=\"rdp-ebb-bodyContent\" class=\"mw-body-content\"><!-- start content --><div id=\"rdp-ebb-mw-content-text\" lang=\"en\" dir=\"ltr\" class=\"mw-content-ltr\"><div class=\"noarticletext mw-content-ltr\" dir=\"ltr\" lang=\"en\">\n<p>There is currently no text in this page.\nYou can search for this page title in other pages, or <span class=\"plainlinks\">search the related logs<\/span>, but you do not have permission to create this page.\n<\/p>\n<\/div><\/div><div class=\"printfooter\">Source: <a rel=\"external_link\" class=\"external\" href=\"https:\/\/www.cannaqa.wiki\/index.php?title=Characterization_of_trichome_phenotypes_to_assess_maturation_and_flower_development_in_Cannabis_sativa_L._by_automatic_trichome_gland_analysis\">https:\/\/www.cannaqa.wiki\/index.php?title=Characterization_of_trichome_phenotypes_to_assess_maturation_and_flower_development_in_Cannabis_sativa_L._by_automatic_trichome_gland_analysis<\/a><\/div>\n<!-- end content --><div class=\"visualClear\"><\/div><\/div><\/div><div class=\"visualClear\"><\/div><\/div><!-- end of the left (by default at least) column --><div class=\"visualClear\"><\/div><\/div>\n<\/body>","52f5a7f2d92e5b3dfce4b5adb1c3576f_images":[],"52f5a7f2d92e5b3dfce4b5adb1c3576f_timestamp":1688138448,"0a2a87b977e7d3227424c019253bf184_type":"article","0a2a87b977e7d3227424c019253bf184_title":"Beyond cannabinoids: Application of NMR-based metabolomics for the assessment of Cannabis sativa L. crop health (Fern\u00e1ndez et al. 2023)","0a2a87b977e7d3227424c019253bf184_url":"https:\/\/www.cannaqa.wiki\/index.php?title=Beyond_cannabinoids:_Application_of_NMR-based_metabolomics_for_the_assessment_of_Cannabis_sativa_L._crop_health","0a2a87b977e7d3227424c019253bf184_plaintext":"\n\nBeyond cannabinoids: Application of NMR-based metabolomics for the assessment of Cannabis sativa L. crop healthFrom CannaQAWikiJump to navigationJump to search\nThere is currently no text in this page.\nYou can search for this page title in other pages, or search the related logs , but you do not have permission to create this page.\n\nSource: <a rel=\"external_link\" class=\"external\" href=\"https:\/\/www.cannaqa.wiki\/index.php?title=Beyond_cannabinoids:_Application_of_NMR-based_metabolomics_for_the_assessment_of_Cannabis_sativa_L._crop_health\">https:\/\/www.cannaqa.wiki\/index.php?title=Beyond_cannabinoids:_Application_of_NMR-based_metabolomics_for_the_assessment_of_Cannabis_sativa_L._crop_health<\/a>\nNavigation menuPage actionsPageDiscussionPage actionsPageDiscussionMoreToolsIn other languagesPersonal toolsLog inNavigationMain pageList of articlesRandom pageRecent changesHelpSearch\u00a0 ToolsWhat links hereSpecial pagesPrintable versionPage informationPrivacy policyAbout CannaQAWikiDisclaimers\n","0a2a87b977e7d3227424c019253bf184_html":"<body class=\"mediawiki ltr sitedir-ltr mw-hide-empty-elt ns-0 ns-subject page-Beyond_cannabinoids_Application_of_NMR-based_metabolomics_for_the_assessment_of_Cannabis_sativa_L_crop_health rootpage-Beyond_cannabinoids_Application_of_NMR-based_metabolomics_for_the_assessment_of_Cannabis_sativa_L_crop_health skin-monobook action-view skin--responsive\"><div id=\"rdp-ebb-globalWrapper\"><div id=\"rdp-ebb-column-content\"><div id=\"rdp-ebb-content\" class=\"mw-body\" role=\"main\"><a id=\"rdp-ebb-top\"><\/a>\n<h1 id=\"rdp-ebb-firstHeading\" class=\"firstHeading\" lang=\"en\">Beyond cannabinoids: Application of NMR-based metabolomics for the assessment of Cannabis sativa L. crop health<\/h1><div id=\"rdp-ebb-bodyContent\" class=\"mw-body-content\"><!-- start content --><div id=\"rdp-ebb-mw-content-text\" lang=\"en\" dir=\"ltr\" class=\"mw-content-ltr\"><div class=\"noarticletext mw-content-ltr\" dir=\"ltr\" lang=\"en\">\n<p>There is currently no text in this page.\nYou can search for this page title in other pages, or <span class=\"plainlinks\">search the related logs<\/span>, but you do not have permission to create this page.\n<\/p>\n<\/div><\/div><div class=\"printfooter\">Source: <a rel=\"external_link\" class=\"external\" href=\"https:\/\/www.cannaqa.wiki\/index.php?title=Beyond_cannabinoids:_Application_of_NMR-based_metabolomics_for_the_assessment_of_Cannabis_sativa_L._crop_health\">https:\/\/www.cannaqa.wiki\/index.php?title=Beyond_cannabinoids:_Application_of_NMR-based_metabolomics_for_the_assessment_of_Cannabis_sativa_L._crop_health<\/a><\/div>\n<!-- end content --><div class=\"visualClear\"><\/div><\/div><\/div><div class=\"visualClear\"><\/div><\/div><!-- end of the left (by default at least) column --><div class=\"visualClear\"><\/div><\/div>\n<\/body>","0a2a87b977e7d3227424c019253bf184_images":[],"0a2a87b977e7d3227424c019253bf184_timestamp":1688138448,"4303b8193c459029fd763128ac952a3c_type":"article","4303b8193c459029fd763128ac952a3c_title":"Academic-industry partnership advancing cannabis science: The Complementary Care Practice-Based Research Network (Ennis et al. 2022)","4303b8193c459029fd763128ac952a3c_url":"https:\/\/www.cannaqa.wiki\/index.php?title=Academic-industry_partnership_advancing_cannabis_science:_The_Complementary_Care_Practice-Based_Research_Network","4303b8193c459029fd763128ac952a3c_plaintext":"\n\nAcademic-industry partnership advancing cannabis science: The Complementary Care Practice-Based Research NetworkFrom CannaQAWikiJump to navigationJump to search\nThere is currently no text in this page.\nYou can search for this page title in other pages, or search the related logs , but you do not have permission to create this page.\n\nSource: <a rel=\"external_link\" class=\"external\" href=\"https:\/\/www.cannaqa.wiki\/index.php?title=Academic-industry_partnership_advancing_cannabis_science:_The_Complementary_Care_Practice-Based_Research_Network\">https:\/\/www.cannaqa.wiki\/index.php?title=Academic-industry_partnership_advancing_cannabis_science:_The_Complementary_Care_Practice-Based_Research_Network<\/a>\nNavigation menuPage actionsPageDiscussionPage actionsPageDiscussionMoreToolsIn other languagesPersonal toolsLog inNavigationMain pageList of articlesRandom pageRecent changesHelpSearch\u00a0 ToolsWhat links hereSpecial pagesPrintable versionPage informationPrivacy policyAbout CannaQAWikiDisclaimers\n","4303b8193c459029fd763128ac952a3c_html":"<body class=\"mediawiki ltr sitedir-ltr mw-hide-empty-elt ns-0 ns-subject page-Academic-industry_partnership_advancing_cannabis_science_The_Complementary_Care_Practice-Based_Research_Network rootpage-Academic-industry_partnership_advancing_cannabis_science_The_Complementary_Care_Practice-Based_Research_Network skin-monobook action-view skin--responsive\"><div id=\"rdp-ebb-globalWrapper\"><div id=\"rdp-ebb-column-content\"><div id=\"rdp-ebb-content\" class=\"mw-body\" role=\"main\"><a id=\"rdp-ebb-top\"><\/a>\n<h1 id=\"rdp-ebb-firstHeading\" class=\"firstHeading\" lang=\"en\">Academic-industry partnership advancing cannabis science: The Complementary Care Practice-Based Research Network<\/h1><div id=\"rdp-ebb-bodyContent\" class=\"mw-body-content\"><!-- start content --><div id=\"rdp-ebb-mw-content-text\" lang=\"en\" dir=\"ltr\" class=\"mw-content-ltr\"><div class=\"noarticletext mw-content-ltr\" dir=\"ltr\" lang=\"en\">\n<p>There is currently no text in this page.\nYou can search for this page title in other pages, or <span class=\"plainlinks\">search the related logs<\/span>, but you do not have permission to create this page.\n<\/p>\n<\/div><\/div><div class=\"printfooter\">Source: <a rel=\"external_link\" class=\"external\" href=\"https:\/\/www.cannaqa.wiki\/index.php?title=Academic-industry_partnership_advancing_cannabis_science:_The_Complementary_Care_Practice-Based_Research_Network\">https:\/\/www.cannaqa.wiki\/index.php?title=Academic-industry_partnership_advancing_cannabis_science:_The_Complementary_Care_Practice-Based_Research_Network<\/a><\/div>\n<!-- end content --><div class=\"visualClear\"><\/div><\/div><\/div><div class=\"visualClear\"><\/div><\/div><!-- end of the left (by default at least) column --><div class=\"visualClear\"><\/div><\/div>\n<\/body>","4303b8193c459029fd763128ac952a3c_images":[],"4303b8193c459029fd763128ac952a3c_timestamp":1688138448,"6b03770f3ae1d0327e8eb69d5900fa48":{"type":"chapter","title":"1. Cannabis analysis and research","key":"6b03770f3ae1d0327e8eb69d5900fa48"}},"link":"https:\/\/www.limswiki.org\/index.php\/Book:LIMSjournal_-_Summer_2023","price_currency":"","price_amount":"","book_size":"","download_url":"https:\/\/www.limsforum.com?ebb_action=book_download&book_id=108315","language":"","cta_button_content":"","toc":[{"type":"chapter","name":"1. Cannabis analysis and research","id":"6b03770f3ae1d0327e8eb69d5900fa48","children":[{"type":"article","name":"Academic-industry partnership advancing cannabis science: The Complementary Care Practice-Based Research Network (Ennis et al. 2022)","id":"4303b8193c459029fd763128ac952a3c","pageUrl":"https:\/\/www.cannaqa.wiki\/index.php?title=Academic-industry_partnership_advancing_cannabis_science:_The_Complementary_Care_Practice-Based_Research_Network"},{"type":"article","name":"Beyond cannabinoids: Application of NMR-based metabolomics for the assessment of Cannabis sativa L. crop health (Fern\u00e1ndez et al. 2023)","id":"0a2a87b977e7d3227424c019253bf184","pageUrl":"https:\/\/www.cannaqa.wiki\/index.php?title=Beyond_cannabinoids:_Application_of_NMR-based_metabolomics_for_the_assessment_of_Cannabis_sativa_L._crop_health"},{"type":"article","name":"Characterization of trichome phenotypes to assess maturation and flower development in Cannabis sativa L. by automatic trichome gland analysis (Sutton et al. 2023)","id":"52f5a7f2d92e5b3dfce4b5adb1c3576f","pageUrl":"https:\/\/www.cannaqa.wiki\/index.php?title=Characterization_of_trichome_phenotypes_to_assess_maturation_and_flower_development_in_Cannabis_sativa_L._by_automatic_trichome_gland_analysis"}]},{"type":"chapter","name":"2. Data management","id":"8ae63df47496eb803fd6a815b2383c52","children":[{"type":"article","name":"Data management of microscale reaction calorimeter using a modular open-source IoT platform (Frede et al. 2023)","id":"3684f315d0144c04cd2ba3828134fad3","pageUrl":"https:\/\/www.limswiki.org\/index.php\/Journal:Data_management_of_microscale_reaction_calorimeter_using_a_modular_open-source_IoT_platform"},{"type":"article","name":"Ten simple rules for maximizing the recommendations of the NIH data management and sharing plan (Gonzales et al. 2022)","id":"558c76387f6f314e1cdfb14c7c293ae7","pageUrl":"https:\/\/www.limswiki.org\/index.php\/Journal:Ten_simple_rules_for_maximizing_the_recommendations_of_the_NIH_data_management_and_sharing_plan"},{"type":"article","name":"A critical literature review of historic scientific analog data: Uses, successes, and challenges (Kelly et al. 2022)","id":"19be31afe217dcc35a45c9d74f9d4aa9","pageUrl":"https:\/\/www.limswiki.org\/index.php\/Journal:A_critical_literature_review_of_historic_scientific_analog_data:_Uses,_successes,_and_challenges"},{"type":"article","name":"An overview of data warehouse and data lake in modern enterprise data management (Nambiar and Mundra 2022)","id":"99089d094ae9eb5f9ae5bdabb8d706dc","pageUrl":"https:\/\/www.limswiki.org\/index.php\/Journal:An_overview_of_data_warehouse_and_data_lake_in_modern_enterprise_data_management"}]},{"type":"chapter","name":"3. Laboratory informatics and management","id":"6abf69c411fdbc28921e83caae4aa6b5","children":[{"type":"article","name":"Integrative diagnostics: The time is now\u2014a report from the International Society for Strategic Studies in Radiology (Beauchamp et al. 2022)","id":"c85ecad158b719016ec41928421b862e","pageUrl":"https:\/\/www.limswiki.org\/index.php\/Journal:Integrative_diagnostics:_The_time_is_now%E2%80%94a_report_from_the_International_Society_for_Strategic_Studies_in_Radiology"},{"type":"article","name":"The modeling of laboratory information systems in higher education based on enterprise architecture planning (EAP) for optimizing monitoring and equipment maintenance (Ifriza et al. 2023)","id":"da73605127ec78cc7d7d98765f3fbcc2","pageUrl":"https:\/\/www.limswiki.org\/index.php\/Journal:The_modeling_of_laboratory_information_systems_in_higher_education_based_on_enterprise_architecture_planning_(EAP)_for_optimizing_monitoring_and_equipment_maintenance"},{"type":"article","name":"Identifying risk management challenges in laboratories (Tziakou et al. 2023)","id":"e100dcbf45911d7ebdcd67493dc727aa","pageUrl":"https:\/\/www.limswiki.org\/index.php\/Journal:Identifying_risk_management_challenges_in_laboratories"}]},{"type":"chapter","name":"4. Laboratory informatics applications","id":"f315a6366c26c252951edbc8987a4f81","children":[{"type":"article","name":"AI4Green: An open-source ELN for green and sustainable chemistry (Boobier et al. 2023)","id":"92f7ee03da2bf61f360ca5692fcf1da0","pageUrl":"https:\/\/www.limswiki.org\/index.php\/Journal:AI4Green:_An_open-source_ELN_for_green_and_sustainable_chemistry"},{"type":"article","name":"ApE, A Plasmid Editor: A freely available DNA manipulation and visualization program (Davis and Jorgensen 2022)","id":"0f31a6a54c07621b155f4fa0d61b1eee","pageUrl":"https:\/\/www.limswiki.org\/index.php\/Journal:ApE,_A_Plasmid_Editor:_A_freely_available_DNA_manipulation_and_visualization_program"},{"type":"article","name":"Development and national scale implementation of an open-source electronic laboratory information system (OpenELIS) in C\u00f4te d\u2019Ivoire: Sustainability lessons from the first 13 years (He et al. 2023)","id":"09a05cec486b0e795821acfbb792b350","pageUrl":"https:\/\/www.limswiki.org\/index.php\/Journal:Development_and_national_scale_implementation_of_an_open-source_electronic_laboratory_information_system_(OpenELIS)_in_C%C3%B4te_d%E2%80%99Ivoire:_Sustainability_lessons_from_the_first_13_years"}]}],"settings":{"show_cover":"1","show_title":"1","show_subtitle":"0","show_full_title":"1","show_editor":"1","show_editor_pic":"1","show_publisher":"1","show_language":"1","show_size":"1","show_toc":"1","show_content_beneath_cover":"1","cta_button":"1","content_location":"1","toc_links":"disabled","log_in_msg":"<span><\/span> Please log in to read online.","cover_size":"medium"},"title_image":"https:\/\/s3.limswiki.org\/www.limswiki.org\/images\/8\/86\/Fig1_Gonzales_PLOSComBio22_18-8.png"}}
LIMSjournal - Summer 2023
Volume 9, Issue 2
Editor: Shawn Douglas
Publisher: LabLynx Press
Copyright LabLynx Inc. All rights reserved.