Evaluation of Secure Messaging Applications for a Health Care System: A Case Study Article Swipe
Xinran Liu
,
Paul S. Sutton
,
Rory McKenna
,
Mika Sinanan
,
Benjamin Fellner
,
Michael G. Leu
,
Cris Ewell
·
YOU?
·
· 2019
· Open Access
·
· DOI: https://doi.org/10.1055/s-0039-1678607
YOU?
·
· 2019
· Open Access
·
· DOI: https://doi.org/10.1055/s-0039-1678607
Objective The use of text messaging in clinical care has become ubiquitous. Due to security and privacy concerns, many hospital systems are evaluating secure text messaging applications. This paper highlights our evaluation process, and offers an overview of secure messaging functionalities, as well as a framework for how to evaluate such applications. Methods Application functionalities were gathered through literature review, Web sites, speaking with representatives, demonstrations, and use cases. Based on similar levels of functionalities, vendors were grouped into three tiers. Essential and secondary functionalities for our health system were defined to help narrow our vendor choices. Results We stratified 19 secure messaging vendors into three tiers: basic secure communication, secure communication within an existing clinical application, and dedicated communication and collaboration systems. Our essential requirements revolved around functionalities to enhance security and communication, while advanced functionalities were mostly considered secondary. We then narrowed our list of 19 vendors to four, then created clinical use cases to rank the final vendors. Discussion When evaluating a secure messaging application, numerous factors must be considered in parallel. These include: what clinical processes to improve, archiving text messages, mobile device management, bring your own device policy, and Wi-Fi architecture. Conclusion Secure messaging applications provide a Health Insurance Portability and Accountability Act (HIPAA) compliant communication platform, and also include functionality to improve clinical collaboration and workflow. We hope that our evaluation framework can be used by other health systems to find a secure messaging application that meets their needs.
Related Topics
Concepts
Metadata
- Type
- article
- Language
- en
- Landing Page
- https://doi.org/10.1055/s-0039-1678607
- http://www.thieme-connect.de/products/ejournals/pdf/10.1055/s-0039-1678607.pdf
- OA Status
- bronze
- Cited By
- 49
- References
- 23
- Related Works
- 10
- OpenAlex ID
- https://openalex.org/W2920002200
All OpenAlex metadata
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W2920002200Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.1055/s-0039-1678607Digital Object Identifier
- Title
-
Evaluation of Secure Messaging Applications for a Health Care System: A Case StudyWork title
- Type
-
articleOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2019Year of publication
- Publication date
-
2019-01-01Full publication date if available
- Authors
-
Xinran Liu, Paul S. Sutton, Rory McKenna, Mika Sinanan, Benjamin Fellner, Michael G. Leu, Cris EwellList of authors in order
- Landing page
-
https://doi.org/10.1055/s-0039-1678607Publisher landing page
- PDF URL
-
https://www.thieme-connect.de/products/ejournals/pdf/10.1055/s-0039-1678607.pdfDirect link to full text PDF
- Open access
-
YesWhether a free full text is available
- OA status
-
bronzeOpen access status per OpenAlex
- OA URL
-
https://www.thieme-connect.de/products/ejournals/pdf/10.1055/s-0039-1678607.pdfDirect OA link when available
- Concepts
-
Computer science, Health Insurance Portability and Accountability Act, Workflow, Software portability, Vendor, Health care, World Wide Web, Protected health information, Computer security, Confidentiality, Health promotion, Database, Programming language, Economic growth, Marketing, Business, HRHIS, EconomicsTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
49Total citation count in OpenAlex
- Citations by year (recent)
-
2025: 12, 2024: 6, 2023: 9, 2022: 9, 2021: 6Per-year citation counts (last 5 years)
- References (count)
-
23Number of works referenced by this work
- Related works (count)
-
10Other works algorithmically related by OpenAlex
Full payload
| id | https://openalex.org/W2920002200 |
|---|---|
| doi | https://doi.org/10.1055/s-0039-1678607 |
| ids.doi | https://doi.org/10.1055/s-0039-1678607 |
| ids.mag | 2920002200 |
| ids.pmid | https://pubmed.ncbi.nlm.nih.gov/30812040 |
| ids.openalex | https://openalex.org/W2920002200 |
| fwci | 9.05873498 |
| mesh[0].qualifier_ui | |
| mesh[0].descriptor_ui | D016494 |
| mesh[0].is_major_topic | True |
| mesh[0].qualifier_name | |
| mesh[0].descriptor_name | Computer Security |
| mesh[1].qualifier_ui | Q000379 |
| mesh[1].descriptor_ui | D003695 |
| mesh[1].is_major_topic | False |
| mesh[1].qualifier_name | methods |
| mesh[1].descriptor_name | Delivery of Health Care |
| mesh[2].qualifier_ui | |
| mesh[2].descriptor_ui | D006801 |
| mesh[2].is_major_topic | False |
| mesh[2].qualifier_name | |
| mesh[2].descriptor_name | Humans |
| mesh[3].qualifier_ui | |
| mesh[3].descriptor_ui | D060145 |
| mesh[3].is_major_topic | True |
| mesh[3].qualifier_name | |
| mesh[3].descriptor_name | Text Messaging |
| mesh[4].qualifier_ui | |
| mesh[4].descriptor_ui | D016494 |
| mesh[4].is_major_topic | True |
| mesh[4].qualifier_name | |
| mesh[4].descriptor_name | Computer Security |
| mesh[5].qualifier_ui | Q000379 |
| mesh[5].descriptor_ui | D003695 |
| mesh[5].is_major_topic | False |
| mesh[5].qualifier_name | methods |
| mesh[5].descriptor_name | Delivery of Health Care |
| mesh[6].qualifier_ui | |
| mesh[6].descriptor_ui | D006801 |
| mesh[6].is_major_topic | False |
| mesh[6].qualifier_name | |
| mesh[6].descriptor_name | Humans |
| mesh[7].qualifier_ui | |
| mesh[7].descriptor_ui | D060145 |
| mesh[7].is_major_topic | True |
| mesh[7].qualifier_name | |
| mesh[7].descriptor_name | Text Messaging |
| type | article |
| title | Evaluation of Secure Messaging Applications for a Health Care System: A Case Study |
| biblio.issue | 01 |
| biblio.volume | 10 |
| biblio.last_page | 150 |
| biblio.first_page | 140 |
| topics[0].id | https://openalex.org/T11446 |
| topics[0].field.id | https://openalex.org/fields/36 |
| topics[0].field.display_name | Health Professions |
| topics[0].score | 0.9998000264167786 |
| topics[0].domain.id | https://openalex.org/domains/4 |
| topics[0].domain.display_name | Health Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/3600 |
| topics[0].subfield.display_name | General Health Professions |
| topics[0].display_name | Mobile Health and mHealth Applications |
| topics[1].id | https://openalex.org/T10350 |
| topics[1].field.id | https://openalex.org/fields/36 |
| topics[1].field.display_name | Health Professions |
| topics[1].score | 0.9894000291824341 |
| topics[1].domain.id | https://openalex.org/domains/4 |
| topics[1].domain.display_name | Health Sciences |
| topics[1].subfield.id | https://openalex.org/subfields/3605 |
| topics[1].subfield.display_name | Health Information Management |
| topics[1].display_name | Electronic Health Records Systems |
| topics[2].id | https://openalex.org/T11519 |
| topics[2].field.id | https://openalex.org/fields/32 |
| topics[2].field.display_name | Psychology |
| topics[2].score | 0.9781000018119812 |
| topics[2].domain.id | https://openalex.org/domains/2 |
| topics[2].domain.display_name | Social Sciences |
| topics[2].subfield.id | https://openalex.org/subfields/3202 |
| topics[2].subfield.display_name | Applied Psychology |
| topics[2].display_name | Digital Mental Health Interventions |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| concepts[0].id | https://openalex.org/C41008148 |
| concepts[0].level | 0 |
| concepts[0].score | 0.7119766473770142 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q21198 |
| concepts[0].display_name | Computer science |
| concepts[1].id | https://openalex.org/C2778306010 |
| concepts[1].level | 3 |
| concepts[1].score | 0.709242582321167 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q606563 |
| concepts[1].display_name | Health Insurance Portability and Accountability Act |
| concepts[2].id | https://openalex.org/C177212765 |
| concepts[2].level | 2 |
| concepts[2].score | 0.6625935435295105 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q627335 |
| concepts[2].display_name | Workflow |
| concepts[3].id | https://openalex.org/C63000827 |
| concepts[3].level | 2 |
| concepts[3].score | 0.6169119477272034 |
| concepts[3].wikidata | https://www.wikidata.org/wiki/Q3080428 |
| concepts[3].display_name | Software portability |
| concepts[4].id | https://openalex.org/C2777338717 |
| concepts[4].level | 2 |
| concepts[4].score | 0.5444255471229553 |
| concepts[4].wikidata | https://www.wikidata.org/wiki/Q1762621 |
| concepts[4].display_name | Vendor |
| concepts[5].id | https://openalex.org/C160735492 |
| concepts[5].level | 2 |
| concepts[5].score | 0.43899866938591003 |
| concepts[5].wikidata | https://www.wikidata.org/wiki/Q31207 |
| concepts[5].display_name | Health care |
| concepts[6].id | https://openalex.org/C136764020 |
| concepts[6].level | 1 |
| concepts[6].score | 0.436578631401062 |
| concepts[6].wikidata | https://www.wikidata.org/wiki/Q466 |
| concepts[6].display_name | World Wide Web |
| concepts[7].id | https://openalex.org/C133652896 |
| concepts[7].level | 5 |
| concepts[7].score | 0.4354398548603058 |
| concepts[7].wikidata | https://www.wikidata.org/wiki/Q7251300 |
| concepts[7].display_name | Protected health information |
| concepts[8].id | https://openalex.org/C38652104 |
| concepts[8].level | 1 |
| concepts[8].score | 0.38634419441223145 |
| concepts[8].wikidata | https://www.wikidata.org/wiki/Q3510521 |
| concepts[8].display_name | Computer security |
| concepts[9].id | https://openalex.org/C71745522 |
| concepts[9].level | 2 |
| concepts[9].score | 0.2531609535217285 |
| concepts[9].wikidata | https://www.wikidata.org/wiki/Q2476929 |
| concepts[9].display_name | Confidentiality |
| concepts[10].id | https://openalex.org/C185618831 |
| concepts[10].level | 3 |
| concepts[10].score | 0.11113986372947693 |
| concepts[10].wikidata | https://www.wikidata.org/wiki/Q1851928 |
| concepts[10].display_name | Health promotion |
| concepts[11].id | https://openalex.org/C77088390 |
| concepts[11].level | 1 |
| concepts[11].score | 0.09747937321662903 |
| concepts[11].wikidata | https://www.wikidata.org/wiki/Q8513 |
| concepts[11].display_name | Database |
| concepts[12].id | https://openalex.org/C199360897 |
| concepts[12].level | 1 |
| concepts[12].score | 0.0 |
| concepts[12].wikidata | https://www.wikidata.org/wiki/Q9143 |
| concepts[12].display_name | Programming language |
| concepts[13].id | https://openalex.org/C50522688 |
| concepts[13].level | 1 |
| concepts[13].score | 0.0 |
| concepts[13].wikidata | https://www.wikidata.org/wiki/Q189833 |
| concepts[13].display_name | Economic growth |
| concepts[14].id | https://openalex.org/C162853370 |
| concepts[14].level | 1 |
| concepts[14].score | 0.0 |
| concepts[14].wikidata | https://www.wikidata.org/wiki/Q39809 |
| concepts[14].display_name | Marketing |
| concepts[15].id | https://openalex.org/C144133560 |
| concepts[15].level | 0 |
| concepts[15].score | 0.0 |
| concepts[15].wikidata | https://www.wikidata.org/wiki/Q4830453 |
| concepts[15].display_name | Business |
| concepts[16].id | https://openalex.org/C147268084 |
| concepts[16].level | 4 |
| concepts[16].score | 0.0 |
| concepts[16].wikidata | https://www.wikidata.org/wiki/Q5635796 |
| concepts[16].display_name | HRHIS |
| concepts[17].id | https://openalex.org/C162324750 |
| concepts[17].level | 0 |
| concepts[17].score | 0.0 |
| concepts[17].wikidata | https://www.wikidata.org/wiki/Q8134 |
| concepts[17].display_name | Economics |
| keywords[0].id | https://openalex.org/keywords/computer-science |
| keywords[0].score | 0.7119766473770142 |
| keywords[0].display_name | Computer science |
| keywords[1].id | https://openalex.org/keywords/health-insurance-portability-and-accountability-act |
| keywords[1].score | 0.709242582321167 |
| keywords[1].display_name | Health Insurance Portability and Accountability Act |
| keywords[2].id | https://openalex.org/keywords/workflow |
| keywords[2].score | 0.6625935435295105 |
| keywords[2].display_name | Workflow |
| keywords[3].id | https://openalex.org/keywords/software-portability |
| keywords[3].score | 0.6169119477272034 |
| keywords[3].display_name | Software portability |
| keywords[4].id | https://openalex.org/keywords/vendor |
| keywords[4].score | 0.5444255471229553 |
| keywords[4].display_name | Vendor |
| keywords[5].id | https://openalex.org/keywords/health-care |
| keywords[5].score | 0.43899866938591003 |
| keywords[5].display_name | Health care |
| keywords[6].id | https://openalex.org/keywords/world-wide-web |
| keywords[6].score | 0.436578631401062 |
| keywords[6].display_name | World Wide Web |
| keywords[7].id | https://openalex.org/keywords/protected-health-information |
| keywords[7].score | 0.4354398548603058 |
| keywords[7].display_name | Protected health information |
| keywords[8].id | https://openalex.org/keywords/computer-security |
| keywords[8].score | 0.38634419441223145 |
| keywords[8].display_name | Computer security |
| keywords[9].id | https://openalex.org/keywords/confidentiality |
| keywords[9].score | 0.2531609535217285 |
| keywords[9].display_name | Confidentiality |
| keywords[10].id | https://openalex.org/keywords/health-promotion |
| keywords[10].score | 0.11113986372947693 |
| keywords[10].display_name | Health promotion |
| keywords[11].id | https://openalex.org/keywords/database |
| keywords[11].score | 0.09747937321662903 |
| keywords[11].display_name | Database |
| language | en |
| locations[0].id | doi:10.1055/s-0039-1678607 |
| locations[0].is_oa | True |
| locations[0].source.id | https://openalex.org/S187139995 |
| locations[0].source.issn | 1869-0327 |
| locations[0].source.type | journal |
| locations[0].source.is_oa | False |
| locations[0].source.issn_l | 1869-0327 |
| locations[0].source.is_core | True |
| locations[0].source.is_in_doaj | False |
| locations[0].source.display_name | Applied Clinical Informatics |
| locations[0].source.host_organization | https://openalex.org/P4310320000 |
| locations[0].source.host_organization_name | Thieme Medical Publishers (Germany) |
| locations[0].source.host_organization_lineage | https://openalex.org/P4310320000 |
| locations[0].source.host_organization_lineage_names | Thieme Medical Publishers (Germany) |
| locations[0].license | |
| locations[0].pdf_url | http://www.thieme-connect.de/products/ejournals/pdf/10.1055/s-0039-1678607.pdf |
| locations[0].version | publishedVersion |
| locations[0].raw_type | journal-article |
| locations[0].license_id | |
| locations[0].is_accepted | True |
| locations[0].is_published | True |
| locations[0].raw_source_name | Applied Clinical Informatics |
| locations[0].landing_page_url | https://doi.org/10.1055/s-0039-1678607 |
| locations[1].id | pmid:30812040 |
| locations[1].is_oa | False |
| locations[1].source.id | https://openalex.org/S4306525036 |
| locations[1].source.issn | |
| locations[1].source.type | repository |
| locations[1].source.is_oa | False |
| locations[1].source.issn_l | |
| locations[1].source.is_core | False |
| locations[1].source.is_in_doaj | False |
| locations[1].source.display_name | PubMed |
| locations[1].source.host_organization | https://openalex.org/I1299303238 |
| locations[1].source.host_organization_name | National Institutes of Health |
| locations[1].source.host_organization_lineage | https://openalex.org/I1299303238 |
| locations[1].license | |
| locations[1].pdf_url | |
| locations[1].version | publishedVersion |
| locations[1].raw_type | |
| locations[1].license_id | |
| locations[1].is_accepted | True |
| locations[1].is_published | True |
| locations[1].raw_source_name | Applied clinical informatics |
| locations[1].landing_page_url | https://pubmed.ncbi.nlm.nih.gov/30812040 |
| locations[2].id | pmh:oai:europepmc.org:5891186 |
| locations[2].is_oa | False |
| locations[2].source.id | https://openalex.org/S4306400806 |
| locations[2].source.issn | |
| locations[2].source.type | repository |
| locations[2].source.is_oa | False |
| locations[2].source.issn_l | |
| locations[2].source.is_core | False |
| locations[2].source.is_in_doaj | False |
| locations[2].source.display_name | Europe PMC (PubMed Central) |
| locations[2].source.host_organization | https://openalex.org/I1303153112 |
| locations[2].source.host_organization_name | European Bioinformatics Institute |
| locations[2].source.host_organization_lineage | https://openalex.org/I1303153112 |
| locations[2].license | |
| locations[2].pdf_url | |
| locations[2].version | submittedVersion |
| locations[2].raw_type | Text |
| locations[2].license_id | |
| locations[2].is_accepted | False |
| locations[2].is_published | False |
| locations[2].raw_source_name | |
| locations[2].landing_page_url | https://www.ncbi.nlm.nih.gov/pmc/articles/6393161 |
| indexed_in | crossref, pubmed |
| authorships[0].author.id | https://openalex.org/A5119564597 |
| authorships[0].author.orcid | https://orcid.org/0000-0003-0692-9534 |
| authorships[0].author.display_name | Xinran Liu |
| authorships[0].countries | US |
| authorships[0].affiliations[0].institution_ids | https://openalex.org/I2801852214 |
| authorships[0].affiliations[0].raw_affiliation_string | Department of Biomedical Informatics and Medical Education, University of Washington, Seattle, Washington, United States |
| authorships[0].affiliations[1].institution_ids | https://openalex.org/I201448701 |
| authorships[0].affiliations[1].raw_affiliation_string | University of Washington Information Technology Services, Seattle, Washington, United States |
| authorships[0].affiliations[2].institution_ids | https://openalex.org/I201448701 |
| authorships[0].affiliations[2].raw_affiliation_string | Department of Internal Medicine, University of Washington, Seattle, Washington, United States |
| authorships[0].institutions[0].id | https://openalex.org/I201448701 |
| authorships[0].institutions[0].ror | https://ror.org/00cvxb145 |
| authorships[0].institutions[0].type | education |
| authorships[0].institutions[0].lineage | https://openalex.org/I201448701 |
| authorships[0].institutions[0].country_code | US |
| authorships[0].institutions[0].display_name | University of Washington |
| authorships[0].institutions[1].id | https://openalex.org/I2801852214 |
| authorships[0].institutions[1].ror | https://ror.org/00wbzw723 |
| authorships[0].institutions[1].type | healthcare |
| authorships[0].institutions[1].lineage | https://openalex.org/I2801852214 |
| authorships[0].institutions[1].country_code | US |
| authorships[0].institutions[1].display_name | University of Washington Medical Center |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Xinran Liu |
| authorships[0].is_corresponding | False |
| authorships[0].raw_affiliation_strings | Department of Biomedical Informatics and Medical Education, University of Washington, Seattle, Washington, United States, Department of Internal Medicine, University of Washington, Seattle, Washington, United States, University of Washington Information Technology Services, Seattle, Washington, United States |
| authorships[1].author.id | https://openalex.org/A5020123088 |
| authorships[1].author.orcid | https://orcid.org/0000-0003-4409-2923 |
| authorships[1].author.display_name | Paul S. Sutton |
| authorships[1].countries | US |
| authorships[1].affiliations[0].institution_ids | https://openalex.org/I201448701 |
| authorships[1].affiliations[0].raw_affiliation_string | Department of Internal Medicine, University of Washington, Seattle, Washington, United States |
| authorships[1].affiliations[1].institution_ids | https://openalex.org/I201448701 |
| authorships[1].affiliations[1].raw_affiliation_string | University of Washington Information Technology Services, Seattle, Washington, United States |
| authorships[1].institutions[0].id | https://openalex.org/I201448701 |
| authorships[1].institutions[0].ror | https://ror.org/00cvxb145 |
| authorships[1].institutions[0].type | education |
| authorships[1].institutions[0].lineage | https://openalex.org/I201448701 |
| authorships[1].institutions[0].country_code | US |
| authorships[1].institutions[0].display_name | University of Washington |
| authorships[1].author_position | middle |
| authorships[1].raw_author_name | Paul Sutton |
| authorships[1].is_corresponding | False |
| authorships[1].raw_affiliation_strings | Department of Internal Medicine, University of Washington, Seattle, Washington, United States, University of Washington Information Technology Services, Seattle, Washington, United States |
| authorships[2].author.id | https://openalex.org/A5019949316 |
| authorships[2].author.orcid | |
| authorships[2].author.display_name | Rory McKenna |
| authorships[2].countries | US |
| authorships[2].affiliations[0].institution_ids | https://openalex.org/I201448701 |
| authorships[2].affiliations[0].raw_affiliation_string | Department of Telecommunications, University of Washington, Seattle, Washington, United States |
| authorships[2].institutions[0].id | https://openalex.org/I201448701 |
| authorships[2].institutions[0].ror | https://ror.org/00cvxb145 |
| authorships[2].institutions[0].type | education |
| authorships[2].institutions[0].lineage | https://openalex.org/I201448701 |
| authorships[2].institutions[0].country_code | US |
| authorships[2].institutions[0].display_name | University of Washington |
| authorships[2].author_position | middle |
| authorships[2].raw_author_name | Rory McKenna |
| authorships[2].is_corresponding | False |
| authorships[2].raw_affiliation_strings | Department of Telecommunications, University of Washington, Seattle, Washington, United States |
| authorships[3].author.id | https://openalex.org/A5083202346 |
| authorships[3].author.orcid | https://orcid.org/0000-0001-5304-9236 |
| authorships[3].author.display_name | Mika Sinanan |
| authorships[3].countries | US |
| authorships[3].affiliations[0].institution_ids | https://openalex.org/I201448701 |
| authorships[3].affiliations[0].raw_affiliation_string | Department of Surgery, University of Washington, Seattle, Washington, United States |
| authorships[3].institutions[0].id | https://openalex.org/I201448701 |
| authorships[3].institutions[0].ror | https://ror.org/00cvxb145 |
| authorships[3].institutions[0].type | education |
| authorships[3].institutions[0].lineage | https://openalex.org/I201448701 |
| authorships[3].institutions[0].country_code | US |
| authorships[3].institutions[0].display_name | University of Washington |
| authorships[3].author_position | middle |
| authorships[3].raw_author_name | Mika Sinanan |
| authorships[3].is_corresponding | False |
| authorships[3].raw_affiliation_strings | Department of Surgery, University of Washington, Seattle, Washington, United States |
| authorships[4].author.id | https://openalex.org/A5064021425 |
| authorships[4].author.orcid | |
| authorships[4].author.display_name | Benjamin Fellner |
| authorships[4].countries | US |
| authorships[4].affiliations[0].institution_ids | https://openalex.org/I201448701 |
| authorships[4].affiliations[0].raw_affiliation_string | University of Washington Information Technology Services, Seattle, Washington, United States |
| authorships[4].affiliations[1].institution_ids | https://openalex.org/I201448701 |
| authorships[4].affiliations[1].raw_affiliation_string | Department of Family Medicine, University of Washington, Seattle, Washington, United States |
| authorships[4].institutions[0].id | https://openalex.org/I201448701 |
| authorships[4].institutions[0].ror | https://ror.org/00cvxb145 |
| authorships[4].institutions[0].type | education |
| authorships[4].institutions[0].lineage | https://openalex.org/I201448701 |
| authorships[4].institutions[0].country_code | US |
| authorships[4].institutions[0].display_name | University of Washington |
| authorships[4].author_position | middle |
| authorships[4].raw_author_name | B. Fellner |
| authorships[4].is_corresponding | False |
| authorships[4].raw_affiliation_strings | Department of Family Medicine, University of Washington, Seattle, Washington, United States, University of Washington Information Technology Services, Seattle, Washington, United States |
| authorships[5].author.id | https://openalex.org/A5051096329 |
| authorships[5].author.orcid | |
| authorships[5].author.display_name | Michael G. Leu |
| authorships[5].countries | US |
| authorships[5].affiliations[0].institution_ids | https://openalex.org/I201448701 |
| authorships[5].affiliations[0].raw_affiliation_string | Department of Pediatrics, University of Washington, Seattle, Washington, United States |
| authorships[5].affiliations[1].institution_ids | https://openalex.org/I2801852214 |
| authorships[5].affiliations[1].raw_affiliation_string | Department of Biomedical Informatics and Medical Education, University of Washington, Seattle, Washington, United States |
| authorships[5].affiliations[2].institution_ids | https://openalex.org/I201448701 |
| authorships[5].affiliations[2].raw_affiliation_string | University of Washington Information Technology Services, Seattle, Washington, United States |
| authorships[5].institutions[0].id | https://openalex.org/I201448701 |
| authorships[5].institutions[0].ror | https://ror.org/00cvxb145 |
| authorships[5].institutions[0].type | education |
| authorships[5].institutions[0].lineage | https://openalex.org/I201448701 |
| authorships[5].institutions[0].country_code | US |
| authorships[5].institutions[0].display_name | University of Washington |
| authorships[5].institutions[1].id | https://openalex.org/I2801852214 |
| authorships[5].institutions[1].ror | https://ror.org/00wbzw723 |
| authorships[5].institutions[1].type | healthcare |
| authorships[5].institutions[1].lineage | https://openalex.org/I2801852214 |
| authorships[5].institutions[1].country_code | US |
| authorships[5].institutions[1].display_name | University of Washington Medical Center |
| authorships[5].author_position | middle |
| authorships[5].raw_author_name | Michael Leu |
| authorships[5].is_corresponding | False |
| authorships[5].raw_affiliation_strings | Department of Biomedical Informatics and Medical Education, University of Washington, Seattle, Washington, United States, Department of Pediatrics, University of Washington, Seattle, Washington, United States, University of Washington Information Technology Services, Seattle, Washington, United States |
| authorships[6].author.id | https://openalex.org/A5058623671 |
| authorships[6].author.orcid | |
| authorships[6].author.display_name | Cris Ewell |
| authorships[6].countries | US |
| authorships[6].affiliations[0].institution_ids | https://openalex.org/I201448701 |
| authorships[6].affiliations[0].raw_affiliation_string | University of Washington Information Technology Services, Seattle, Washington, United States |
| authorships[6].institutions[0].id | https://openalex.org/I201448701 |
| authorships[6].institutions[0].ror | https://ror.org/00cvxb145 |
| authorships[6].institutions[0].type | education |
| authorships[6].institutions[0].lineage | https://openalex.org/I201448701 |
| authorships[6].institutions[0].country_code | US |
| authorships[6].institutions[0].display_name | University of Washington |
| authorships[6].author_position | last |
| authorships[6].raw_author_name | Cris Ewell |
| authorships[6].is_corresponding | False |
| authorships[6].raw_affiliation_strings | University of Washington Information Technology Services, Seattle, Washington, United States |
| has_content.pdf | True |
| has_content.grobid_xml | True |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | http://www.thieme-connect.de/products/ejournals/pdf/10.1055/s-0039-1678607.pdf |
| open_access.oa_status | bronze |
| open_access.any_repository_has_fulltext | False |
| created_date | 2025-10-10T00:00:00 |
| display_name | Evaluation of Secure Messaging Applications for a Health Care System: A Case Study |
| has_fulltext | True |
| is_retracted | False |
| updated_date | 2025-11-06T03:46:38.306776 |
| primary_topic.id | https://openalex.org/T11446 |
| primary_topic.field.id | https://openalex.org/fields/36 |
| primary_topic.field.display_name | Health Professions |
| primary_topic.score | 0.9998000264167786 |
| primary_topic.domain.id | https://openalex.org/domains/4 |
| primary_topic.domain.display_name | Health Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/3600 |
| primary_topic.subfield.display_name | General Health Professions |
| primary_topic.display_name | Mobile Health and mHealth Applications |
| related_works | https://openalex.org/W4301229064, https://openalex.org/W4388893881, https://openalex.org/W2101632871, https://openalex.org/W1963768196, https://openalex.org/W2110275798, https://openalex.org/W2412384041, https://openalex.org/W2396740917, https://openalex.org/W3007566991, https://openalex.org/W2009386163, https://openalex.org/W2620869127 |
| cited_by_count | 49 |
| counts_by_year[0].year | 2025 |
| counts_by_year[0].cited_by_count | 12 |
| counts_by_year[1].year | 2024 |
| counts_by_year[1].cited_by_count | 6 |
| counts_by_year[2].year | 2023 |
| counts_by_year[2].cited_by_count | 9 |
| counts_by_year[3].year | 2022 |
| counts_by_year[3].cited_by_count | 9 |
| counts_by_year[4].year | 2021 |
| counts_by_year[4].cited_by_count | 6 |
| counts_by_year[5].year | 2020 |
| counts_by_year[5].cited_by_count | 2 |
| counts_by_year[6].year | 2019 |
| counts_by_year[6].cited_by_count | 3 |
| counts_by_year[7].year | 2018 |
| counts_by_year[7].cited_by_count | 1 |
| locations_count | 3 |
| best_oa_location.id | doi:10.1055/s-0039-1678607 |
| best_oa_location.is_oa | True |
| best_oa_location.source.id | https://openalex.org/S187139995 |
| best_oa_location.source.issn | 1869-0327 |
| best_oa_location.source.type | journal |
| best_oa_location.source.is_oa | False |
| best_oa_location.source.issn_l | 1869-0327 |
| best_oa_location.source.is_core | True |
| best_oa_location.source.is_in_doaj | False |
| best_oa_location.source.display_name | Applied Clinical Informatics |
| best_oa_location.source.host_organization | https://openalex.org/P4310320000 |
| best_oa_location.source.host_organization_name | Thieme Medical Publishers (Germany) |
| best_oa_location.source.host_organization_lineage | https://openalex.org/P4310320000 |
| best_oa_location.source.host_organization_lineage_names | Thieme Medical Publishers (Germany) |
| best_oa_location.license | |
| best_oa_location.pdf_url | http://www.thieme-connect.de/products/ejournals/pdf/10.1055/s-0039-1678607.pdf |
| best_oa_location.version | publishedVersion |
| best_oa_location.raw_type | journal-article |
| best_oa_location.license_id | |
| best_oa_location.is_accepted | True |
| best_oa_location.is_published | True |
| best_oa_location.raw_source_name | Applied Clinical Informatics |
| best_oa_location.landing_page_url | https://doi.org/10.1055/s-0039-1678607 |
| primary_location.id | doi:10.1055/s-0039-1678607 |
| primary_location.is_oa | True |
| primary_location.source.id | https://openalex.org/S187139995 |
| primary_location.source.issn | 1869-0327 |
| primary_location.source.type | journal |
| primary_location.source.is_oa | False |
| primary_location.source.issn_l | 1869-0327 |
| primary_location.source.is_core | True |
| primary_location.source.is_in_doaj | False |
| primary_location.source.display_name | Applied Clinical Informatics |
| primary_location.source.host_organization | https://openalex.org/P4310320000 |
| primary_location.source.host_organization_name | Thieme Medical Publishers (Germany) |
| primary_location.source.host_organization_lineage | https://openalex.org/P4310320000 |
| primary_location.source.host_organization_lineage_names | Thieme Medical Publishers (Germany) |
| primary_location.license | |
| primary_location.pdf_url | http://www.thieme-connect.de/products/ejournals/pdf/10.1055/s-0039-1678607.pdf |
| primary_location.version | publishedVersion |
| primary_location.raw_type | journal-article |
| primary_location.license_id | |
| primary_location.is_accepted | True |
| primary_location.is_published | True |
| primary_location.raw_source_name | Applied Clinical Informatics |
| primary_location.landing_page_url | https://doi.org/10.1055/s-0039-1678607 |
| publication_date | 2019-01-01 |
| publication_year | 2019 |
| referenced_works | https://openalex.org/W1996298679, https://openalex.org/W2606392219, https://openalex.org/W2038335020, https://openalex.org/W4292983986, https://openalex.org/W2337485826, https://openalex.org/W2504838905, https://openalex.org/W2620670582, https://openalex.org/W2312000225, https://openalex.org/W3035058834, https://openalex.org/W1508796064, https://openalex.org/W2722360008, https://openalex.org/W2515682654, https://openalex.org/W2766134301, https://openalex.org/W2738201146, https://openalex.org/W2101632871, https://openalex.org/W2340929530, https://openalex.org/W1833865265, https://openalex.org/W2184224772, https://openalex.org/W4236420350, https://openalex.org/W2752099845, https://openalex.org/W1559365618, https://openalex.org/W1592984616, https://openalex.org/W2736256999 |
| referenced_works_count | 23 |
| abstract_inverted_index.a | 44, 164, 201, 237 |
| abstract_inverted_index.19 | 100, 147 |
| abstract_inverted_index.We | 98, 141, 222 |
| abstract_inverted_index.an | 35, 113 |
| abstract_inverted_index.as | 41, 43 |
| abstract_inverted_index.be | 171, 229 |
| abstract_inverted_index.by | 231 |
| abstract_inverted_index.in | 6, 173 |
| abstract_inverted_index.of | 3, 37, 73, 146 |
| abstract_inverted_index.on | 70 |
| abstract_inverted_index.to | 13, 48, 91, 129, 149, 156, 180, 216, 235 |
| abstract_inverted_index.Act | 207 |
| abstract_inverted_index.Due | 12 |
| abstract_inverted_index.Our | 123 |
| abstract_inverted_index.The | 1 |
| abstract_inverted_index.Web | 60 |
| abstract_inverted_index.and | 15, 33, 66, 82, 117, 120, 132, 193, 205, 212, 220 |
| abstract_inverted_index.are | 21 |
| abstract_inverted_index.can | 228 |
| abstract_inverted_index.for | 46, 85 |
| abstract_inverted_index.has | 9 |
| abstract_inverted_index.how | 47 |
| abstract_inverted_index.our | 30, 86, 94, 144, 225 |
| abstract_inverted_index.own | 190 |
| abstract_inverted_index.the | 158 |
| abstract_inverted_index.use | 2, 67, 154 |
| abstract_inverted_index.This | 27 |
| abstract_inverted_index.When | 162 |
| abstract_inverted_index.also | 213 |
| abstract_inverted_index.care | 8 |
| abstract_inverted_index.find | 236 |
| abstract_inverted_index.help | 92 |
| abstract_inverted_index.hope | 223 |
| abstract_inverted_index.into | 78, 104 |
| abstract_inverted_index.list | 145 |
| abstract_inverted_index.many | 18 |
| abstract_inverted_index.must | 170 |
| abstract_inverted_index.rank | 157 |
| abstract_inverted_index.such | 50 |
| abstract_inverted_index.text | 4, 24, 183 |
| abstract_inverted_index.that | 224, 241 |
| abstract_inverted_index.then | 142, 151 |
| abstract_inverted_index.used | 230 |
| abstract_inverted_index.well | 42 |
| abstract_inverted_index.were | 55, 76, 89, 137 |
| abstract_inverted_index.what | 177 |
| abstract_inverted_index.with | 63 |
| abstract_inverted_index.your | 189 |
| abstract_inverted_index.Based | 69 |
| abstract_inverted_index.These | 175 |
| abstract_inverted_index.Wi-Fi | 194 |
| abstract_inverted_index.basic | 107 |
| abstract_inverted_index.bring | 188 |
| abstract_inverted_index.cases | 155 |
| abstract_inverted_index.final | 159 |
| abstract_inverted_index.four, | 150 |
| abstract_inverted_index.meets | 242 |
| abstract_inverted_index.other | 232 |
| abstract_inverted_index.paper | 28 |
| abstract_inverted_index.their | 243 |
| abstract_inverted_index.three | 79, 105 |
| abstract_inverted_index.while | 134 |
| abstract_inverted_index.Health | 202 |
| abstract_inverted_index.Secure | 197 |
| abstract_inverted_index.around | 127 |
| abstract_inverted_index.become | 10 |
| abstract_inverted_index.cases. | 68 |
| abstract_inverted_index.device | 186, 191 |
| abstract_inverted_index.health | 87, 233 |
| abstract_inverted_index.levels | 72 |
| abstract_inverted_index.mobile | 185 |
| abstract_inverted_index.mostly | 138 |
| abstract_inverted_index.narrow | 93 |
| abstract_inverted_index.needs. | 244 |
| abstract_inverted_index.offers | 34 |
| abstract_inverted_index.secure | 23, 38, 101, 108, 110, 165, 238 |
| abstract_inverted_index.sites, | 61 |
| abstract_inverted_index.system | 88 |
| abstract_inverted_index.tiers. | 80 |
| abstract_inverted_index.tiers: | 106 |
| abstract_inverted_index.vendor | 95 |
| abstract_inverted_index.within | 112 |
| abstract_inverted_index.(HIPAA) | 208 |
| abstract_inverted_index.Methods | 52 |
| abstract_inverted_index.Results | 97 |
| abstract_inverted_index.created | 152 |
| abstract_inverted_index.defined | 90 |
| abstract_inverted_index.enhance | 130 |
| abstract_inverted_index.factors | 169 |
| abstract_inverted_index.grouped | 77 |
| abstract_inverted_index.improve | 217 |
| abstract_inverted_index.include | 214 |
| abstract_inverted_index.policy, | 192 |
| abstract_inverted_index.privacy | 16 |
| abstract_inverted_index.provide | 200 |
| abstract_inverted_index.review, | 59 |
| abstract_inverted_index.similar | 71 |
| abstract_inverted_index.systems | 20, 234 |
| abstract_inverted_index.through | 57 |
| abstract_inverted_index.vendors | 75, 103, 148 |
| abstract_inverted_index.advanced | 135 |
| abstract_inverted_index.choices. | 96 |
| abstract_inverted_index.clinical | 7, 115, 153, 178, 218 |
| abstract_inverted_index.evaluate | 49 |
| abstract_inverted_index.existing | 114 |
| abstract_inverted_index.gathered | 56 |
| abstract_inverted_index.hospital | 19 |
| abstract_inverted_index.improve, | 181 |
| abstract_inverted_index.include: | 176 |
| abstract_inverted_index.narrowed | 143 |
| abstract_inverted_index.numerous | 168 |
| abstract_inverted_index.overview | 36 |
| abstract_inverted_index.process, | 32 |
| abstract_inverted_index.revolved | 126 |
| abstract_inverted_index.security | 14, 131 |
| abstract_inverted_index.speaking | 62 |
| abstract_inverted_index.systems. | 122 |
| abstract_inverted_index.vendors. | 160 |
| abstract_inverted_index.Essential | 81 |
| abstract_inverted_index.Insurance | 203 |
| abstract_inverted_index.Objective | 0 |
| abstract_inverted_index.archiving | 182 |
| abstract_inverted_index.compliant | 209 |
| abstract_inverted_index.concerns, | 17 |
| abstract_inverted_index.dedicated | 118 |
| abstract_inverted_index.essential | 124 |
| abstract_inverted_index.framework | 45, 227 |
| abstract_inverted_index.messages, | 184 |
| abstract_inverted_index.messaging | 5, 25, 39, 102, 166, 198, 239 |
| abstract_inverted_index.parallel. | 174 |
| abstract_inverted_index.platform, | 211 |
| abstract_inverted_index.processes | 179 |
| abstract_inverted_index.secondary | 83 |
| abstract_inverted_index.workflow. | 221 |
| abstract_inverted_index.Conclusion | 196 |
| abstract_inverted_index.Discussion | 161 |
| abstract_inverted_index.considered | 139, 172 |
| abstract_inverted_index.evaluating | 22, 163 |
| abstract_inverted_index.evaluation | 31, 226 |
| abstract_inverted_index.highlights | 29 |
| abstract_inverted_index.literature | 58 |
| abstract_inverted_index.secondary. | 140 |
| abstract_inverted_index.stratified | 99 |
| abstract_inverted_index.Application | 53 |
| abstract_inverted_index.Portability | 204 |
| abstract_inverted_index.application | 240 |
| abstract_inverted_index.management, | 187 |
| abstract_inverted_index.ubiquitous. | 11 |
| abstract_inverted_index.application, | 116, 167 |
| abstract_inverted_index.applications | 199 |
| abstract_inverted_index.requirements | 125 |
| abstract_inverted_index.applications. | 26, 51 |
| abstract_inverted_index.architecture. | 195 |
| abstract_inverted_index.collaboration | 121, 219 |
| abstract_inverted_index.communication | 111, 119, 210 |
| abstract_inverted_index.functionality | 215 |
| abstract_inverted_index.Accountability | 206 |
| abstract_inverted_index.communication, | 109, 133 |
| abstract_inverted_index.demonstrations, | 65 |
| abstract_inverted_index.functionalities | 54, 84, 128, 136 |
| abstract_inverted_index.functionalities, | 40, 74 |
| abstract_inverted_index.representatives, | 64 |
| cited_by_percentile_year.max | 99 |
| cited_by_percentile_year.min | 90 |
| countries_distinct_count | 1 |
| institutions_distinct_count | 7 |
| citation_normalized_percentile.value | 0.97087603 |
| citation_normalized_percentile.is_in_top_1_percent | False |
| citation_normalized_percentile.is_in_top_10_percent | True |