Assessing the Usability of Complex Psychosocial Interventions: The Intervention Usability Scale Article Swipe
Aaron R. Lyon
,
Michael D. Pullmann
,
Jedediah Jacobson
,
Katie Osterhage
,
Morhaf Al Achkar
,
Brenna N. Renn
,
Sean A. Munson
,
Patricia A. Areán
·
YOU?
·
· 2020
· Open Access
·
· DOI: https://doi.org/10.21203/rs.3.rs-20758/v2
YOU?
·
· 2020
· Open Access
·
· DOI: https://doi.org/10.21203/rs.3.rs-20758/v2
BackgroundUsability – the extent to which an intervention can be used by specified users to achieve specified goals with effectiveness, efficiency, and satisfaction – is a key determinant of implementation success. However, usability is rarely assessed in implementation research and no instruments have been developed to measure the design quality of complex health interventions, such as the evidence-based psychosocial interventions that characterize the majority of effective practices in mental and behavioral health services. This study evaluated the structural validity of the Intervention Usability Scale (IUS), an adapted version of the well-established System Usability Scale for digital technologies, when measuring the usability of complex health interventions. Prior studies of the original System Usability Scale have found both one- and two-factor solutions, both of which were examined in the current study of the IUS.MethodsA survey was administered to 205 healthcare professionals working at 11 primary care sites. Surveys collected demographic information, including each participant’s professional role (i.e., medical provider, mental/behavioral health provider, pharmacist), and IUS ratings for one of six common evidence-based psychosocial interventions (e.g., cognitive behavioral therapy, motivational interviewing) that they reported using most regularly. Factor analyses replicated the procedures used in prior research on the System Usability Scale, and a sensitivity analysis using analyses of variance compared IUS scores across different groups of respondents and interventions assessed.ResultsAnalyses indicated that a two-factor solution (with “usable” and “learnable” subscales) in which one item was removed best fit the data. This solution accounted for 52.6% of the variance observed. Inter-item reliabilities for the total score, usable subscale, and learnable subscale were α = .83, α = .82, and α = .63, respectively. Resulting scores indicated that usability ranged from below acceptable standards to good, depending on the intervention. On average, behavioral health providers found the interventions to be more usable that other types of healthcare providers.ConclusionsThe current study provides evidence for a two-factor IUS structure consistent with some prior research, as well as acceptable reliability and sensitivity to role and intervention. Future directions for implementation research evaluating the usability of complex health interventions are discussed.Contributions to the Literature• The ease with which interventions can be readily adopted by service providers is a key predictor of implementation success, but very little implementation research has attended to intervention usability.• No instruments exist to evaluate the usability of complex health interventions, such as the evidence-based practices that are commonly used to integrate mental and behavioral health services into primary care.• The current study evaluated the first instrument for assessing the usability of complex health interventions and found that its factor structure replicated some research with the original version of the instrument, a scale developed to assess the usability of digital systems.
Related Topics
Concepts
Metadata
- Type
- preprint
- Language
- en
- Landing Page
- https://doi.org/10.21203/rs.3.rs-20758/v2
- OA Status
- gold
- Cited By
- 16
- References
- 36
- Related Works
- 10
- OpenAlex ID
- https://openalex.org/W4231262474
All OpenAlex metadata
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W4231262474Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.21203/rs.3.rs-20758/v2Digital Object Identifier
- Title
-
Assessing the Usability of Complex Psychosocial Interventions: The Intervention Usability ScaleWork title
- Type
-
preprintOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2020Year of publication
- Publication date
-
2020-04-15Full publication date if available
- Authors
-
Aaron R. Lyon, Michael D. Pullmann, Jedediah Jacobson, Katie Osterhage, Morhaf Al Achkar, Brenna N. Renn, Sean A. Munson, Patricia A. AreánList of authors in order
- Landing page
-
https://doi.org/10.21203/rs.3.rs-20758/v2Publisher landing page
- Open access
-
YesWhether a free full text is available
- OA status
-
goldOpen access status per OpenAlex
- OA URL
-
https://doi.org/10.21203/rs.3.rs-20758/v2Direct OA link when available
- Concepts
-
Usability, System usability scale, Psychological intervention, Psychosocial, Intervention (counseling), Scale (ratio), Web usability, Psychology, Computer science, Human–computer interaction, Psychotherapist, Geography, Psychiatry, CartographyTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
16Total citation count in OpenAlex
- Citations by year (recent)
-
2025: 1, 2024: 3, 2023: 9, 2022: 2, 2021: 1Per-year citation counts (last 5 years)
- References (count)
-
36Number of works referenced by this work
- Related works (count)
-
10Other works algorithmically related by OpenAlex
Full payload
| id | https://openalex.org/W4231262474 |
|---|---|
| doi | https://doi.org/10.21203/rs.3.rs-20758/v2 |
| ids.doi | https://doi.org/10.21203/rs.3.rs-20758/v2 |
| ids.openalex | https://openalex.org/W4231262474 |
| fwci | 3.60806149 |
| type | preprint |
| title | Assessing the Usability of Complex Psychosocial Interventions: The Intervention Usability Scale |
| biblio.issue | |
| biblio.volume | |
| biblio.last_page | |
| biblio.first_page | |
| topics[0].id | https://openalex.org/T10629 |
| topics[0].field.id | https://openalex.org/fields/36 |
| topics[0].field.display_name | Health Professions |
| topics[0].score | 0.9944000244140625 |
| topics[0].domain.id | https://openalex.org/domains/4 |
| topics[0].domain.display_name | Health Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/3600 |
| topics[0].subfield.display_name | General Health Professions |
| topics[0].display_name | Health Policy Implementation Science |
| topics[1].id | https://openalex.org/T11519 |
| topics[1].field.id | https://openalex.org/fields/32 |
| topics[1].field.display_name | Psychology |
| topics[1].score | 0.9843000173568726 |
| topics[1].domain.id | https://openalex.org/domains/2 |
| topics[1].domain.display_name | Social Sciences |
| topics[1].subfield.id | https://openalex.org/subfields/3202 |
| topics[1].subfield.display_name | Applied Psychology |
| topics[1].display_name | Digital Mental Health Interventions |
| topics[2].id | https://openalex.org/T10272 |
| topics[2].field.id | https://openalex.org/fields/32 |
| topics[2].field.display_name | Psychology |
| topics[2].score | 0.957099974155426 |
| topics[2].domain.id | https://openalex.org/domains/2 |
| topics[2].domain.display_name | Social Sciences |
| topics[2].subfield.id | https://openalex.org/subfields/3207 |
| topics[2].subfield.display_name | Social Psychology |
| topics[2].display_name | Mental Health Treatment and Access |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| concepts[0].id | https://openalex.org/C170130773 |
| concepts[0].level | 2 |
| concepts[0].score | 0.9303073883056641 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q216378 |
| concepts[0].display_name | Usability |
| concepts[1].id | https://openalex.org/C139225968 |
| concepts[1].level | 4 |
| concepts[1].score | 0.6730013489723206 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q17146354 |
| concepts[1].display_name | System usability scale |
| concepts[2].id | https://openalex.org/C27415008 |
| concepts[2].level | 2 |
| concepts[2].score | 0.6102815270423889 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q7256382 |
| concepts[2].display_name | Psychological intervention |
| concepts[3].id | https://openalex.org/C150966472 |
| concepts[3].level | 2 |
| concepts[3].score | 0.5743998885154724 |
| concepts[3].wikidata | https://www.wikidata.org/wiki/Q3410145 |
| concepts[3].display_name | Psychosocial |
| concepts[4].id | https://openalex.org/C2780665704 |
| concepts[4].level | 2 |
| concepts[4].score | 0.5478628873825073 |
| concepts[4].wikidata | https://www.wikidata.org/wiki/Q959298 |
| concepts[4].display_name | Intervention (counseling) |
| concepts[5].id | https://openalex.org/C2778755073 |
| concepts[5].level | 2 |
| concepts[5].score | 0.5385241508483887 |
| concepts[5].wikidata | https://www.wikidata.org/wiki/Q10858537 |
| concepts[5].display_name | Scale (ratio) |
| concepts[6].id | https://openalex.org/C4237393 |
| concepts[6].level | 3 |
| concepts[6].score | 0.4486982524394989 |
| concepts[6].wikidata | https://www.wikidata.org/wiki/Q1636686 |
| concepts[6].display_name | Web usability |
| concepts[7].id | https://openalex.org/C15744967 |
| concepts[7].level | 0 |
| concepts[7].score | 0.38318926095962524 |
| concepts[7].wikidata | https://www.wikidata.org/wiki/Q9418 |
| concepts[7].display_name | Psychology |
| concepts[8].id | https://openalex.org/C41008148 |
| concepts[8].level | 0 |
| concepts[8].score | 0.3785739541053772 |
| concepts[8].wikidata | https://www.wikidata.org/wiki/Q21198 |
| concepts[8].display_name | Computer science |
| concepts[9].id | https://openalex.org/C107457646 |
| concepts[9].level | 1 |
| concepts[9].score | 0.33260735869407654 |
| concepts[9].wikidata | https://www.wikidata.org/wiki/Q207434 |
| concepts[9].display_name | Human–computer interaction |
| concepts[10].id | https://openalex.org/C542102704 |
| concepts[10].level | 1 |
| concepts[10].score | 0.13424023985862732 |
| concepts[10].wikidata | https://www.wikidata.org/wiki/Q183257 |
| concepts[10].display_name | Psychotherapist |
| concepts[11].id | https://openalex.org/C205649164 |
| concepts[11].level | 0 |
| concepts[11].score | 0.11854055523872375 |
| concepts[11].wikidata | https://www.wikidata.org/wiki/Q1071 |
| concepts[11].display_name | Geography |
| concepts[12].id | https://openalex.org/C118552586 |
| concepts[12].level | 1 |
| concepts[12].score | 0.0 |
| concepts[12].wikidata | https://www.wikidata.org/wiki/Q7867 |
| concepts[12].display_name | Psychiatry |
| concepts[13].id | https://openalex.org/C58640448 |
| concepts[13].level | 1 |
| concepts[13].score | 0.0 |
| concepts[13].wikidata | https://www.wikidata.org/wiki/Q42515 |
| concepts[13].display_name | Cartography |
| keywords[0].id | https://openalex.org/keywords/usability |
| keywords[0].score | 0.9303073883056641 |
| keywords[0].display_name | Usability |
| keywords[1].id | https://openalex.org/keywords/system-usability-scale |
| keywords[1].score | 0.6730013489723206 |
| keywords[1].display_name | System usability scale |
| keywords[2].id | https://openalex.org/keywords/psychological-intervention |
| keywords[2].score | 0.6102815270423889 |
| keywords[2].display_name | Psychological intervention |
| keywords[3].id | https://openalex.org/keywords/psychosocial |
| keywords[3].score | 0.5743998885154724 |
| keywords[3].display_name | Psychosocial |
| keywords[4].id | https://openalex.org/keywords/intervention |
| keywords[4].score | 0.5478628873825073 |
| keywords[4].display_name | Intervention (counseling) |
| keywords[5].id | https://openalex.org/keywords/scale |
| keywords[5].score | 0.5385241508483887 |
| keywords[5].display_name | Scale (ratio) |
| keywords[6].id | https://openalex.org/keywords/web-usability |
| keywords[6].score | 0.4486982524394989 |
| keywords[6].display_name | Web usability |
| keywords[7].id | https://openalex.org/keywords/psychology |
| keywords[7].score | 0.38318926095962524 |
| keywords[7].display_name | Psychology |
| keywords[8].id | https://openalex.org/keywords/computer-science |
| keywords[8].score | 0.3785739541053772 |
| keywords[8].display_name | Computer science |
| keywords[9].id | https://openalex.org/keywords/human–computer-interaction |
| keywords[9].score | 0.33260735869407654 |
| keywords[9].display_name | Human–computer interaction |
| keywords[10].id | https://openalex.org/keywords/psychotherapist |
| keywords[10].score | 0.13424023985862732 |
| keywords[10].display_name | Psychotherapist |
| keywords[11].id | https://openalex.org/keywords/geography |
| keywords[11].score | 0.11854055523872375 |
| keywords[11].display_name | Geography |
| language | en |
| locations[0].id | doi:10.21203/rs.3.rs-20758/v2 |
| locations[0].is_oa | True |
| locations[0].source | |
| locations[0].license | cc-by |
| locations[0].pdf_url | |
| locations[0].version | acceptedVersion |
| locations[0].raw_type | posted-content |
| locations[0].license_id | https://openalex.org/licenses/cc-by |
| locations[0].is_accepted | True |
| locations[0].is_published | False |
| locations[0].raw_source_name | |
| locations[0].landing_page_url | https://doi.org/10.21203/rs.3.rs-20758/v2 |
| indexed_in | crossref |
| authorships[0].author.id | https://openalex.org/A5023701288 |
| authorships[0].author.orcid | https://orcid.org/0000-0003-3657-5060 |
| authorships[0].author.display_name | Aaron R. Lyon |
| authorships[0].countries | US |
| authorships[0].affiliations[0].institution_ids | https://openalex.org/I201448701 |
| authorships[0].affiliations[0].raw_affiliation_string | University of Washington |
| authorships[0].institutions[0].id | https://openalex.org/I201448701 |
| authorships[0].institutions[0].ror | https://ror.org/00cvxb145 |
| authorships[0].institutions[0].type | education |
| authorships[0].institutions[0].lineage | https://openalex.org/I201448701 |
| authorships[0].institutions[0].country_code | US |
| authorships[0].institutions[0].display_name | University of Washington |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Aaron R Lyon |
| authorships[0].is_corresponding | True |
| authorships[0].raw_affiliation_strings | University of Washington |
| authorships[1].author.id | https://openalex.org/A5076711710 |
| authorships[1].author.orcid | https://orcid.org/0000-0001-8404-864X |
| authorships[1].author.display_name | Michael D. Pullmann |
| authorships[1].countries | US |
| authorships[1].affiliations[0].institution_ids | https://openalex.org/I201448701 |
| authorships[1].affiliations[0].raw_affiliation_string | University of Washington |
| authorships[1].institutions[0].id | https://openalex.org/I201448701 |
| authorships[1].institutions[0].ror | https://ror.org/00cvxb145 |
| authorships[1].institutions[0].type | education |
| authorships[1].institutions[0].lineage | https://openalex.org/I201448701 |
| authorships[1].institutions[0].country_code | US |
| authorships[1].institutions[0].display_name | University of Washington |
| authorships[1].author_position | middle |
| authorships[1].raw_author_name | Michael D. Pullmann |
| authorships[1].is_corresponding | False |
| authorships[1].raw_affiliation_strings | University of Washington |
| authorships[2].author.id | https://openalex.org/A5039302972 |
| authorships[2].author.orcid | |
| authorships[2].author.display_name | Jedediah Jacobson |
| authorships[2].countries | US |
| authorships[2].affiliations[0].institution_ids | https://openalex.org/I201448701 |
| authorships[2].affiliations[0].raw_affiliation_string | University of Washington |
| authorships[2].institutions[0].id | https://openalex.org/I201448701 |
| authorships[2].institutions[0].ror | https://ror.org/00cvxb145 |
| authorships[2].institutions[0].type | education |
| authorships[2].institutions[0].lineage | https://openalex.org/I201448701 |
| authorships[2].institutions[0].country_code | US |
| authorships[2].institutions[0].display_name | University of Washington |
| authorships[2].author_position | middle |
| authorships[2].raw_author_name | Jedediah Jacobson |
| authorships[2].is_corresponding | False |
| authorships[2].raw_affiliation_strings | University of Washington |
| authorships[3].author.id | https://openalex.org/A5091182364 |
| authorships[3].author.orcid | https://orcid.org/0000-0001-9112-2262 |
| authorships[3].author.display_name | Katie Osterhage |
| authorships[3].countries | US |
| authorships[3].affiliations[0].institution_ids | https://openalex.org/I201448701 |
| authorships[3].affiliations[0].raw_affiliation_string | University of Washington |
| authorships[3].institutions[0].id | https://openalex.org/I201448701 |
| authorships[3].institutions[0].ror | https://ror.org/00cvxb145 |
| authorships[3].institutions[0].type | education |
| authorships[3].institutions[0].lineage | https://openalex.org/I201448701 |
| authorships[3].institutions[0].country_code | US |
| authorships[3].institutions[0].display_name | University of Washington |
| authorships[3].author_position | middle |
| authorships[3].raw_author_name | Katie Osterhage |
| authorships[3].is_corresponding | False |
| authorships[3].raw_affiliation_strings | University of Washington |
| authorships[4].author.id | https://openalex.org/A5081951832 |
| authorships[4].author.orcid | https://orcid.org/0000-0002-4160-0550 |
| authorships[4].author.display_name | Morhaf Al Achkar |
| authorships[4].countries | US |
| authorships[4].affiliations[0].institution_ids | https://openalex.org/I201448701 |
| authorships[4].affiliations[0].raw_affiliation_string | University of Washington |
| authorships[4].institutions[0].id | https://openalex.org/I201448701 |
| authorships[4].institutions[0].ror | https://ror.org/00cvxb145 |
| authorships[4].institutions[0].type | education |
| authorships[4].institutions[0].lineage | https://openalex.org/I201448701 |
| authorships[4].institutions[0].country_code | US |
| authorships[4].institutions[0].display_name | University of Washington |
| authorships[4].author_position | middle |
| authorships[4].raw_author_name | Morhaf Al Achkar |
| authorships[4].is_corresponding | False |
| authorships[4].raw_affiliation_strings | University of Washington |
| authorships[5].author.id | https://openalex.org/A5090755519 |
| authorships[5].author.orcid | https://orcid.org/0000-0002-8746-171X |
| authorships[5].author.display_name | Brenna N. Renn |
| authorships[5].countries | US |
| authorships[5].affiliations[0].institution_ids | https://openalex.org/I201448701 |
| authorships[5].affiliations[0].raw_affiliation_string | University of Washington |
| authorships[5].institutions[0].id | https://openalex.org/I201448701 |
| authorships[5].institutions[0].ror | https://ror.org/00cvxb145 |
| authorships[5].institutions[0].type | education |
| authorships[5].institutions[0].lineage | https://openalex.org/I201448701 |
| authorships[5].institutions[0].country_code | US |
| authorships[5].institutions[0].display_name | University of Washington |
| authorships[5].author_position | middle |
| authorships[5].raw_author_name | Brenna N. Renn |
| authorships[5].is_corresponding | False |
| authorships[5].raw_affiliation_strings | University of Washington |
| authorships[6].author.id | https://openalex.org/A5068504623 |
| authorships[6].author.orcid | https://orcid.org/0000-0002-0472-6138 |
| authorships[6].author.display_name | Sean A. Munson |
| authorships[6].countries | US |
| authorships[6].affiliations[0].institution_ids | https://openalex.org/I201448701 |
| authorships[6].affiliations[0].raw_affiliation_string | University of Washington |
| authorships[6].institutions[0].id | https://openalex.org/I201448701 |
| authorships[6].institutions[0].ror | https://ror.org/00cvxb145 |
| authorships[6].institutions[0].type | education |
| authorships[6].institutions[0].lineage | https://openalex.org/I201448701 |
| authorships[6].institutions[0].country_code | US |
| authorships[6].institutions[0].display_name | University of Washington |
| authorships[6].author_position | middle |
| authorships[6].raw_author_name | Sean A. Munson |
| authorships[6].is_corresponding | False |
| authorships[6].raw_affiliation_strings | University of Washington |
| authorships[7].author.id | https://openalex.org/A5025522473 |
| authorships[7].author.orcid | https://orcid.org/0000-0001-5971-6319 |
| authorships[7].author.display_name | Patricia A. Areán |
| authorships[7].countries | US |
| authorships[7].affiliations[0].institution_ids | https://openalex.org/I201448701 |
| authorships[7].affiliations[0].raw_affiliation_string | University of Washington |
| authorships[7].institutions[0].id | https://openalex.org/I201448701 |
| authorships[7].institutions[0].ror | https://ror.org/00cvxb145 |
| authorships[7].institutions[0].type | education |
| authorships[7].institutions[0].lineage | https://openalex.org/I201448701 |
| authorships[7].institutions[0].country_code | US |
| authorships[7].institutions[0].display_name | University of Washington |
| authorships[7].author_position | last |
| authorships[7].raw_author_name | Patricia A. Areán |
| authorships[7].is_corresponding | False |
| authorships[7].raw_affiliation_strings | University of Washington |
| has_content.pdf | False |
| has_content.grobid_xml | False |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://doi.org/10.21203/rs.3.rs-20758/v2 |
| open_access.oa_status | gold |
| open_access.any_repository_has_fulltext | False |
| created_date | 2025-10-10T00:00:00 |
| display_name | Assessing the Usability of Complex Psychosocial Interventions: The Intervention Usability Scale |
| has_fulltext | False |
| is_retracted | False |
| updated_date | 2025-11-06T03:46:38.306776 |
| primary_topic.id | https://openalex.org/T10629 |
| primary_topic.field.id | https://openalex.org/fields/36 |
| primary_topic.field.display_name | Health Professions |
| primary_topic.score | 0.9944000244140625 |
| primary_topic.domain.id | https://openalex.org/domains/4 |
| primary_topic.domain.display_name | Health Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/3600 |
| primary_topic.subfield.display_name | General Health Professions |
| primary_topic.display_name | Health Policy Implementation Science |
| related_works | https://openalex.org/W4312686479, https://openalex.org/W4318240367, https://openalex.org/W2016308011, https://openalex.org/W4381511419, https://openalex.org/W4281738665, https://openalex.org/W3165016276, https://openalex.org/W15383416, https://openalex.org/W2115121425, https://openalex.org/W2320191080, https://openalex.org/W2015697469 |
| cited_by_count | 16 |
| counts_by_year[0].year | 2025 |
| counts_by_year[0].cited_by_count | 1 |
| counts_by_year[1].year | 2024 |
| counts_by_year[1].cited_by_count | 3 |
| counts_by_year[2].year | 2023 |
| counts_by_year[2].cited_by_count | 9 |
| counts_by_year[3].year | 2022 |
| counts_by_year[3].cited_by_count | 2 |
| counts_by_year[4].year | 2021 |
| counts_by_year[4].cited_by_count | 1 |
| locations_count | 1 |
| best_oa_location.id | doi:10.21203/rs.3.rs-20758/v2 |
| best_oa_location.is_oa | True |
| best_oa_location.source | |
| best_oa_location.license | cc-by |
| best_oa_location.pdf_url | |
| best_oa_location.version | acceptedVersion |
| best_oa_location.raw_type | posted-content |
| best_oa_location.license_id | https://openalex.org/licenses/cc-by |
| best_oa_location.is_accepted | True |
| best_oa_location.is_published | False |
| best_oa_location.raw_source_name | |
| best_oa_location.landing_page_url | https://doi.org/10.21203/rs.3.rs-20758/v2 |
| primary_location.id | doi:10.21203/rs.3.rs-20758/v2 |
| primary_location.is_oa | True |
| primary_location.source | |
| primary_location.license | cc-by |
| primary_location.pdf_url | |
| primary_location.version | acceptedVersion |
| primary_location.raw_type | posted-content |
| primary_location.license_id | https://openalex.org/licenses/cc-by |
| primary_location.is_accepted | True |
| primary_location.is_published | False |
| primary_location.raw_source_name | |
| primary_location.landing_page_url | https://doi.org/10.21203/rs.3.rs-20758/v2 |
| publication_date | 2020-04-15 |
| publication_year | 2020 |
| referenced_works | https://openalex.org/W2889456626, https://openalex.org/W4242282959, https://openalex.org/W2135236068, https://openalex.org/W2008519433, https://openalex.org/W1969129400, https://openalex.org/W2108349955, https://openalex.org/W2789576887, https://openalex.org/W19399978, https://openalex.org/W3110183584, https://openalex.org/W2908782975, https://openalex.org/W2900659870, https://openalex.org/W2120270590, https://openalex.org/W3088139539, https://openalex.org/W2207811989, https://openalex.org/W2102582267, https://openalex.org/W2043555414, https://openalex.org/W43120215, https://openalex.org/W2093274439, https://openalex.org/W2980059451, https://openalex.org/W4255997753, https://openalex.org/W2032191478, https://openalex.org/W2750615195, https://openalex.org/W1488466620, https://openalex.org/W1628516742, https://openalex.org/W2051163483, https://openalex.org/W2014817805, https://openalex.org/W2910064571, https://openalex.org/W2081753990, https://openalex.org/W1481275473, https://openalex.org/W2134025113, https://openalex.org/W2021321460, https://openalex.org/W2120941905, https://openalex.org/W4239720002, https://openalex.org/W4253289976, https://openalex.org/W2595934339, https://openalex.org/W2136558449 |
| referenced_works_count | 36 |
| abstract_inverted_index.= | 260, 263, 267 |
| abstract_inverted_index.a | 26, 200, 220, 309, 359, 436 |
| abstract_inverted_index.11 | 142 |
| abstract_inverted_index.No | 375 |
| abstract_inverted_index.On | 286 |
| abstract_inverted_index.an | 7, 86 |
| abstract_inverted_index.as | 56, 318, 320, 387 |
| abstract_inverted_index.at | 141 |
| abstract_inverted_index.be | 10, 295, 352 |
| abstract_inverted_index.by | 12, 355 |
| abstract_inverted_index.in | 37, 68, 126, 191, 228 |
| abstract_inverted_index.is | 25, 34, 358 |
| abstract_inverted_index.no | 41 |
| abstract_inverted_index.of | 29, 51, 65, 80, 89, 102, 108, 122, 130, 167, 205, 213, 243, 301, 337, 362, 382, 416, 433, 443 |
| abstract_inverted_index.on | 194, 283 |
| abstract_inverted_index.to | 5, 15, 46, 136, 280, 294, 325, 343, 372, 378, 395, 439 |
| abstract_inverted_index.α | 259, 262, 266 |
| abstract_inverted_index.205 | 137 |
| abstract_inverted_index.IUS | 163, 208, 311 |
| abstract_inverted_index.The | 346, 405 |
| abstract_inverted_index.and | 22, 40, 70, 118, 162, 199, 215, 225, 255, 265, 323, 327, 398, 420 |
| abstract_inverted_index.are | 341, 392 |
| abstract_inverted_index.but | 365 |
| abstract_inverted_index.can | 9, 351 |
| abstract_inverted_index.fit | 235 |
| abstract_inverted_index.for | 95, 165, 241, 249, 308, 331, 412 |
| abstract_inverted_index.has | 370 |
| abstract_inverted_index.its | 423 |
| abstract_inverted_index.key | 27, 360 |
| abstract_inverted_index.one | 166, 230 |
| abstract_inverted_index.six | 168 |
| abstract_inverted_index.the | 3, 48, 57, 63, 77, 81, 90, 100, 109, 127, 131, 188, 195, 236, 244, 250, 284, 292, 335, 344, 380, 388, 409, 414, 430, 434, 441 |
| abstract_inverted_index.was | 134, 232 |
| abstract_inverted_index.– | 2, 24 |
| abstract_inverted_index..63, | 268 |
| abstract_inverted_index..82, | 264 |
| abstract_inverted_index..83, | 261 |
| abstract_inverted_index.This | 74, 238 |
| abstract_inverted_index.been | 44 |
| abstract_inverted_index.best | 234 |
| abstract_inverted_index.both | 116, 121 |
| abstract_inverted_index.care | 144 |
| abstract_inverted_index.each | 151 |
| abstract_inverted_index.ease | 347 |
| abstract_inverted_index.from | 276 |
| abstract_inverted_index.have | 43, 114 |
| abstract_inverted_index.into | 402 |
| abstract_inverted_index.item | 231 |
| abstract_inverted_index.more | 296 |
| abstract_inverted_index.most | 183 |
| abstract_inverted_index.one- | 117 |
| abstract_inverted_index.role | 154, 326 |
| abstract_inverted_index.some | 315, 427 |
| abstract_inverted_index.such | 55, 386 |
| abstract_inverted_index.that | 61, 179, 219, 273, 298, 391, 422 |
| abstract_inverted_index.they | 180 |
| abstract_inverted_index.used | 11, 190, 394 |
| abstract_inverted_index.very | 366 |
| abstract_inverted_index.well | 319 |
| abstract_inverted_index.were | 124, 258 |
| abstract_inverted_index.when | 98 |
| abstract_inverted_index.with | 19, 314, 348, 429 |
| abstract_inverted_index.(with | 223 |
| abstract_inverted_index.52.6% | 242 |
| abstract_inverted_index.Prior | 106 |
| abstract_inverted_index.Scale | 84, 94, 113 |
| abstract_inverted_index.below | 277 |
| abstract_inverted_index.data. | 237 |
| abstract_inverted_index.exist | 377 |
| abstract_inverted_index.first | 410 |
| abstract_inverted_index.found | 115, 291, 421 |
| abstract_inverted_index.goals | 18 |
| abstract_inverted_index.good, | 281 |
| abstract_inverted_index.other | 299 |
| abstract_inverted_index.prior | 192, 316 |
| abstract_inverted_index.scale | 437 |
| abstract_inverted_index.study | 75, 129, 305, 407 |
| abstract_inverted_index.total | 251 |
| abstract_inverted_index.types | 300 |
| abstract_inverted_index.users | 14 |
| abstract_inverted_index.using | 182, 203 |
| abstract_inverted_index.which | 6, 123, 229, 349 |
| abstract_inverted_index.(IUS), | 85 |
| abstract_inverted_index.(e.g., | 173 |
| abstract_inverted_index.(i.e., | 155 |
| abstract_inverted_index.Factor | 185 |
| abstract_inverted_index.Future | 329 |
| abstract_inverted_index.Scale, | 198 |
| abstract_inverted_index.System | 92, 111, 196 |
| abstract_inverted_index.across | 210 |
| abstract_inverted_index.assess | 440 |
| abstract_inverted_index.common | 169 |
| abstract_inverted_index.design | 49 |
| abstract_inverted_index.extent | 4 |
| abstract_inverted_index.factor | 424 |
| abstract_inverted_index.groups | 212 |
| abstract_inverted_index.health | 53, 72, 104, 159, 289, 339, 384, 400, 418 |
| abstract_inverted_index.little | 367 |
| abstract_inverted_index.mental | 69, 397 |
| abstract_inverted_index.ranged | 275 |
| abstract_inverted_index.rarely | 35 |
| abstract_inverted_index.score, | 252 |
| abstract_inverted_index.scores | 209, 271 |
| abstract_inverted_index.sites. | 145 |
| abstract_inverted_index.survey | 133 |
| abstract_inverted_index.usable | 253, 297 |
| abstract_inverted_index.Surveys | 146 |
| abstract_inverted_index.achieve | 16 |
| abstract_inverted_index.adapted | 87 |
| abstract_inverted_index.adopted | 354 |
| abstract_inverted_index.complex | 52, 103, 338, 383, 417 |
| abstract_inverted_index.current | 128, 304, 406 |
| abstract_inverted_index.digital | 96, 444 |
| abstract_inverted_index.measure | 47 |
| abstract_inverted_index.medical | 156 |
| abstract_inverted_index.primary | 143, 403 |
| abstract_inverted_index.quality | 50 |
| abstract_inverted_index.ratings | 164 |
| abstract_inverted_index.readily | 353 |
| abstract_inverted_index.removed | 233 |
| abstract_inverted_index.service | 356 |
| abstract_inverted_index.studies | 107 |
| abstract_inverted_index.version | 88, 432 |
| abstract_inverted_index.working | 140 |
| abstract_inverted_index.However, | 32 |
| abstract_inverted_index.analyses | 186, 204 |
| abstract_inverted_index.analysis | 202 |
| abstract_inverted_index.assessed | 36 |
| abstract_inverted_index.attended | 371 |
| abstract_inverted_index.average, | 287 |
| abstract_inverted_index.care.• | 404 |
| abstract_inverted_index.commonly | 393 |
| abstract_inverted_index.compared | 207 |
| abstract_inverted_index.evaluate | 379 |
| abstract_inverted_index.evidence | 307 |
| abstract_inverted_index.examined | 125 |
| abstract_inverted_index.majority | 64 |
| abstract_inverted_index.original | 110, 431 |
| abstract_inverted_index.provides | 306 |
| abstract_inverted_index.reported | 181 |
| abstract_inverted_index.research | 39, 193, 333, 369, 428 |
| abstract_inverted_index.services | 401 |
| abstract_inverted_index.solution | 222, 239 |
| abstract_inverted_index.subscale | 257 |
| abstract_inverted_index.success, | 364 |
| abstract_inverted_index.success. | 31 |
| abstract_inverted_index.systems. | 445 |
| abstract_inverted_index.therapy, | 176 |
| abstract_inverted_index.validity | 79 |
| abstract_inverted_index.variance | 206, 245 |
| abstract_inverted_index.Resulting | 270 |
| abstract_inverted_index.Usability | 83, 93, 112, 197 |
| abstract_inverted_index.accounted | 240 |
| abstract_inverted_index.assessing | 413 |
| abstract_inverted_index.cognitive | 174 |
| abstract_inverted_index.collected | 147 |
| abstract_inverted_index.depending | 282 |
| abstract_inverted_index.developed | 45, 438 |
| abstract_inverted_index.different | 211 |
| abstract_inverted_index.effective | 66 |
| abstract_inverted_index.evaluated | 76, 408 |
| abstract_inverted_index.including | 150 |
| abstract_inverted_index.indicated | 218, 272 |
| abstract_inverted_index.integrate | 396 |
| abstract_inverted_index.learnable | 256 |
| abstract_inverted_index.measuring | 99 |
| abstract_inverted_index.observed. | 246 |
| abstract_inverted_index.practices | 67, 390 |
| abstract_inverted_index.predictor | 361 |
| abstract_inverted_index.provider, | 157, 160 |
| abstract_inverted_index.providers | 290, 357 |
| abstract_inverted_index.research, | 317 |
| abstract_inverted_index.services. | 73 |
| abstract_inverted_index.specified | 13, 17 |
| abstract_inverted_index.standards | 279 |
| abstract_inverted_index.structure | 312, 425 |
| abstract_inverted_index.subscale, | 254 |
| abstract_inverted_index.usability | 33, 101, 274, 336, 381, 415, 442 |
| abstract_inverted_index.Inter-item | 247 |
| abstract_inverted_index.acceptable | 278, 321 |
| abstract_inverted_index.behavioral | 71, 175, 288, 399 |
| abstract_inverted_index.consistent | 313 |
| abstract_inverted_index.directions | 330 |
| abstract_inverted_index.evaluating | 334 |
| abstract_inverted_index.healthcare | 138, 302 |
| abstract_inverted_index.instrument | 411 |
| abstract_inverted_index.procedures | 189 |
| abstract_inverted_index.regularly. | 184 |
| abstract_inverted_index.replicated | 187, 426 |
| abstract_inverted_index.solutions, | 120 |
| abstract_inverted_index.structural | 78 |
| abstract_inverted_index.subscales) | 227 |
| abstract_inverted_index.two-factor | 119, 221, 310 |
| abstract_inverted_index.demographic | 148 |
| abstract_inverted_index.determinant | 28 |
| abstract_inverted_index.efficiency, | 21 |
| abstract_inverted_index.instrument, | 435 |
| abstract_inverted_index.instruments | 42, 376 |
| abstract_inverted_index.reliability | 322 |
| abstract_inverted_index.respondents | 214 |
| abstract_inverted_index.sensitivity | 201, 324 |
| abstract_inverted_index.Intervention | 82 |
| abstract_inverted_index.administered | 135 |
| abstract_inverted_index.characterize | 62 |
| abstract_inverted_index.information, | 149 |
| abstract_inverted_index.intervention | 8, 373 |
| abstract_inverted_index.motivational | 177 |
| abstract_inverted_index.pharmacist), | 161 |
| abstract_inverted_index.professional | 153 |
| abstract_inverted_index.psychosocial | 59, 171 |
| abstract_inverted_index.satisfaction | 23 |
| abstract_inverted_index.“usable” | 224 |
| abstract_inverted_index.intervention. | 285, 328 |
| abstract_inverted_index.interventions | 60, 172, 216, 293, 340, 350, 419 |
| abstract_inverted_index.interviewing) | 178 |
| abstract_inverted_index.professionals | 139 |
| abstract_inverted_index.reliabilities | 248 |
| abstract_inverted_index.respectively. | 269 |
| abstract_inverted_index.technologies, | 97 |
| abstract_inverted_index.usability.• | 374 |
| abstract_inverted_index.effectiveness, | 20 |
| abstract_inverted_index.evidence-based | 58, 170, 389 |
| abstract_inverted_index.implementation | 30, 38, 332, 363, 368 |
| abstract_inverted_index.interventions, | 54, 385 |
| abstract_inverted_index.interventions. | 105 |
| abstract_inverted_index.participant’s | 152 |
| abstract_inverted_index.“learnable” | 226 |
| abstract_inverted_index.well-established | 91 |
| abstract_inverted_index.mental/behavioral | 158 |
| abstract_inverted_index.Literature</bold>• | 345 |
| abstract_inverted_index.<title>Abstract</title> | 0 |
| abstract_inverted_index.IUS.<bold>Methods</bold>A | 132 |
| abstract_inverted_index.discussed.<bold>Contributions | 342 |
| abstract_inverted_index.<bold>Background</bold>Usability | 1 |
| abstract_inverted_index.assessed.<bold>Results</bold>Analyses | 217 |
| abstract_inverted_index.providers.<bold>Conclusions</bold>The | 303 |
| cited_by_percentile_year.max | 99 |
| cited_by_percentile_year.min | 89 |
| corresponding_author_ids | https://openalex.org/A5023701288 |
| countries_distinct_count | 1 |
| institutions_distinct_count | 8 |
| corresponding_institution_ids | https://openalex.org/I201448701 |
| citation_normalized_percentile.value | 0.93357447 |
| citation_normalized_percentile.is_in_top_1_percent | False |
| citation_normalized_percentile.is_in_top_10_percent | True |