Examiner seniority and experience are associated with bias when scoring communication, but not examination, skills in objective structured clinical examinations in Australia Article Swipe
Lauren S. H. Chong
,
Silas Taylor
,
Matthew Haywood
,
Barbara‐Ann Adelstein
,
Boaz Shulruf
·
YOU?
·
· 2018
· Open Access
·
· DOI: https://doi.org/10.3352/jeehp.2018.15.17
YOU?
·
· 2018
· Open Access
·
· DOI: https://doi.org/10.3352/jeehp.2018.15.17
Purpose: The biases that may influence objective structured clinical examination (OSCE) scoring are well understood, and recent research has attempted to establish the magnitude of their impact. However, the influence of examiner experience, clinical seniority, and occupation on communication and physical examination scores in OSCEs has not yet been clearly established. Methods: We compared the mean scores awarded for generic and clinical communication and physical examination skills in 2 undergraduate medicine OSCEs in relation to examiner characteristics (gender, examining experience, occupation, seniority, and speciality). The statistical significance of the differences was calculated using the 2-tailed independent t-test and analysis of variance. Results: Five hundred and seventeen students were examined by 237 examiners at the University of New South Wales in 2014 and 2016. Examiner gender, occupation (academic, clinician, or clinical tutor), and job type (specialist or generalist) did not significantly impact scores. Junior doctors gave consistently higher scores than senior doctors in all domains, and this difference was statistically significant for generic and clinical communication scores. Examiner experience was significantly inversely correlated with generic communication scores. Conclusion: We suggest that the assessment of examination skills may be less susceptible to bias because this process is fairly prescriptive, affording greater scoring objectivity. We recommend training to define the marking criteria, teaching curriculum, and expected level of performance in communication skills to reduce bias in OSCE assessment.
Related Topics
Concepts
Metadata
- Type
- article
- Language
- en
- Landing Page
- https://doi.org/10.3352/jeehp.2018.15.17
- OA Status
- diamond
- Cited By
- 37
- References
- 8
- Related Works
- 10
- OpenAlex ID
- https://openalex.org/W2884664992
All OpenAlex metadata
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W2884664992Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.3352/jeehp.2018.15.17Digital Object Identifier
- Title
-
Examiner seniority and experience are associated with bias when scoring communication, but not examination, skills in objective structured clinical examinations in AustraliaWork title
- Type
-
articleOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2018Year of publication
- Publication date
-
2018-07-18Full publication date if available
- Authors
-
Lauren S. H. Chong, Silas Taylor, Matthew Haywood, Barbara‐Ann Adelstein, Boaz ShulrufList of authors in order
- Landing page
-
https://doi.org/10.3352/jeehp.2018.15.17Publisher landing page
- Open access
-
YesWhether a free full text is available
- OA status
-
diamondOpen access status per OpenAlex
- OA URL
-
https://doi.org/10.3352/jeehp.2018.15.17Direct OA link when available
- Concepts
-
Objective structured clinical examination, Seniority, Curriculum, Medical education, Test (biology), Physical examination, TUTOR, Communication skills, Medicine, Psychology, Family medicine, Mathematics education, Pedagogy, Surgery, Political science, Biology, Paleontology, LawTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
37Total citation count in OpenAlex
- Citations by year (recent)
-
2025: 2, 2024: 12, 2023: 4, 2022: 7, 2021: 6Per-year citation counts (last 5 years)
- References (count)
-
8Number of works referenced by this work
- Related works (count)
-
10Other works algorithmically related by OpenAlex
Full payload
| id | https://openalex.org/W2884664992 |
|---|---|
| doi | https://doi.org/10.3352/jeehp.2018.15.17 |
| ids.doi | https://doi.org/10.3352/jeehp.2018.15.17 |
| ids.mag | 2884664992 |
| ids.pmid | https://pubmed.ncbi.nlm.nih.gov/30016854 |
| ids.openalex | https://openalex.org/W2884664992 |
| fwci | 3.28746141 |
| mesh[0].qualifier_ui | |
| mesh[0].descriptor_ui | D001315 |
| mesh[0].is_major_topic | False |
| mesh[0].qualifier_name | |
| mesh[0].descriptor_name | Australia |
| mesh[1].qualifier_ui | |
| mesh[1].descriptor_ui | D015982 |
| mesh[1].is_major_topic | True |
| mesh[1].qualifier_name | |
| mesh[1].descriptor_name | Bias |
| mesh[2].qualifier_ui | Q000592 |
| mesh[2].descriptor_ui | D002983 |
| mesh[2].is_major_topic | False |
| mesh[2].qualifier_name | standards |
| mesh[2].descriptor_name | Clinical Competence |
| mesh[3].qualifier_ui | |
| mesh[3].descriptor_ui | D003142 |
| mesh[3].is_major_topic | True |
| mesh[3].qualifier_name | |
| mesh[3].descriptor_name | Communication |
| mesh[4].qualifier_ui | Q000592 |
| mesh[4].descriptor_ui | D004504 |
| mesh[4].is_major_topic | False |
| mesh[4].qualifier_name | standards |
| mesh[4].descriptor_name | Education, Medical, Undergraduate |
| mesh[5].qualifier_ui | Q000592 |
| mesh[5].descriptor_ui | D004521 |
| mesh[5].is_major_topic | False |
| mesh[5].qualifier_name | standards |
| mesh[5].descriptor_name | Educational Measurement |
| mesh[6].qualifier_ui | |
| mesh[6].descriptor_ui | D005180 |
| mesh[6].is_major_topic | True |
| mesh[6].qualifier_name | |
| mesh[6].descriptor_name | Faculty, Medical |
| mesh[7].qualifier_ui | |
| mesh[7].descriptor_ui | D005260 |
| mesh[7].is_major_topic | False |
| mesh[7].qualifier_name | |
| mesh[7].descriptor_name | Female |
| mesh[8].qualifier_ui | |
| mesh[8].descriptor_ui | D006801 |
| mesh[8].is_major_topic | False |
| mesh[8].qualifier_name | |
| mesh[8].descriptor_name | Humans |
| mesh[9].qualifier_ui | |
| mesh[9].descriptor_ui | D008297 |
| mesh[9].is_major_topic | False |
| mesh[9].qualifier_name | |
| mesh[9].descriptor_name | Male |
| mesh[10].qualifier_ui | Q000592 |
| mesh[10].descriptor_ui | D010808 |
| mesh[10].is_major_topic | False |
| mesh[10].qualifier_name | standards |
| mesh[10].descriptor_name | Physical Examination |
| mesh[11].qualifier_ui | Q000592 |
| mesh[11].descriptor_ui | D012577 |
| mesh[11].is_major_topic | False |
| mesh[11].qualifier_name | standards |
| mesh[11].descriptor_name | Schools, Medical |
| mesh[12].qualifier_ui | |
| mesh[12].descriptor_ui | D001315 |
| mesh[12].is_major_topic | False |
| mesh[12].qualifier_name | |
| mesh[12].descriptor_name | Australia |
| mesh[13].qualifier_ui | |
| mesh[13].descriptor_ui | D015982 |
| mesh[13].is_major_topic | True |
| mesh[13].qualifier_name | |
| mesh[13].descriptor_name | Bias |
| mesh[14].qualifier_ui | Q000592 |
| mesh[14].descriptor_ui | D002983 |
| mesh[14].is_major_topic | False |
| mesh[14].qualifier_name | standards |
| mesh[14].descriptor_name | Clinical Competence |
| mesh[15].qualifier_ui | |
| mesh[15].descriptor_ui | D003142 |
| mesh[15].is_major_topic | True |
| mesh[15].qualifier_name | |
| mesh[15].descriptor_name | Communication |
| mesh[16].qualifier_ui | Q000592 |
| mesh[16].descriptor_ui | D004504 |
| mesh[16].is_major_topic | False |
| mesh[16].qualifier_name | standards |
| mesh[16].descriptor_name | Education, Medical, Undergraduate |
| mesh[17].qualifier_ui | Q000592 |
| mesh[17].descriptor_ui | D004521 |
| mesh[17].is_major_topic | False |
| mesh[17].qualifier_name | standards |
| mesh[17].descriptor_name | Educational Measurement |
| mesh[18].qualifier_ui | |
| mesh[18].descriptor_ui | D005180 |
| mesh[18].is_major_topic | True |
| mesh[18].qualifier_name | |
| mesh[18].descriptor_name | Faculty, Medical |
| mesh[19].qualifier_ui | |
| mesh[19].descriptor_ui | D005260 |
| mesh[19].is_major_topic | False |
| mesh[19].qualifier_name | |
| mesh[19].descriptor_name | Female |
| mesh[20].qualifier_ui | |
| mesh[20].descriptor_ui | D006801 |
| mesh[20].is_major_topic | False |
| mesh[20].qualifier_name | |
| mesh[20].descriptor_name | Humans |
| mesh[21].qualifier_ui | |
| mesh[21].descriptor_ui | D008297 |
| mesh[21].is_major_topic | False |
| mesh[21].qualifier_name | |
| mesh[21].descriptor_name | Male |
| mesh[22].qualifier_ui | Q000592 |
| mesh[22].descriptor_ui | D010808 |
| mesh[22].is_major_topic | False |
| mesh[22].qualifier_name | standards |
| mesh[22].descriptor_name | Physical Examination |
| mesh[23].qualifier_ui | Q000592 |
| mesh[23].descriptor_ui | D012577 |
| mesh[23].is_major_topic | False |
| mesh[23].qualifier_name | standards |
| mesh[23].descriptor_name | Schools, Medical |
| type | article |
| title | Examiner seniority and experience are associated with bias when scoring communication, but not examination, skills in objective structured clinical examinations in Australia |
| biblio.issue | |
| biblio.volume | 15 |
| biblio.last_page | 17 |
| biblio.first_page | 17 |
| topics[0].id | https://openalex.org/T10254 |
| topics[0].field.id | https://openalex.org/fields/27 |
| topics[0].field.display_name | Medicine |
| topics[0].score | 0.9998000264167786 |
| topics[0].domain.id | https://openalex.org/domains/4 |
| topics[0].domain.display_name | Health Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/2739 |
| topics[0].subfield.display_name | Public Health, Environmental and Occupational Health |
| topics[0].display_name | Innovations in Medical Education |
| topics[1].id | https://openalex.org/T12574 |
| topics[1].field.id | https://openalex.org/fields/27 |
| topics[1].field.display_name | Medicine |
| topics[1].score | 0.9983999729156494 |
| topics[1].domain.id | https://openalex.org/domains/4 |
| topics[1].domain.display_name | Health Sciences |
| topics[1].subfield.id | https://openalex.org/subfields/2714 |
| topics[1].subfield.display_name | Family Practice |
| topics[1].display_name | Clinical Reasoning and Diagnostic Skills |
| topics[2].id | https://openalex.org/T12602 |
| topics[2].field.id | https://openalex.org/fields/27 |
| topics[2].field.display_name | Medicine |
| topics[2].score | 0.9955000281333923 |
| topics[2].domain.id | https://openalex.org/domains/4 |
| topics[2].domain.display_name | Health Sciences |
| topics[2].subfield.id | https://openalex.org/subfields/2739 |
| topics[2].subfield.display_name | Public Health, Environmental and Occupational Health |
| topics[2].display_name | Medical Education and Admissions |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| concepts[0].id | https://openalex.org/C2778000598 |
| concepts[0].level | 2 |
| concepts[0].score | 0.7856827974319458 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q11237593 |
| concepts[0].display_name | Objective structured clinical examination |
| concepts[1].id | https://openalex.org/C2780783599 |
| concepts[1].level | 2 |
| concepts[1].score | 0.7125553488731384 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q1931779 |
| concepts[1].display_name | Seniority |
| concepts[2].id | https://openalex.org/C47177190 |
| concepts[2].level | 2 |
| concepts[2].score | 0.5585024356842041 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q207137 |
| concepts[2].display_name | Curriculum |
| concepts[3].id | https://openalex.org/C509550671 |
| concepts[3].level | 1 |
| concepts[3].score | 0.49368056654930115 |
| concepts[3].wikidata | https://www.wikidata.org/wiki/Q126945 |
| concepts[3].display_name | Medical education |
| concepts[4].id | https://openalex.org/C2777267654 |
| concepts[4].level | 2 |
| concepts[4].score | 0.4898921847343445 |
| concepts[4].wikidata | https://www.wikidata.org/wiki/Q3519023 |
| concepts[4].display_name | Test (biology) |
| concepts[5].id | https://openalex.org/C527108885 |
| concepts[5].level | 2 |
| concepts[5].score | 0.48513731360435486 |
| concepts[5].wikidata | https://www.wikidata.org/wiki/Q835153 |
| concepts[5].display_name | Physical examination |
| concepts[6].id | https://openalex.org/C2778371403 |
| concepts[6].level | 2 |
| concepts[6].score | 0.4761369526386261 |
| concepts[6].wikidata | https://www.wikidata.org/wiki/Q7672049 |
| concepts[6].display_name | TUTOR |
| concepts[7].id | https://openalex.org/C2988115150 |
| concepts[7].level | 2 |
| concepts[7].score | 0.4675185978412628 |
| concepts[7].wikidata | https://www.wikidata.org/wiki/Q11024 |
| concepts[7].display_name | Communication skills |
| concepts[8].id | https://openalex.org/C71924100 |
| concepts[8].level | 0 |
| concepts[8].score | 0.4639676809310913 |
| concepts[8].wikidata | https://www.wikidata.org/wiki/Q11190 |
| concepts[8].display_name | Medicine |
| concepts[9].id | https://openalex.org/C15744967 |
| concepts[9].level | 0 |
| concepts[9].score | 0.4411594569683075 |
| concepts[9].wikidata | https://www.wikidata.org/wiki/Q9418 |
| concepts[9].display_name | Psychology |
| concepts[10].id | https://openalex.org/C512399662 |
| concepts[10].level | 1 |
| concepts[10].score | 0.3206366300582886 |
| concepts[10].wikidata | https://www.wikidata.org/wiki/Q3505712 |
| concepts[10].display_name | Family medicine |
| concepts[11].id | https://openalex.org/C145420912 |
| concepts[11].level | 1 |
| concepts[11].score | 0.171716570854187 |
| concepts[11].wikidata | https://www.wikidata.org/wiki/Q853077 |
| concepts[11].display_name | Mathematics education |
| concepts[12].id | https://openalex.org/C19417346 |
| concepts[12].level | 1 |
| concepts[12].score | 0.14629805088043213 |
| concepts[12].wikidata | https://www.wikidata.org/wiki/Q7922 |
| concepts[12].display_name | Pedagogy |
| concepts[13].id | https://openalex.org/C141071460 |
| concepts[13].level | 1 |
| concepts[13].score | 0.0884455144405365 |
| concepts[13].wikidata | https://www.wikidata.org/wiki/Q40821 |
| concepts[13].display_name | Surgery |
| concepts[14].id | https://openalex.org/C17744445 |
| concepts[14].level | 0 |
| concepts[14].score | 0.0 |
| concepts[14].wikidata | https://www.wikidata.org/wiki/Q36442 |
| concepts[14].display_name | Political science |
| concepts[15].id | https://openalex.org/C86803240 |
| concepts[15].level | 0 |
| concepts[15].score | 0.0 |
| concepts[15].wikidata | https://www.wikidata.org/wiki/Q420 |
| concepts[15].display_name | Biology |
| concepts[16].id | https://openalex.org/C151730666 |
| concepts[16].level | 1 |
| concepts[16].score | 0.0 |
| concepts[16].wikidata | https://www.wikidata.org/wiki/Q7205 |
| concepts[16].display_name | Paleontology |
| concepts[17].id | https://openalex.org/C199539241 |
| concepts[17].level | 1 |
| concepts[17].score | 0.0 |
| concepts[17].wikidata | https://www.wikidata.org/wiki/Q7748 |
| concepts[17].display_name | Law |
| keywords[0].id | https://openalex.org/keywords/objective-structured-clinical-examination |
| keywords[0].score | 0.7856827974319458 |
| keywords[0].display_name | Objective structured clinical examination |
| keywords[1].id | https://openalex.org/keywords/seniority |
| keywords[1].score | 0.7125553488731384 |
| keywords[1].display_name | Seniority |
| keywords[2].id | https://openalex.org/keywords/curriculum |
| keywords[2].score | 0.5585024356842041 |
| keywords[2].display_name | Curriculum |
| keywords[3].id | https://openalex.org/keywords/medical-education |
| keywords[3].score | 0.49368056654930115 |
| keywords[3].display_name | Medical education |
| keywords[4].id | https://openalex.org/keywords/test |
| keywords[4].score | 0.4898921847343445 |
| keywords[4].display_name | Test (biology) |
| keywords[5].id | https://openalex.org/keywords/physical-examination |
| keywords[5].score | 0.48513731360435486 |
| keywords[5].display_name | Physical examination |
| keywords[6].id | https://openalex.org/keywords/tutor |
| keywords[6].score | 0.4761369526386261 |
| keywords[6].display_name | TUTOR |
| keywords[7].id | https://openalex.org/keywords/communication-skills |
| keywords[7].score | 0.4675185978412628 |
| keywords[7].display_name | Communication skills |
| keywords[8].id | https://openalex.org/keywords/medicine |
| keywords[8].score | 0.4639676809310913 |
| keywords[8].display_name | Medicine |
| keywords[9].id | https://openalex.org/keywords/psychology |
| keywords[9].score | 0.4411594569683075 |
| keywords[9].display_name | Psychology |
| keywords[10].id | https://openalex.org/keywords/family-medicine |
| keywords[10].score | 0.3206366300582886 |
| keywords[10].display_name | Family medicine |
| keywords[11].id | https://openalex.org/keywords/mathematics-education |
| keywords[11].score | 0.171716570854187 |
| keywords[11].display_name | Mathematics education |
| keywords[12].id | https://openalex.org/keywords/pedagogy |
| keywords[12].score | 0.14629805088043213 |
| keywords[12].display_name | Pedagogy |
| keywords[13].id | https://openalex.org/keywords/surgery |
| keywords[13].score | 0.0884455144405365 |
| keywords[13].display_name | Surgery |
| language | en |
| locations[0].id | doi:10.3352/jeehp.2018.15.17 |
| locations[0].is_oa | True |
| locations[0].source.id | https://openalex.org/S30317932 |
| locations[0].source.issn | 1975-5937 |
| locations[0].source.type | journal |
| locations[0].source.is_oa | True |
| locations[0].source.issn_l | 1975-5937 |
| locations[0].source.is_core | True |
| locations[0].source.is_in_doaj | True |
| locations[0].source.display_name | Journal of Educational Evaluation for Health Professions |
| locations[0].source.host_organization | https://openalex.org/P4310319416 |
| locations[0].source.host_organization_name | Korea Health Insurance Licensing Examination Institute |
| locations[0].source.host_organization_lineage | https://openalex.org/P4310319416 |
| locations[0].license | cc-by |
| locations[0].pdf_url | |
| locations[0].version | publishedVersion |
| locations[0].raw_type | journal-article |
| locations[0].license_id | https://openalex.org/licenses/cc-by |
| locations[0].is_accepted | True |
| locations[0].is_published | True |
| locations[0].raw_source_name | Journal of Educational Evaluation for Health Professions |
| locations[0].landing_page_url | https://doi.org/10.3352/jeehp.2018.15.17 |
| locations[1].id | pmid:30016854 |
| locations[1].is_oa | False |
| locations[1].source.id | https://openalex.org/S4306525036 |
| locations[1].source.issn | |
| locations[1].source.type | repository |
| locations[1].source.is_oa | False |
| locations[1].source.issn_l | |
| locations[1].source.is_core | False |
| locations[1].source.is_in_doaj | False |
| locations[1].source.display_name | PubMed |
| locations[1].source.host_organization | https://openalex.org/I1299303238 |
| locations[1].source.host_organization_name | National Institutes of Health |
| locations[1].source.host_organization_lineage | https://openalex.org/I1299303238 |
| locations[1].license | |
| locations[1].pdf_url | |
| locations[1].version | publishedVersion |
| locations[1].raw_type | |
| locations[1].license_id | |
| locations[1].is_accepted | True |
| locations[1].is_published | True |
| locations[1].raw_source_name | Journal of educational evaluation for health professions |
| locations[1].landing_page_url | https://pubmed.ncbi.nlm.nih.gov/30016854 |
| locations[2].id | pmh:oai:doaj.org/article:5c916fb20c124f8f9dbef2fd19bbb313 |
| locations[2].is_oa | True |
| locations[2].source.id | https://openalex.org/S4306401280 |
| locations[2].source.issn | |
| locations[2].source.type | repository |
| locations[2].source.is_oa | False |
| locations[2].source.issn_l | |
| locations[2].source.is_core | False |
| locations[2].source.is_in_doaj | False |
| locations[2].source.display_name | DOAJ (DOAJ: Directory of Open Access Journals) |
| locations[2].source.host_organization | |
| locations[2].source.host_organization_name | |
| locations[2].source.host_organization_lineage | |
| locations[2].license | cc-by-sa |
| locations[2].pdf_url | |
| locations[2].version | submittedVersion |
| locations[2].raw_type | article |
| locations[2].license_id | https://openalex.org/licenses/cc-by-sa |
| locations[2].is_accepted | False |
| locations[2].is_published | False |
| locations[2].raw_source_name | Journal of Educational Evaluation for Health Professions, Vol 15 (2018) |
| locations[2].landing_page_url | https://doaj.org/article/5c916fb20c124f8f9dbef2fd19bbb313 |
| locations[3].id | pmh:oai:pubmedcentral.nih.gov:6194481 |
| locations[3].is_oa | True |
| locations[3].source.id | https://openalex.org/S2764455111 |
| locations[3].source.issn | |
| locations[3].source.type | repository |
| locations[3].source.is_oa | False |
| locations[3].source.issn_l | |
| locations[3].source.is_core | False |
| locations[3].source.is_in_doaj | False |
| locations[3].source.display_name | PubMed Central |
| locations[3].source.host_organization | https://openalex.org/I1299303238 |
| locations[3].source.host_organization_name | National Institutes of Health |
| locations[3].source.host_organization_lineage | https://openalex.org/I1299303238 |
| locations[3].license | other-oa |
| locations[3].pdf_url | |
| locations[3].version | submittedVersion |
| locations[3].raw_type | Text |
| locations[3].license_id | https://openalex.org/licenses/other-oa |
| locations[3].is_accepted | False |
| locations[3].is_published | False |
| locations[3].raw_source_name | J Educ Eval Health Prof |
| locations[3].landing_page_url | https://www.ncbi.nlm.nih.gov/pmc/articles/6194481 |
| locations[4].id | pmh:oai:europepmc.org:5150173 |
| locations[4].is_oa | True |
| locations[4].source.id | https://openalex.org/S4306400806 |
| locations[4].source.issn | |
| locations[4].source.type | repository |
| locations[4].source.is_oa | False |
| locations[4].source.issn_l | |
| locations[4].source.is_core | False |
| locations[4].source.is_in_doaj | False |
| locations[4].source.display_name | Europe PMC (PubMed Central) |
| locations[4].source.host_organization | https://openalex.org/I1303153112 |
| locations[4].source.host_organization_name | European Bioinformatics Institute |
| locations[4].source.host_organization_lineage | https://openalex.org/I1303153112 |
| locations[4].license | other-oa |
| locations[4].pdf_url | |
| locations[4].version | submittedVersion |
| locations[4].raw_type | Text |
| locations[4].license_id | https://openalex.org/licenses/other-oa |
| locations[4].is_accepted | False |
| locations[4].is_published | False |
| locations[4].raw_source_name | |
| locations[4].landing_page_url | http://europepmc.org/pmc/articles/PMC6194481 |
| locations[5].id | pmh:oai:unsworks.library.unsw.edu.au:1959.4/unsworks_63997 |
| locations[5].is_oa | True |
| locations[5].source.id | https://openalex.org/S4306401737 |
| locations[5].source.issn | |
| locations[5].source.type | repository |
| locations[5].source.is_oa | False |
| locations[5].source.issn_l | |
| locations[5].source.is_core | False |
| locations[5].source.is_in_doaj | False |
| locations[5].source.display_name | UNSWorks (University of New South Wales, Sydney, Australia) |
| locations[5].source.host_organization | https://openalex.org/I40053085 |
| locations[5].source.host_organization_name | Australian Defence Force Academy |
| locations[5].source.host_organization_lineage | https://openalex.org/I40053085 |
| locations[5].license | cc-by-nc-nd |
| locations[5].pdf_url | |
| locations[5].version | submittedVersion |
| locations[5].raw_type | http://purl.org/coar/resource_type/c_6501 |
| locations[5].license_id | https://openalex.org/licenses/cc-by-nc-nd |
| locations[5].is_accepted | False |
| locations[5].is_published | False |
| locations[5].raw_source_name | Journal of Educational Evaluation for Health Professions, 15, 17 |
| locations[5].landing_page_url | http://hdl.handle.net/1959.4/unsworks_63997 |
| indexed_in | crossref, doaj, pubmed |
| authorships[0].author.id | https://openalex.org/A5078949357 |
| authorships[0].author.orcid | |
| authorships[0].author.display_name | Lauren S. H. Chong |
| authorships[0].countries | AU |
| authorships[0].affiliations[0].institution_ids | https://openalex.org/I4210108821 |
| authorships[0].affiliations[0].raw_affiliation_string | Clinical Skills Teaching Unit, Prince of Wales Hospital, Sydney, Australia |
| authorships[0].institutions[0].id | https://openalex.org/I4210108821 |
| authorships[0].institutions[0].ror | https://ror.org/022arq532 |
| authorships[0].institutions[0].type | healthcare |
| authorships[0].institutions[0].lineage | https://openalex.org/I4210108821 |
| authorships[0].institutions[0].country_code | AU |
| authorships[0].institutions[0].display_name | Prince of Wales Hospital |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Lauren Chong |
| authorships[0].is_corresponding | False |
| authorships[0].raw_affiliation_strings | Clinical Skills Teaching Unit, Prince of Wales Hospital, Sydney, Australia |
| authorships[1].author.id | https://openalex.org/A5017022818 |
| authorships[1].author.orcid | https://orcid.org/0000-0003-1992-8485 |
| authorships[1].author.display_name | Silas Taylor |
| authorships[1].countries | AU |
| authorships[1].affiliations[0].institution_ids | https://openalex.org/I31746571 |
| authorships[1].affiliations[0].raw_affiliation_string | University of New South Wales, Sydney, Australia |
| authorships[1].institutions[0].id | https://openalex.org/I31746571 |
| authorships[1].institutions[0].ror | https://ror.org/03r8z3t63 |
| authorships[1].institutions[0].type | education |
| authorships[1].institutions[0].lineage | https://openalex.org/I31746571 |
| authorships[1].institutions[0].country_code | AU |
| authorships[1].institutions[0].display_name | UNSW Sydney |
| authorships[1].author_position | middle |
| authorships[1].raw_author_name | Silas Taylor |
| authorships[1].is_corresponding | False |
| authorships[1].raw_affiliation_strings | University of New South Wales, Sydney, Australia |
| authorships[2].author.id | https://openalex.org/A5026867124 |
| authorships[2].author.orcid | https://orcid.org/0000-0003-3600-7987 |
| authorships[2].author.display_name | Matthew Haywood |
| authorships[2].countries | AU |
| authorships[2].affiliations[0].institution_ids | https://openalex.org/I31746571 |
| authorships[2].affiliations[0].raw_affiliation_string | University of New South Wales, Sydney, Australia |
| authorships[2].institutions[0].id | https://openalex.org/I31746571 |
| authorships[2].institutions[0].ror | https://ror.org/03r8z3t63 |
| authorships[2].institutions[0].type | education |
| authorships[2].institutions[0].lineage | https://openalex.org/I31746571 |
| authorships[2].institutions[0].country_code | AU |
| authorships[2].institutions[0].display_name | UNSW Sydney |
| authorships[2].author_position | middle |
| authorships[2].raw_author_name | Matthew Haywood |
| authorships[2].is_corresponding | False |
| authorships[2].raw_affiliation_strings | University of New South Wales, Sydney, Australia |
| authorships[3].author.id | https://openalex.org/A5008087173 |
| authorships[3].author.orcid | https://orcid.org/0000-0002-7866-665X |
| authorships[3].author.display_name | Barbara‐Ann Adelstein |
| authorships[3].countries | AU |
| authorships[3].affiliations[0].institution_ids | https://openalex.org/I31746571 |
| authorships[3].affiliations[0].raw_affiliation_string | Prince of Wales Clinical School, University of New South Wales, Sydney, Australia |
| authorships[3].institutions[0].id | https://openalex.org/I31746571 |
| authorships[3].institutions[0].ror | https://ror.org/03r8z3t63 |
| authorships[3].institutions[0].type | education |
| authorships[3].institutions[0].lineage | https://openalex.org/I31746571 |
| authorships[3].institutions[0].country_code | AU |
| authorships[3].institutions[0].display_name | UNSW Sydney |
| authorships[3].author_position | middle |
| authorships[3].raw_author_name | Barbara-Ann Adelstein |
| authorships[3].is_corresponding | False |
| authorships[3].raw_affiliation_strings | Prince of Wales Clinical School, University of New South Wales, Sydney, Australia |
| authorships[4].author.id | https://openalex.org/A5034597140 |
| authorships[4].author.orcid | https://orcid.org/0000-0003-3644-727X |
| authorships[4].author.display_name | Boaz Shulruf |
| authorships[4].countries | AU, NZ |
| authorships[4].affiliations[0].institution_ids | https://openalex.org/I31746571 |
| authorships[4].affiliations[0].raw_affiliation_string | Office of Medical Education, University of New South Wales, Sydney, Australia |
| authorships[4].affiliations[1].institution_ids | https://openalex.org/I154130895 |
| authorships[4].affiliations[1].raw_affiliation_string | Centre for Medical and Health Sciences Education, University of Auckland, Auckland, New Zealand |
| authorships[4].institutions[0].id | https://openalex.org/I31746571 |
| authorships[4].institutions[0].ror | https://ror.org/03r8z3t63 |
| authorships[4].institutions[0].type | education |
| authorships[4].institutions[0].lineage | https://openalex.org/I31746571 |
| authorships[4].institutions[0].country_code | AU |
| authorships[4].institutions[0].display_name | UNSW Sydney |
| authorships[4].institutions[1].id | https://openalex.org/I154130895 |
| authorships[4].institutions[1].ror | https://ror.org/03b94tp07 |
| authorships[4].institutions[1].type | education |
| authorships[4].institutions[1].lineage | https://openalex.org/I154130895 |
| authorships[4].institutions[1].country_code | NZ |
| authorships[4].institutions[1].display_name | University of Auckland |
| authorships[4].author_position | last |
| authorships[4].raw_author_name | Boaz Shulruf |
| authorships[4].is_corresponding | True |
| authorships[4].raw_affiliation_strings | Centre for Medical and Health Sciences Education, University of Auckland, Auckland, New Zealand, Office of Medical Education, University of New South Wales, Sydney, Australia |
| has_content.pdf | False |
| has_content.grobid_xml | False |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://doi.org/10.3352/jeehp.2018.15.17 |
| open_access.oa_status | diamond |
| open_access.any_repository_has_fulltext | False |
| created_date | 2025-10-10T00:00:00 |
| display_name | Examiner seniority and experience are associated with bias when scoring communication, but not examination, skills in objective structured clinical examinations in Australia |
| has_fulltext | False |
| is_retracted | False |
| updated_date | 2025-11-06T03:46:38.306776 |
| primary_topic.id | https://openalex.org/T10254 |
| primary_topic.field.id | https://openalex.org/fields/27 |
| primary_topic.field.display_name | Medicine |
| primary_topic.score | 0.9998000264167786 |
| primary_topic.domain.id | https://openalex.org/domains/4 |
| primary_topic.domain.display_name | Health Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/2739 |
| primary_topic.subfield.display_name | Public Health, Environmental and Occupational Health |
| primary_topic.display_name | Innovations in Medical Education |
| related_works | https://openalex.org/W2092776764, https://openalex.org/W2981861109, https://openalex.org/W2103745921, https://openalex.org/W1897895570, https://openalex.org/W2160258436, https://openalex.org/W1986610724, https://openalex.org/W3199540664, https://openalex.org/W2505104363, https://openalex.org/W2798256235, https://openalex.org/W1513078292 |
| cited_by_count | 37 |
| counts_by_year[0].year | 2025 |
| counts_by_year[0].cited_by_count | 2 |
| counts_by_year[1].year | 2024 |
| counts_by_year[1].cited_by_count | 12 |
| counts_by_year[2].year | 2023 |
| counts_by_year[2].cited_by_count | 4 |
| counts_by_year[3].year | 2022 |
| counts_by_year[3].cited_by_count | 7 |
| counts_by_year[4].year | 2021 |
| counts_by_year[4].cited_by_count | 6 |
| counts_by_year[5].year | 2020 |
| counts_by_year[5].cited_by_count | 4 |
| counts_by_year[6].year | 2019 |
| counts_by_year[6].cited_by_count | 2 |
| locations_count | 6 |
| best_oa_location.id | doi:10.3352/jeehp.2018.15.17 |
| best_oa_location.is_oa | True |
| best_oa_location.source.id | https://openalex.org/S30317932 |
| best_oa_location.source.issn | 1975-5937 |
| best_oa_location.source.type | journal |
| best_oa_location.source.is_oa | True |
| best_oa_location.source.issn_l | 1975-5937 |
| best_oa_location.source.is_core | True |
| best_oa_location.source.is_in_doaj | True |
| best_oa_location.source.display_name | Journal of Educational Evaluation for Health Professions |
| best_oa_location.source.host_organization | https://openalex.org/P4310319416 |
| best_oa_location.source.host_organization_name | Korea Health Insurance Licensing Examination Institute |
| best_oa_location.source.host_organization_lineage | https://openalex.org/P4310319416 |
| best_oa_location.license | cc-by |
| best_oa_location.pdf_url | |
| best_oa_location.version | publishedVersion |
| best_oa_location.raw_type | journal-article |
| best_oa_location.license_id | https://openalex.org/licenses/cc-by |
| best_oa_location.is_accepted | True |
| best_oa_location.is_published | True |
| best_oa_location.raw_source_name | Journal of Educational Evaluation for Health Professions |
| best_oa_location.landing_page_url | https://doi.org/10.3352/jeehp.2018.15.17 |
| primary_location.id | doi:10.3352/jeehp.2018.15.17 |
| primary_location.is_oa | True |
| primary_location.source.id | https://openalex.org/S30317932 |
| primary_location.source.issn | 1975-5937 |
| primary_location.source.type | journal |
| primary_location.source.is_oa | True |
| primary_location.source.issn_l | 1975-5937 |
| primary_location.source.is_core | True |
| primary_location.source.is_in_doaj | True |
| primary_location.source.display_name | Journal of Educational Evaluation for Health Professions |
| primary_location.source.host_organization | https://openalex.org/P4310319416 |
| primary_location.source.host_organization_name | Korea Health Insurance Licensing Examination Institute |
| primary_location.source.host_organization_lineage | https://openalex.org/P4310319416 |
| primary_location.license | cc-by |
| primary_location.pdf_url | |
| primary_location.version | publishedVersion |
| primary_location.raw_type | journal-article |
| primary_location.license_id | https://openalex.org/licenses/cc-by |
| primary_location.is_accepted | True |
| primary_location.is_published | True |
| primary_location.raw_source_name | Journal of Educational Evaluation for Health Professions |
| primary_location.landing_page_url | https://doi.org/10.3352/jeehp.2018.15.17 |
| publication_date | 2018-07-18 |
| publication_year | 2018 |
| referenced_works | https://openalex.org/W2001277066, https://openalex.org/W2608645592, https://openalex.org/W2018155718, https://openalex.org/W2061520049, https://openalex.org/W935577048, https://openalex.org/W2164973508, https://openalex.org/W1979181064, https://openalex.org/W2319749590 |
| referenced_works_count | 8 |
| abstract_inverted_index.2 | 68 |
| abstract_inverted_index.We | 52, 177, 201 |
| abstract_inverted_index.at | 112 |
| abstract_inverted_index.be | 186 |
| abstract_inverted_index.by | 109 |
| abstract_inverted_index.in | 43, 67, 72, 119, 151, 216, 222 |
| abstract_inverted_index.is | 194 |
| abstract_inverted_index.of | 24, 30, 87, 99, 115, 182, 214 |
| abstract_inverted_index.on | 37 |
| abstract_inverted_index.or | 128, 135 |
| abstract_inverted_index.to | 20, 74, 189, 204, 219 |
| abstract_inverted_index.237 | 110 |
| abstract_inverted_index.New | 116 |
| abstract_inverted_index.The | 1, 84 |
| abstract_inverted_index.all | 152 |
| abstract_inverted_index.and | 15, 35, 39, 60, 63, 82, 97, 104, 121, 131, 154, 162, 211 |
| abstract_inverted_index.are | 12 |
| abstract_inverted_index.did | 137 |
| abstract_inverted_index.for | 58, 160 |
| abstract_inverted_index.has | 18, 45 |
| abstract_inverted_index.job | 132 |
| abstract_inverted_index.may | 4, 185 |
| abstract_inverted_index.not | 46, 138 |
| abstract_inverted_index.the | 22, 28, 54, 88, 93, 113, 180, 206 |
| abstract_inverted_index.was | 90, 157, 168 |
| abstract_inverted_index.yet | 47 |
| abstract_inverted_index.2014 | 120 |
| abstract_inverted_index.Five | 102 |
| abstract_inverted_index.OSCE | 223 |
| abstract_inverted_index.been | 48 |
| abstract_inverted_index.bias | 190, 221 |
| abstract_inverted_index.gave | 144 |
| abstract_inverted_index.less | 187 |
| abstract_inverted_index.mean | 55 |
| abstract_inverted_index.than | 148 |
| abstract_inverted_index.that | 3, 179 |
| abstract_inverted_index.this | 155, 192 |
| abstract_inverted_index.type | 133 |
| abstract_inverted_index.well | 13 |
| abstract_inverted_index.were | 107 |
| abstract_inverted_index.with | 172 |
| abstract_inverted_index.2016. | 122 |
| abstract_inverted_index.OSCEs | 44, 71 |
| abstract_inverted_index.South | 117 |
| abstract_inverted_index.Wales | 118 |
| abstract_inverted_index.level | 213 |
| abstract_inverted_index.their | 25 |
| abstract_inverted_index.using | 92 |
| abstract_inverted_index.(OSCE) | 10 |
| abstract_inverted_index.Junior | 142 |
| abstract_inverted_index.biases | 2 |
| abstract_inverted_index.define | 205 |
| abstract_inverted_index.fairly | 195 |
| abstract_inverted_index.higher | 146 |
| abstract_inverted_index.impact | 140 |
| abstract_inverted_index.recent | 16 |
| abstract_inverted_index.reduce | 220 |
| abstract_inverted_index.scores | 42, 56, 147 |
| abstract_inverted_index.senior | 149 |
| abstract_inverted_index.skills | 66, 184, 218 |
| abstract_inverted_index.t-test | 96 |
| abstract_inverted_index.awarded | 57 |
| abstract_inverted_index.because | 191 |
| abstract_inverted_index.clearly | 49 |
| abstract_inverted_index.doctors | 143, 150 |
| abstract_inverted_index.gender, | 124 |
| abstract_inverted_index.generic | 59, 161, 173 |
| abstract_inverted_index.greater | 198 |
| abstract_inverted_index.hundred | 103 |
| abstract_inverted_index.impact. | 26 |
| abstract_inverted_index.marking | 207 |
| abstract_inverted_index.process | 193 |
| abstract_inverted_index.scores. | 141, 165, 175 |
| abstract_inverted_index.scoring | 11, 199 |
| abstract_inverted_index.suggest | 178 |
| abstract_inverted_index.tutor), | 130 |
| abstract_inverted_index.(gender, | 77 |
| abstract_inverted_index.2-tailed | 94 |
| abstract_inverted_index.Examiner | 123, 166 |
| abstract_inverted_index.However, | 27 |
| abstract_inverted_index.Methods: | 51 |
| abstract_inverted_index.Purpose: | 0 |
| abstract_inverted_index.Results: | 101 |
| abstract_inverted_index.analysis | 98 |
| abstract_inverted_index.clinical | 8, 33, 61, 129, 163 |
| abstract_inverted_index.compared | 53 |
| abstract_inverted_index.domains, | 153 |
| abstract_inverted_index.examined | 108 |
| abstract_inverted_index.examiner | 31, 75 |
| abstract_inverted_index.expected | 212 |
| abstract_inverted_index.medicine | 70 |
| abstract_inverted_index.physical | 40, 64 |
| abstract_inverted_index.relation | 73 |
| abstract_inverted_index.research | 17 |
| abstract_inverted_index.students | 106 |
| abstract_inverted_index.teaching | 209 |
| abstract_inverted_index.training | 203 |
| abstract_inverted_index.affording | 197 |
| abstract_inverted_index.attempted | 19 |
| abstract_inverted_index.criteria, | 208 |
| abstract_inverted_index.establish | 21 |
| abstract_inverted_index.examiners | 111 |
| abstract_inverted_index.examining | 78 |
| abstract_inverted_index.influence | 5, 29 |
| abstract_inverted_index.inversely | 170 |
| abstract_inverted_index.magnitude | 23 |
| abstract_inverted_index.objective | 6 |
| abstract_inverted_index.recommend | 202 |
| abstract_inverted_index.seventeen | 105 |
| abstract_inverted_index.variance. | 100 |
| abstract_inverted_index.(academic, | 126 |
| abstract_inverted_index.University | 114 |
| abstract_inverted_index.assessment | 181 |
| abstract_inverted_index.calculated | 91 |
| abstract_inverted_index.clinician, | 127 |
| abstract_inverted_index.correlated | 171 |
| abstract_inverted_index.difference | 156 |
| abstract_inverted_index.experience | 167 |
| abstract_inverted_index.occupation | 36, 125 |
| abstract_inverted_index.seniority, | 34, 81 |
| abstract_inverted_index.structured | 7 |
| abstract_inverted_index.(specialist | 134 |
| abstract_inverted_index.Conclusion: | 176 |
| abstract_inverted_index.assessment. | 224 |
| abstract_inverted_index.curriculum, | 210 |
| abstract_inverted_index.differences | 89 |
| abstract_inverted_index.examination | 9, 41, 65, 183 |
| abstract_inverted_index.experience, | 32, 79 |
| abstract_inverted_index.generalist) | 136 |
| abstract_inverted_index.independent | 95 |
| abstract_inverted_index.occupation, | 80 |
| abstract_inverted_index.performance | 215 |
| abstract_inverted_index.significant | 159 |
| abstract_inverted_index.statistical | 85 |
| abstract_inverted_index.susceptible | 188 |
| abstract_inverted_index.understood, | 14 |
| abstract_inverted_index.consistently | 145 |
| abstract_inverted_index.established. | 50 |
| abstract_inverted_index.objectivity. | 200 |
| abstract_inverted_index.significance | 86 |
| abstract_inverted_index.speciality). | 83 |
| abstract_inverted_index.communication | 38, 62, 164, 174, 217 |
| abstract_inverted_index.prescriptive, | 196 |
| abstract_inverted_index.significantly | 139, 169 |
| abstract_inverted_index.statistically | 158 |
| abstract_inverted_index.undergraduate | 69 |
| abstract_inverted_index.characteristics | 76 |
| cited_by_percentile_year.max | 99 |
| cited_by_percentile_year.min | 94 |
| corresponding_author_ids | https://openalex.org/A5034597140 |
| countries_distinct_count | 2 |
| institutions_distinct_count | 5 |
| corresponding_institution_ids | https://openalex.org/I154130895, https://openalex.org/I31746571 |
| sustainable_development_goals[0].id | https://metadata.un.org/sdg/4 |
| sustainable_development_goals[0].score | 0.7900000214576721 |
| sustainable_development_goals[0].display_name | Quality Education |
| citation_normalized_percentile.value | 0.89938792 |
| citation_normalized_percentile.is_in_top_1_percent | False |
| citation_normalized_percentile.is_in_top_10_percent | True |