Development and validation of a portfolio assessment system for medical schools in Korea Article Swipe
YOU?
·
· 2020
· Open Access
·
· DOI: https://doi.org/10.3352/jeehp.2020.17.39
Purpose: Consistent evaluation procedures based on objective and rational standards are essential for the sustainability of portfolio-based education, which has been widely introduced in medical education. We aimed to develop and implement a portfolio assessment system, and to assess its validity and reliability.Methods: We developed a portfolio assessment system from March 2019 to August 2019 and confirmed its content validity through expert assessment by an expert group comprising 2 medical education specialists, 2 professors involved in education at medical school, and a professor of basic medical science. Six trained assessors conducted 2 rounds of evaluation of 7 randomly selected portfolios for the “Self-Development and Portfolio II” course from January 2020 to July 2020. These data are used inter-rater reliability was evaluated using intra-class correlation coefficients (ICCs) in September 2020.Results: The portfolio assessment system is based on the following process; assessor selection, training, analytical/comprehensive evaluation, and consensus. Appropriately trained assessors evaluated portfolios based on specific assessment criteria and a rubric for assigning points. In the analysis of inter-rater reliability, the first round of evaluation grades was submitted, and all assessment areas except “goal-setting” showed a high ICC of 0.81 or higher. After the first round of assessment, we attempted to standardize objective assessment procedures. As a result, all components of the assessments showed close correlations, with ICCs of 0.81 or higher.Conclusion: We confirmed that when assessors with an appropriate training conduct portfolio assessment based on specified standards through a systematic procedure, the results are reliable.
Related Topics
- Type
- article
- Language
- en
- Landing Page
- https://doi.org/10.3352/jeehp.2020.17.39
- OA Status
- diamond
- Cited By
- 11
- References
- 9
- Related Works
- 10
- OpenAlex ID
- https://openalex.org/W3111884771
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W3111884771Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.3352/jeehp.2020.17.39Digital Object Identifier
- Title
-
Development and validation of a portfolio assessment system for medical schools in KoreaWork title
- Type
-
articleOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2020Year of publication
- Publication date
-
2020-12-09Full publication date if available
- Authors
-
Dong-Mi Yoo, A-Ra Cho, Sun KimList of authors in order
- Landing page
-
https://doi.org/10.3352/jeehp.2020.17.39Publisher landing page
- Open access
-
YesWhether a free full text is available
- OA status
-
diamondOpen access status per OpenAlex
- OA URL
-
https://doi.org/10.3352/jeehp.2020.17.39Direct OA link when available
- Concepts
-
Rubric, Portfolio, Reliability (semiconductor), Medical education, Peer assessment, Computer science, Self-assessment, Educational measurement, Psychology, Medical physics, Medicine, Curriculum, Mathematics education, Pedagogy, Business, Power (physics), Finance, Quantum mechanics, PhysicsTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
11Total citation count in OpenAlex
- Citations by year (recent)
-
2025: 1, 2024: 4, 2022: 4, 2021: 2Per-year citation counts (last 5 years)
- References (count)
-
9Number of works referenced by this work
- Related works (count)
-
10Other works algorithmically related by OpenAlex
Full payload
| id | https://openalex.org/W3111884771 |
|---|---|
| doi | https://doi.org/10.3352/jeehp.2020.17.39 |
| ids.doi | https://doi.org/10.3352/jeehp.2020.17.39 |
| ids.mag | 3111884771 |
| ids.pmid | https://pubmed.ncbi.nlm.nih.gov/33291206 |
| ids.openalex | https://openalex.org/W3111884771 |
| fwci | 1.28206329 |
| mesh[0].qualifier_ui | |
| mesh[0].descriptor_ui | D002983 |
| mesh[0].is_major_topic | False |
| mesh[0].qualifier_name | |
| mesh[0].descriptor_name | Clinical Competence |
| mesh[1].qualifier_ui | |
| mesh[1].descriptor_ui | D004521 |
| mesh[1].is_major_topic | True |
| mesh[1].qualifier_name | |
| mesh[1].descriptor_name | Educational Measurement |
| mesh[2].qualifier_ui | |
| mesh[2].descriptor_ui | D006801 |
| mesh[2].is_major_topic | False |
| mesh[2].qualifier_name | |
| mesh[2].descriptor_name | Humans |
| mesh[3].qualifier_ui | |
| mesh[3].descriptor_ui | D015203 |
| mesh[3].is_major_topic | False |
| mesh[3].qualifier_name | |
| mesh[3].descriptor_name | Reproducibility of Results |
| mesh[4].qualifier_ui | |
| mesh[4].descriptor_ui | D056910 |
| mesh[4].is_major_topic | False |
| mesh[4].qualifier_name | |
| mesh[4].descriptor_name | Republic of Korea |
| mesh[5].qualifier_ui | |
| mesh[5].descriptor_ui | D012577 |
| mesh[5].is_major_topic | True |
| mesh[5].qualifier_name | |
| mesh[5].descriptor_name | Schools, Medical |
| mesh[6].qualifier_ui | |
| mesh[6].descriptor_ui | D002983 |
| mesh[6].is_major_topic | False |
| mesh[6].qualifier_name | |
| mesh[6].descriptor_name | Clinical Competence |
| mesh[7].qualifier_ui | |
| mesh[7].descriptor_ui | D004521 |
| mesh[7].is_major_topic | True |
| mesh[7].qualifier_name | |
| mesh[7].descriptor_name | Educational Measurement |
| mesh[8].qualifier_ui | |
| mesh[8].descriptor_ui | D006801 |
| mesh[8].is_major_topic | False |
| mesh[8].qualifier_name | |
| mesh[8].descriptor_name | Humans |
| mesh[9].qualifier_ui | |
| mesh[9].descriptor_ui | D015203 |
| mesh[9].is_major_topic | False |
| mesh[9].qualifier_name | |
| mesh[9].descriptor_name | Reproducibility of Results |
| mesh[10].qualifier_ui | |
| mesh[10].descriptor_ui | D056910 |
| mesh[10].is_major_topic | False |
| mesh[10].qualifier_name | |
| mesh[10].descriptor_name | Republic of Korea |
| mesh[11].qualifier_ui | |
| mesh[11].descriptor_ui | D012577 |
| mesh[11].is_major_topic | True |
| mesh[11].qualifier_name | |
| mesh[11].descriptor_name | Schools, Medical |
| type | article |
| title | Development and validation of a portfolio assessment system for medical schools in Korea |
| biblio.issue | |
| biblio.volume | 17 |
| biblio.last_page | 39 |
| biblio.first_page | 39 |
| topics[0].id | https://openalex.org/T10254 |
| topics[0].field.id | https://openalex.org/fields/27 |
| topics[0].field.display_name | Medicine |
| topics[0].score | 0.9972000122070312 |
| topics[0].domain.id | https://openalex.org/domains/4 |
| topics[0].domain.display_name | Health Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/2739 |
| topics[0].subfield.display_name | Public Health, Environmental and Occupational Health |
| topics[0].display_name | Innovations in Medical Education |
| topics[1].id | https://openalex.org/T11238 |
| topics[1].field.id | https://openalex.org/fields/27 |
| topics[1].field.display_name | Medicine |
| topics[1].score | 0.9837999939918518 |
| topics[1].domain.id | https://openalex.org/domains/4 |
| topics[1].domain.display_name | Health Sciences |
| topics[1].subfield.id | https://openalex.org/subfields/2737 |
| topics[1].subfield.display_name | Physiology |
| topics[1].display_name | Simulation-Based Education in Healthcare |
| topics[2].id | https://openalex.org/T12244 |
| topics[2].field.id | https://openalex.org/fields/29 |
| topics[2].field.display_name | Nursing |
| topics[2].score | 0.9678000211715698 |
| topics[2].domain.id | https://openalex.org/domains/4 |
| topics[2].domain.display_name | Health Sciences |
| topics[2].subfield.id | https://openalex.org/subfields/2911 |
| topics[2].subfield.display_name | Leadership and Management |
| topics[2].display_name | Healthcare Education and Workforce Issues |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| concepts[0].id | https://openalex.org/C111640148 |
| concepts[0].level | 2 |
| concepts[0].score | 0.8664001226425171 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q847349 |
| concepts[0].display_name | Rubric |
| concepts[1].id | https://openalex.org/C2780821815 |
| concepts[1].level | 2 |
| concepts[1].score | 0.7463141679763794 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q5340806 |
| concepts[1].display_name | Portfolio |
| concepts[2].id | https://openalex.org/C43214815 |
| concepts[2].level | 3 |
| concepts[2].score | 0.5840334892272949 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q7310987 |
| concepts[2].display_name | Reliability (semiconductor) |
| concepts[3].id | https://openalex.org/C509550671 |
| concepts[3].level | 1 |
| concepts[3].score | 0.5390891432762146 |
| concepts[3].wikidata | https://www.wikidata.org/wiki/Q126945 |
| concepts[3].display_name | Medical education |
| concepts[4].id | https://openalex.org/C53839665 |
| concepts[4].level | 2 |
| concepts[4].score | 0.5108775496482849 |
| concepts[4].wikidata | https://www.wikidata.org/wiki/Q2067088 |
| concepts[4].display_name | Peer assessment |
| concepts[5].id | https://openalex.org/C41008148 |
| concepts[5].level | 0 |
| concepts[5].score | 0.4504830837249756 |
| concepts[5].wikidata | https://www.wikidata.org/wiki/Q21198 |
| concepts[5].display_name | Computer science |
| concepts[6].id | https://openalex.org/C205333247 |
| concepts[6].level | 2 |
| concepts[6].score | 0.44492581486701965 |
| concepts[6].wikidata | https://www.wikidata.org/wiki/Q1602656 |
| concepts[6].display_name | Self-assessment |
| concepts[7].id | https://openalex.org/C22156102 |
| concepts[7].level | 3 |
| concepts[7].score | 0.4426419138908386 |
| concepts[7].wikidata | https://www.wikidata.org/wiki/Q5341294 |
| concepts[7].display_name | Educational measurement |
| concepts[8].id | https://openalex.org/C15744967 |
| concepts[8].level | 0 |
| concepts[8].score | 0.36067110300064087 |
| concepts[8].wikidata | https://www.wikidata.org/wiki/Q9418 |
| concepts[8].display_name | Psychology |
| concepts[9].id | https://openalex.org/C19527891 |
| concepts[9].level | 1 |
| concepts[9].score | 0.3370511531829834 |
| concepts[9].wikidata | https://www.wikidata.org/wiki/Q1120908 |
| concepts[9].display_name | Medical physics |
| concepts[10].id | https://openalex.org/C71924100 |
| concepts[10].level | 0 |
| concepts[10].score | 0.27985119819641113 |
| concepts[10].wikidata | https://www.wikidata.org/wiki/Q11190 |
| concepts[10].display_name | Medicine |
| concepts[11].id | https://openalex.org/C47177190 |
| concepts[11].level | 2 |
| concepts[11].score | 0.26683592796325684 |
| concepts[11].wikidata | https://www.wikidata.org/wiki/Q207137 |
| concepts[11].display_name | Curriculum |
| concepts[12].id | https://openalex.org/C145420912 |
| concepts[12].level | 1 |
| concepts[12].score | 0.2319890260696411 |
| concepts[12].wikidata | https://www.wikidata.org/wiki/Q853077 |
| concepts[12].display_name | Mathematics education |
| concepts[13].id | https://openalex.org/C19417346 |
| concepts[13].level | 1 |
| concepts[13].score | 0.11077108979225159 |
| concepts[13].wikidata | https://www.wikidata.org/wiki/Q7922 |
| concepts[13].display_name | Pedagogy |
| concepts[14].id | https://openalex.org/C144133560 |
| concepts[14].level | 0 |
| concepts[14].score | 0.08233079314231873 |
| concepts[14].wikidata | https://www.wikidata.org/wiki/Q4830453 |
| concepts[14].display_name | Business |
| concepts[15].id | https://openalex.org/C163258240 |
| concepts[15].level | 2 |
| concepts[15].score | 0.0 |
| concepts[15].wikidata | https://www.wikidata.org/wiki/Q25342 |
| concepts[15].display_name | Power (physics) |
| concepts[16].id | https://openalex.org/C10138342 |
| concepts[16].level | 1 |
| concepts[16].score | 0.0 |
| concepts[16].wikidata | https://www.wikidata.org/wiki/Q43015 |
| concepts[16].display_name | Finance |
| concepts[17].id | https://openalex.org/C62520636 |
| concepts[17].level | 1 |
| concepts[17].score | 0.0 |
| concepts[17].wikidata | https://www.wikidata.org/wiki/Q944 |
| concepts[17].display_name | Quantum mechanics |
| concepts[18].id | https://openalex.org/C121332964 |
| concepts[18].level | 0 |
| concepts[18].score | 0.0 |
| concepts[18].wikidata | https://www.wikidata.org/wiki/Q413 |
| concepts[18].display_name | Physics |
| keywords[0].id | https://openalex.org/keywords/rubric |
| keywords[0].score | 0.8664001226425171 |
| keywords[0].display_name | Rubric |
| keywords[1].id | https://openalex.org/keywords/portfolio |
| keywords[1].score | 0.7463141679763794 |
| keywords[1].display_name | Portfolio |
| keywords[2].id | https://openalex.org/keywords/reliability |
| keywords[2].score | 0.5840334892272949 |
| keywords[2].display_name | Reliability (semiconductor) |
| keywords[3].id | https://openalex.org/keywords/medical-education |
| keywords[3].score | 0.5390891432762146 |
| keywords[3].display_name | Medical education |
| keywords[4].id | https://openalex.org/keywords/peer-assessment |
| keywords[4].score | 0.5108775496482849 |
| keywords[4].display_name | Peer assessment |
| keywords[5].id | https://openalex.org/keywords/computer-science |
| keywords[5].score | 0.4504830837249756 |
| keywords[5].display_name | Computer science |
| keywords[6].id | https://openalex.org/keywords/self-assessment |
| keywords[6].score | 0.44492581486701965 |
| keywords[6].display_name | Self-assessment |
| keywords[7].id | https://openalex.org/keywords/educational-measurement |
| keywords[7].score | 0.4426419138908386 |
| keywords[7].display_name | Educational measurement |
| keywords[8].id | https://openalex.org/keywords/psychology |
| keywords[8].score | 0.36067110300064087 |
| keywords[8].display_name | Psychology |
| keywords[9].id | https://openalex.org/keywords/medical-physics |
| keywords[9].score | 0.3370511531829834 |
| keywords[9].display_name | Medical physics |
| keywords[10].id | https://openalex.org/keywords/medicine |
| keywords[10].score | 0.27985119819641113 |
| keywords[10].display_name | Medicine |
| keywords[11].id | https://openalex.org/keywords/curriculum |
| keywords[11].score | 0.26683592796325684 |
| keywords[11].display_name | Curriculum |
| keywords[12].id | https://openalex.org/keywords/mathematics-education |
| keywords[12].score | 0.2319890260696411 |
| keywords[12].display_name | Mathematics education |
| keywords[13].id | https://openalex.org/keywords/pedagogy |
| keywords[13].score | 0.11077108979225159 |
| keywords[13].display_name | Pedagogy |
| keywords[14].id | https://openalex.org/keywords/business |
| keywords[14].score | 0.08233079314231873 |
| keywords[14].display_name | Business |
| language | en |
| locations[0].id | doi:10.3352/jeehp.2020.17.39 |
| locations[0].is_oa | True |
| locations[0].source.id | https://openalex.org/S30317932 |
| locations[0].source.issn | 1975-5937 |
| locations[0].source.type | journal |
| locations[0].source.is_oa | True |
| locations[0].source.issn_l | 1975-5937 |
| locations[0].source.is_core | True |
| locations[0].source.is_in_doaj | True |
| locations[0].source.display_name | Journal of Educational Evaluation for Health Professions |
| locations[0].source.host_organization | https://openalex.org/P4310319416 |
| locations[0].source.host_organization_name | Korea Health Insurance Licensing Examination Institute |
| locations[0].source.host_organization_lineage | https://openalex.org/P4310319416 |
| locations[0].license | cc-by |
| locations[0].pdf_url | |
| locations[0].version | publishedVersion |
| locations[0].raw_type | journal-article |
| locations[0].license_id | https://openalex.org/licenses/cc-by |
| locations[0].is_accepted | True |
| locations[0].is_published | True |
| locations[0].raw_source_name | Journal of Educational Evaluation for Health Professions |
| locations[0].landing_page_url | https://doi.org/10.3352/jeehp.2020.17.39 |
| locations[1].id | pmid:33291206 |
| locations[1].is_oa | False |
| locations[1].source.id | https://openalex.org/S4306525036 |
| locations[1].source.issn | |
| locations[1].source.type | repository |
| locations[1].source.is_oa | False |
| locations[1].source.issn_l | |
| locations[1].source.is_core | False |
| locations[1].source.is_in_doaj | False |
| locations[1].source.display_name | PubMed |
| locations[1].source.host_organization | https://openalex.org/I1299303238 |
| locations[1].source.host_organization_name | National Institutes of Health |
| locations[1].source.host_organization_lineage | https://openalex.org/I1299303238 |
| locations[1].license | |
| locations[1].pdf_url | |
| locations[1].version | publishedVersion |
| locations[1].raw_type | |
| locations[1].license_id | |
| locations[1].is_accepted | True |
| locations[1].is_published | True |
| locations[1].raw_source_name | Journal of educational evaluation for health professions |
| locations[1].landing_page_url | https://pubmed.ncbi.nlm.nih.gov/33291206 |
| locations[2].id | pmh:oai:pubmedcentral.nih.gov:7859386 |
| locations[2].is_oa | True |
| locations[2].source.id | https://openalex.org/S2764455111 |
| locations[2].source.issn | |
| locations[2].source.type | repository |
| locations[2].source.is_oa | False |
| locations[2].source.issn_l | |
| locations[2].source.is_core | False |
| locations[2].source.is_in_doaj | False |
| locations[2].source.display_name | PubMed Central |
| locations[2].source.host_organization | https://openalex.org/I1299303238 |
| locations[2].source.host_organization_name | National Institutes of Health |
| locations[2].source.host_organization_lineage | https://openalex.org/I1299303238 |
| locations[2].license | other-oa |
| locations[2].pdf_url | |
| locations[2].version | submittedVersion |
| locations[2].raw_type | Text |
| locations[2].license_id | https://openalex.org/licenses/other-oa |
| locations[2].is_accepted | False |
| locations[2].is_published | False |
| locations[2].raw_source_name | J Educ Eval Health Prof |
| locations[2].landing_page_url | https://www.ncbi.nlm.nih.gov/pmc/articles/7859386 |
| locations[3].id | pmh:oai:doaj.org/article:8607db7a00a843d08370d24a6f587e40 |
| locations[3].is_oa | True |
| locations[3].source.id | https://openalex.org/S4306401280 |
| locations[3].source.issn | |
| locations[3].source.type | repository |
| locations[3].source.is_oa | False |
| locations[3].source.issn_l | |
| locations[3].source.is_core | False |
| locations[3].source.is_in_doaj | False |
| locations[3].source.display_name | DOAJ (DOAJ: Directory of Open Access Journals) |
| locations[3].source.host_organization | |
| locations[3].source.host_organization_name | |
| locations[3].source.host_organization_lineage | |
| locations[3].license | cc-by-sa |
| locations[3].pdf_url | |
| locations[3].version | submittedVersion |
| locations[3].raw_type | article |
| locations[3].license_id | https://openalex.org/licenses/cc-by-sa |
| locations[3].is_accepted | False |
| locations[3].is_published | False |
| locations[3].raw_source_name | Journal of Educational Evaluation for Health Professions, Vol 17 (2020) |
| locations[3].landing_page_url | https://doaj.org/article/8607db7a00a843d08370d24a6f587e40 |
| indexed_in | crossref, doaj, pubmed |
| authorships[0].author.id | https://openalex.org/A5014131845 |
| authorships[0].author.orcid | https://orcid.org/0000-0002-9344-6807 |
| authorships[0].author.display_name | Dong-Mi Yoo |
| authorships[0].countries | KR |
| authorships[0].affiliations[0].institution_ids | https://openalex.org/I87111246 |
| authorships[0].affiliations[0].raw_affiliation_string | Department of Medical Education, College of Medicine, The Catholic University of Korea, Seoul, Korea |
| authorships[0].institutions[0].id | https://openalex.org/I87111246 |
| authorships[0].institutions[0].ror | https://ror.org/01fpnj063 |
| authorships[0].institutions[0].type | education |
| authorships[0].institutions[0].lineage | https://openalex.org/I87111246 |
| authorships[0].institutions[0].country_code | KR |
| authorships[0].institutions[0].display_name | Catholic University of Korea |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Dong Mi Yoo |
| authorships[0].is_corresponding | False |
| authorships[0].raw_affiliation_strings | Department of Medical Education, College of Medicine, The Catholic University of Korea, Seoul, Korea |
| authorships[1].author.id | https://openalex.org/A5021444227 |
| authorships[1].author.orcid | https://orcid.org/0000-0003-0458-5256 |
| authorships[1].author.display_name | A-Ra Cho |
| authorships[1].countries | KR |
| authorships[1].affiliations[0].institution_ids | https://openalex.org/I87111246 |
| authorships[1].affiliations[0].raw_affiliation_string | Department of Medical Education, College of Medicine, The Catholic University of Korea, Seoul, Korea |
| authorships[1].institutions[0].id | https://openalex.org/I87111246 |
| authorships[1].institutions[0].ror | https://ror.org/01fpnj063 |
| authorships[1].institutions[0].type | education |
| authorships[1].institutions[0].lineage | https://openalex.org/I87111246 |
| authorships[1].institutions[0].country_code | KR |
| authorships[1].institutions[0].display_name | Catholic University of Korea |
| authorships[1].author_position | middle |
| authorships[1].raw_author_name | A Ra Cho |
| authorships[1].is_corresponding | False |
| authorships[1].raw_affiliation_strings | Department of Medical Education, College of Medicine, The Catholic University of Korea, Seoul, Korea |
| authorships[2].author.id | https://openalex.org/A5100460445 |
| authorships[2].author.orcid | https://orcid.org/0000-0002-5152-9153 |
| authorships[2].author.display_name | Sun Kim |
| authorships[2].countries | KR |
| authorships[2].affiliations[0].institution_ids | https://openalex.org/I87111246 |
| authorships[2].affiliations[0].raw_affiliation_string | Department of Medical Education, College of Medicine, The Catholic University of Korea, Seoul, Korea |
| authorships[2].institutions[0].id | https://openalex.org/I87111246 |
| authorships[2].institutions[0].ror | https://ror.org/01fpnj063 |
| authorships[2].institutions[0].type | education |
| authorships[2].institutions[0].lineage | https://openalex.org/I87111246 |
| authorships[2].institutions[0].country_code | KR |
| authorships[2].institutions[0].display_name | Catholic University of Korea |
| authorships[2].author_position | last |
| authorships[2].raw_author_name | Sun Kim |
| authorships[2].is_corresponding | False |
| authorships[2].raw_affiliation_strings | Department of Medical Education, College of Medicine, The Catholic University of Korea, Seoul, Korea |
| has_content.pdf | False |
| has_content.grobid_xml | False |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://doi.org/10.3352/jeehp.2020.17.39 |
| open_access.oa_status | diamond |
| open_access.any_repository_has_fulltext | False |
| created_date | 2025-10-10T00:00:00 |
| display_name | Development and validation of a portfolio assessment system for medical schools in Korea |
| has_fulltext | False |
| is_retracted | False |
| updated_date | 2025-11-06T03:46:38.306776 |
| primary_topic.id | https://openalex.org/T10254 |
| primary_topic.field.id | https://openalex.org/fields/27 |
| primary_topic.field.display_name | Medicine |
| primary_topic.score | 0.9972000122070312 |
| primary_topic.domain.id | https://openalex.org/domains/4 |
| primary_topic.domain.display_name | Health Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/2739 |
| primary_topic.subfield.display_name | Public Health, Environmental and Occupational Health |
| primary_topic.display_name | Innovations in Medical Education |
| related_works | https://openalex.org/W2488232887, https://openalex.org/W1648438236, https://openalex.org/W3138734495, https://openalex.org/W2912039502, https://openalex.org/W4293234378, https://openalex.org/W2182425248, https://openalex.org/W3178954124, https://openalex.org/W2364011943, https://openalex.org/W2080627647, https://openalex.org/W2992816059 |
| cited_by_count | 11 |
| counts_by_year[0].year | 2025 |
| counts_by_year[0].cited_by_count | 1 |
| counts_by_year[1].year | 2024 |
| counts_by_year[1].cited_by_count | 4 |
| counts_by_year[2].year | 2022 |
| counts_by_year[2].cited_by_count | 4 |
| counts_by_year[3].year | 2021 |
| counts_by_year[3].cited_by_count | 2 |
| locations_count | 4 |
| best_oa_location.id | doi:10.3352/jeehp.2020.17.39 |
| best_oa_location.is_oa | True |
| best_oa_location.source.id | https://openalex.org/S30317932 |
| best_oa_location.source.issn | 1975-5937 |
| best_oa_location.source.type | journal |
| best_oa_location.source.is_oa | True |
| best_oa_location.source.issn_l | 1975-5937 |
| best_oa_location.source.is_core | True |
| best_oa_location.source.is_in_doaj | True |
| best_oa_location.source.display_name | Journal of Educational Evaluation for Health Professions |
| best_oa_location.source.host_organization | https://openalex.org/P4310319416 |
| best_oa_location.source.host_organization_name | Korea Health Insurance Licensing Examination Institute |
| best_oa_location.source.host_organization_lineage | https://openalex.org/P4310319416 |
| best_oa_location.license | cc-by |
| best_oa_location.pdf_url | |
| best_oa_location.version | publishedVersion |
| best_oa_location.raw_type | journal-article |
| best_oa_location.license_id | https://openalex.org/licenses/cc-by |
| best_oa_location.is_accepted | True |
| best_oa_location.is_published | True |
| best_oa_location.raw_source_name | Journal of Educational Evaluation for Health Professions |
| best_oa_location.landing_page_url | https://doi.org/10.3352/jeehp.2020.17.39 |
| primary_location.id | doi:10.3352/jeehp.2020.17.39 |
| primary_location.is_oa | True |
| primary_location.source.id | https://openalex.org/S30317932 |
| primary_location.source.issn | 1975-5937 |
| primary_location.source.type | journal |
| primary_location.source.is_oa | True |
| primary_location.source.issn_l | 1975-5937 |
| primary_location.source.is_core | True |
| primary_location.source.is_in_doaj | True |
| primary_location.source.display_name | Journal of Educational Evaluation for Health Professions |
| primary_location.source.host_organization | https://openalex.org/P4310319416 |
| primary_location.source.host_organization_name | Korea Health Insurance Licensing Examination Institute |
| primary_location.source.host_organization_lineage | https://openalex.org/P4310319416 |
| primary_location.license | cc-by |
| primary_location.pdf_url | |
| primary_location.version | publishedVersion |
| primary_location.raw_type | journal-article |
| primary_location.license_id | https://openalex.org/licenses/cc-by |
| primary_location.is_accepted | True |
| primary_location.is_published | True |
| primary_location.raw_source_name | Journal of Educational Evaluation for Health Professions |
| primary_location.landing_page_url | https://doi.org/10.3352/jeehp.2020.17.39 |
| publication_date | 2020-12-09 |
| publication_year | 2020 |
| referenced_works | https://openalex.org/W2996825337, https://openalex.org/W2802900570, https://openalex.org/W2140608827, https://openalex.org/W2529430547, https://openalex.org/W2528286413, https://openalex.org/W2334544874, https://openalex.org/W2111412547, https://openalex.org/W2187116726, https://openalex.org/W2168420151 |
| referenced_works_count | 9 |
| abstract_inverted_index.2 | 68, 72, 91 |
| abstract_inverted_index.7 | 96 |
| abstract_inverted_index.a | 32, 45, 81, 157, 183, 204, 237 |
| abstract_inverted_index.As | 203 |
| abstract_inverted_index.In | 162 |
| abstract_inverted_index.We | 26, 43, 220 |
| abstract_inverted_index.an | 64, 226 |
| abstract_inverted_index.at | 77 |
| abstract_inverted_index.by | 63 |
| abstract_inverted_index.in | 23, 75, 126 |
| abstract_inverted_index.is | 133 |
| abstract_inverted_index.of | 15, 83, 93, 95, 165, 171, 186, 194, 208, 216 |
| abstract_inverted_index.on | 5, 135, 152, 233 |
| abstract_inverted_index.or | 188, 218 |
| abstract_inverted_index.to | 28, 37, 52, 110, 198 |
| abstract_inverted_index.we | 196 |
| abstract_inverted_index.ICC | 185 |
| abstract_inverted_index.Six | 87 |
| abstract_inverted_index.The | 129 |
| abstract_inverted_index.all | 177, 206 |
| abstract_inverted_index.and | 7, 30, 36, 41, 55, 80, 103, 144, 156, 176 |
| abstract_inverted_index.are | 10, 115, 242 |
| abstract_inverted_index.for | 12, 100, 159 |
| abstract_inverted_index.has | 19 |
| abstract_inverted_index.its | 39, 57 |
| abstract_inverted_index.the | 13, 101, 136, 163, 168, 191, 209, 240 |
| abstract_inverted_index.was | 119, 174 |
| abstract_inverted_index.0.81 | 187, 217 |
| abstract_inverted_index.2019 | 51, 54 |
| abstract_inverted_index.2020 | 109 |
| abstract_inverted_index.ICCs | 215 |
| abstract_inverted_index.July | 111 |
| abstract_inverted_index.been | 20 |
| abstract_inverted_index.data | 114 |
| abstract_inverted_index.from | 49, 107 |
| abstract_inverted_index.high | 184 |
| abstract_inverted_index.that | 222 |
| abstract_inverted_index.used | 116 |
| abstract_inverted_index.when | 223 |
| abstract_inverted_index.with | 214, 225 |
| abstract_inverted_index.2020. | 112 |
| abstract_inverted_index.After | 190 |
| abstract_inverted_index.II” | 105 |
| abstract_inverted_index.March | 50 |
| abstract_inverted_index.These | 113 |
| abstract_inverted_index.aimed | 27 |
| abstract_inverted_index.areas | 179 |
| abstract_inverted_index.based | 4, 134, 151, 232 |
| abstract_inverted_index.basic | 84 |
| abstract_inverted_index.close | 212 |
| abstract_inverted_index.first | 169, 192 |
| abstract_inverted_index.group | 66 |
| abstract_inverted_index.round | 170, 193 |
| abstract_inverted_index.using | 121 |
| abstract_inverted_index.which | 18 |
| abstract_inverted_index.(ICCs) | 125 |
| abstract_inverted_index.August | 53 |
| abstract_inverted_index.assess | 38 |
| abstract_inverted_index.course | 106 |
| abstract_inverted_index.except | 180 |
| abstract_inverted_index.expert | 61, 65 |
| abstract_inverted_index.grades | 173 |
| abstract_inverted_index.rounds | 92 |
| abstract_inverted_index.rubric | 158 |
| abstract_inverted_index.showed | 182, 211 |
| abstract_inverted_index.system | 48, 132 |
| abstract_inverted_index.widely | 21 |
| abstract_inverted_index.January | 108 |
| abstract_inverted_index.conduct | 229 |
| abstract_inverted_index.content | 58 |
| abstract_inverted_index.develop | 29 |
| abstract_inverted_index.higher. | 189 |
| abstract_inverted_index.medical | 24, 69, 78, 85 |
| abstract_inverted_index.points. | 161 |
| abstract_inverted_index.result, | 205 |
| abstract_inverted_index.results | 241 |
| abstract_inverted_index.school, | 79 |
| abstract_inverted_index.system, | 35 |
| abstract_inverted_index.through | 60, 236 |
| abstract_inverted_index.trained | 88, 147 |
| abstract_inverted_index.Purpose: | 0 |
| abstract_inverted_index.analysis | 164 |
| abstract_inverted_index.assessor | 139 |
| abstract_inverted_index.criteria | 155 |
| abstract_inverted_index.involved | 74 |
| abstract_inverted_index.process; | 138 |
| abstract_inverted_index.randomly | 97 |
| abstract_inverted_index.rational | 8 |
| abstract_inverted_index.science. | 86 |
| abstract_inverted_index.selected | 98 |
| abstract_inverted_index.specific | 153 |
| abstract_inverted_index.training | 228 |
| abstract_inverted_index.validity | 40, 59 |
| abstract_inverted_index.Portfolio | 104 |
| abstract_inverted_index.September | 127 |
| abstract_inverted_index.assessors | 89, 148, 224 |
| abstract_inverted_index.assigning | 160 |
| abstract_inverted_index.attempted | 197 |
| abstract_inverted_index.conducted | 90 |
| abstract_inverted_index.confirmed | 56, 221 |
| abstract_inverted_index.developed | 44 |
| abstract_inverted_index.education | 70, 76 |
| abstract_inverted_index.essential | 11 |
| abstract_inverted_index.evaluated | 120, 149 |
| abstract_inverted_index.following | 137 |
| abstract_inverted_index.implement | 31 |
| abstract_inverted_index.objective | 6, 200 |
| abstract_inverted_index.portfolio | 33, 46, 130, 230 |
| abstract_inverted_index.professor | 82 |
| abstract_inverted_index.reliable. | 243 |
| abstract_inverted_index.specified | 234 |
| abstract_inverted_index.standards | 9, 235 |
| abstract_inverted_index.training, | 141 |
| abstract_inverted_index.Consistent | 1 |
| abstract_inverted_index.assessment | 34, 47, 62, 131, 154, 178, 201, 231 |
| abstract_inverted_index.components | 207 |
| abstract_inverted_index.comprising | 67 |
| abstract_inverted_index.consensus. | 145 |
| abstract_inverted_index.education, | 17 |
| abstract_inverted_index.education. | 25 |
| abstract_inverted_index.evaluation | 2, 94, 172 |
| abstract_inverted_index.introduced | 22 |
| abstract_inverted_index.portfolios | 99, 150 |
| abstract_inverted_index.procedure, | 239 |
| abstract_inverted_index.procedures | 3 |
| abstract_inverted_index.professors | 73 |
| abstract_inverted_index.selection, | 140 |
| abstract_inverted_index.submitted, | 175 |
| abstract_inverted_index.systematic | 238 |
| abstract_inverted_index.appropriate | 227 |
| abstract_inverted_index.assessment, | 195 |
| abstract_inverted_index.assessments | 210 |
| abstract_inverted_index.correlation | 123 |
| abstract_inverted_index.evaluation, | 143 |
| abstract_inverted_index.inter-rater | 117, 166 |
| abstract_inverted_index.intra-class | 122 |
| abstract_inverted_index.procedures. | 202 |
| abstract_inverted_index.reliability | 118 |
| abstract_inverted_index.standardize | 199 |
| abstract_inverted_index.coefficients | 124 |
| abstract_inverted_index.reliability, | 167 |
| abstract_inverted_index.specialists, | 71 |
| abstract_inverted_index.2020.Results: | 128 |
| abstract_inverted_index.Appropriately | 146 |
| abstract_inverted_index.correlations, | 213 |
| abstract_inverted_index.sustainability | 14 |
| abstract_inverted_index.portfolio-based | 16 |
| abstract_inverted_index.higher.Conclusion: | 219 |
| abstract_inverted_index.“goal-setting” | 181 |
| abstract_inverted_index.“Self-Development | 102 |
| abstract_inverted_index.reliability.Methods: | 42 |
| abstract_inverted_index.analytical/comprehensive | 142 |
| cited_by_percentile_year.max | 98 |
| cited_by_percentile_year.min | 91 |
| countries_distinct_count | 1 |
| institutions_distinct_count | 3 |
| sustainable_development_goals[0].id | https://metadata.un.org/sdg/4 |
| sustainable_development_goals[0].score | 0.41999998688697815 |
| sustainable_development_goals[0].display_name | Quality Education |
| citation_normalized_percentile.value | 0.80586886 |
| citation_normalized_percentile.is_in_top_1_percent | False |
| citation_normalized_percentile.is_in_top_10_percent | False |