Mark J. Gierl
YOU?
Author Swipe
View article: Assessing Dental Students’ Emotions While Treating Uncooperative Children: A Pilot Study
Assessing Dental Students’ Emotions While Treating Uncooperative Children: A Pilot Study Open
Introduction: Dental students often face emotional challenges when managing uncooperative pediatric patients, which may lead to reduced interest in treating children post-graduation, limiting access to pediatric dental care. Objective: Thi…
View article: Using a Rule-Based System to Identify Flawed Multiple-Choice Items
Using a Rule-Based System to Identify Flawed Multiple-Choice Items Open
Daniels et al. (2025) created use-inspired item-writing guidelines that map onto the processes and practices used by non-professional item writers in order to describe a logical sequence of steps that are used when creating new multiple-ch…
View article: A review of automatic item generation techniques leveraging large language models
A review of automatic item generation techniques leveraging large language models Open
This study reviews existing research on the use of large language models (LLMs) for automatic item generation (AIG). We performed a comprehensive literature search across seven research databases, selected studies based on predefined crite…
View article: Generating Testlets to Measure Clinical Reasoning Skills in Medicine
Generating Testlets to Measure Clinical Reasoning Skills in Medicine Open
Clinical reasoning is a core competency required by all medical professionals. A testlet is group of two or more items based on the same clinical scenario. A testlet can be used to measure clinical reasoning skills because each scenario is…
View article: Automating bone loss measurement on periapical radiographs for predicting the periodontitis stage and grade
Automating bone loss measurement on periapical radiographs for predicting the periodontitis stage and grade Open
Background The aim of this study was to develop and evaluate an automated approach for segmenting bone loss (BL) on periapical (PA) radiographs and predicting the stage and grade of periodontitis. Methods One thousand PA radiographs obtain…
View article: Using Automated Procedures to Score Educational Essays Written in Three Languages
Using Automated Procedures to Score Educational Essays Written in Three Languages Open
The purpose of this study is to describe and evaluate a multilingual automated essay scoring (AES) system for grading essays in three languages. Two different sentence embedding models were evaluated within the AES system, multilingual BER…
View article: A Review of Automatic Item Generation Techniques Leveraging Large Language Models
A Review of Automatic Item Generation Techniques Leveraging Large Language Models Open
Over a decade ago, automatic item generation (AIG) was introduced to meet the increasing need for high-quality items in educational measurement. Around the same time, a new area of research in computer science began to develop questions fo…
View article: An engagement-aware predictive model to evaluate problem-solving performance from the study of adult skills' (PIAAC 2012) process data
An engagement-aware predictive model to evaluate problem-solving performance from the study of adult skills' (PIAAC 2012) process data Open
The benefits of incorporating process information in a large-scale assessment with the complex micro-level evidence from the examinees (i.e., process log data) are well documented in the research across large-scale assessments and learning…
View article: Using OpenAI GPT to Generate Reading Comprehension Items
Using OpenAI GPT to Generate Reading Comprehension Items Open
The purpose of this study is to introduce and evaluate a method for generating reading comprehension items using template‐based automatic item generation. To begin, we describe a new model for generating reading comprehension items called …
View article: Automatic item generation for non-verbal reasoning items
Automatic item generation for non-verbal reasoning items Open
The purpose of this study is to generate non-verbal items for a visual reasoning test using templated-based automatic item generation (AIG). The fundamental research method involved following the three stages of template-based AIG. An item…
View article: Language models in automated essay scoring: Insights for the Turkish language
Language models in automated essay scoring: Insights for the Turkish language Open
The proliferation of large language models represents a paradigm shift in the landscape of automated essay scoring (AES) systems, fundamentally elevating their accuracy and efficacy. This study presents an extensive examination of large la…
View article: Neural Semantic Video Analysis
Neural Semantic Video Analysis Open
Videos are a rich form of data intended for capturing, storing, and communicating information. The availability of inexpensive and accessible video-capturing sensors in smartphones, handheld cameras, and consumer security cameras has expon…
View article: Automatic item generation for online measurement and evaluation: Turkish literature items
Automatic item generation for online measurement and evaluation: Turkish literature items Open
Developments in the field of education have significantly affected test development processes, and computer-based test applications have been started in many institutions. In our country, research on the application of measurement and eval…
View article: Using Automatic Item Generation to Create Multiple-Choice Questions for Pharmacy Assessment
Using Automatic Item Generation to Create Multiple-Choice Questions for Pharmacy Assessment Open
This research demonstrates the AIG process is a viable strategy for creating a test item bank to provide MCQs appropriate for inclusion in a pharmacy licensing examination.
View article: Using Active Learning Methods to Strategically Select Essays for Automated Scoring
Using Active Learning Methods to Strategically Select Essays for Automated Scoring Open
Research on automated essay scoring has become increasing important because it serves as a method for evaluating students' written-responses at scale. Scalable methods for scoring written responses are needed as students migrate to online …
View article: Using Active Learning Methods to Strategically Select Essays for Automated Scoring
Using Active Learning Methods to Strategically Select Essays for Automated Scoring Open
Research on Automated Essay Scoring has become increasing important because it serves as a method for evaluating students’ written responses at scale. Scalable methods for scoring written responses are needed as students migrate to online …
View article: Using Content Coding and Automatic Item Generation to Improve Test Security
Using Content Coding and Automatic Item Generation to Improve Test Security Open
Automatic item generation (AIG) is the process of using models to generate items using computer technology. AIG is a scalable content development method because it relies on the item model as the unit of analysis which means that it is mor…
View article: Development Practices of Trusted AI Systems among Canadian Data Scientists
Development Practices of Trusted AI Systems among Canadian Data Scientists Open
The introduction of Artificial Intelligence (AI) systems has demonstrated impeccable potential and benefits to enhance the decision-making processes in our society. However, despite the successful performance of AI systems to date, skeptic…
View article: Can automated item generation be used to develop high quality MCQs that assess application of knowledge?
Can automated item generation be used to develop high quality MCQs that assess application of knowledge? Open
The purpose of this study was to compare the quality of multiple choice questions (MCQs) developed using automated item generation (AIG) versus traditional methods, as judged by a panel of experts. The quality of MCQs developed using two m…
View article: Three Applications of Automated Test Assembly within a User-Friendly Modeling Environment
Three Applications of Automated Test Assembly within a User-Friendly Modeling Environment Open
While linear programming is a common tool in business and industry, there have not been many applications in educational assessment and only a handful of individuals have been actively involved in conducting psychometric research in this a…
View article: Automated scoring of junior and senior high essays using Coh-Metrix features: Implications for large-scale language testing
Automated scoring of junior and senior high essays using Coh-Metrix features: Implications for large-scale language testing Open
An automated essay scoring (AES) program is a software system that uses techniques from corpus and computational linguistics and machine learning to grade essays. In this study, we aimed to describe and evaluate particular language feature…
View article: Multiple-Choice Item Distractor Development Using Topic Modeling Approaches
Multiple-Choice Item Distractor Development Using Topic Modeling Approaches Open
Writing a high-quality, multiple-choice test item is a complex process. Creating plausible but incorrect options for each item poses significant challenges for the content specialist because this task is often undertaken without implementi…
View article: Using Automatic Item Generation to Create Solutions and Rationales for Computerized Formative Testing
Using Automatic Item Generation to Create Solutions and Rationales for Computerized Formative Testing Open
Computerized testing provides many benefits to support formative assessment. However, the advent of computerized formative testing has also raised formidable new challenges, particularly in the area of item development. Large numbers of di…
View article: A structural equation modeling approach for examining position effects in large-scale assessments
A structural equation modeling approach for examining position effects in large-scale assessments Open
Position effects may occur in both paper–pencil tests and computerized assessments when examinees respond to the same test items located in different positions on the test. To examine position effects in large-scale assessments, previous s…
View article: Issue Information ‐ TOC & Editorial board
Issue Information ‐ TOC & Editorial board Open
Society and MembershipOffice: EMIP is published on behalf of the National Council on Measurement in Education, an association of individuals working to promote greater understanding and improved use of measurement techniques