Seth Aycock
YOU?
Author Swipe
View article: How Important is `Perfect' English for Machine Translation Prompts?
How Important is `Perfect' English for Machine Translation Prompts? Open
Large language models (LLMs) have achieved top results in recent machine translation evaluations, but they are also known to be sensitive to errors and perturbations in their prompts. We systematically evaluate how both humanly plausible a…
View article: LLM-as-a-qualitative-judge: automating error analysis in natural language generation
LLM-as-a-qualitative-judge: automating error analysis in natural language generation Open
Prompting large language models (LLMs) to evaluate generated text, known as LLM-as-a-judge, has become a standard evaluation approach in natural language generation (NLG), but is primarily used as a quantitative tool, i.e. with numerical s…
View article: Please Translate Again: Two Simple Experiments on Whether Human-Like Reasoning Helps Translation
Please Translate Again: Two Simple Experiments on Whether Human-Like Reasoning Helps Translation Open
Large Language Models (LLMs) demonstrate strong reasoning capabilities for many tasks, often by explicitly decomposing the task via Chain-of-Thought (CoT) reasoning. Recent work on LLM-based translation designs hand-crafted prompts to deco…