Benjamin Chess
YOU?
Author Swipe
View article: Evaluating the Effectiveness of Large Language Models in Representing Textual Descriptions of Geometry and Spatial Relations (Short Paper)
Evaluating the Effectiveness of Large Language Models in Representing Textual Descriptions of Geometry and Spatial Relations (Short Paper) Open
This research focuses on assessing the ability of large language models (LLMs) in representing geometries and their spatial relations. We utilize LLMs including GPT-2 and BERT to encode the well-known text (WKT) format of geometries and th…
View article: Ninth Workshop on Speech and Language Processing for Assistive Technologies (SLPAT-2022)
Ninth Workshop on Speech and Language Processing for Assistive Technologies (SLPAT-2022) Open
We present MozoLM, an open-source language model microservice package intended for use in AAC text-entry applications, with a particular focus on the design principles of the library.The intent of the library is to allow the ensembling of …
View article: Proceedings of the First Workshop on Intelligent and Interactive Writing Assistants (In2Writing 2022)
Proceedings of the First Workshop on Intelligent and Interactive Writing Assistants (In2Writing 2022) Open
Today, data-to-text systems are used as commercial solutions for automated text production of large quantities of text.Therefore, they already represent a new technology of writing.This new technology requires the author, as an act of writ…
View article: WebGPT: Browser-assisted question-answering with human feedback
WebGPT: Browser-assisted question-answering with human feedback Open
We fine-tune GPT-3 to answer long-form questions using a text-based web-browsing environment, which allows the model to search and navigate the web. By setting up the task so that it can be performed by humans, we are able to train models …
View article: Proceedings of the Fourth Workshop on NLP for Internet Freedom: Censorship, Disinformation, and Propaganda
Proceedings of the Fourth Workshop on NLP for Internet Freedom: Censorship, Disinformation, and Propaganda Open
Welcome to the fourth edition of the Workshop on NLP for Internet Freedom: Censorship, Disinformation, and Propaganda.This is the second time we are running the workshop virtually, due to the COVID-19 pandemic.The pandemic has had a profou…
View article: Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies: Tutorials
Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies: Tutorials Open
The goal of text ranking is to generate an ordered list of texts retrieved from a corpus in response to a query for a particular task.Although the most common formulation of text ranking is search, instances of the task can also be found i…
View article: Language Models are Few-Shot Learners
Language Models are Few-Shot Learners Open
Recent work has demonstrated substantial gains on many NLP tasks and benchmarks by pre-training on a large corpus of text followed by fine-tuning on a specific task. While typically task-agnostic in architecture, this method still requires…
View article: Scaling Laws for Neural Language Models
Scaling Laws for Neural Language Models Open
We study empirical scaling laws for language model performance on the cross-entropy loss. The loss scales as a power-law with model size, dataset size, and the amount of compute used for training, with some trends spanning more than seven …