Benjamin Bowman
YOU?
Author Swipe
View article: Automated Cyber Defense with Generalizable Graph-based Reinforcement Learning Agents
Automated Cyber Defense with Generalizable Graph-based Reinforcement Learning Agents Open
Deep reinforcement learning (RL) is emerging as a viable strategy for automated cyber defense (ACD). The traditional RL approach represents networks as a list of computers in various states of safety or threat. Unfortunately, these models …
View article: Maximally-Informative Retrieval for State Space Model Generation
Maximally-Informative Retrieval for State Space Model Generation Open
Given a query and dataset, the optimal way of answering the query is to make use all the information available. Modern LLMs exhibit impressive ability to memorize training data, but data not deemed important during training is forgotten, a…
View article: Expansion Span: Combining Fading Memory and Retrieval in Hybrid State Space Models
Expansion Span: Combining Fading Memory and Retrieval in Hybrid State Space Models Open
The "state" of State Space Models (SSMs) represents their memory, which fades exponentially over an unbounded span. By contrast, Attention-based models have "eidetic" (i.e., verbatim, or photographic) memory over a finite span (context siz…
View article: B'MOJO: Hybrid State Space Realizations of Foundation Models with Eidetic and Fading Memory
B'MOJO: Hybrid State Space Realizations of Foundation Models with Eidetic and Fading Memory Open
We describe a family of architectures to support transductive inference by allowing memory to grow to a finite but a-priori unknown bound while making efficient use of finite resources for inference. Current architectures use such resource…
View article: The precarity of hope at the end of the world: young climate activism in search of a future
The precarity of hope at the end of the world: young climate activism in search of a future Open
Young people are imagining a better world in conversations locally and globally, in the streets, in the classrooms and in their everyday life. Young climate activists are people who work for transformative change, radical kindness towards …
View article: À-la-carte Prompt Tuning (APT): Combining Distinct Data Via Composable Prompting
À-la-carte Prompt Tuning (APT): Combining Distinct Data Via Composable Prompting Open
We introduce À-la-carte Prompt Tuning (APT), a transformer-based scheme to tune prompts on distinct data so that they can be arbitrarily composed at inference time. The individual prompts can be trained in isolation, possibly on different …
View article: Your representations are in the network: composable and parallel adaptation for large scale models
Your representations are in the network: composable and parallel adaptation for large scale models Open
We propose InCA, a lightweight method for transfer learning that cross-attends to any activation layer of a pre-trained model. During training, InCA uses a single forward pass to extract multiple activations, which are passed to external c…
View article: Characterizing the Spectrum of the NTK via a Power Series Expansion
Characterizing the Spectrum of the NTK via a Power Series Expansion Open
Under mild conditions on the network initialization we derive a power series expansion for the Neural Tangent Kernel (NTK) of arbitrarily deep feedforward networks in the infinite width limit. We provide expressions for the coefficients of…
View article: In it together! Cultivating space for intergenerational dialogue, empathy and hope in a climate of uncertainty
In it together! Cultivating space for intergenerational dialogue, empathy and hope in a climate of uncertainty Open
The urgent and interlocking social, economic and ecological crises faced by societies around the world require dialogue, empathy and above all, hope that transcends social divides. At a time of uncertainty and crisis, many societies are di…
View article: Young people's climate activism: A review of the literature
Young people's climate activism: A review of the literature Open
The year 2018 was a watershed year for young people's climate activism. In this review article, we explore the methodological trends and key themes across contemporary academic literature on young people's climate activism. In the academic…
View article: Spectral Bias Outside the Training Set for Deep Networks in the Kernel Regime
Spectral Bias Outside the Training Set for Deep Networks in the Kernel Regime Open
We provide quantitative bounds measuring the $L^2$ difference in function space between the trajectory of a finite-width network trained on finitely many samples from the idealized kernel dynamics of infinite width and infinite data. An im…
View article: Is it radical to be kind? New civic education in the era of young people’s dissent
Is it radical to be kind? New civic education in the era of young people’s dissent Open
Our age of dissent offers opportunity for new civics scholars to welcome young dissent within the concept of the civic. New civics ‘[makes] explicit the inherent tension between the goal of creating citizens who will be actively involved i…
View article: Implicit Bias of MSE Gradient Optimization in Underparameterized Neural Networks
Implicit Bias of MSE Gradient Optimization in Underparameterized Neural Networks Open
We study the dynamics of a neural network in function space when optimizing the mean squared error via gradient flow. We show that in the underparameterized regime the network learns eigenfunctions of an integral operator $T_{K^\infty}$ de…
View article: Not (just) a protest: the Youth Strike for Climate as cultural exchange and collaborative text
Not (just) a protest: the Youth Strike for Climate as cultural exchange and collaborative text Open
In this essay, Chloé Germaine Buckley and Benjamin Bowman discuss the School Strike for Climate movement. Rather than consider the strikes as a protest movement for a large-scale shift in climate policy, they suggest viewing them as a form…
View article: Peace, Protest and Precarity: Making Conceptual Sense of Young People’s Non-violent Dissent in a Period of Intersecting Crises
Peace, Protest and Precarity: Making Conceptual Sense of Young People’s Non-violent Dissent in a Period of Intersecting Crises Open
The current young generation are living through socio-historically situated intersecting crises, including precarity and climate change. In these times of crisis, young people are also bearing witness to a distinctive global wave of youth-…
View article: PicoDomain: A Compact High-Fidelity Cybersecurity Dataset
PicoDomain: A Compact High-Fidelity Cybersecurity Dataset Open
Analysis of cyber relevant data has become an area of increasing focus. As larger percentages of businesses and governments begin to understand the implications of cyberattacks, the impetus for better cybersecurity solutions has increased.…
View article: Imagining future worlds alongside young climate activists: a new framework for research
Imagining future worlds alongside young climate activists: a new framework for research Open
Young people’s climate activism must stand as one of the most remarkable and important mass movements of our age. At levels of organization from the local to the global, young climate activists are coming together in massive mobilizations,…
View article: Strategic and Tactical Guidance for the Connected and Autonomous Vehicle Future
Strategic and Tactical Guidance for the Connected and Autonomous Vehicle Future Open
Autonomous vehicle (AV) and Connected vehicle (CV) technologies are rapidly maturing and the timeline for their wider deployment is currently uncertain. These technologies are expected to have a number of significant societal benefits: tra…
View article: The under 30s in the UK: a generation used to not getting what they voted for
The under 30s in the UK: a generation used to not getting what they voted for Open
The EU Referendum underlined a clear disconnect between the ruling elites and the electorate, writes Benjamin Bowman. Disappointment with political choices is particularly marked among the younger generation, whose disaffection exemplifies…
View article: "They don't know what's going on": Exploring young people's political subjectivities during transitions to adulthood in the UK
"They don't know what's going on": Exploring young people's political subjectivities during transitions to adulthood in the UK Open
The transitions of young people to adulthood in the UK are a political threshold that has received much public attention. The trend for young people to abstain from elections relative to older generations is one example of the many reasons…