Jaron Lanier
YOU?
Author Swipe
View article: Social Conjuring: Multi-User Runtime Collaboration with AI in Building Virtual 3D Worlds
Social Conjuring: Multi-User Runtime Collaboration with AI in Building Virtual 3D Worlds Open
Generative artificial intelligence has shown promise in prompting virtual worlds into existence, yet little attention has been given to understanding how this process unfolds as social interaction. We present Social Conjurer, a framework f…
View article: LLMR: Real-time Prompting of Interactive Worlds using Large Language Models
LLMR: Real-time Prompting of Interactive Worlds using Large Language Models Open
We present Large Language Model for Mixed Reality (LLMR), a framework for the real-time creation and modification of interactive Mixed Reality experiences using LLMs. LLMR leverages novel strategies to tackle difficult cases where ideal tr…
View article: Real-time Animation Generation and Control on Rigged Models via Large Language Models
Real-time Animation Generation and Control on Rigged Models via Large Language Models Open
We introduce a novel method for real-time animation control and generation on rigged models using natural language input. First, we embed a large language model (LLM) in Unity to output structured texts that can be parsed into diverse and …
View article: LLMR: Real-time Prompting of Interactive Worlds using Large Language Models
LLMR: Real-time Prompting of Interactive Worlds using Large Language Models Open
We present Large Language Model for Mixed Reality (LLMR), a framework for the real-time creation and modification of interactive Mixed Reality experiences using LLMs. LLMR leverages novel strategies to tackle difficult cases where ideal tr…
View article: Beyond Audio: Towards a Design Space of Headphones as a Site for Interaction and Sensing
Beyond Audio: Towards a Design Space of Headphones as a Site for Interaction and Sensing Open
Via Research through Design (RtD), we explore the potential of headphones as a general-purpose input device for both foreground motion-gestures as well as background sensing of user activity. As a familiar wearable device, headphones offer…
View article: Steps towards prompt-based creation of virtual worlds
Steps towards prompt-based creation of virtual worlds Open
Large language models trained for code generation can be applied to speaking virtual worlds into existence (creating virtual worlds). In this work we show that prompt-based methods can both accelerate in-VR level editing, as well as can be…
View article: Taxonomy of Hand-Object Haptics for Virtual Reality
Taxonomy of Hand-Object Haptics for Virtual Reality Open
Manipulation of hand-held objects in Virtual Reality (VR) requires input tracking with high freedom of movement, as well as haptic feedback of hand-object interactions. Through our prototypes we demonstrate a pragmatic approach to haptic f…
View article: Taxonomy of Hand-Object Haptics for Virtual Reality
Taxonomy of Hand-Object Haptics for Virtual Reality Open
Manipulation of hand-held objects in Virtual Reality (VR) requires input tracking with high freedom of movement, as well as haptic feedback of hand-object interactions. Through our prototypes we demonstrate a pragmatic approach to haptic f…
View article: Non-local Field Theory from Matrix Models
Non-local Field Theory from Matrix Models Open
We show that a class of matrix theories can be understood as an extension of quantum field theory which has non-local interactions. This reformulation is based on the Wigner-Weyl transformation, and the interactions take the form of Moyal …
View article: AllTogether: Effect of Avatars in Mixed-Modality Conferencing Environments
AllTogether: Effect of Avatars in Mixed-Modality Conferencing Environments Open
Visual representation in most video conferencing systems is a binary option between camera on and off. With such systems, voice-only participants might feel left-out, particularly in configurations that situate video participants in a shar…
View article: Follow Your Nose: Extended Arm Reach After Pinocchio Illusion in Virtual Reality
Follow Your Nose: Extended Arm Reach After Pinocchio Illusion in Virtual Reality Open
In this study, we recreate the Pinocchio Illusion—a bodily illusion whereby the perceived length of one’s nose is extended—in Virtual Reality. Participants ( n = 38) self-administered tapping on the tip of the nose of a virtual avatar seen…
View article: A Cubic Matrix Action for the Standard Model and Beyond
A Cubic Matrix Action for the Standard Model and Beyond Open
We propose a new framework for matrix theories that are equivalent to field theories on a toroidal spacetime. The correspondence is accomplished via infinite Toeplitz matrices whose entries match the field degrees of freedom on an energy-m…
View article: The Autodidactic Universe
The Autodidactic Universe Open
We present an approach to cosmology in which the Universe learns its own physical laws. It does so by exploring a landscape of possible laws, which we express as a certain class of matrix models. We discover maps that put each of these mat…
View article: The Rocketbox Library and the Utility of Freely Available Rigged Avatars
The Rocketbox Library and the Utility of Freely Available Rigged Avatars Open
As part of the open sourcing of the Microsoft Rocketbox avatar library for research and academic purposes, here we discuss the importance of rigged avatars for the Virtual and Augmented Reality (VR, AR) research community. Avatars, virtual…
View article: Should We Treat Data as Labor? Moving Beyond 'Free'
Should We Treat Data as Labor? Moving Beyond 'Free' Open
In the digital economy, user data is typically treated as capital created by corporations observing willing individuals. This neglects users' role in creating data, reducing incentives for users, distributing the gains from the data econom…
View article: Model of Illusions and Virtual Reality
Model of Illusions and Virtual Reality Open
In Virtual Reality (VR) it is possible to induce illusions in which users report and behave as if they have entered into altered situations and identities. The effect can be robust enough for participants to respond "realistically," meanin…