Ai Haber – Türkiyenin Yapay Zeka Haber Portalı

Vibe Coding XR: Accelerating AI + XR Prototyping with XR Blocks and Gemini

Ruofei Du Benjamin Hersh David Li Nels Numan Xun Qian Yanhe Chen Zhongyi Zhou Xingyue Chen Jiahao Ren Robert Timothy Bettridge Steve Toh David Kim
25 Mart 2026 popülerlik 4

Özet

While large language models have accelerated software development through "vibe coding", prototyping intelligent Extended Reality (XR) experiences remains inaccessible due to the friction of complex game engines and low-level sensor integration. To bridge this gap, we contribute XR Blocks, an open-source, modular WebXR framework that abstracts spatial computing complexities into high-level, human-centered primitives. Building upon this foundation, we present Vibe Coding XR, an end-to-end rapid prototyping workflow that leverages LLMs to translate natural language intent directly into functional XR software. Using a web-based interface, creators can transform high-level prompts (e.g., "create a dandelion that reacts to hand") into interactive WebXR applications in under a minute. We provide a preliminary technical evaluation on a pilot dataset (VCXR60) alongside diverse application scenarios highlighting mixed-reality realism, multi-modal interaction, and generative AI integrations. By democratizing spatial software creation, this work empowers practitioners to bypass low-level hurdles and rapidly move from "idea to reality." Code and live demos are available at https://xrblocks.github.io/gem and https://github.com/google/xrblocks.

Etki Puanı 5/10

Şekiller & Sayfalar

PDF sayfalarından elde edilen şekiller ve grafikler

Detaylı Analiz

Giriş

While large language models have accelerated software development through “vibe coding”, prototyping intelligent Extended Reality (XR) experiences remains inaccessible due to the friction of complex game engines and low-level sensor integration. To bridge this gap, we contribute XR Blocks, an open-source, modular WebXR framework that abstracts spatial computing complexities into high-level, human-centered primitives.

Araştırma Detayları

Building upon this foundation, we present Vibe Coding XR, an end-to-end rapid prototyping workflow that leverages LLMs to translate natural language intent directly into functional XR software. Using a web-based interface, creators can transform high-level prompts (e.g., “create a dandelion that reacts to hand”) into interactive WebXR applications in under a minute. We provide a preliminary technical evaluation on a pilot dataset (VCXR60) alongside diverse application scenarios highlighting mixed-reality realism, multi-modal interaction, and generative AI integrations.

Sonuç

By democratizing spatial software creation, this work empowers practitioners to bypass low-level hurdles and rapidly move from “idea to reality.” Code and live demos are available at https://xrblocks.github.io/gem and https://github.com/google/xrblocks.

Yazarlar

Ruofei Du, Benjamin Hersh, David Li, Nels Numan, Xun Qian, Yanhe Chen, Zhongyi Zhou, Xingyue Chen, Jiahao Ren, Robert Timothy Bettridge, Steve Toh, David Kim

Kategoriler

cs.HC

Kaynaklar

PDF Oku

PDF Orijinal
PDF Orijinal
X

Yorumlar & Tartışma

Tartışma

Bu habere emoji ile tepki ver

1 kişi tepki verdi

Hizli:

Henüz yorum yok. İlk yorumu siz yapın!

Yapıcı ve saygılı yorumlar bekliyoruz. Topluluk kuralları