Runway’s WorldPrompt and the Engineering of Real-Time Worlds
Artikelbild eller återanvändbart omslag för Latent Space
Earlier this month, world model company Runway introduced GWM Worlds 2, a research preview that “turns high-fidelity video and audio generation into real-time interactive simulation.” Runway calls this an “autoregressive diffusion” model; with autoregressive describing how it generates over time.One new feature in particular caught our eye: WorldPrompt, a proposed input format for specifying a generated world and the actions within it.
It allows you to fix some aspects of a simulated environment — including the first frame — and then create a series of timestamped events. The events, or actions, can even be prompted in real-time.To understand the implications of WorldPrompt, we spoke to Kamil Sindi, Runway’s CTO, and Robin Kahlow, its Principal Research Scientist for generative video and multimodal AI.
Texten är källans egen beskrivning av publiceringen. Innehållet tillhör Latent Space.
Mer från Latent Space
Using Agents for Long-Horizon Financial Work — Aman Singh, Arca
Latent Space för 13 tim sedan
⚡ Building ChatGPT for Finance — Joseph Kim, OpenAI's Head of Financial Services
Latent Space 31 okt.
One word for AI agents in 2027
Nate Herk för 4 tim sedan
Tests: chatbots rely on three obscure AI-built voter sites for US midterm answers; Copilot cited the error-prone Ballot Brief in 75% of tests and ChatGPT in 22%
Techmeme för 5 tim sedan