🎨 Runway introduced Solaris — code-free interfaces, in real time
The Interface World Models family model draws an app screen frame-by-frame at 720p: clicks and drags are fed to it as conditioning for the next frame. Technically, this is a refined Gen-4.5 video model, with the “mind” being a separate LLM. In a study with 250 participants, Solaris was preferred 61% to 24% on instruction following.
🌍 According to Runway’s assessment, translating an interface into code loses information — that is the conclusion of the “translation cost” benchmark. The company proposes removing this layer: if the OS itself generates the interface for a task, the app’s behavior is defined by a world model, not by hard-coded workflows.
👤 There is no public access — only early access applications. Open issues: readable text, reliability, long sessions, screen readers. Rights to generated interfaces and interaction data are not disclosed.
Source 1: https://runway.com/news/research/introducing-solaris