A new Sony patent uses your actual body movements to build characters

Sony Interactive Entertainment has published a new patent detailing a system that uses real-world body movements to generate custom in-game characters. The technology, published on July 2 under patent US 20260183673 A1, translates physical gestures and user input data directly into digital avatars.

Most character creators rely on sliders, color wheels, and drop-down menus. You tweak cheekbone depth by dragging a cursor or selecting from a grid of presets. This new approach shifts the process into physical space. The system interprets motion data to establish proportions, posture, and movement quirks for the in-game model. It bridges the gap between the player's actual body and their digital representation.

Swinging arms to build shoulders

I keep thinking about how this could integrate into current and future PlayStation hardware. The PSVR2 already tracks head and hand positions with high precision using its inside-out cameras and Sense controllers. If I boot up a VR role-playing game, I could theoretically set my character's wingspan just by reaching my arms out. I could define their walking animation by pacing across my living room. It takes the abstraction out of the character creation screen entirely.

Looking ahead to the PlayStation 6, this tech makes even more sense as a core platform feature. Sony has spent the current console generation pushing immersion through the DualSense controller's haptics and adaptive triggers. Adding camera-based or sensor-based body tracking to the base console experience would allow developers to map physical traits directly into big-budget games. If I have a slight slouch or a specific way of shifting my weight, the game could capture that and apply it to my custom protagonist in a multiplayer spin-off or a sports title.

The EyeToy lineage

Sony has a long history of experimenting with camera and motion tech. The EyeToy launched on the PlayStation 2 in 2003, followed by the PlayStation Move on the PS3 and the PlayStation Camera on the PS4. Those older peripherals were mostly used for minigames or basic augmented reality overlays. This new system applies motion tracking to foundational game mechanics. Instead of just using a camera to swing a virtual tennis racket, the hardware uses that same spatial awareness to build the person holding the racket.

The gaming industry has been trying to solve the uncanny valley of custom characters for years. Games like Black Desert Online or Dragon's Dogma 2 offer incredibly dense creation tools, but the resulting characters often move with stiff, generic animations that do not match their customized bodies. By capturing actual body movement during the creation phase, developers could generate custom animation skeletons that match the player's physical inputs. A tall, lanky character would move differently than a short, stocky one, because the underlying motion data comes from a real person.

Prototyping the next generation

Patents do not always translate into immediate consumer products. Hardware manufacturers file hundreds of concepts a year to protect ideas they are prototyping in their research and development labs. A body-movement character creator fits perfectly into Sony's current trajectory of making games feel more physically connected to the player. I would gladly trade an hour of tweaking jawline sliders for a system that just looks at how I stand and builds a character around it.