Animating Realistic Piano Performances is Tricky. This Motion Capture Tech Provides a Solution
The ultimate test for animation on-screen might be piano playing, where every key must be hit in its exact place, and the fingers’ motion has to match perfectly.
Edited by EE Staff
Games
Aug 4, 2026
When animating piano playing, most animators have traditionally been forced to compromise, often sacrificing accuracy for speed and cost. Even as AI tools are flooding the market, piano animation remains far too complex to automate convincingly. Het Nieuwe Kader, one of the Netherlands’ leading animation studios, saw this as a challenge. They chose to put MANUS Metagloves Pro, an EMF-powered finger tracking solution to the ultimate test. Unlike other motion capture (mocap) systems, Metagloves Pro are unaffected by occlusion or drift.
Because the Metagloves Pro focus on finger tracking, Het Nieuwe Kader paired them with OptiTrack for positional accuracy. According to Co-Owner and Head of 3D & Visual Effects, Niels, “We attached markers both to the gloves and at the beginning and end points of the piano keyboard. This setup gave us a reliable relative position between the fingers and the keys, ensuring every motion lined up naturally.”
Surprisingly the setup was quick and easy. When one of the actors was delayed, it was easy to use a stand-in for calibrations so that when the performer arrives, they simply slipped on the gloves and, within seconds, was ready to record. “That kind of flexibility saved us valuable time during the session,” Niels said.
The team used twelve PrimeX 13 cameras for the demo. Once everything was calibrated, the team started to capture the piano performance. In MANUS Core, even the subtlest fingertip movements translate smoothly into animation data. Watching the model play in real time allowed the team to witness every twist, press, and release represented with remarkable fidelity. Niels said, “For us, this was a breakthrough moment: the gloves weren’t just capturing the movements, they were literally a digital representation of the performer’s hands.”
Traditionally, piano animation requires hours of post-recording work—correcting occlusion errors, fixing drift, and ensuring fingers made believable contact with keys. Using Metagloves Pro eliminated most of those issues as they were already solved at the capture stage. This meant that time spent in Autodesk Maya could be spent on what really mattered—the artistry. Instead of repairing broken data, the team was able to spend that time on refining and stylizing the performance.
For example, key alignment only required minor adjustments since finger trajectories already matched the keys closely. Dynamics were handled in the graph editor where velocity curves could be enhanced to emphasize the natural weight and rhythm of each keystroke. With reliable data as a base, it was easy to experiment more freely—adding wrist rolls, exaggerating fingertip pressure, or pushing timing slightly off-beat to achieve a more expressive, stylized feel. “This flexibility is the real benefit of the workflow: by removing technical distractions, the gloves gave us space to focus on expression, style, and creative intent, rather than just accuracy,” Niels said.
In addition to creating the animation, the company took the opportunity to experiment beyond human performance by rendering a robotic hand driven with the Metagloves Pro. Every subtle movement of the human hand was accurately mirrored by the digital counterpart, demonstrating not only precision but also the potential for applications in robotics, virtual production, and beyond. With this workflow, what was once an animator’s nightmare has become a seamless process, opening the door to both authentic realism and creative stylization in hand animation.
For information: