CLUTCH: Contextualized Language Model for Unlocking Text-Conditioned Hand Motion Modelling in the Wild
CLUTCH combines language grounding with motion diffusion to synthesize and caption in-the-wild hand motions from textual prompts.
About Me
Hi! I’m Balamurugan Thambiraja, presently pursuing a PhD at the
Neural Capture and Synthesis group
of Prof. Justus Thies
at the Max-Planck Institute for Intelligent Systems, Germany. During my Ph.D., I'm collobrating with
Darren Cosker
and Sadegh Aliakbarian
from Mesh Labs, Microsoft, Cambrdige.
In my Ph.D., I am exploring ways to leverage seq2seq and foundational models for synthesizing human motion and its underlying dynamics. Recently, I have been working with diffusion models and large language models for motion synthesis and editing, aiming to enhance the realism, controllability and generalization to in-the-wild scenarios.
Before the PhD, I did a Masters in Informatics at TUM, Germany, where I worked on human modelling and
sign language synthesis
at the
Visual Computing and Artificial Intelligence group
of Prof. Matthias Niessner. Before that, I did my Bachelors in Electrical and Electronics Engineering at Kumaraguru College of Technology, Coimbatore, India.
