Deep Learning

We present Pos3R, a training-free method for estimating the 6D pose of any object from a single RGB image by leveraging a 3D foundation model, eliminating the need for pose supervision or task-specific training.

Official implementation of Manual-PA: Learning 3D Part Assembly from Instruction Diagrams.

Official implementation of WACV 2025 Temporal Instructional Diagram Grounding in Unconstrained Videos.

We introduce Manual-PA, a transformer-based framework that leverages diagrammatic assembly manuals to guide both the selection and 6D pose estimation of furniture parts, enabling efficient and realistic 3D assembly by aligning parts with instructional illustrations.

We introduce a new approach to simultaneously localize a sequence of instructional diagrams in videos by modeling their mutual relationships and temporal order, rather than handling each step independently.

Official implementation of CVPR 2023 Aligning Step-by-Step Instructional Diagrams to Video Demonstrations.

We introduce a new framework and dataset (IAW) for aligning assembly diagrams from instruction manuals with real-world video segments, enabling cross-modal retrieval and step-level alignment between illustrated instructions and assembly actions in videos.

GoferBot is a novel assembly system that seamlessly integrates all sub-modules by utilising implicit semantic information purely from visual perception.

An encoder(Resnet152)-decoder(LSTM) implementation of image caption model.