Multimodal Learning for Robot Control

Unsupervised pretraining for imitation learning.

Unsupervised Multimodal Representation Learning for Robot Controls
[Research Project] @ RVL. With Yewon L., Pranit C.

Investigated how unsupervised representation learning could be utilized in an imitation learning (IL) task such as robot path following. In this project, we successfully trained a multimodal representation from unlabelled path traversal data, fine-tuned on minimal labeled data.