Research Project Title:
Language-Conditioned 3D Robotics
abstract:There is an increasing effort across various lines of devices to make them interactive via language interface, powered by recent advances in NLP and speech recognition technology. This effort is even more useful in robotics as visual interface is not convenient. Recent work has resulted in robots doing simple table-top tasks following language commands. Another recent work (Neural Descriptor Fields) is where robots are able to do 3D tasks with efficient training by exploiting symmetry in shape and color of the objects. This project aims to combine the benefits of both to create a 3D robotic manipulator conditioned on language input.
I am intrigued by the boundaries of robotics and applications of AI to physical objects. SuperUROP will provide a structured program and help me improve research communication as well.