The project will build upon an existing system which allows a user to search over a large video corpora for clips which depict a natural-language query in the form of a sentence. The system uses compositional semantics to recognize differences between two sentences which have the same nouns and verbs but have different meaning, such as “The person rode the horse” and “The horse rode the person.”” Thus, a user can search over a large database of video clips for a specific event.

I have done research in big data and computer vision. My past experience in these areas will be helpful for exploring this difficult problem.