Deep learning has recently shown much promise for NLP applications.
Unlike most approaches in which documents or sentences are represented by a sparse bag-of-words vector, our work in the intersection of deep learning and natural language processing
handles variable sized sentences in a natural way and captures the recursive nature of natural language. We explore recursive neural networks for parsing, paraphrase detection of short phrases and longer sentences and sentiment
analysis. Our approaches go beyong learning word vectors and instead learn vector representations for multi-word phrases which are useful for different applications.
Richard Socher, Brody Huval, Christopher D. Manning and Andrew Y. Ng, "Semantic Compositionality through Recursive Matrix-Vector Spaces"
[pdf], [website]
Eric H. Huang, Richard Socher, Christopher D. Manning and Andrew Y. Ng, "Improving Word Representations via Global Context and Multiple Word
Prototypes", ACL 2012
[pdf], [website]
Richard Socher, Eric Huang, Jeffrey Pennington, Andrew Y. Ng, and Christopher D. Manning, "Unfolding Recursive Autoencoders for Full Sentence Paraphrase Detection". NIPS 2011
[pdf], [website]
Richard Socher, Jeffrey Pennington, Eric Huang, Andrew Y. Ng, and Christopher D. Manning, "Semi-Supervised Recursive Autoencoders for Predicting Sentiment Distributions". EMNLP 2011.
[pdf], [website]
Richard Socher, Cliff Lin, Andrew Y. Ng, and Christopher D. Manning, "Parsing Natural Scenes and Natural Language with Recursive Neural Networks". ICML 2011 (Distinguished Application Paper Award)
[pdf], [website]
Richard Socher, Christopher D. Manning, Andrew Y. Ng, "Learning Continuous Phrase Representations and Syntactic Parsing with Recursive Neural Networks". NIPS Deep Learning and Unsupervised Feature Learning Workshop 2010.
[pdf]
Contact Information
For any comments or questions, please feel free to email Richard at Socher . org