Title: How can we learn language from scratch? Abstract: Sorry, I'm not going to give the answer to the question in the title of this talk :( -- but I will do what I can. I will present some work on architectures and loss functions for learning the semantics of language given only weakly labeled data in a (simulated) environment. I will then speculate about ways these models can be improved. Joint work with Antoine Bordes, Nicolas Usunier and Ronan Collobert.