I am a Senior Applied Scientist at Microsoft, where I develop AI agents for enterprises. More about me.
This space is where I share my personal thoughts and ideas.
Looking for something to do here? Read my last academic papers: Practical alignment and Human-compatible learning. More papers at my Google Scholar.
Highlights of my academic career:
- EMNLP’17 explores RLHF for text generation two years before OpenAI adopted this method and made it famous.
- EMNLP’15 brings calibration to NLP sequence prediction problems.
- CVPR’19 pioneers robots that ask for help.
- NeurIPS’24WS introduces language-guided world models.