Guiding Language Models of Code with Global Context using Monitors

cross-posted from: https://kbin.social/m/ArtificialIntelligence/t/70565

LLMs often hallucinate incorrect names, especially in private codebases. We introduce Monitor-Guided Decoding (MGD)-guide LMs to generate compilable code with correct symbol names more reliably!🚀 (Work w/ @adityakanade0 Navin Goyal @LahiriShuvendu @SriramRajamani @MSFTResearch)