We study the ability of state-of-the art models to answer constraint satisfaction queries for information retrieval (e.g., ‘a list of ice cream shops in San Diego’). In the past, such queries were ...

We investigate the internal behavior of Transformer-based Large Language Models (LLMs) when they generate factually incorrect text. We propose modeling factual queries as Constraint Satisfaction ...