You're all that I been looking for: A theoretical paradigm for Logically Pretraining Question-Answering models
Copyright: ANDRANIK HAKOBYAN Introduction: This article attempts to draw attention to a potential learning procedure of language models, specifically for the task of Question-Answering, modeling the logical relationship between a given sentence, that we understand to be query, and an additional sentence that is provides the relevant response to the query. I propose that we can accomplish this by applying a linear transformation to a query context vector and subsequently get the correct response vector to search for some of its identical properties, within the query vector. The intuition behind this approach is that when the response vector searches for its properties, inside the transformation vector, it will also begin to search for the propertie...