1. Validation of Facts Against Textual Sources
- Author
-
Anupam Jamatia, Shriya Reddy, Simran Sinha, Vamsi Krishna Pendyala, and Satya Prakash
- Subjects
Relation (database) ,business.industry ,Computer science ,Print media ,Verification system ,Context (language use) ,computer.software_genre ,Term (time) ,Knowledge base ,Artificial intelligence ,business ,Textual entailment ,computer ,Sentence ,Natural language processing - Abstract
In today’s digital world of information, a fact verification system to disprove assertions made in speech, print media or online content is the need of the hour. We propose a system which would verify a claim against a source and classify the claim to be true, false, out-of-context or an inappropriate claim with respect to the textual source provided to the system. A true label is used if the claim is true, false if it is false, if the claim has no relation with the source then it is classified as out-of-context and if the claim cannot be verified at all then it is classified as inappropriate. This would help us to verify a claim or a fact as well as know about the source or our knowledge base against which we are trying to verify our facts. We used a two-step approach to achieve our goal. At first, we retrieved evidence related to the claims from the textual source using the Term Frequency-Inverse Document Frequency(TF-IDF) vectors. Later we classified the claim-evidence pairs as true, false, inappropriate and out of context using a modified version of textual entailment module. Textual entailment module calculates the probability of each sentence supporting the claim, contradicting the claim or not providing any relevant information using Bi-LSTM network to assess the veracity of the claim. The accuracy of the best performing system is 64.49%
- Published
- 2019
- Full Text
- View/download PDF