Tabular Natural Language Inference (TNLI) involves machine learning models that assess whether structured tabular data supports or contradicts a hypothesis formulated in natural language. TNLI models typically require large sets of training examples, which are costly to produce manually. In this demonstration, we present Tenet, a system for the automatic generation of training examples for TNLI applications. Existing TNLI training approaches either depend on Donatello Santoro donatello.santoro@unibas.it University of Basilicata Potenza, Italy Paolo Papotti paolo.papotti@eurecom.fr EURECOM Biot, France Table: Person Name t1 Mike t2 t3 Anne John Age City 47 22 SF NY 19 SF TENET Training data Example A Claim: "Mike and Anne come from the same city" Label: Refutes Evidence cells: {t1.Name: "Mike", t2.Name: "Anne", t1.city: "SF", t2.City: "NY"} Example B Claim: "Mike is older than Anne" Label: Supports Evidence cells: {t1.Name: "Mike", t2.Name: "Anne", t1.Age: 47, t2.Age: 22} costly human annotation or generate simplistic examples that lack data diversity and complex reasoning. In contrast, Tenet can start from a small set of manually annotated examples to automatically TNLI Application Test data Figure 1: Given a table and selected cells, Tenet creates traingenerate a large and diverse training dataset. Tenet is based on the idea that SQL queries are the right tool for obtaining rich and complex generated examples. To ensure data variety, evidence-queries extract cell values from tables based on diverse data patterns. Once the relevant data are identi ed, semantic queries de ne di erent ways to interpret it using SQL clauses. These interpretations are then verbalized as text to create annotated examples for TNLI. This demonstration o ers an interactive experience where users will be able to select evidence from tabular data, inspect and re ne generated queries, and observe how Tenet transforms structured data into natural language hypotheses. By engaging with di erent scenarios, users will see how Tenet enables the rapid creation of high-quality TNLI datasets, leading to inference models with performance comparable to those trained on manually crafted examples.
Accelerating Tabular Inference: Training Data Generation with TENET
Veltri E.
;Santoro D.;
2025-01-01
Abstract
Tabular Natural Language Inference (TNLI) involves machine learning models that assess whether structured tabular data supports or contradicts a hypothesis formulated in natural language. TNLI models typically require large sets of training examples, which are costly to produce manually. In this demonstration, we present Tenet, a system for the automatic generation of training examples for TNLI applications. Existing TNLI training approaches either depend on Donatello Santoro donatello.santoro@unibas.it University of Basilicata Potenza, Italy Paolo Papotti paolo.papotti@eurecom.fr EURECOM Biot, France Table: Person Name t1 Mike t2 t3 Anne John Age City 47 22 SF NY 19 SF TENET Training data Example A Claim: "Mike and Anne come from the same city" Label: Refutes Evidence cells: {t1.Name: "Mike", t2.Name: "Anne", t1.city: "SF", t2.City: "NY"} Example B Claim: "Mike is older than Anne" Label: Supports Evidence cells: {t1.Name: "Mike", t2.Name: "Anne", t1.Age: 47, t2.Age: 22} costly human annotation or generate simplistic examples that lack data diversity and complex reasoning. In contrast, Tenet can start from a small set of manually annotated examples to automatically TNLI Application Test data Figure 1: Given a table and selected cells, Tenet creates traingenerate a large and diverse training dataset. Tenet is based on the idea that SQL queries are the right tool for obtaining rich and complex generated examples. To ensure data variety, evidence-queries extract cell values from tables based on diverse data patterns. Once the relevant data are identi ed, semantic queries de ne di erent ways to interpret it using SQL clauses. These interpretations are then verbalized as text to create annotated examples for TNLI. This demonstration o ers an interactive experience where users will be able to select evidence from tabular data, inspect and re ne generated queries, and observe how Tenet transforms structured data into natural language hypotheses. By engaging with di erent scenarios, users will see how Tenet enables the rapid creation of high-quality TNLI datasets, leading to inference models with performance comparable to those trained on manually crafted examples.| File | Dimensione | Formato | |
|---|---|---|---|
|
p5303-veltri.pdf
accesso aperto
Tipologia:
Pdf editoriale
Licenza:
Creative commons
Dimensione
805.82 kB
Formato
Adobe PDF
|
805.82 kB | Adobe PDF | Visualizza/Apri |
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.


