TabSketchFM: Sketch-Based Tabular Representation Learning for Data Discovery over Data Lakes
Abstract
In this paper, we present TabSketchFM, a neural tabular model for data discovery over data lakes. First, we propose novel pre-training: a sketch-based approach to enhance the effectiveness of data discovery in neural tabular models. Second, we finetune the model for identifying unionable, joinable, and subset table pairs and show significant improvement over previous tabular neural models. Third, we use these finetuned models to perform table search; i.e., given a query table, find other tables in a corpus that are unionable, joinable, or that are subsets of the query. Our results demonstrate significant improvements for search compared to state-of-the-art techniques. Finally, we show significant transfer across datasets and tasks establishing that our model can generalize across different tasks and over different data lakes.
Cite
Text
Khatiwada et al. "TabSketchFM: Sketch-Based Tabular Representation Learning for Data Discovery over Data Lakes." NeurIPS 2024 Workshops: TRL, 2024.Markdown
[Khatiwada et al. "TabSketchFM: Sketch-Based Tabular Representation Learning for Data Discovery over Data Lakes." NeurIPS 2024 Workshops: TRL, 2024.](https://mlanthology.org/neuripsw/2024/khatiwada2024neuripsw-tabsketchfm/)BibTeX
@inproceedings{khatiwada2024neuripsw-tabsketchfm,
title = {{TabSketchFM: Sketch-Based Tabular Representation Learning for Data Discovery over Data Lakes}},
author = {Khatiwada, Aamod and Kokel, Harsha and Abdelaziz, Ibrahim and Chaudhury, Subhajit and Dolby, Julian and Hassanzadeh, Oktie and Huang, Zhenhan and Pedapati, Tejaswini and Samulowitz, Horst and Srinivas, Kavitha},
booktitle = {NeurIPS 2024 Workshops: TRL},
year = {2024},
url = {https://mlanthology.org/neuripsw/2024/khatiwada2024neuripsw-tabsketchfm/}
}