Search

Your search keyword '"Renée J. Miller"' showing total 288 results
Start Over Author "Renée J. Miller"
288 results on '"Renée J. Miller"'

116. Pytheas

Author

Eric B. Munson, Moshe Gabel, Angela Demke Brown, Christina Christodoulakis, and Renée J. Miller

Subjects
Automated data, Measure (data warehouse), Task (computing), Open data, Information retrieval, Computer science, General Engineering, Table (database), Value (computer science), Precision and recall, Column (database)
Abstract

CSV is a popular Open Data format widely used in a variety of domains for its simplicity and effectiveness in storing and disseminating data. Unfortunately, data published in this format often does not conform to strict specifications, making automated data extraction from CSV files a painful task. While table discovery from HTML pages or spreadsheets has been studied extensively, extracting tables from CSV files still poses a considerable challenge due to their loosely defined format and limited embedded metadata. In this work we lay out the challenges of discovering tables in CSV files, and propose Pytheas: a principled method for automatically classifying lines in a CSV file and discovering tables within it based on the intuition that tables maintain a coherency of values in each column. We evaluate our methods over two manually annotated data sets: 2000 CSV files sampled from four Canadian Open Data portals, and 2500 additional files sampled from Canadian, US, UK and Australian portals. Our comparison to state-of-the-art approaches shows that Pytheas is able to successfully discover tables with precision and recall of over 95.9% and 95.7% respectively, while current approaches achieve around 89.6% precision and 81.3% recall. Furthermore, Pytheas's accuracy for correctly classifying all lines per CSV file is 95.6%, versus a maximum of 86.9% for compared approaches. Pytheas generalizes well to new data, with a table discovery F-measure above 95% even when trained on Canadian data and applied to data from different countries. Finally, we introduce a confidence measure for table discovery and demonstrate its value for accurately identifying potential errors.

Published
2020
Full Text
View/download PDF

136. Schema Discovery.

Author

Renée J. Miller and Periklis Andritsos

Published
2003

139. BibBase triplified.

Author

Oktie Hassanzadeh, Reynold Xin, Christian Fritz 0001, Yang Yang, Jiang Du 0001, Minghua Zhao, and Renée J. Miller

Published
2010
Full Text
View/download PDF

142. Schema Management.

Author

Periklis Andritsos, Ronald Fagin, Ariel Fuxman, Laura M. Haas, Mauricio A. Hernández, C. T. Howard Ho, Anastasios Kementsietsidis, Renée J. Miller, Felix Naumann, Lucian Popa 0001, Yannis Velegrakis, Charlotte Vilarem, and Ling-Ling Yan

Published
2002

Catalog

Books, media, physical & digital resources
See catalog results