Repositories list

• MatchGPT

  Public
  This repository contains code and extensive prompt examples to reproduce and extend the experiments in our papers "Using ChatGPT for Entity Matching" and "Entity Matching using Large Language Models".

  entity-resolutionproduct-matching

  Jupyter Notebook

  •11•49•0•0•Updated Oct 18, 2024Oct 18, 2024

• TailorMatch

  Public
  This repository contains code and comprehensive examples to replicate and build upon the experiments presented in our paper “Fine-tuning Large Language Models for Entity Matching” The repository provides resources for implementing fine-tuning techniques on large language models specifically for entity matching tasks.

  Jupyter Notebook

  •1•7•0•0•Updated Sep 13, 2024Sep 13, 2024

• wdc-pave

  Public
  Web Data Commons - Using LLMs for Product Attribute Value Extraction and Normalization

  Python

  •1•8•0•0•Updated Jul 3, 2024Jul 3, 2024

• wdc-page

  Public
  This repository contains the source files of the Web Data Commons website and is used to maintain the site. The Web Data Commons project extracts structured data from the Common Crawl

  web-data-extraction

  HTML

  •1•1•0•0•Updated Jul 3, 2024Jul 3, 2024

• SC-Block

  Public
  SC-Block is a supervised contrastive blocking method which combines supervised contrastive learning for positioning records in an embedding space and nearest neighbour search for candidate set building.

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •2•8•0•0•Updated Jun 10, 2024Jun 10, 2024

• wdc-sotab

  Public
  Jupyter Notebook

  •0•4•1•0•Updated Jun 3, 2024Jun 3, 2024

• TabAnnGPT

  Public
  This repository contains the code for the experiments run in the papers "Column Type Annotation using ChatGPT" and "Column Property Annotation using Large Language Models".

  Jupyter Notebook

  •2•9•0•0•Updated May 28, 2024May 28, 2024

• ExtractGPT

  Public
  Attribute Value Extraction using Large Language Models

  Python

  •

  Apache License 2.0

  •7•22•0•0•Updated May 24, 2024May 24, 2024

• wdc-smb

  Public
  This repository contains the code and data download links to reproduce building the WDC SMB Benchmark.

  BSD 3-Clause "New" or "Revised" License

  •0•0•0•0•Updated Dec 11, 2023Dec 11, 2023

• pie_chatgpt

  Public
  Product Information Extraction using ChatGPT

  Jupyter Notebook

  •0•2•0•0•Updated Oct 4, 2023Oct 4, 2023

• wdc-lspc-v2

  Public
  This repository contains code and data download scripts for the paper "Using schema.org annotations for training and maintaining product matchers" by Ralph Peeters, Anna Primpeli, Benedikt Wichtlhuber and Christian Bizer.

  entity-resolutionschema-orgproduct-matching+ 1deepmatcher

  Jupyter Notebook

  •

  BSD 3-Clause "New" or "Revised" License

  •3•15•1•0•Updated Aug 29, 2023Aug 29, 2023

• wdcproducts

  Public
  This repository contains the code and data download links to reproduce building the WDC Products Benchmark.

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •3•12•0•0•Updated Jul 13, 2023Jul 13, 2023

• SubsetCreatorJupyterNBs

  Public
  Jupyter notebooks used to create the schema.org subsets from the MD and JSON-LD corpus for the WDC 2020 structured data extraction.

  Python

  •1•3•0•0•Updated Feb 28, 2023Feb 28, 2023

• WDCFramework

  Public
  Java Framework which is used by the Web Data Commons project to extract Microdata, Microformats and RDFa data, Web graphs, and HTML tables from the web crawls provided by the Common Crawl Foundation.

  schema-orgjson-ldmicrodata+ 1web-data-extraction

  Java

  •1•8•0•0•Updated Dec 13, 2022Dec 13, 2022

• productbert-intermediate

  Public
  This repository contains code and data download scripts for the paper "Intermediate Training of BERT for Product Matching" by Ralph Peeters, Christian Bizer and Goran Glavaš.

  entity-resolutionproduct-matchingbert

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •11•35•0•20•Updated Dec 8, 2022Dec 8, 2022

• StructuredDataProfiler

  Public
  Java project for profiling the results of the yearly Web Data Commons extraction of structured data with RDFa, Microdata, Microformat, and Embedded JSON-LD annotations.

  schema-orgjson-ldmicrodata+ 2profilingweb-data-extraction

  Java

  •0•0•0•0•Updated Oct 17, 2022Oct 17, 2022

• winter

  Public
  WInte.r is a Java framework for end-to-end data integration. The WInte.r framework implements well-known methods for data pre-processing, schema matching, identity resolution, data fusion, and result evaluation.

  conflict-resolutionentity-resolutiondeduplication+ 5link-discoverydata-fusionentity-matchingdata-matchingconflict-resolver

  Java

  •

  Apache License 2.0

  •32•8•0•5•Updated Sep 1, 2022Sep 1, 2022

• UnsupervisedBootAL

  Public
  Unsupervised Bootstrapping of Active Learning for Entity Resolution

  Jupyter Notebook

  •1•6•0•1•Updated Mar 25, 2022Mar 25, 2022

• EntityMatchingTaskProfiler

  Public
  Code for profiling entity matching tasks using the dimensions described in the following paper: Primpeli, Anna, and Christian Bizer. "Profiling entity matching benchmark tasks." Proceedings of the 29th ACM International Conference on Information & Knowledge Management. 2020.

  benchmarkingentity-resolution

  Python

  •0•6•0•0•Updated Mar 8, 2022Mar 8, 2022

• contrastive-product-matching

  Public
  This repository contains the code to reproduce the experiments of the poster "Supervised Contrastive Learning for Product Matching"

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •14•36•4•0•Updated Feb 11, 2022Feb 11, 2022

• ALMSER-GEN

  Public
  This repository contains the code and data for reproducing the results of the paper "Active Learning for Multi-Source Entity Matching: How do the Characteristics of the Task Impact Performance?" .

  Python

  •1•2•0•0•Updated Nov 30, 2021Nov 30, 2021

• ALMSER-GB

  Public
  This repository contains the code and data for reproducing the results of the paper "Graph-boosted Active Learning for Multi-Source Entity Resolution" presented at ISWC2021.

  entity-resolutionactive-learning

  Jupyter Notebook

  •2•4•0•0•Updated Oct 1, 2021Oct 1, 2021

• DeepAL_for_ER

  Public
  Code and Data to reproduce the results of the Master Thesis of Stephan Waitz on "Combining Deep Learning and Active Learning for Entity Resolution"

  HTML

  •2•0•0•0•Updated Sep 2, 2021Sep 2, 2021

• jointbert

  Public
  This repository contains the code and data download links to reproduce the experiments of the PVLDB paper "Dual-Objective Fine-Tuning of BERT for Entity Matching" by Ralph Peeters and Christian Bizer.

  entity-resolutionbertweb-data-integration

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •6•14•0•0•Updated Jun 7, 2021Jun 7, 2021

• schemaorg-tables

  Public
  This repository contains the code and data download links to reproduce the building process of the 2021 Schema.org Table Corpus.

  schema-orgweb-data-extractionweb-tables

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •2•3•0•0•Updated May 12, 2021May 12, 2021

• MannheimSearchJoinsEngine

  Public
  A Search Join is a join operation which extends a user-provided table with additional attributes based on a large corpus of heterogeneous data originating from the Web or corporate intranets.

  data-integrationdata-searchdata-lakes+ 1table-augmentation

  Java

  •3•1•0•0•Updated May 11, 2021May 11, 2021

• productCategorization

  Public
  This repository contains code and data download instructions for the workshop paper "Improving Hierarchical Product Classification using Domain-specific Language Modelling" by Alexander Brinkmann and Christian Bizer.

  hierarchical-classificationproduct-categorizationlanguage-modelling+ 1transformer-models

  Python

  •

  MIT License

  •2•17•0•0•Updated Apr 30, 2021Apr 30, 2021