Results 1 to 1 of 1
Thread: Duke 0.5
- 04-02-2012, 06:17 PM #1Senior Member
- Join Date
- Sep 2011
- Rep Power
Duke is a fast and flexible record linkage engine. It does not use the traditional blocking (sort by key) approach, but instead relies on Lucene. This makes it high-performance (able to process 1,000,000 records in ~10 minutes). Duke can be run from the command line, but also has an API allowing incremental linking applications to be built easily. It supports reading data from CSV, JDBC, SPARQL, and NTriples, and also supports a number of string comparators and string normalizers.
The internals have been cleaned and refactored, adding some performance tuning parameters. There are new cleaners, support for pluggable backends, a new naïve in-memory backend, and much more.
URL: duke - Fast deduplication engine - Google Project Hosting
- By java software in forum Java SoftwareReplies: 0Last Post: 01-25-2012, 06:52 PM
- By drone13 in forum Forum LobbyReplies: 1Last Post: 02-09-2010, 10:40 PM
- By Mark in forum Reviews / AdvertisingReplies: 2Last Post: 12-28-2007, 04:00 PM