Algorithm to match short text strings (equivalent product names from disparate sources)
£20-250 GBP
Paid on delivery
We have an existing MS SQL database which is populated with products retrieved from various sources (portals).
The various portals usually have slightly different names for the products.
E.G
Portal 1:
PortalProduct 1: CocaCola
PortalProduct 2: Manchester United
PortalProduct 3: Maplin Electronics
Portal 2:
PortalProduct 1: Coca-Cola
PortalProduct 2: Man Utd
PortalProduct 3: Maplin Elec Ltd.
- We need to correlate these PortalProducts to a central list of Products.
- One Product can have 1-to-many PortalProducts
- The database is populated with around 10,000 PortalProducts
- The database is not populated with any Products. Products need to be added for each new PortalProduct that doesn't match an existing Product.
This must be implemented as a C# console application so that a) we can see the results when the correlate is run and b) so that we can ultimately run it on a task-schedule.
The developer must develop a text matching algorithm to correlate PortalProduct names with Product names (and create a product where there is no match). The emphasis is on the accuracy of the text matching algorithm. Speed is less important than [login to view URL] developer should have a mathematical mind and preferably has experience in developing mathematical text matching algorithms.
Examples of mathematical text matching algorithms that could be used (and potentially refined and combined) to meet our requirements are:
String metric
Locality-sensitive hashing
Needleman–Wunsch algorithm
Smith–Waterman algorithm
Levenshtein distance
Concept Search
Approximate matching with addition of regular expressions ability
Regular expressions for non-fuzzy (exact) matching
Metaphone
Soundex
Agrep
Plagiarism detection
[login to view URL]
Ideally the developer will already understand and have used some of these before and able to pick the best algorithm(s) for this application.
Project ID: #10964138
About the project
14 freelancers are bidding on average £174 for this job
Hi there, You have a Challenge, We Create the Solution Solution Engineering is a Team of quality and solution oriented engineering professionals across various engineering disciplines that have tackled challenges lik More
hi. im a software development engineer with excellent algorithm design skills. i can do this work for you
I'm C# developer. I worked in Microsoft in AppFactory program for developing Windows 8 and Windows Phone Apps. I got here many Desktop and WPF projects. You can check my profile and if you accepted, just let me know to More
Hello, I hope you doing very well! I have gone through the description and would like to provide a quality solution using my 5+ years of professional experience in required skills. (.NET/ASP.NET - MVC, EF, SQL, C#). More
First, when using an algorithm, instead of a list that contains phrase pairs considered equivalent, there's no way to be completely certain that a match is correct. Any match would have a confidence level. Your first More
I have used Copyleaks and Fuzzystring in a plagiarism checking software for library for a college. Im sure it will be more than enough for this purpose.