Data Cleaning publication categorizer

Online market intelligence (OMI), in particular competitive
intelligence for product pricing, is a very important application
area for Web data extraction. However, OMI presents
non-trivial challenges to data extraction technology. Sophisticated
and highly parameterized navigation and extraction
tasks are required. On-the-fly data cleansing is necessary in
order two identify identical products from different suppliers.
It must be possible to smoothly define data flow scenarios
that merge and filter streams of extracted data stemming