Thanks @kenny for your feedback. One of our customers uses dfk for aggregating data about physicians extracted from different web sites.

The volume of scraped data is about several millions of pages per web site.

DFK is able to extract data from Java script driven pages and from websites behind login form.