Can someone lend a hand on this? I would like to create a job that similar to the "download from web" function determines if a page is nofollow or do follow.

Ideal it would work like this:

Loop through a list of urls:

For each url state if it is a nofollow or dofollow. The dofollow code is by default so it would just need to check to see if the nofollow tag is in place. I think the main issue is the regular expression drama needed when parsing the page and searching for info.

Thanks in advance for any tips - I'm sure that not just I would find this job HELPFUL.