You have to login in order to post a reply to this topic.

5 replies [Last post]
PeterW
User offline. Last seen 2 years 1 week ago. Offline
Joined: 11/18/2009
Posts: 10

I have a job in WA that searches a URL in yahoo site explorer. The reults page gives the option to download the first 1000 results into a TSV file.

At the moment I'm using the macro recorder and mouse clicks to click the download link.

Is there a way to do this using Get and Post?

The URL to get the search results is as follows - the %URLVariable% part is where you would put in the URL you want to search on:

http://siteexplorer.search.yahoo.com/search?p=%URLVariable%&bwm=i&bwmo=s&bwmf=s

In the results page there is a link on the right above the results that says "Export first 1000 results to TSV" which is hyperlinked to the following URL:

http://rds.yahoo.com/_ylt=A0oG7zZ xLyJLlt4Al.vbl8kF/SIG=13jr9hs6u/EXP=1260617969/* *http%3a//siteexplorer.search.yahoo.com/ export%3fp=%URLVariable%26bwm=i%26bwmf=s%26bwmo=s

Is there a way to grab this TSV file through Get/Post?

I am aware that Yahoo have an API for getting this data but it is limited to a certain amount of searches a day

 

codex
codex's picture
User offline. Last seen 18 weeks 4 days ago. Offline
Joined: 11/12/2009
Posts: 161
Re: Downloading TSV files from Yahoo Site Explorer using ...

Peter, the second link that you provided does not work, and I cannot find the "Export first 1000 results to TSV" option that you mentioned. Can you please attach a screenshot to show us what you mean?

__________________

Error is not blindness, error is cowardice

__________________

Error is not blindness, error is cowardice

PeterW
User offline. Last seen 2 years 1 week ago. Offline
Joined: 11/18/2009
Posts: 10
Re: Downloading TSV files from Yahoo Site Explorer using ...

HI - sorry for that, here is a real example using winautomation.com:

The Yahoo results of the search:

http://siteexplorer.search.yahoo.com/search?p=www.winautomation.com&bwm=i&bwmo=d&bwmf=s

The option is at the top of the search results and to the right, this is the link it points to:

http://rds.yahoo.com/_ylt=A0oG7zEFUSJL8v8AJsXbl8kF/SIG=13jm6hd5e/EXP= 1260626565/* *http%3a//siteexplorer.search.yahoo.com/export%3fp =www.winautomation.com%26bwm=i%26bwmf=s%26bwmo=d

Thanks :D

codex
codex's picture
User offline. Last seen 18 weeks 4 days ago. Offline
Joined: 11/12/2009
Posts: 161
Re: Downloading TSV files from Yahoo Site Explorer using ...

Something like the job that I attached?

AttachmentSize
Download TSV File.waj 17 KB
__________________

Error is not blindness, error is cowardice

__________________

Error is not blindness, error is cowardice

PeterW
User offline. Last seen 2 years 1 week ago. Offline
Joined: 11/18/2009
Posts: 10
Re: Downloading TSV files from Yahoo Site Explorer using ...

Yes that works perfectly

Thankyou very much!

codex
codex's picture
User offline. Last seen 18 weeks 4 days ago. Offline
Joined: 11/12/2009
Posts: 161
Re: Downloading TSV files from Yahoo Site Explorer using ...

Glad that I could help Peter! :-)

__________________

Error is not blindness, error is cowardice

__________________

Error is not blindness, error is cowardice