Marth said:
Out of curiosity: How does your crawler work? Maybe your solution is way better then mine and so I can improve it. My programm is very brute force atm :D |
It uses lynx to dump the page source and with grep obtains the line where the ranking is. The it uses sed to only show the number. I can share with you how I did it so we can make both crawlers better. Not a great programmer skills but for it gets the job done. I can't execute every time because Amazon then tells me I'm a robot, so it fails to obtain the numbers xD