| Arcturus said:
Yeah I've often wondered how sites like PSNprofiles gathers its data, considering the number of people they track and the frequency in which they update their data.
KylieDog had an interesting though a few pages back - create a web scraping script to grab trophy data from PSNprofiles. My knowledge is limited in this field but it seems like it would be fairly easy to do:
1. Read list of users from a txt or csv file
2. Navigate to http://psnprofiles.com/
3. Scrape trophy data from page source. For example:
4. Repeat steps 2 and 3 for each other user.
5. Output all data to csv or xls file.
I would love to attempt writing a script like this, but I don't know where to start.
Does anyone have any good resources for creating simple web scraping scripts for beginners?
|
That would work... the worry there is that PSNProfiles doesn't generally have the most up to date info. I've noticed mine updates automatically sometimes, but other times not. It's possible the script could kick off the update process, I guess.
The script I had made might be a good starting point, if either of us can find it.
Essay Pro