Ok, so forcing psnprofiles to update every account is mandatory for you, is that right?

I've been playing around with it and I was able to send an update to psnprofiles for an account. So far so good.

After a couple of updates I got the human verification error, just as you said.

Here comes the interesting part: I went to psnprofiles and did the CAPTCHA verification manually and was able to get the CAPTCHA ID with Live HTTP headers.

With that ID I was able to post 10 updates until I got the human verification error, so that's the limit.

Now, I've done some research and I think I'd be able to integrate the CAPTCHA verification in our app and MAYBE psnprofile will accept my ID. If I succeed you would have to do the verification manually every 10 accounts.

Would this be ok for you? I need to know that, because integrating it might be challenging for me and I wouldn't make the effort otherwise

The other thing I have to find out yet is what is the "cooldown" time of the human verification. If it's acceptable, I could try to make a service that posts 10 updates every (insert cooldown time here, let's say 1 hour) automatically.

You know what, forget this. Let's use http://psntrophyleaders.com instead. Manual updates are unlimited and you can add 5 users per day, which will be more than enough once we've initialized our app.

I'd have to redo all the code for gathering trophy data from the site, which is a rather shitty task, but if you're down with it, I'm down. What do you think?

The only thing that bothers me a little is that some accounts seem to have hidden trophies. To name a few, our buddies FadetoOne and Veritaz seem to have some. Could you maybe explain how this works? Thanks. (I'll do a separate post for this)

@FadeToOne, @Veritaz

As you may have noticed, I'm trying to improve the trophy retrieving system for Arc. I'll try to update and gather trophy data from http://psntrophyleaders.com.

The only thing that bothers me a little is that some accounts - like yours -seem to have hidden trophies. . Could you maybe explain how this works?

Thanks.

I think what is happening here is that you can hide games from appearing in your trophy details. Any trophies earned from those hidden games still appear in your trophy totals, but the hidden games won't appear in the detailed list of games you've played and earned trophies for.

If psntrophyleaders.com is easier to automatically scrape the data from, then I would be interested in looking into it. I haven't visited this before before (until today) so I'll have to poke around it some more to see if there is anything in its design that would cause us problems.

Can you elaborate on being limited to adding 5 users per day? Does that mean the site only accepts 5 new users a day, or they limit the adding of users from a single IP to 5 a day?

It's weird. If we take a look at Faster55's profile: http://psntrophyleaders.com/faster55#games

on the top corner of the page, it says right now 13,226 trophies, which I assume is the amount of trophies you'd get from the trophy log - the view I'll retreive the trophy data from. This is also the amount of trophies PSN Profiles dislays: http://psnprofiles.com/Faster55

But on the lower left side of the screen on trophyleaders, it says 13,258 trophies. So where the heck are those 32 trophies and how can you hide them?

I've made a free account there and saw nothing.

Can you elaborate on being limited to adding 5 users per day? Does that mean the site only accepts 5 new users a day, or they limit the adding of users from a single IP to 5 a day?

It's 5 users per IP, I just added a 6th one on another PC.

I'm pretty sure everything should work fine, I've already made my app update 15 of our user's profiles successfully. It takes several seconds per profile though.

Of course, if this site changes something in their code or update policies, it could screw us pretty easily, but this applies to all of our potiental "sources" - including the official playstation site.

You can hide any game you want from on your PS3 or PS4 on the options menu in trophies. I hid about 32 of mine which was about 8 games or something and I don't beliew the games or trophies hidden show up on PSNPROFILES. I did it because I only had a couple of trophies in each game and I didn't like them so I never expected to come back. It was making my completion percentage a lot worse so I just hid them.

Oh, didn't know that, thanks! And sorry for exposing you in this thread, I just realized it could offend someone... I'm just trying to make this league even more awesome

No problem, anything that can help the league is my pleasure.

Maybe I'm late, but thanks for the updates. Man, I've done quite a leap this past month, though competition is going to be stiff from now on.

The thing is, I don't know how they get so much information. On the official site you only see trophies of your friends and even then you can't see secret trophies or the date when they earned them. However, the trophy sites seem to be able to pull very detailed data from every profile, at any time.

My guess is that those sites pay Playstation for an official webservice that provides all the trophy data that's available, otherwise any random guy with programming skills - like me - could create a little trophy site like theirs.