Nothing.

Definitely agree with a lot of these points. Bolded ones in particular. 

Would add, dropping support for products that fail also hate the majority of their exec.

1 - I can't remember when was the last time that a first party studio of them made a traditional JRPG for home consoles.
2 - Their support for the Vita left much to be desired.
3 - I never liked their Dualshock controllers.
4 - Forcing people to pay for the online features is a disgusting practice.
5 - No backward compatibility.

Gaming
1: Paying for online
2: Lack of triple AAA JRPG
3: Using their dominance to promote PS VR rather then the stuff I want :P.

Other
4. Movie division has really weakened lately
5. Lack of well thought out plans for tv and mobile businesses.

My biggest complaints are that I think PS+ is a scam when online should be free, I'm not too big of a fan of most of Sony's first party games, and the terribly poor battery on the dualshock 4.  Also, I don't know if this is just me, but it seems like their controllers are extremely fragile.  I've already had probably 5 PS3 controllers break and one PS4 controller break.

1. Paying for online for PS4, especially the shady way they tried to not mention it at their E3 2013 conference because it would be a negative thing and ruin their parade of "Look at all these good things we have on PS4 such as used games, etc, etc" moments, which led to people being confused as to whether you had to pay or not.

2. Giving up on the Vita and dropping support way too fast. Like someone else said, it makes sense from a business perspective that they would switch focus to PS4 considering how well it's doing, but I feel bad for anyone that bought a PS Vita and wanted a lot of Sony first party games from it.

Oh man, totally forgot about Colony Wars, that game was legit.

Not making a PS-Phone

Not remastering Rule of Roses

Not supporting their japanese gaming devision as much as the others

My issues are all related to PSN policies.

I can't change the region of my PSN account. I moved to Japan recently and I can only access to the european store.
Since I'm going all digital this generation it sucks that I am forced to buy physical japanese games.

Also, I can't use my japanese credit card nor my Paypal account linked to said card to make purchases on the EU PSN store, which is ridiculous. I'm using an italian card right now, but every time I want to buy something I need someone to charge it. It doesn't help that Amazon Italy is the only Amazon shop that actually sends you PSN cards instead of just sending the code via email.
It's funny, I want to give Sony my money but they are making it super difficult to do it!

Also some other minor things like no wish list on PS4 Store App (seriously?), no notification when games on my wish list are on sale, and games aren't automatically deleted from my wish list when I buy them.
I mean, Steam does all this stuff since forever, is it so difficult to do the same?

During the conference they never said that PS Plus was NEEDED for online multiplayer.  By E3 2013 I meant the conference specifically, so let me fix my post there quickly. 

Perhaps you aren't remembering the conference too well? They specifically left that out, even if they said it later in E3 2013, for a person who didn't see that article you're talking about they wouldn't have known. That's why a lot of people DIDN'T know until later.