Maybe a 7-day vegan challenge will solve all your problems ;)
I think the best way is to do gradual food elimination over the course of several months and then see how you feel. Many people who tried switching to veganism temporarily report feeling less energetic because they seemingly rely on processed food and/or don't make the best decisions of what they should eat. I never thought I could ever live without white bread, but had somehow managed to eliminate 90% of my intake of it by doing it gradually. My salt intake has also decreased tremendously over the course of a few years (still working on that addictive processed sugar, though).
Ultimately, only you can decide whether it is worth or not and in what capacities (for you personally, for the environment or for whatever other reasons). Everyone will give you their personal beliefs on the matter, which are quite subjective. If you want to get to the bottom of this, you would probably be better off pouring yourself into scientific literature on the matter comparing eating habits, lifestyles and health. I find Mike the Vegan YouTube channel to be informative as he always cites peer-reviewed scientific research and appears to be objective enough about what is expected from a plant-based diet (inlcuding having to take in some supplements; which shouldn't be exclusive to such diet, by the way).
I am not vegan myself but I mainly subsist on chicken and fish plus the ocassional red meat once or twice a month. I have days where I don't eat any kind of meat. This works for me now, but I'm always looking into ways to improve my diet.
No foreign sky protected me,
No stranger's wing shielded my face.
I stand as witness to the common lot,
survivor of that time, that place.
- From 'Requiem' by Anna Akhmatova
