So hours ago I started playing and soon realized today I was getting a smoother framerate on the village I was compared to yesterday, then I went to the main menu and I saw the game was updated to v 1.1.1 but I wasn't sure if there was a direct correlation between both so I looked on youtube and found this:
https://www.youtube.com/watch?v=xRUFzGvngYk
Looks like the framerate has improved quite a bit both on Switch and WiiU