Ultron minions == Chitauri in the sense that even a human such as Black Widow or Hawkeye can take them down.
Ultron himself - well, I don't have high hopes for him to be able to kill even 1 Avenger. For all his talk about how mankind needs to be eradicated, I doubt he'll be able to do much damage.