It is a difference in marketing. Dwarf Fortress is based upon being ambitious and almost entirely uncompromosing in its vision. That is why people like it and that is the whole point to the game.
If Toady concentrated only on what was needed to make this game fun. It would be done by now except you wouldn't be here (and likely I wouldn't be either). Except that wouldn't be Dwarf Fortress.
Now years down the road when the game finally gets closer to release a lot of these features you want (such as improved UI) will be added to the game. You just need to be patient until then.
I find it risky to delay important features five years into the future and instead add eyelids to all creatures. Toady might lose interest, get sick or have no time. And then we'll never see those features. I know too much about game or software development to be patient for such a long time (Duke Nukem called and said he agrees with me).
No. If games have taught me anything is that developers loathe AI.
Sadly true. Even though it's such a fascinating topic and a lot of fun to work at. DF is no exception here. But that's beside the point: If you can spend your time on a project, figure out where it matters most. Do you really have to render the jiggling of boobs in excruciating detail before you even get basic gameplay done? (Graphics are a major offender for big-name titles, they swallow up all resources and in the end, we get boring games). Toady does the same, only "eye candy" equals "simulated details" to him.
See now the humans are planned to be fully playable in the future. So yeah SURE the Dwarves could look amazing now, but that would harm future development.
Nothing prevents you from adding the human stuff then. I have trouble coming up with a reason why a more streamlined menu structure (such as alphabetically sorted menus) could ever harm future development. Worst case the time spent on it is wasted because it has to be changed from scratch. That is why one starts where very little time matters a lot, as only very little time can then be rendered pointless. if you spend three hours on menus, at worst you lose three hours of work in two years when you have to overhaul it. In the mean-time (two years!) you had a far more usable version and everyone could enjoy it much more. That's acceptable. Iterative development is very reasonable.
Couple Hundred? You need to increase your numbers quite a bit. Dwarf Fortress didn't start development this year and even then he has likely wracked up numbers in the thousands of hours for just this year so far.
I know. Things I would want to see could get done in less than 40 hours for sure. I don't root for an AI that's more intelligent than Einstein, I want sorted menus, low/high priority labour assignments, basic mouse support, streamlined hotkeys and something along the lines of Dwarf Manager.
I always get into DF and then lose interest because the thing is so damn unfriendly to use. It's just not much fun to go on a drive when you have to push your car 80% of the time instead of driving it.