depends on how you define success. sure, some other systems have achieved success in the niche videogame market, but nothing like the mass appeal of the ps1. here's an example. here in the US i can walk into a grocery store and they have a handfull of ps1 titles for sale. i've never seen another console reach that point, nor did i expect the psx to.
I've seen the gba in more supermarkets than the psx.
other than the cart limitation the n64 was superior hardware. and the cart limitation wasn't as much of a limitation as far as achievable content was concerned (look at re2, all the fmv and voice from the psx version, although noticibly compressed). it was more cost prohibitive than anything else. and it's the "vs Sony red carpet" part of your statement that negates your argument. sure, nintendo's own mishaps might have eventualy been the undoing for n64, but it was the well marketed alternative offered by sony that drew developers and custmers away.
I heard that the n64 was pretty poorly balanced(4K of texture ram only, poor memory system), but nintendo made it worse by restricting the code developers were allowed to use.(supposendly the n64 could use code very similar to the psx, but nintendo didn't allow developers too, and the code they were left with was either inferior in the power it could utilize, or just harder to use....I saw one press release about nintendo microcode on the n64 where the initial microcode only allowed 150,000 polygons to be used, while the new microcode would allow up to 1.5 million)
BTW, n64 sold quite well in the US, I believe pretty close to the psx up until 2000, and worldwide it was selling ahead of the psx till 1998. It's really quite strange that gamecube was less US focused than n64 was, sort of like how saturn was less US focused than Genesis and partly failed because of it. Gamecube I think has done better than n64 in Japan, or at least as well, and Saturn did better in Japan or at least as well as Genesis, but at the expense of the US market.
I guess a "Dynamic UI" would be that the touch screen can display any buttons it wants, in any arrangement, and only when it needs to. If nintendo put buttons on the system, they might not be in the best arrangement for that game, they might not have a fancy border layout, they might not display the correct information on them, there may not be enough, etc.