Tegra uses reference ARM the same as Vita did. Maybe you mean a better core like A72 or A73. But I remind you that the Vita route resulted in Cortex-A9 cores that were clocked at a scant 444MHz, when contemporary phones used Cortex-A9s clocked at > 1GHz.
The Vita uses 4x 444MHz Cortex A9, whereas contemporary flagship phones from late 2011 / early 2012 used 2x ~1GHz Cortex A9. So from a phone-to-console comparison, in the CPU side the Vita was well ahead of what the Switch seems to be if it's 4x A57 @ 1GHz. Vita had a higher core count, the Switch as a lower one.
If we go by GPU comparison, the Vita had a PowerVR 543MP4, practically the same as the top-end ipad 2 of the time with a A5X and estimated 32 GFLOPs. Current top-end 9.7" ipad pro AFAIK does close to 500 GFLOPs FP32 and 1 TFLOPs FP16.
And then the Vita had the exquisite 128MB dedicated VRAM with a probably large bandwidth using TSV.
Screen resolution and quality was also above most phones at the time, offering OLED RGB 960*540 while android flagships had 800*480 screens.
And the console was sold at $250/250€ without 3G, AFAIR at a profit.
Just to say the Vita compared much more favorably to 2011 top-end phones/tablets than the Switch compares to 2016 top-end phones/tablets (and the console isn't even releasing in 2016). And Sony didn't try to sell the Vita as a hybrid console.
Oh, and the Vita didn't burn little kids' hands. Neither does it need air vents and fans. Food for thought.
All this - again - assuming the Switch has 2 SM clocked at 300-760MHz, which is pure speculation at the moment.
I haven't yet seen evidence that PowerVR from comparable generation has significantly better power efficiency than Maxwell in the X1 implementation. People focus heavily on power consumption at max clocks but that doesn't tell the whole story, you really have to look at the entire perf/W vs perf curve and rarely does anyone do this.
I believe Maxwell Tegra would probably be competitive with PowerVR 7XT, if there were SoCs with 7XT built on 20nm. There aren't any, though. So the best you can do is compare to 6XT, but no 6XT SoC is trying to reach TX1's absolute performance in 3D.