Apple is an existential threat to the PC

[wco81]

Yeah not having discrete GPU support is a liability but I guess Apple decided the market for people who need that is not going to offer them the ROI.

They know what their MP sales were. Probably not enough to justify iterating regularly.

 

[Wesker]

Very interesting results, and it's the first benchmarks I've seen of AI/LLM.
M4 Max actually manages to outperform the RTX 4090 once model sizes become too big for the 4090's RAM pool.

 

[MfA]

That's what tensor parallelism is for in AI/LLM ... just plug in more RTX 3090s (don't really need 4090 with low batch sizes). Even across PCIe tensor parallelism works good enough.

Though unless it's for porn, you can just do it in the cloud too.

 

[Pressure]

It's interesting to see the E cores in the M4 nearing the P cores of the M1. Faster in some and still slower in other areas.

More observations here: Inside M4 chips: CPU core performance (by Dr. Howard Oakley at The Eclectic Light Company).