Usually this kind of per-pixel displacement map algorithm cannot be anti-aliased (MSAA), that's the main reason why they're not popular in video games. This one doesn't look like an exception too. SSAA is ok to make a demo, but definitely a no no for an actual game.
