I'm not worried about it, but the powerplay has definitely been important. It has to be in the back of the other teams' heads that they can't take penalties against the Jets, which maybe allows the team a little more room at 5v5.
The Jets powerplay as a whole is shooting 23.4%. The next closest team is Tampa at 18.3%. The best team PP SH% each year are usually under 20%. The Oilers and Lightning are the only ones to hit that since 2007-08, and even then just barely.
I don't think Davis Payne invented moving around on the powerplay, and while it's possible the Jets have the best combination of talent ever seen on both units, I think it's probably more likely that they're quite good, but on an unsustainable run.