Hi,
I had the same Problem – I used “snitch” to locate the Problem. And there it was. WP Hide My Admin uses an outgoing connection for the “class.helper.php”. This connection took 5-8 seconds – I blocked this connection using “snitch” and suddenly the admin was fast as it should.
Hope it helps!