It MIGHT be slow because the PTR was just released, so it's possible Blizzards download servers are busy so you aren't getting much bandwidth from them, while also not downloading data most people do so there's no Peer transfers.
Actual patches work MUCH quicker when downloading since it works like a torrent. Chances are you're downloading a torrent with 1 seed and no peers to leech from.
XI Wiki


