I have this stutter as well... Uninstalled QoS and tried disabling all USB devices and no change. I do play with a controller but with or without it there is no difference.
What did help a bit was disabling Intel Speedstep in the BIOS... so that the CPU runs at full speed at all times instead of underclocking when idle. This has a noticeable boost, but if you look close enough you can still see the stutter, although its by far not as annoying now.
Still, this isn't a solution and I haven't been able to find a sure-fire way yet. Googled and tried other things like port forwarding too... /sigh Why can't this game behave nicely for once after 5 systems since I started playing it -.-
XI Wiki

