I've had this problem in the past. I was lagging a log while none else was and my internet was fine. One of the devs asked to send a traceroute to them and I haven't had any of that issue since.
So make sure your internet is fine when that happens.
also, this might help you:http://wiki.arelith.com/Port