In the config panel I've set the bufffer size to 32. I am using Cubase 6.5 as DAW and because I have multiple interface, I use asio4all where I have put this buffer size to 64. According to cubase my latency is like 4-5 ms. Also real time latency, for my feeling was as good as non existence. There is no POP or CLICKS anywhere, so I'm happy
Might be a dumb suggestion but did you ever check out your processes under task manager? I was having some issues with latency issues and when I checked my processes I found that I had something I wasn't even using that was hogging up a lot of my CPU (around 60%-80%). I ended that and a couple of other processes and it seemed to help a lot. I haven't run my system through the ringer with tons of effects, eq, compression but when I was experiencing latency, I was running about 30 tracks with about 4-6 tracks running some reverb. When I made those changes I haven't had the problem.