Going by your speed test results you reported, your connection seems to be running as expected with a few results better than the best I've seen from my 3Mbps DSL connection.
The next time you notice your speed running connection running slow, could you run a speed test at that moment? Also, try running a test download from the 15MB file at
BT Openworld This usually gives a reliable result for your maximum transfer rate.