Hm, why don't you use the internal fan connector? It is connected to a temperature sensor and additional to a circuit that makes it react to actual power used?
If it's still too loud, you could try using a 25mm thick fan on the outside instead of the inside one, or a 7V low noise adapter as last...