If you reduce the size of duct the speed will increase and also the noise will increase with this. Ideally you need to open the duct size out bigger than fan and also take into mind area loss of silencer, if the silencer baffling is in air flow. You would also need to open out for filters area loss.