I think the best way to go is return your 4" speakers for 3.5's to be sure it'll be installed correctly and sound correctly. If you mount the new speaker to the passive radiator, it'll be covered by the dash and pointing to your feet. I also doubt you could modify the 3.5" hole since the width of the enclosure is smaller than the 4" speaker.