Do I use a harness or the rca connectors to connect an aftermarket headunit to the factory amp?

If the answer is harness, won't the 45watts x 4 from my headunit distort the sound quality?