Anything can be done with enough money.
The 1JZ engine is used in RWD platforms. So the first question is; do you intend to convert to RWD or keep it FWD? RWD would entail cutting up the floor pan and fabricating a tunnel for the drive shaft. Then making a home for the diff. And custom drive shafts. And custom rear wheel hubs to take them.
If staying with FWD, what FWD transmission would bolt up to a 1JZ? I doubt one exists. So now you need adapters for mounting one. But which? And would the motor even fit crosswise in the engine bay? Being an in-line 6, it’s a long motor.
In the end, you’ll likely have $50k invested in a Camry that’s worth what?... $10k??? On a good day? Not a concern if you’re gonna keep it forever. But wouldn’t you rather spend $50k on a nice Supra? Instead of a cobbled together Camry?