I am afraid so. Those plugs are there to fill the cut out where the line-bore machine were used to machine the cam journals in the heads at the factory. It is fairly easy to do when the valve cover is off.
This is the picture of the four cylinder head for the Camry:
http://www.strictlyea.com/forum/files/done_245.jpg, the half-moon plugs are on the exhaust cam, or near side of the picture and then there is the round one for the intake cam on the right end of the head, where the bracket is. One more area to look at is where the machine parts come together, sealer should be use in those area along with the gaskets.
N.E.O.