In Legend of Zelda TP: Temple of Time, did I screw up my opportunity at a Poe?

I got the dominion rod, and took the statue to a gate in the circle chamber with the elevator in the middle. I teleported him out of there, then I saw another gate with a poe inside it. Did I miss my chance at getting that poe, or is there another way I can get it?