To Leave the Land without time, you must match 5 colors frequencies, according to the ugly spirit upstairs island 1. There are two ways to "solve this puzzle", considering that at the beginning, you might have 2 colors properly set and 3 colors that still need to.

First solution, talk with him till he asks you to give your three amulets. This will match the 3 remaining colors frequencies. So you will leave, but you have lost you 3 amulets and you'll have no XP reward.

Second solution, you need to use the Glass Sphere . You can do so just after a random teleportation, and only in certain spots, (otherwise you "can't use the sphere here"), by dropping the sphere on the ground, and "use" it. There should be some kind of color change around. Then, let yourself be teleportated again and try in another place, till you have 3 different colors "changed". Check your progresses each time you can meet the ugly spirit.

There are 5 different spots to change frequencies, and you have to set exactly 3 frequencies... The good combination changes each time you go into Land without Time, of course.

Then go back to see the ugly spirit to check your progress. He will reward you with 2.500 XPs and you will find yourself teleportated in the Land of time (Clockwork island 1, actually).