I have to agree, in terms of gameplay this was pretty horrible, and annoying.
Honestly, it's like you went to great lengths to ensure the experience would be as much of a nuisance as possible. The ultra-slow movement, the constant warping... at halfway I just wanted it to end.
There was a good deal of charm, though; the voiceacting, the premise and presentation were impressive (although at the very beggining I felt like "ok, here I am stuck in a bunch of rocks, listening to some trippy music"). So there's obviously some potential here.
If you can change just one thing, do away with the sluggish walking; it's just really annoying and tiring.