If you’ve seen Microsoft’s creepy Productivity Future Vision video, this article does a great job explaining why it (and most other interfaces today) are missing the point:
Our hands feel things, and our hands manipulate things. Why aim for anything less than a dynamic medium that we can see, feel, and manipulate?