Are you acquainted with the mood of mind in which, if you were seated alone, and the cat licking its kitten on the rug before you, you would watch the operation so intently that puss's neglect of one ear would put you seriously out of temper?
There is no ideal in observation. When you have an ideal, you cease to observe, you are then merely approximating the present to the idea, and therefore there is duality, conflict, and all the rest of it. The mind has to be in the state when it can see, observe. The experience of the observation is really an astonishing state. In that there is no duality. The mind is simply - aware.
But if nothing but soul, or in soul mind, is qualified to count, it is impossible for there to be time unless there is soul, but only that of which time is an attribute, i.e. if change can exist without soul.
Follow the wandering, the distraction, find out why the mind has wandered; pursue it, go into it fully. When the distraction is completely understood, then that particular distraction is gone. When another comes, pursue it also.