selective screen reading and mouse positioning

[synkarius]

After rewriting the DP grid, include the following functionality: the ability to highlight squares on the grid with voice commands, then save the pixels that were under those squares as a picture file. By invoking the name of the picture file, a screen read is done and that image is attempted to be found in the larger image. If it is found, move the mouse to the center of the image in the larger image i.e. the screen.

[synkarius]

Wait for response windows to do this.

[synkarius]

SikuliX already does this way better than I am envisioning. Better to learn SikuliX than to reinvent the wheel.