Need to automate the mouse movements, based on what's displayed on-screen.

Hey everyone, is this even possible?

I am completely new to java, and programming in general (as in started up a couple of weeks ago).
Essentially I couldn't find a program to do the above task, so i thought I'd attempt to write one myself.
Now I know it's going to be hideously complex and completely out of reach for a good few weeks/months, if it's even possible at all.

I know there are auto clickers out there, but I need to pair it with something to recognise the screen and click accordingly.

For example, an online card game in a pop out window.
When certain cards are displayed, it clicks one button.
When others are displayed it clicks another button.

Could this possibly be done with screen shots?
Or is it beyond the capabilities of java?
(I've looked briefly into image recognition and fell head first into the deep end of neural networks and genetic algorithms :(doh):)

Once you have bunch of images there should be a mechanism to identify them in your logic or the code. Simple flag you can used based on the implementation. Using the flag you can control different events and all.

Once you have enough historical data you can train the network with a well formed genetic algorithm, but not with a ANN. Because there is no guarantee that the same results would come up for the same input in different trials.

Hey thanks for the reply :)

So in that case would I definitely need a genetic algorithm?
Like I said, I am completely new to this and so GA's are a bit out of my depth.


Would it be a case of linking to image files and having "if" commands with mouse automation?
Or something more?

Sorry for the complete inexperience, :P
I really appreciate the help.

If you are new to the areas like GA and all, bet thing for the moment is forget about. Just start with the basis like how to design the UI and handle the interaction with the user. Later on you can integrate the intelligence into the game.