Results 1 to 4 of 4
  1. #1
    element_n_h is offline Member
    Join Date
    Feb 2012
    Posts
    2
    Rep Power
    0

    Default Need to automate the mouse movements, based on what's displayed on-screen.

    Hey everyone, is this even possible?

    I am completely new to java, and programming in general (as in started up a couple of weeks ago).
    Essentially I couldn't find a program to do the above task, so i thought I'd attempt to write one myself.
    Now I know it's going to be hideously complex and completely out of reach for a good few weeks/months, if it's even possible at all.

    I know there are auto clickers out there, but I need to pair it with something to recognise the screen and click accordingly.

    For example, an online card game in a pop out window.
    When certain cards are displayed, it clicks one button.
    When others are displayed it clicks another button.

    Could this possibly be done with screen shots?
    Or is it beyond the capabilities of java?
    (I've looked briefly into image recognition and fell head first into the deep end of neural networks and genetic algorithms )

  2. #2
    Eranga's Avatar
    Eranga is offline Moderator
    Join Date
    Jul 2007
    Location
    Colombo, Sri Lanka
    Posts
    11,371
    Blog Entries
    1
    Rep Power
    20

    Default Re: Need to automate the mouse movements, based on what's displayed on-screen.

    Once you have bunch of images there should be a mechanism to identify them in your logic or the code. Simple flag you can used based on the implementation. Using the flag you can control different events and all.

    Once you have enough historical data you can train the network with a well formed genetic algorithm, but not with a ANN. Because there is no guarantee that the same results would come up for the same input in different trials.

  3. #3
    element_n_h is offline Member
    Join Date
    Feb 2012
    Posts
    2
    Rep Power
    0

    Default Re: Need to automate the mouse movements, based on what's displayed on-screen.

    Hey thanks for the reply :)

    So in that case would I definitely need a genetic algorithm?
    Like I said, I am completely new to this and so GA's are a bit out of my depth.


    Would it be a case of linking to image files and having "if" commands with mouse automation?
    Or something more?

    Sorry for the complete inexperience, :P
    I really appreciate the help.

  4. #4
    Eranga's Avatar
    Eranga is offline Moderator
    Join Date
    Jul 2007
    Location
    Colombo, Sri Lanka
    Posts
    11,371
    Blog Entries
    1
    Rep Power
    20

    Default Re: Need to automate the mouse movements, based on what's displayed on-screen.

    If you are new to the areas like GA and all, bet thing for the moment is forget about. Just start with the basis like how to design the UI and handle the interaction with the user. Later on you can integrate the intelligence into the game.

Similar Threads

  1. Rpg map movements?
    By mrhid6 in forum Java Gaming
    Replies: 0
    Last Post: 10-29-2011, 01:27 AM
  2. Mouse position in applet window not screen
    By 0circle0 in forum Java Applets
    Replies: 1
    Last Post: 07-22-2011, 01:33 PM
  3. Repositioning components based on mouse position
    By robbie.26 in forum AWT / Swing
    Replies: 3
    Last Post: 06-21-2011, 07:55 AM
  4. making mouse movements human like [help]
    By crikey in forum Advanced Java
    Replies: 22
    Last Post: 08-20-2010, 11:33 PM
  5. Clear Screen in Console based programs
    By kirly in forum New To Java
    Replies: 5
    Last Post: 02-05-2009, 06:59 AM

Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •