Your server will keep track of the ip of the connected users. Whenever you want to broadcast a message to them, your server will send a message to the client side. It will be more clear if you read Sun's tutorial:
Lesson: All About Sockets (The Java™ Tutorials > Custom Networking)