Results 1 to 2 of 2
 02062010, 11:54 AM #1Member
 Join Date
 Feb 2010
 Posts
 1
 Rep Power
 0
Newbie distributed computing question
I am interested in distributed computing but new to this field. Now I have a question regarding to this field. My question is `how can I programm to compute and find the occurrence of a great deal of integers?' For instance, suppose there 1m integers, in which there are several integer which may repeat, e.g., ... 2, 2, .... 999 ... 999 ...; therefore, what I would like to do is to
count how many times those integers occur.
I understand there has some frameworks, e.g., Hadoop, which can help to deal with such kind of task. But what I would like is to go through some explain and learn some important issues related to distributed computing through a simple example.
Is there any example/ tutorial that may have such kind of explain? Or any resource/book may talk about this?
I appreciate any suggestion.
Thank you very much.
 02062010, 01:00 PM #2
 Join Date
 Sep 2008
 Location
 Voorschoten, the Netherlands
 Posts
 14,316
 Blog Entries
 7
 Rep Power
 25
The classical MPI type of approach (MPI == Message Passing Interface, a distributed computing system) is as follows: given a (long) list of numbers n1, n2, n3 ..., assume the list is sorted; chop up the list so that the chunks are completely disjunct from each other; distribute the chunks to the 'other' machines in the cluster and let them do their job. Finally collect all the statistics.
If the list is not sorted you can do the same but then you have to do some post processing on all the results because those chunks might not have been disjunct.
kind regards,
Jos
Similar Threads

HROMJI: A new distributed computing java framework
By dicromo in forum Java SoftwareReplies: 0Last Post: 01192010, 03:50 PM 
newbie question
By ronguilmet in forum New To JavaReplies: 2Last Post: 11162009, 03:37 AM 
Newbie question; Vectors
By Kern in forum New To JavaReplies: 7Last Post: 08032008, 06:59 AM 
distributed computing in java
By pushpik in forum Advanced JavaReplies: 0Last Post: 03312008, 06:50 PM
Bookmarks