How can I improve the execution time of a Java Project

[Nicholas Jordan]

OP: That is almost expected. I have worked on the code all week or better and have realized the problem is not as simple as the person that fired you would expect. I have big plans, small resources - but some of the resources are of such a nature that running my code would be effective in your current situation. This work can pay remarkably well, I have work if I can get sufficiently skilled people.

We can gather from reading the sources you provide that such things as passing the file writes and so on to a second and third thread would have exposed the entire project to hidden gotcha's ... the code is written by someone who knows what they are doing and I suggest it is best if we leave the project in the hands of whomever decided to use the code in the first place. Let them either deal with it as it is or go to the vendor. I dreaded becoming involved and was coding to make a titanium harness.

It is telling of the nature of the work that I had to go to the length of writing an entire program just to convey a method of contact. That never ceases, I have great experience with that: I am the Personal Assistant of one who manages some pretty hefty work, I spend all of my time watching blunders like what you just went through and exercising adroit skills at thwarting those failures in advance where possible. I like this forum better, it is more active and has enough to keep me busy for hours at any time. I will soon be allowed pm's if not already so find some way to get in contact with me.

Are you degreed, and if so is the field cs? How many years experience do you have? ( coding ) My uplink is weak signal for almost a month and is likely not to be fixed soon because of re-alignments going on in telco and network businesses.

[Ndt]

Nicholas, I worked as Programmer from 98-2002, 2005-2008 and as System Analyst/Production Support from 2003-2005. I have a college 4 years degree (graduated in Canada in 92) in Professional CS (equivalent to University 3 years degree). Back then, 4 years degree in college was devoted to train a Programmer Analyst (which means coding more than analyzing) and 3 years in University produce an Analyst Programmer (do more design and analyst and least programming). I am old school Procedural programming and only OOP since 2005, I am all about VB/VBA/VB scripts with relational DB as Oracle, Access, SQL Server. I started to use Java, ASP/ VB.Net since 2006 but on small projects therefore I considered myself as junior in OOP/.Net thing. I also knew old stuffs such as Cobol, Clipper, Dbase3+ but these old stuffs is not using nowadays anymore.

[Nicholas Jordan]

Okay, I should say noted but that sounds too formalistic and Wow is invitational for distraction side issues but we now have a new member, one fishtoprecords and I can totally assure you he and I will be interested in a PostMortem ( fired, hired or limbo ) as to how a company ( of any size or savy ) can dismiss such a heavily credentialed worker over Threading the Bean.

Many, if not too many, computer security issues derive from the Human Mind. The equipment works, but we have intrusions. I do not want to diverge to the discussion of such, I have an 800 page Addison-Wesley imprint © 2008 and the Lead Author warns in the preface too many have been lost to trying one thing or another on a machine that is not authorized.

If you are Old School and VB, then there likely would be a coding style difference but I would like to describe my project to you:

About two or three kilowatts of computing power and up. An established commercial entity has people 'installing software' from the internet. Rather than go to a straight firewall / blocking approach, the customer for whatever reason elects to use our software to filter and remove any traffic from sites that the System Adminstrator chooses to block or deny. To do this, the system uses Artificial Intelligence to effect the wishes of the Operator / System Administrator.

A highly trained worker in cs gave up on implemeting AI in Java. I don't think so.

Want some?

[fishtoprecords]

Quote:

Originally Posted by Zosden

Three words switch to c++. Java is slow

What utter drivel.

In selected cases, C++ may be faster than Java on a modern JVM. But as a general statement, your claim is demonstrably false.

And the OP is interacting with a database. In at least 99% of the cases, the time to interact with the database overwhelms any claimed inprovement in the language's speed. C++, Java, perl, lua, python, all end up the same when the database is the bottleneck.

Without looking carefully at the OP's code, its hard to say, perhaps there are so many records than the JVM is doing too many GC calls, or the OS is swapping. In either case, more real memory is the easy way to performance, with a couple of appropriate MX values.

[developer321]

I agree with you that C++ may not be faster than Java.
In this case either Database/Network are the bottleneck,how can C++ help in this regard?

[Nicholas Jordan]

Quote:

Originally Posted by developer321

I agree with you that C++ may not be faster than Java.

I dug through the code several times, it appears ( I did not follow up ) that a single Thread retrieves all the entries then writes them. An intermediate FIFO Thread passing to a writer Thread should show improvements over a simple recode in C or CPP.

I bogged trying to implement a FIFO, it does appear that there is a call to several date functions for each data record write. Moving the date / time to a constructor or initializer was an idea I put on my list for discussion with OP.

I have done some simple testing of Threading in Java, a read -> process -> write does show good responsiveness and supports the idea that Java may be time effective for some design needs.