Mountain View, Calif.'s Reasoning, which charts the degree of flaws in such programming languages as Java, C++ and C, found 31 software defects in 58,944 lines of Apache Web server V 2.1 code.
Using the industry-accepted reliability indicator called defect density, which is the number of defects found per thousand lines of source code, the group found a defect density of the Apache code of 0.53 per thousand lines of source code. Meanwhile, the average defect density of commercial code was 0.51 per thousand lines of source code.
The findings could leave folks to draw their own conclusions, but for those advocates of commercial products, it could poke holes into their oft-floated assertions that software that is sold is of higher quality -- an argument leading vendors have made when trying to discredit open-source operating systems like Linux, or open-source databases such as MySQL.
Bill Payne, President & CEO of Reasoning, said that February study, which concluded that open source had a significantly lower defect density compared to commercial equivalents, led for developers to call for another similar test, albeit one in which the open-source application was less mature.
"We received numerous inquiries about that study and took seriously requests for us to examine defect density rates in a less mature Open Source application and compare it with the commercial equivalent," Payne said. "Taking advantage of our database of automated software code inspection projects, we were able to do exactly that, and found the difference in defect density between the two was not significant."
Reasoning's inspection service is based on a combination of proprietary technology and repeatable process. The company pledges objective results that are comparable across software applications, development methodologies, and coding styles.