04
Mon, Nov
5 New Articles

IBM Challenges Competitors in New Benchmark

Analysis of News Events
Typography
  • Smaller Small Medium Big Bigger
  • Default Helvetica Segoe Georgia Times

Two weeks ago, IBM revealed information about how its eServer i5 performs against Windows and Linux servers on an industry benchmark. That benchmark says a lot about the claims that Big Blue can rightfully make about the i5. On closer inspection, it also reveals some claims that the company cannot make...at least, not yet.

The benchmark to which I am referring is the two-tier Sales and Distribution (SD) test from SAP. As its name implies, the SAP SD benchmark tests the ability of a server to process SAP transactions that include the opening of customer orders, the creation of invoices, and changes to existing customer orders. On the benchmark, the i5 demonstrated that it can outperform other servers in its class.

Sizing Up the Competition

For the benchmark, IBM pitted its two-way eServer i5 Model 520-0905 against several two-way servers from Hewlett-Packard, Sun Microsystems, and Dell. Most of these servers were running Windows Server 2003 on Intel's 32-bit Xeon DP processors, though the Sun server was running SuSE's Linux Enterprise 8 on AMD's 64-bit Opteron processors.

As the following table shows, the i5 Model 520 outperformed two-way servers from all three of IBM's top competitors. In the case of Dell's PowerEdge 2650, the performance difference was considerable.

 

SAP SD Benchmarks--eServer i5 and Competitive Servers
Model
Processors
Cache Size
Memory
Operating System
Database
SAP SD Benchmark Users Supported
IBM eServer i5 520-0905
POWER5
2-way
1.65 GHz
1.9 MB L2
36 MB L3
8 GB
I5/OS V5R3
DB2 UDB
433
Sun Fire V20z
AMD Opteron
2-way
2.2 GHz
1 MB L2
16 GB
SuSE Linux Enterprise
Server 8
Oracle 9i
410
HP Proliant BL20p G2
Intel Xeon DP
2-way
3.2 GHz
512 KB L2
2 MB L3
8 GB
Windows Server 2003 Enterprise Edition
SQL Server 2000
408
Dell PowerEdge 2650
Intel Xeon DP
2-way
3.06 GHz
512 KB L2
1 MB L3
4 GB
Windows Server 2003 Enterprise Edition
SQL Server 2000
290

As the table demonstrates, the two-way i5 has a performance edge over Intel's fastest 32-bit chips running at almost twice the clock speed of the i5's POWER5 processors. It also outperforms the two-way, 64-bit Opteron server from Sun. These results are not that surprising for several reasons. First, each POWER5 processor has two CPU cores instead of the single cores of the Intel and AMD processors, giving it twice the number of computing engines. The POWER5 processor also has a huge L3 cache that lets it keep data close to those engines. While both the POWER5 and Xeon DP processors have multithreading capabilities (each processor can manage two threads simultaneously), IBM's chip has the edge with its 64-bit bandwidth. Indeed, given these strengths, it is somewhat surprising that the i5 did not outperform these servers by a wider margin. This may reflect Big Blue's relative lack of experience in tuning POWER5 servers for various workloads. Over time, the company will probably do a better job of optimizing the i5 for public benchmarks.

While the SAP SD benchmark attests to the performance of the i5, it says nothing about the price/performance of the server. However, anyone who understands how to configure these servers can get a general idea of where the i5 stands on that metric. For instance, the minimum configuration of the i5 520-0905 Standard Edition has a list price of $104,000. When you add the memory and disk storage needed to create the configuration that IBM used for the SAP SD benchmark, the list price rises to slightly more than $160,000. This means that the two-way i5 Model 520 probably costs around $370 per SAP SD benchmark user.

By contrast, the cost per SD user is much lower for the Intel and AMD servers. For instance, you can buy the HP BL20p G2--a blade server--as it was configured for its SAP SD tests for just over $20,000. That price includes an enclosure unit for the BL20p that can support seven additional blades. Throw in a Windows Server 2003 Enterprise Edition license for around $4,000 and a two-processor license to SQL Server 2000 for $40,000, and your total cost is around $64,000. Since the HP BL20p G2 supports 408 SD users, its cost per SD user is around $157. The other Intel and AMD servers have similar per SD user costs.

While the i5 Model 520's competitors may cost less per SD user on paper, it is not clear that they would cost less in actual data centers. In the SD benchmark tests, all of the servers achieved their recorded user levels by running at more than 95% CPU utilization rates. Would any of us run a Windows or Linux server at such a utilization rate, particularly on a mission-critical workload such as an SAP system? Of course not. We probably would not run an i5 at such rates either, but most of us would feel comfortable running SAP on an i5 or iSeries at much higher utilization rates than on a Windows or Linux server. That is largely because the i5 and iSeries have the necessary workload and systems management tools to support higher utilization rates at acceptable reliability levels.

As a consequence, the effective cost per SD of the i5 is probably much closer to that of Windows and Intel servers than the theoretical cost per SD. Unfortunately, the industry's benchmark tests fail to make this clear. Given this fact, it would greatly benefit IBM if it were to educate decision-makers about how to compare benchmarks that pit the iSeries and i5 against Windows and Linux servers. Such education could make the i5 more of a contender in competitive bidding environments.

IBM could also benefit from educating customers about the i5's superior ability to run multiple applications at high CPU utilization levels. While Windows and Linux servers may have superior price/performance to the i5 when running single workloads, they still cannot manage multiple workloads with the same agility. As a result, their price/performance curves plunge as workloads are added. Because of this, I would encourage IBM to give its Three-in-One Benchmark--or a similar multi-workload benchmark--to a standards body to administer, and then challenge Windows and Linux server vendors to beat the i5's price/performance on the test. Such a move could help the IT market understand how much of a value the eServer i5 really is.

Lee Kroon is a Senior Industry Analyst for Andrews Consulting Group, a firm that helps mid-sized companies manage business transformation through technology. You can reach him at This email address is being protected from spambots. You need JavaScript enabled to view it..

LEE KROON
Lee Kroon is a Senior Industry Analyst for Andrews Consulting Group, a firm that helps mid-sized companies manage business transformation through technology.
BLOG COMMENTS POWERED BY DISQUS

LATEST COMMENTS

Support MC Press Online

$

Book Reviews

Resource Center

  • SB Profound WC 5536 Have you been wondering about Node.js? Our free Node.js Webinar Series takes you from total beginner to creating a fully-functional IBM i Node.js business application. You can find Part 1 here. In Part 2 of our free Node.js Webinar Series, Brian May teaches you the different tooling options available for writing code, debugging, and using Git for version control. Brian will briefly discuss the different tools available, and demonstrate his preferred setup for Node development on IBM i or any platform. Attend this webinar to learn:

  • SB Profound WP 5539More than ever, there is a demand for IT to deliver innovation. Your IBM i has been an essential part of your business operations for years. However, your organization may struggle to maintain the current system and implement new projects. The thousands of customers we've worked with and surveyed state that expectations regarding the digital footprint and vision of the company are not aligned with the current IT environment.

  • SB HelpSystems ROBOT Generic IBM announced the E1080 servers using the latest Power10 processor in September 2021. The most powerful processor from IBM to date, Power10 is designed to handle the demands of doing business in today’s high-tech atmosphere, including running cloud applications, supporting big data, and managing AI workloads. But what does Power10 mean for your data center? In this recorded webinar, IBMers Dan Sundt and Dylan Boday join IBM Power Champion Tom Huntington for a discussion on why Power10 technology is the right strategic investment if you run IBM i, AIX, or Linux. In this action-packed hour, Tom will share trends from the IBM i and AIX user communities while Dan and Dylan dive into the tech specs for key hardware, including:

  • Magic MarkTRY the one package that solves all your document design and printing challenges on all your platforms. Produce bar code labels, electronic forms, ad hoc reports, and RFID tags – without programming! MarkMagic is the only document design and print solution that combines report writing, WYSIWYG label and forms design, and conditional printing in one integrated product. Make sure your data survives when catastrophe hits. Request your trial now!  Request Now.

  • SB HelpSystems ROBOT GenericForms of ransomware has been around for over 30 years, and with more and more organizations suffering attacks each year, it continues to endure. What has made ransomware such a durable threat and what is the best way to combat it? In order to prevent ransomware, organizations must first understand how it works.

  • SB HelpSystems ROBOT GenericIT security is a top priority for businesses around the world, but most IBM i pros don’t know where to begin—and most cybersecurity experts don’t know IBM i. In this session, Robin Tatam explores the business impact of lax IBM i security, the top vulnerabilities putting IBM i at risk, and the steps you can take to protect your organization. If you’re looking to avoid unexpected downtime or corrupted data, you don’t want to miss this session.

  • SB HelpSystems ROBOT GenericCan you trust all of your users all of the time? A typical end user receives 16 malicious emails each month, but only 17 percent of these phishing campaigns are reported to IT. Once an attack is underway, most organizations won’t discover the breach until six months later. A staggering amount of damage can occur in that time. Despite these risks, 93 percent of organizations are leaving their IBM i systems vulnerable to cybercrime. In this on-demand webinar, IBM i security experts Robin Tatam and Sandi Moore will reveal:

  • FORTRA Disaster protection is vital to every business. Yet, it often consists of patched together procedures that are prone to error. From automatic backups to data encryption to media management, Robot automates the routine (yet often complex) tasks of iSeries backup and recovery, saving you time and money and making the process safer and more reliable. Automate your backups with the Robot Backup and Recovery Solution. Key features include:

  • FORTRAManaging messages on your IBM i can be more than a full-time job if you have to do it manually. Messages need a response and resources must be monitored—often over multiple systems and across platforms. How can you be sure you won’t miss important system events? Automate your message center with the Robot Message Management Solution. Key features include:

  • FORTRAThe thought of printing, distributing, and storing iSeries reports manually may reduce you to tears. Paper and labor costs associated with report generation can spiral out of control. Mountains of paper threaten to swamp your files. Robot automates report bursting, distribution, bundling, and archiving, and offers secure, selective online report viewing. Manage your reports with the Robot Report Management Solution. Key features include:

  • FORTRAFor over 30 years, Robot has been a leader in systems management for IBM i. With batch job creation and scheduling at its core, the Robot Job Scheduling Solution reduces the opportunity for human error and helps you maintain service levels, automating even the biggest, most complex runbooks. Manage your job schedule with the Robot Job Scheduling Solution. Key features include:

  • LANSA Business users want new applications now. Market and regulatory pressures require faster application updates and delivery into production. Your IBM i developers may be approaching retirement, and you see no sure way to fill their positions with experienced developers. In addition, you may be caught between maintaining your existing applications and the uncertainty of moving to something new.

  • LANSAWhen it comes to creating your business applications, there are hundreds of coding platforms and programming languages to choose from. These options range from very complex traditional programming languages to Low-Code platforms where sometimes no traditional coding experience is needed. Download our whitepaper, The Power of Writing Code in a Low-Code Solution, and:

  • LANSASupply Chain is becoming increasingly complex and unpredictable. From raw materials for manufacturing to food supply chains, the journey from source to production to delivery to consumers is marred with inefficiencies, manual processes, shortages, recalls, counterfeits, and scandals. In this webinar, we discuss how:

  • The MC Resource Centers bring you the widest selection of white papers, trial software, and on-demand webcasts for you to choose from. >> Review the list of White Papers, Trial Software or On-Demand Webcast at the MC Press Resource Center. >> Add the items to yru Cart and complet he checkout process and submit

  • Profound Logic Have you been wondering about Node.js? Our free Node.js Webinar Series takes you from total beginner to creating a fully-functional IBM i Node.js business application.

  • SB Profound WC 5536Join us for this hour-long webcast that will explore:

  • Fortra IT managers hoping to find new IBM i talent are discovering that the pool of experienced RPG programmers and operators or administrators with intimate knowledge of the operating system and the applications that run on it is small. This begs the question: How will you manage the platform that supports such a big part of your business? This guide offers strategies and software suggestions to help you plan IT staffing and resources and smooth the transition after your AS/400 talent retires. Read on to learn: