29
Fri, Nov
0 New Articles

Big Data Challenge Demands Big Tape Solution

Storage
Typography
  • Smaller Small Medium Big Bigger
  • Default Helvetica Segoe Georgia Times

IBM introduces tomorrow's tape storage offerings today that are capable of handling a massive 2.7 exabytes using new "shuttle" technology. 

IBM has announced new tape storage and enhanced archiving, deduplication offerings designed to help clients efficiently store and extract intelligence from massive amounts of data. 

The amount of information generated is increasing dramatically each year driven by armies of sensors, mobile devices, social networks, cloud computing, and public sources of information like the Web. At the same time, demand for storage capacity worldwide will continue to grow at a compound annual growth rate of 49.8 percent from 2009-2014, according to IDC (1). Clients are requiring new technologies and ways to capitalize on the growing volume, variety and velocity of information known as "Big Data," according to IBM. 

The company continues to invest in the development of tape storage as an inexpensive, efficient way to store massive volumes of data. For example, IBM is today detailing seven significant improvements to its portfolio of tape and other storage archiving products, including the industry's first tape library system to provide over 2.7 exabytes of automated, low cost storage--enough to store nearly three times all the mobile data generated in the U.S. in 2010 (an exabyte is 1 followed by 18 zeroes) (2). 

IBM System Storage TS3500 Tape Library is enabled by a new, IBM-developed shuttle technology--a mechanical attachment that connects up to 15 tape libraries to create a single, high capacity library complex at a lower cost. The TS3500 offers 80 percent more capacity than a comparable Oracle tape library and is the highest capacity library in the industry, making it ideal for the world's largest data archives (3). 

For example, the National Institute of Water & Atmospheric Research (NIWA) in New Zealand uses two TS3500 Tape Libraries to support a sophisticated POWER supercomputer used to tackle challenges in such fields as energy, aerospace, weather and climate modeling. The libraries together hold five petabytes of data, the equivalent of more than 1,000,000 DVDs. This means that if a DVD were written to the tape libraries at the rate of one every minute, it would take more than two years before their capacity was exhausted. 

IBM in 1952 pioneered the use of magnetic tape for data storage, which is one of the 100 Icons of Progress in IBM's century-long history. IBM is announcing the IBM System Storage TS1140 Tape Drive, which holds two million times more data than IBM's first tape drive (4). The TS1140 employs fewer and more efficient components developed with IBM Research, enabling it to use up to 64 percent less energy and can deliver up to 80 percent more performance than a comparable Oracle drive, so clients can improve productivity at a lower cost (5). 

Tape storage is gaining new opportunities as a low cost, energy efficient way for companies in industries like media and entertainment and healthcare to create huge archives of digital assets and information being driven by Big Data. In fact, the amount of digital archives stored to tape is set to experience a six fold increase from 2010 through 2015, according to Enterprise Strategy Group (6). IBM is well positioned to capitalize on this opportunity as the tape storage market share leader with over 40 percent revenue share--more than twice as much share as the next competitors HP and Oracle, according to IDC (7). 

IBM has announced file system access to select IBM tape libraries with the IBM Linear Tape File System Library Edition (LTFS LE), invented by IBM Research to provide a simple, cost efficient way to access and manage massive archives of data and digital assets. LTFS clients can now more efficiently index, search, retrieve and share data stored on Generation 5 LTO tape, an open tape storage format. 

IBM has a clear edge over storage vendors like EMC that don't support or develop tape. Tape and disk can be used together to deliver clients tiered storage that enables them to store data within the different tiers based on their data priorities. For example, IBM's Scale-out Network Attached Storage (SONAS) system and Information Archive both use policies to automatically migrate data to the tape storage tier. This can reduce total cost of ownership for clients by up to 40 percent in the long-term, according to an internal IBM study (8). 

Klinikverbund Suedwest GmbH is an association of clinics and hospitals in Southwest Germany with 4,200 employees caring for more than 250,000 patients each year. Working with IBM Business Partner Profi AG, the Association installed the IBM XIV storage system with IBM Tivoli Storage Manager to work with its existing IBM System Storage TS3310 Tape Library. "By using both IBM tape and disk technology, the Association has lowered storage costs significantly," said Dr. med. Gunther K. Weiss, M.Sc., managing director, Klinikverbund Suedwest GmbH. "With these different storage tiers at our disposal, we can ensure that our clients and employees have secure, ready access to their data." 

IBM also announced enhancements to SONAS, which scales to over 14 petabytes of clustered storage and is based on technology invented by IBM Research. SONAS now offers double the throughput -- or the amount of data processed by the system during a given period of time -- of its predecessor and faster response times (9). The technology, which will provide support for commonly used anti-virus applications, is designed to offer protection from viruses and malware threats with the ability to scan archived data and isolate or delete compromised files. In addition, SONAS will now support an open standard protocol called NDMP, enabling clients to backup and protect large amounts of data in SONAS using ISV applications that support NDMP. 

IBM is also improving the IBM Information Archive for Email, Files and eDiscovery, a pre-installed, pre-configured archiving solution. With integrated hardware, software and services, the technology can reduce the cost of installing and implementing a storage archive by up to 70 percent compared to starting with piece parts and can be deployed in a few days, according to IBM's internal measurements (10). 

Finally, IBM is announcing new or enhanced tape virtualization offerings for mainframe or open storage environments to provide clients improved access to and protection for their data in the virtualized datacenter. These include: 

  • The addition of a many-to-many replication feature to IBM System Storage TS7650 ProtecTIER Deduplication Solutions that will allow enterprises with multiple data centers to automatically replicate backup data between locations so multiple copies of critical data can be stored and quickly restored if needed. By stripping out duplicate data before it's replicated, ProtecTIER customers have experienced a reduction in bandwidth needed to send the data of up to 95 percent or more, reducing the amount of storage needed to archive and protect data (11); and
  • Enhancements to the TS7700 Virtual Tape Library family include doubling the number of virtual tape cartridges it contains to 2 million and leveraging IBM POWER7 technology to significantly improve performance, delivering 70 percent better performance than a comparable Oracle offering (12).

"As part of its $6 billion annual investment in R&D, IBM continues to develop innovative storage technologies for smarter computing," said Brian Truskowski, general manager, IBM System Storage and Networking. "The data protection and retention solutions IBM is announcing today provide clients with a comprehensive approach to protecting and accessing their most valuable asset--their data." 

For more information on IBM storage, visit http://www-03.ibm.com/systems/storage/. For more information on IBM Smarter Computing, visit:

http://www-03.ibm.com/systems/data/flash/smartercomputing/. Also visit www.storagecommunity.org, a new online storage community launched today and sponsored by IBM. Participants can network with peers, share best practices and dialogue with storage experts.

___________________

1. IDC, Worldwide Enterprise Storage Systems 2010-2014 Forecast Update: Better Expectations on 2010 Growth, No Changes to Long-Term Outlook, Doc # 224618, August 2010.

2. Data traffic on cell phones in the U.S. reached an exabyte in 2010, according to Chetan Sharma Consulting. Comparison assumes 3:1 compressed data. 

3. As compared to the Oracle SL8500 max tape library complex with native T10000c, which offers a max capacity of 500PB. The TS3500 max tape library complex with native TS1140 offers a max capacity of 900PB, when maximizing cartridge capacity. SL8500 source: http://www.oracle.com/us/products/servers-storage/storage/tape-storage/034341.pdf.

4. The TS1140 holds 4,000,000MB. The IBM 726 Magnetic Tape Unit held 2MB.

5. As compared to the Oracle T10k-C. The TS1140 operates at 51W and at 24W standby power. The Oracle T10k-C operates at 67W max power. The TS1140 max throughput is 650MBps. The Oracle T10k-C max throughput is 360MBps. Assumes compressible data.

6. Briefs: NERSC: Proving Tape as Cost-Effective and Reliable Primary Data Storage, Enterprise Strategy Group, December 2010.

7. Total branded tape storage revenue share, IDC Branded Tape Pivot Q4CY10.

8. Based on an internal IBM study.

9. SONAS single interface node doubled the available bandwidth with dual active 10 GbE interface ports, while code optimization improved pathlength efficiency.

10. Based on IBM's internal measurements.

11. ProtecTIER's deduplication reduces storage requirements 20:1 per IBM production client data.

12. The TS7700 delivers up to 900MBps throughput compared to Oracle StorageTek Virtual Storage Manager's 640MBps throughput.

IBM is a leading global hybrid cloud and AI, and business services provider, helping clients in more than 175 countries capitalize on insights from their data, streamline business processes, reduce costs and gain the competitive edge in their industries. Nearly 3,000 government and corporate entities in critical infrastructure areas such as financial services, telecommunications and healthcare rely on IBM's hybrid cloud platform and Red Hat OpenShift to affect their digital transformations quickly, efficiently, and securely. IBM's breakthrough innovations in AI, quantum computing, industry-specific cloud solutions and business services deliver open and flexible options to our clients. All of this is backed by IBM's legendary commitment to trust, transparency, responsibility, inclusivity, and service.

For more information, visit: www.ibm.com.

BLOG COMMENTS POWERED BY DISQUS

LATEST COMMENTS

Support MC Press Online

$

Book Reviews

Resource Center

  • SB Profound WC 5536 Have you been wondering about Node.js? Our free Node.js Webinar Series takes you from total beginner to creating a fully-functional IBM i Node.js business application. You can find Part 1 here. In Part 2 of our free Node.js Webinar Series, Brian May teaches you the different tooling options available for writing code, debugging, and using Git for version control. Brian will briefly discuss the different tools available, and demonstrate his preferred setup for Node development on IBM i or any platform. Attend this webinar to learn:

  • SB Profound WP 5539More than ever, there is a demand for IT to deliver innovation. Your IBM i has been an essential part of your business operations for years. However, your organization may struggle to maintain the current system and implement new projects. The thousands of customers we've worked with and surveyed state that expectations regarding the digital footprint and vision of the company are not aligned with the current IT environment.

  • SB HelpSystems ROBOT Generic IBM announced the E1080 servers using the latest Power10 processor in September 2021. The most powerful processor from IBM to date, Power10 is designed to handle the demands of doing business in today’s high-tech atmosphere, including running cloud applications, supporting big data, and managing AI workloads. But what does Power10 mean for your data center? In this recorded webinar, IBMers Dan Sundt and Dylan Boday join IBM Power Champion Tom Huntington for a discussion on why Power10 technology is the right strategic investment if you run IBM i, AIX, or Linux. In this action-packed hour, Tom will share trends from the IBM i and AIX user communities while Dan and Dylan dive into the tech specs for key hardware, including:

  • Magic MarkTRY the one package that solves all your document design and printing challenges on all your platforms. Produce bar code labels, electronic forms, ad hoc reports, and RFID tags – without programming! MarkMagic is the only document design and print solution that combines report writing, WYSIWYG label and forms design, and conditional printing in one integrated product. Make sure your data survives when catastrophe hits. Request your trial now!  Request Now.

  • SB HelpSystems ROBOT GenericForms of ransomware has been around for over 30 years, and with more and more organizations suffering attacks each year, it continues to endure. What has made ransomware such a durable threat and what is the best way to combat it? In order to prevent ransomware, organizations must first understand how it works.

  • SB HelpSystems ROBOT GenericIT security is a top priority for businesses around the world, but most IBM i pros don’t know where to begin—and most cybersecurity experts don’t know IBM i. In this session, Robin Tatam explores the business impact of lax IBM i security, the top vulnerabilities putting IBM i at risk, and the steps you can take to protect your organization. If you’re looking to avoid unexpected downtime or corrupted data, you don’t want to miss this session.

  • SB HelpSystems ROBOT GenericCan you trust all of your users all of the time? A typical end user receives 16 malicious emails each month, but only 17 percent of these phishing campaigns are reported to IT. Once an attack is underway, most organizations won’t discover the breach until six months later. A staggering amount of damage can occur in that time. Despite these risks, 93 percent of organizations are leaving their IBM i systems vulnerable to cybercrime. In this on-demand webinar, IBM i security experts Robin Tatam and Sandi Moore will reveal:

  • FORTRA Disaster protection is vital to every business. Yet, it often consists of patched together procedures that are prone to error. From automatic backups to data encryption to media management, Robot automates the routine (yet often complex) tasks of iSeries backup and recovery, saving you time and money and making the process safer and more reliable. Automate your backups with the Robot Backup and Recovery Solution. Key features include:

  • FORTRAManaging messages on your IBM i can be more than a full-time job if you have to do it manually. Messages need a response and resources must be monitored—often over multiple systems and across platforms. How can you be sure you won’t miss important system events? Automate your message center with the Robot Message Management Solution. Key features include:

  • FORTRAThe thought of printing, distributing, and storing iSeries reports manually may reduce you to tears. Paper and labor costs associated with report generation can spiral out of control. Mountains of paper threaten to swamp your files. Robot automates report bursting, distribution, bundling, and archiving, and offers secure, selective online report viewing. Manage your reports with the Robot Report Management Solution. Key features include:

  • FORTRAFor over 30 years, Robot has been a leader in systems management for IBM i. With batch job creation and scheduling at its core, the Robot Job Scheduling Solution reduces the opportunity for human error and helps you maintain service levels, automating even the biggest, most complex runbooks. Manage your job schedule with the Robot Job Scheduling Solution. Key features include:

  • LANSA Business users want new applications now. Market and regulatory pressures require faster application updates and delivery into production. Your IBM i developers may be approaching retirement, and you see no sure way to fill their positions with experienced developers. In addition, you may be caught between maintaining your existing applications and the uncertainty of moving to something new.

  • LANSAWhen it comes to creating your business applications, there are hundreds of coding platforms and programming languages to choose from. These options range from very complex traditional programming languages to Low-Code platforms where sometimes no traditional coding experience is needed. Download our whitepaper, The Power of Writing Code in a Low-Code Solution, and:

  • LANSASupply Chain is becoming increasingly complex and unpredictable. From raw materials for manufacturing to food supply chains, the journey from source to production to delivery to consumers is marred with inefficiencies, manual processes, shortages, recalls, counterfeits, and scandals. In this webinar, we discuss how:

  • The MC Resource Centers bring you the widest selection of white papers, trial software, and on-demand webcasts for you to choose from. >> Review the list of White Papers, Trial Software or On-Demand Webcast at the MC Press Resource Center. >> Add the items to yru Cart and complet he checkout process and submit

  • Profound Logic Have you been wondering about Node.js? Our free Node.js Webinar Series takes you from total beginner to creating a fully-functional IBM i Node.js business application.

  • SB Profound WC 5536Join us for this hour-long webcast that will explore:

  • Fortra IT managers hoping to find new IBM i talent are discovering that the pool of experienced RPG programmers and operators or administrators with intimate knowledge of the operating system and the applications that run on it is small. This begs the question: How will you manage the platform that supports such a big part of your business? This guide offers strategies and software suggestions to help you plan IT staffing and resources and smooth the transition after your AS/400 talent retires. Read on to learn: