Joe McKendrick: Eye on the Enterprise

RedMonk Analyst James Governor, who has had one ear to the IBM space and another to the burgeoning SOA/Enterprise 2.0 space for some time now, recently reflected on the changing role of CICS, once the standard middleware for mainframes. (Around before middleware was even called middleware.)

James wonders whether IBM’s pitch to abstract CICS functions into an SOA-based service layer can alleviate the need for hard-core mainframe programming and administration skills. Under the law of “leaky abstractions,” he says, things go wrong, and there will always be a need to dig underneath the virtual layer and learn to code what’s underneath.

Thus, if the mainframe is to be a player in SOA, companies will need a solid core of mainframe skills — not just SOA skills.

Still, maybe CICS’s time has come again. “Originally it was a customer information control system. I think its time to make CICS a front and center information management platform again, rather than just providing transaction management services. That’s a potential new frame for the frame. And yes - IBM’s moves to offer REST interfaces to CICS is a good move in that direction, as is all the WS-* service enablement.”

“This is the era of extreme integration… We’re not too far away from seeing a million-server data center.” This prediction by Kirk Skaugen, vice president and co-general manager at Intel Corporation, was part of an experts’ panel at the recent Windows 2008 launch, hosted by Al Gillen, vice president at IDC. (Archived video available here — requires Microsoft SilverLight download.)

While the vast majority of enterprises, of course, will not be faced with managing a million servers anytime soon, it’s fair to say that server proliferation and sprawl is now a pervasive problem, compounded by enormous growth in data and storage requirements.

Add to this the impetus to better align with the business, by being more flexible and adaptable to fast-changing processes. Given the prominence of the panel at the Windows 2008 event, this signals that data center efficiency is clearly an emerging positioning strategy for Microsoft - and perhaps a defensive one as well. Other leading vendors, including IBM and Sun, have been promoting this concept for several years, and have gained a lot of traction by blaming Windows-based servers for a lot of the server sprawl and waste that now dots enterprise landscapes.

Skaugen made the direct shot over the bows of the big server companies by pointing out that while distributed systems and storage put their share of strain on data center environments, large centralized systems are not above blame, either. “Intel and AMD today have 94 percent of the units of servers, but six percent of what is still RISC and mainframe computing make up almost 50 percent of the IT spend on hardware spend,” he said.

Regardless of platform environment, panelists agreed that the emphasis of data center value is rapidly evolving from “watts and slots” to achieving higher efficiency and better business delivery. The bottom line is that data center infrastructures need to deliver more for the business, while reducing their own footprints. “If you look at the emergence of these huge data centers, the new metric is going to be performance per watt per cubic foot - how much computational ability can you put into a volume space,” said Randy Allen, corporate vice president of AMD’s Server and Workstation Division.

James Mouton, vice president of the platform division within the HP Industry Standard Server business unit, suggested that executives and managers view data center metrics over at least a three-year time horizon. “You’ve got to look at that cost at least over a three-year period, including the power and cooling prices,” he said. “The manageability of the infrastructure overall is key. Unless you can see what’s going on, and map that to the application service level, you’re missing the forward-looking thinking. You have to make sure you’re looking at that very holistically, including business outcomes. It may or may not be a server uptime question — more likely, it’s a question of, ‘are your apps doing what they’re expected to do? Are your IT costs going down, as well as your overall three-year horizon of overall costs?‘”

Panelists also agreed that virtualization was clearly the best strategy for managing the complexity of server sprawl. Allen noted that the ability to pack greater processing power into smaller, more efficient spaces is a natural opportunity for virtualizing resources. “Virtualization flows right into that, offering simplicity in terms of managing all the complexity,” he said.

As enterprises demand more and more computing power, the challenge is more efficiently managing large-scale resources, and virtualization is one key element of such an approach. The challenges not only include improving the efficiency of data centers, but also reigning in energy consumption while correcting the underutilization of servers. As Skaugen put it, “The challenge that everyone’s facing today is that servers are only used 10 to 15 percent of their utilization in a standard data center, which is appalling.”

Rick Becker, vice president of software and solutions for Dell, added an additional element that should be considered alongside virtualization - intelligent network storage. “Intelligent storage is the next piece of the puzzle,” he said. “The only thing growing faster than server proliferation is data proliferation. As we go digital, we have to get intelligent about how we manage and grow storage. You also get more benefit out of a virtual environment when in fact the workloads are on a shared resource.”

Enterprises need to view their data center costs and benefits more holistically in terms of the business, panelists agreed. “In the old days, the question was on the entry price of the gear, and sometimes, enterprises would miss the whole, ‘once I deploy it, how do I deploy it, how do I maintain it what type of staff do I need, what type of training do they need to have?‘” said James Mouton, vice president of the platform division within the HP Industry Standard Server business unit.

Ultimately, the data center needs to view itself as a business, and not as a technology shop - a view echoed by another panelist, Ajei Gopal, senior vice president and general manager of the Enterprise Systems Management business unit at CA. Gopal said there’s an evolution underway, from “IT as a cost center to IT as a driver of the business.” Data centers need to think of themselves more as service centers, he added. As part of this initiative, Gopal advices data center executives and managers to embrace best practices such as ITIL [Information Technology Infrastructure Library].

Ultimately, through strategies such as adopting best practices and virtualization, many companies may be able to forego the need to dramatically expand or build new data centers to alleviate the crush of data and applications. “We have the ability to find the hidden data centers we have in our data centers,” said Becker.

Microsoft, when it’s not tweaking operating systems, releasing security patches, or dissing open source, has another project it’s bringing to the fore: it’s first data center in a box. (Uh, sorry, I meant “containerized datacenter facility.”)

The idea is that these data centers, literally housed in portable shipping containers, can be trucked and parked at a corporate site, and quickly be up and running.

As relayed by Mary Jo Foley in her leatest Microsoft Watch blog post, Microsoft, on April 1st (no fooling!) announced publicly its plans to build a completely containerized production data center. The facility will be in Microsoft’s Northlake, Illinois facility.

Microsoft’s James Hamiltion provided some additional details about the facility in a blog post: The facility “is a two-floor design where the first floor is a containerized design housing 150 to 220 40’ containers each 1,000 to 1,000 servers. Chicago is large facility with the low end of the ranges Mike (Manos who leads the Microsoft Global Foundations Data Center team) quoted yielding 150k serves and the high end running to 440k servers. If you assume 200W/server, the critical load would run between 30MW and 88MW for the half of the data center that is containerized. If you assume a PUE of 1.5, we can estimate the containerized portion of the data center at between 45MW and 132MW total load. It’s a substantial facility.”

Hamilton has been Microsoft’s thought leader on the data center in a box proposition. I posted some details about his vision last year. As Hamilton put it, a standard 20×8×8-foot ship­ping container is “ideal” for this purpose, since not only is it is rugged and built to withstand ocean voyages, but also “relatively inexpensive and environmentally robust.” Upon delivery to a site, a data center container could simply be attached to the network, chilled water, and powered up. Each container can be fully equipped with networking gear, compute nodes, and persistent storage.”

Other vendors getting into the data center in a box garme include IBM, Dell, Sun and Verari.

HP has just announced it is delivering a range of virtualization and cloud-computing capabilities it brands as “Next Generation DataCenter (NGDC).” The crux of the announcement is that capacity will be organized into a more abstract service layer, whether it comes from within the enterprise itself, or from HP’s latest on-demand offerings.

This is a vision, actually, that has been talked about for years by the large infrastructure vendors. I remember 10 years ago when Sun’s irrepressible Scott McNealy talked about delivering compute capacity via a “Big Freakin’ Webtone Switch.” Around the same time, IBM began talking about building server farms that will deliver capacity on demand to customers from remote locations.

HP’s “Adaptive Infrastructure as a Service” (AIaaS — now there’s a mouthful) is particularly interesting, since its a data center offered through the cloud from HP. HP AIaaS offers customers access to HP-owned and managed data centers that deliver applocations such as Exchange and SAP. HP did not mention others, though it did leave the door open to “other critical business applications.”

HP also is offering a range of virtualization capabilities which it calls HP Data Center Virtualization services, along with virtualization software, which supports all kinds of virtualization across servers, storage, networks and applications.

The move to cloud-based data centers continues, and thanks to high bandwidth networks, is technically feasible. Today’s economics is also helping to fuel this decade-old dream: the costs of building and maintaining data centers that can keep growing with demands for more data and digitalization of processes are going through the roof. Energy is one cost drain, but simply being able to find, train, and retain staff talent required to keep things going is a huge budget item. Tapping into data centers in the cloud offers a more incrementally priced alternative.

We just wrapped a survey of members of the Oracle Applications Users Group — which includes IT directors, CIOs, IT operations managers, and developers — on the extent to which they’re able to employ automated processes to manage multi-application workloads. In other words, are there processes in place in handle the management and movement of data across Oracle, PeopleSoft, and anything else that helps keep the enterprise running?

The survey of 344 companies, sponsored by UC4, found there’s still a lot of work to be done in this area. More than 75 percent of organizations surveyed are having difficulties managing and monitoring workload.

Over two thirds of survey respondents reported delays in business processing that could be directly attributed to the inefficiencies and errors that are introduced when manual intervention is required to drive processes that span multiple applications. Automation is helping address some IT process management issues, but adoption is slow. Three out of four operations still either rely on manual scripting, or simply don’t know what approaches they should take.

The need to automate IT processes is pressing. Not only are data center infrastructures becoming more complex; the challenge of managing workload that spans multiple business applications, such as Oracle EBS, PeopleSoft and SAP, adds to this complexity. The survey shows that organizations recognize the overall value and benefit that can be derived from end-to-end process management and visibility. Unfortunately, budget constraints combined with some companies’ inability to adopt standardized IT procedures is holding back more widespread deployment of IT automation solutions.

Most organizations turn to IT process automation to reduce the amount of staff time consumed by routine or manual tasks. However, in many cases, there is little room in corporate budgets for extensive business process management (BPM) solutions that provide automated modeling, management, and monitoring capabilities. One third of those surveyed are considering strategies based on Oracle Fusion, BPEL and Application Integration Architecture (AIA). However, at this stage most are undecided or unclear about the viability of these technologies as workload automation platforms.

Copies of the full survey are available here (registration required) at UC4’s Web site.

Just when you think the operating system space is about as saturated as it could get — and all the action has moved to the middleware and applications layers of the stack — there’s a new OS added to the mix.

Unlike most OSes, however, the new OS, called Cosmos, doesn’t run on the bare metal of machines. Rather, it’s a virtualized OS that runs within the .NET container, intended to support .NET-based languages (particularly C#) that are also resident on the .NET container. Cosmos stands for “C# Open Source Managed Operating System.”

The OS is also open source, issued under the BSD license.

Why develop Cosmos? Actually, Microsoft also has a .NET-based OS called Singularity that also runs within this environment. The reason stated in the Cosmos FAQ section is that:

“Primarily because it’s fun. But beyond that, how else can you boot .NET on a floppy or small USB stick? Who else will try to put .NET on the Wii, OLPC, and iPhone? We are also developing a TCP/IP stack. Imagine instead of deploying half a dozen virtualized OS’s, deploying many dozens of dedicated OS’s. One that only does DNS, a few that only do HTTP, etc. One instance, one function.”

Welcome to the party, Cosmos. Mary Jo Foley, who first uncovered this announcement, also spoke with Chad “Kudzu” Hower, a former Microsoft employee, who admitted the OS has a “super geeky” flavor to it, and even has garned independent interest from Microsoft staffers.

It’s no secret that Cisco Systems sees data center management in it’s future, beyond simply being a hub-router-switch vendor. Cisco’s strategy for the past few years has to promote the idea of moving intelligence off the server and out onto the network.

For example, Cisco has been promoting its Service Oriented Network Architecture (that’s SONA, not SOA), intended to abstract network functions — such as switching, security and storage — to a more manageable and uniform service layer.

Now, the vendor has unveiled what analysts see as a bold move to take control of the data center once and for all. Cisco announced a family of data center-class switching platforms , the Cisco Nexus Series, designed, the vendor says, for “next-generation mission-critical data centers.”

At the heart of the announcement is the Cisco Nexus 7000 super-switch, which combines Ethernet, IP, and storage capabilities across one unified network fabric. This monster supports 15 terabits per second of switching capacity in its chassis, with room for 512 10-Gbps Ethernet, and the capability of upgrading to 40 and 100 Gbps.

As one analyst explained: “Most data centers have a separate network for high-performance clusters and a network for storage. Cisco is saying you don’t need all these different network silos. You can have one network to support everything.”

Maybe Sun was right all those years ago — the network is the computer.

Last May, I posted details on a novel approach to data center flexibility — offering data centers-in-a-box, in the form of fully loaded and equipped portable trailers that could be pulled right up into corporate parking lots and plugged in. IBM, Sun, and even Microsoft were talking up such mobile approaches.

Kind of a neat idea, but I wondered at that point if in this age of emerging software-as-a-service, on-demand, and in-the-cloud com­puting approaches, were such bolt-on facilities really needed?

Plus, another trend working against trailer DCs is the increasing compute power constantly being packed into smaller and denser chips, as well as geometrically growing stor­age capacity that shows no signs of abating. It’s not inconceivable that all the func­tions of an average data center could eventually be packed into a box the size of a desktop computer. IBM’s System z was proof in point — these powerful boxes have relatively small footprints compared to mainframes of old.

Well, Sun Microsystems, which has been making a big deal out of its Project Blackbox, reports that it has signed on about four or five customers. These include the Stanford Linear Accelerator Center (SLAC), Hansen Transmissions, Radboud University Nijmegen Medical Centre (UMCN) and Mobile TeleSystems OJSC (MTS).

You could look at the announcement in terms of the glass being half full or half empty (or better yet, one percent full, 99% empty.)

One industry commentary puts it in the 99% empty perspective, pointing out that in the 15 months Sun has been pushing this trailer approach, it has only signed on four or five customers. That doesn’t seem like an exciting value proposition for vendors contemplating this space, or for companies that want to see how the approach working out in reality.

For end user IT managers, perhaps, as one commenter to the report pointed out, “the real answer is to update your existing datacenter vs. branching out to the parking lot.”

Brian Cinque, data center architect for Sun Microsystems, intends to put himself out of a job. By 2013, he said in a recent blog post, Sun intends to consolidate 50 percent of its data center footprint, and end up with no data centers within the two years that follow.

Along with SaaS, Sun will employ server virtualization, storage consolidation, and application consolidation strategies. Here’s how Cinque says they will accomplish this:

• Server Virtualization – “Xen/xVM, Solaris Zones/LDOMS”
• Storage Consolidation – “Tiered storage, NAS, etc.”
• Application Consolidation – “For SunIT its called IBIS”
• WAN acceleration – “Another interesting technology in which its roots have been around for a while.:
• SaaS - “SaaS plays a huge role. SaaS and mashups are an interesting discussion.”

Sun always has had a flair for the dramatic in its pronouncements, but it will be interesting to see how close it gets to this goal, and what kind of “gotchas” it hits along the way.

Two giant enterprise vendors announced they are absorbing major players in the SOA middleware and database worlds. Does this mean more consolidation is on the way? Not necessarily.

On Wednesday, BEA finally accepted a generous bid from Oracle Corporation, at $8.5 billion, far more generous than the measly $6.7 billion offered last fall. In a much smaller deal (only $1 billion), Sun Microsystems announced it is acquiring the largest open source database company on the market, MySQL.

Oracle appears to be evolving into a large assemblage of application and middleware offerings underpinned by a database; while Sun appears to be evolving into a large assemblage of open-source communities underpinned by hardware.

From the Oracle-BEA perspective, it’s now likely that BEA will likely sooner or later be absorbed into Oracle “Fusion” of enterprise software companies. BEA is a big player in the SOA and app server space, so this is not a trivial acqusition for Oracle, which also seeks to dominate this sector. In fact, for Oracle, the ability to dominate SOA middleware is essential to the long-term future of the company. Both Oracle’s bread-and-butter products — its database and ERP suite — could be usurped by functionality moved up into the middleware layer. Companies are alreday finding ways to do end-runs around upgrading these expensive solutions with their own standardized services and interfaces.

Sun appears to be increasingly betting its business on the open source world, with a revenue emphasis on service and servers versus actual software sales. Sun’s two software jewels — its Solaris operating system and Java programming language — have been open sourced. Sun also supports open-source middleware in the form of the Glassfish application server. Add to that the OpenOffice.org offering for desktop productivity systems.

Call it the “JASMO” stack — Java/Apache/Solaris/MySQL/OpenOffice.

From a MySQL customer perspective, the deal puts a large and deep-pocketed support structure behind the open source database. Surveys and interviews we have done here for Unisphere Research and Database Trends & Applications have consistently found a lingering perception open source databases don’t have the support structure that an Oracle or DB2 have behind them — a key crtieria for entreprise customers.