How the Cloud is Abstracting Complex Systems Details, with Detrimental Effects

skill at computing comes naturally to those who are adept at abstraction. the best developers can instantly change focus - one moment they are orchestrating high level connections between abstract entities; the next they are sweating through the side effects of each individual line of code. abstraction in computing not only provides necessary containment, but also offers clear boundaries.

there is also something very liberating about that line you don’t need to cross. when i write java code i’m happy to never think about byte code (unless something is going terribly wrong). and when i did board-level digital design, i could stop at the chip and not think much about individual gates or even transistors. it is undeniably important to understand the entire stack; but nothing would ever get done without sustained focus applied to a narrow segment.

cloud is the latest in a long line of valuable abstractions that extend the computing stack. it pushes down complex details of systems and their management under a view that promotes self-service and elastic computing. in this way, cloud is as liberating for developers as objects were over assembler.

the physical location of resources is one of the first and most important casualties of such a model. cloud means you should never have to worry about the day a power failure hits the data center. of course the truth is that as you move down the stack from cloud to system through transistor to electron, physical location matters a lot. so any cloud is only as good as its ability to accommodate any failure of the real systems that underpin the resource abstraction.

layer 7 has recently become involved in an interesting project that will showcase how cloud providers (public or private) can manage cloud workloads in the face of threats to their underlying infrastructure. the inspiration for this project is the following display from esri, one of the world’s leading gis vendors:

esri developed this display to illustrate wireless outages as a storm rips through central florida. but suppose now that instead of a wireless base station, each green diamond represents a data center that contributes its hardware resources to a cloud. as the storm moves through the state, it may affect power, communications, and even physical premises. work loads in the cloud, which ultimately could map to hardware hosted inside at-risk sites, must be shifted transparently to locations that are at less of a risk of a catastrophic failure.

today, few clouds offer the mass physical dispersion of compute hardware suggested by this display. amazon web services, for instance, has the concept of an availability zone, which consists of several massive data centers interconnected within a region (such as us-east, which is in the dulles area, or eu, which is hosted in ireland). their cloud is designed to leverage this regional redundancy to provide continuous service in the event of a site failure.

this big data center approach makes perfect sense for a service like amazon. there will always be a place for the large data center that leverages commodity hardware deployed on a breathtaking scale. but there is an alternative that i think is set to become increasingly important. this is the cloud composed of many smaller compute facilities. we will increasingly see large clouds coalesce out of multiple small independent hardware sites—more seti@home than supercomputer. this is where our initiative provides real value.

these highly mobile, micro-clouds make particular sense in the defense sector. here, compute resources can be highly mobile, and face threats more diverse and much less predictable than hurricanes. this is an arena in which the physical shape of the cloud may be in continuous change.

this project is being done as a catalyst within the tm forum, and we will show it at the tm forum management world 2012 show in dublin this may. catalysts are projects that showcase new technology for executives in the telecommunications and defense industries. this catalyst is sponsored by telstra , and brings together a number of important contributors, including:

• layer 7 technologies
• ca
• csc
• thales
• esri
• ventraq
• oss invent
• tno

source: http://scottmorrison.sys-con.com/node/2170951