Showing posts with label cloud. Show all posts
Showing posts with label cloud. Show all posts

Friday, November 27, 2020

When the cloud goes dark: Amazon’s Cloud Servers goes down and people complaint they can't use their doorbell or Vacuums

Amazon Web Services (AWS), Amazon’s cloud service is the backbone of many websites and apps across the globe. And when it encountered a multi-hour outage this week, it sent the digirati and media buzzing. 

The multi-hour outage on Wednesday before Thanksgiving impacted many popular services like Adobe Cloud Software, 1Password, Flickr  that tweeted about AWS outage impacting their services - - 1Password, Acorns, Adobe_Spark, Anchor, Autodesk, Capital_Gazette, Coinbase, DataCamp, Getaround, Glassdoor, Flickr, iRobot, The Philadelphia Inquirer, Pocket, RadioLab, Roku, RSS Podcasting, Tampa Bay Times, Vonage.



AWS' brief outage highlights the risk of IOT dependent services

Internet of Things (IOT) describes the network of physical objects - "things" - that are embedded with sensors, software, and other technologies for the purpose of connecting and exchanging data with other devices and systems over the Internet. Many of our modern devices, gadgets and Smart Homes are IOT enabled by sensors and software and are dependent on access to the internet. 

An outage like this can disrupt the functioning of IOT and internet dependent devices and services. Not surprisingly, consumer tweets didn't mince words, highlight the sign of our times and how dependent we are on uninterrupted internet services:  


Comments on social media sites like Reddit were equally pithy

yoloman0805 posted "The future is here. Can't wait for smart toilet paper dispenser which connects to to the internet." and  CaptainFunktastic added "Our houses could be filled to the brim with all kinds of stupid things wired and connected in such a way that they do everything we think a chip in our brain could do, but somehow having vaccine crosses the line." 

Butwinsky posted

Public: The government wants to put chips in our brains!
Amazon: oh no! Anyways, here's our new Alexa enabled literally everything
Public: Shut up and take my money!






As of 4:18AM ET on Thursday morning (26th Nov) , Amazon announced that the service has been restored. AWS Service Health Dashboard posted an update: 

“We have restored all traffic to Kinesis Data Streams via all endpoints and it is now operating normally. We have also resolved the error rates invoking CloudWatch APIs. We continue to work towards full recovery for IoT SiteWise and details of the service status is below. All other services are operating normally. We have identified the root cause of the Kinesis Data Streams event, and have completed immediate actions to prevent recurrence.” 

Tuesday, July 11, 2017

What's the biggest blocker for legacy large companies IT to switch to cloud technologies?

Here is a recent question in an online forum. My response follows.

A few years ago, a new CIO took over our organization, a multinational supply-chain company and had a clear cloud-first mandate. The team was able to get the stakeholders aligned on a cloud (SaaS, PaaS, IaaS) based portfolio strategy.
I led an extensive assessment of the application portfolio, reviewing the different dimensions of individual platforms and capabilities.
  1. Some applications were clearly SaaS candidates since the vendor offerings had matured
  2. A few were good candidates for PaaS, especially where the organization had the capability to manage the service
  3. Due to network, latency, data volume, legal and other constraints, some applications would have to remain in IaaS (Private, Virtual Private Cloud)
  4. Some legacy applications had clearly not been designed to be virtualized and would not benefit from a move to the cloud (even to IaaS). These were running on old/proprietary hardware infrastructure and would have to be redesigned (and not just ‘migrated’)
If we set aside politics, turf wars, legal and privacy constraints, one will still encounter genuine technical constraints (#4 above) that prevent an application move to the cloud.

One might argue that even those applications can be ‘migrated’ to a cloud with some refactoring. However, the cost of such migration may not justify the benefit. Doing so merely to satisfy CxOs ego to say ‘we are entirely on the cloud’ is bound to be counterproductive. 

Sunday, November 16, 2014

Amazon's re:invent - A cloud roadmap for the Enterprise

I was at the AWS re:invent this week in sunny Las Vegas. It was an opportunity to observe and learn from experiences of other large enterprises starting on their cloud journey. A few observations that I plan to share with fellow Enterprise Architects and IS executives.

Putting together a show for a large gathering of nearly 13500+ participants is by itself a testament to the seriousness of the cloud strategy. As expected, the Amazon team put together an A-game to demonstrate their cloud roadmaps, but what was more impressive was the large contingent of product vendors and System Integrator partners joining to showcase their capabilities.

The keynote sessions were designed to drive home the point that "The cloud is the new normal," and that AWS is a significant player here. Large customers – Coke America, MLB Advanced Media, Condé Nast were out there to highlight their seriousness in the cloud journey.
Some of the deep-dive sessions highlighted the following
  • Amazon’s AWS is a large, serious public cloud platform that can enable Virtual private clouds (VPC) for enterprises looking to minimize/eliminate their hosted data center footprint.
  • Vendor ecosystem is maturing and working hard to keep up with updates on AWS offerings.
    • For instance many SI partners have ‘cloud service management’ portals and frameworks to address configuration and license key management and service catalogs – services that AWS also announced at re:invent.
  • Prepare adequately while planning a larger scale migration of a portfolio of applications.
    • Lift-and-shift may be a misnomer – legacy applications will have to be lifted-considerably-refactored before ‘shifted’ to the cloud.
  • Virtual private cloud (VPC) holds promise for enterprises looking to “shut” or minimize IS application footprint in their data centers.
    • Configuration, setup and ongoing maintenance of VPC from one’s data center is a complex and highly technical endeavor.
  • Large enterprises may not have the luxury of learning on the job.
    • Design and integrating a VPC with one’s hosted data center is not a walk in the park.
    • Rather than DIY panning to the cloud, selecting the right SI partner is a key to enable the cloud journey.
Also unsaid in the sessions
  • AWS is not the only game in town: the other software giant from Seattle has a serious proposition too.
    • As of 2014, Most large enterprises are ‘wetting their toes in the cloud’ and few are willing or able to bet the farm on a single vendor’s cloud
  • CIO’s Organizations aspire to “shut their datacenters” and move to the cloud
    • Many case studies highlighted the aspiration but only the new-startup’s highlighted operations without traditional data centers. Perhaps the reality of legacy weighs too heavily?
  • Large enterprises may opt for hybrid model
    • The future for large enterprises may well be an ecosystem of VPC’s on AWS and other cloud providers, in addition to their on-premise data centers for critical workloads
  • Architects and engineers at large enterprises need to prepare for the alphabet soup.
    • In addition to existing products, AWS announced a slew of new technologies at the conference - EC2 container, AWS Lambda, Aurora DB, Code deploy, Key management, Config etc. Other cloud vendors have other acronyms for their technologies.
    • Other vendors have other naming, branding and versioning. And it is not just keeping up with branding but versioning and capabilities
  • Cloud is yet another component, albeit a significant component, in the IS technology management mix.
    • For instance, moving 100 ‘legacy’ corporate applications to a VPC on AWS will not minimize the inherent design complexity.
    • The move may reduce cost of infrastructure hosting but not necessarily the cost and complexity of ongoing maintenance and support.
Although these notes are from the AWS re:invent this week, I am sure the other cloud guys down the road in Seattle throw an equally exiting conference to showcase their partner ecosystem, replete with vendor presentations and parties.

(stating the obvious: while thankful to my employer for the trip, and to an SI partner for a ‘free’ event pass, these views are mine alone and not an endorsement of my employer’s cloud strategy) repost from linkedin

Wednesday, September 26, 2012

Debate on Power, pollution and the Internet, Data Barns

There was a fascinating series in this Sunday’s New York Times that highlights the ugly byproduct of the digital age we live in: energy consumption driven by digitization. (“Power, pollution and the Internet” and “Data Barns in a Farm Town, Gobbling Power and Flexing Muscle”)

The author, James Glanz starts off by making an argument that "foundation of the information industry is sharply at odds with its image of sleek efficiency and environmental friendliness." A viewpoint like this is bound to have strong critics and digirati and technologists are sharply divided over how to respond to this article. A few critiques:

Dan Woods counters the article with a Viewpoint in Forbes: Why The New York Times Story 'Power, Pollution, And The Internet' Is A Sloppy Failure. Primarily starting off with the utility argument: "Roads aren’t 100 percent utilized. The telephone system isn’t 100 percent utilized. They are there when they are needed."

Richard Fichera for Forrester Research makes a similar argument in “Data Center Power And Efficiency – Public Enemy #1 Or The Latest Media Punching Bag?” "The simple fact is that if we want to live in an information society, we need the plumbing to support it. That is perhaps the most salient observation that the New York Times has made — there really is no cloud, just more and more really big data centers."

The fact remains, most of us, even techies and geeks would be quickly out of out our depth when it comes to intricacies of calculating environmental impact of data centers. Some of the analysis is based on complex calculations and number crunching but a lot more on empirical knowledge, inputs from analysts and other closely guarded sources. I agree with James when he states “Improving or even assessing the field is complicated by the secretive nature of an industry”

Another key argument made by James in his NYT piece is on the risk aversion of data center managers. The article quotes a vendor saying, "A crash or a slow down could end a career."  Dan Woods counters "There are a number of problems here. Anyone doing a hard job that is mission critical lives in fear. The people operating the printing plants at The New York Times have the same fear as the data center operators. Data center operations don’t have a special fear, just the normal one involved in doing a good job"

It is true that most of us in hi-tech operate under the environment where "fear" of "business" in a sense afraid to say No! even to bizarre requirements. A case study from my consulting days:

A fortune 500 retailer had a disaster recovery (DR) contract with a tier-1 technology vendor. This was in addition to the contract to host their data centers in the vendor’s “cloud”. One year, the periodic DR test failed to meet the RTO, RPO objectives, and the matter quickly got escalated to the board of directors. It was decided that it was more than a business continuity risk, a market perception/reputation risk, that the retail giant couldn’t afford.

The solution? The retail giant decided to invest in their own data-center, exclusively to support disaster-recovery, while the vendor continues to host all business (IT) applications from their cloud-based data center. Power consumption and pollution be damned: Risk of failure was the driver, with the cost being just one additional constraint!

The offshoring, globalization angle

While on the topic of environmental impact of data centers, it would be interesting to review the redundancy global organizations are building while offshoring technology services and business processes. The western world has been steadily outsourcing manufacturing to China during the past few decades and is only now waking up to the impact of pollution and emissions from there. Similarly, large IT development centers and call-centers in the west are steadily being Bangalored to India, China and Philippines and elsewhere. Along goes power guzzling servers, network hubs, desktops and laptops that starting to suck scarce power from an already stretched infrastructure in third world countries. All this in addition to “production” servers to run live business applications out of data centers/cloud in native countries.

Ref my earlier post on power grid failure in India  and a recent article  One killed in Indian nuclear power plant protests Wonder how much of this is attributable to globalization, offshoring and power guzzling data centers?

Argument and counter-views aside, the discussion in NYT article is really about the environmental impact of server farms, internet data centers, corporate data centers and the cloud.  I love the way Richard Fichera summarizes “ Despite the NY Times’ sudden discovery of the problem, the IT industry has been working diligently on solving these problems for years and will continue to make progress long after the mainstream media has gone on to expose killer mimes and the hazards of the exploding population of Frisbee-playing bears. The simple fact is that if we want to live in an information society, we need the plumbing to support it. That is perhaps the most salient observation that the New York Times made — there really is no cloud, just more and more really big data centers.”

Tweets: #TalkEnergy, #"Power, Pollution and the Internet"

Wednesday, June 29, 2011

Microsoft 365 on the cloud: The Future is Past

With rollout of Microsoft 365, Redmond has finally got an answer to Cloud Computing, at least in the commodity applications space.

So what’s new? Not much if you, like me, have also been using Microsoft’ hotmail account – email over cloud - for over a decade. Every large Software vendor aspires to a share of the next big thing and for now it is the cloud. Same goes for every IT professional, self included, who wishes to keep on top of the latest: one just can’t stay away from the hype over cloud computing.

Much of the research surveys point to how commodity applications from Apple, Google and Microsoft are going to change our lives. Surveys also highlight the fact that few IT executives expect their organizations to select a public cloud over a private cloud.

As regards commodity applications, they are not as new as they are being touted to be. I guess the change is already here:
• email on the cloud – since mid 1990s : over 15 years old
• WebEx, instant messenger services on the cloud – since late 1990s – over a decade
• SalesForce case studies on cloud computing – since early 2000 – nearly a decade
• Online learning tools – since mid 1990s – over 15 years
• Social media tools – evolving for the past decade
• Music and video on the cloud – services evolving for the past decade. Remember the hype when google bought out youtube?
• Documents on the web? Openoffice, OpenDocs etc since late 1990s.

A few blogs on the topic
• Cloud Computing: The Future is Past
• For Microsoft, Is The Cloud A Threat – Or Their Secret Weapon?
• My Musing on Cloud Computing, Sourcing and Offshoring
• Memo to Microsoft: It’s Time for Windows 365