Serverless Is Widespread in the Big 3 Clouds: Virtualization Review

Serverless Is Widespread in the Big 3 Clouds: Virtualization Review


Report: Serverless is Pervasive in the Big Three Clouds

A new Datadog report indicates that serverless computing has gone mainstream and is now used by more than half of the company’s customers across all of the “Big 3” cloud computing platforms: Amazon Web Services (AWS), Microsoft Azure and Google Cloud Platform (GCP).

The monitoring and security specialist leveraged usage telemetry from thousands of its clients to compile the report on serverless computing, which typically involves distributed snippets of code, or functions, that are triggered by various types of user or system events. , instead of monolithic programs.

“Serverless has transformed application development by removing the need to provision and manage any underlying infrastructure,” the report says. “Today’s serverless ecosystem has become more mature and now has considerable overlap with the world of container-based technologies. The wide range of options available has led more than half of organizations operating on every cloud to adopt serverless technology.

In fact, the chart below shows Amazon Cloud leading in the percentage of Datadog users using AWS Lambda, the main serverless service, or its other options: AWS App Runner, ECS Fargate, and EKS Fargate.

Serverless adoption by cloud provider
[Click on image for larger view.] Serverless adoption by cloud provider (source: Datadog).

Datadog started the State of Serverless reports years ago and now updates the numbers regularly; this is the third edition. Throughout the series, the company has noted a growing correlation between serverless computing and the use of containers. In this report, container-related data points for each cloud include:

  • Google Cloud CareerGCP’s serverless container product, is now used by nearly 40% of Datadog customers running on Google Cloud, a fourfold increase since January 2020.
  • The percentage of Azure customers using Azure container instances has seen a 67 percent increase from 2020 to this year, which Datadog says indicates the growing maturity of the serverless market and the value of technologies that can be used to deploy existing applications like containers while also leveraging the serverless technology.
  • In the first quarter of 2020, less than 12 percent of AWSLambda users were taking advantage of its serverless container product, ECS Fargate. Today, more than 20% of AWS Lambda users have adopted ECS Fargate. The percentage of AWS Lambda customers running ECS ​​on EC2 has similarly decreased, indicating that organizations are doubling down on serverless across different types of workloads.

Emphasizing again the growing serverless/container connection, Datadog said: “This evolution highlights the growing range of options available to organizations that want to use serverless technology, as well as a shift in the way serverless technologies are leveraged. For example, in addition to using serverless functions to execute event-driven code, many organizations are also deploying containerized applications on serverless platforms such as Azure Container Instances, Google Cloud Run, and Amazon ECS Fargate.”

In fact, the report indicates that one in five Lambda users are deploying functions as container images. Datadog said that approach has several advantages, including the ability to have much larger containers, up to 10GB, compared to the .zip file approach, which is limited to 250MB.

“This significantly larger size limit allows organizations to take advantage of highly dependent libraries like NumPy and PyTorch, which support data analytics and machine learning tasks,” Datadog said. “In addition, packaging Lambda functions as container images makes it easy for organizations with existing Docker-based deployments and CI/CD pipelines to integrate serverless solutions. This ability to seamlessly incorporate serverless functions into existing workflows can save teams a significant amount of time and increase their productivity.

Other highlights of the report include:

  • Python and Node.js continue to dominate among Lambda users: Around 99 percent of organizations use Python, while Node.js is only slightly behind at around 98 percent, followed by Java at less than 40 percent.
  • More than 60% of large organizations have implemented Lambda functions in at least three languages: About 33 percent of organizations use two or three languages, while about 19 percent use four, about 7 percent use five, about 5 percent use six or more, and about 4 percent use only one. .
  • API Gateway and SQS are the AWS technologies that most frequently invoke Lambda functions: API Gateway is responsible for more than half of all Lambda function calls. SQS is at about 18 percent.
  • 80 percent of Lambda calls from API Gateway are for single-purpose functions: “The vast majority of Lambda invocations by API Gateway are for single-purpose functions, which are used by more than 60 percent of our customers. This data reflects the many key benefits of single-purpose functions.”
  • More than 20 percent of Lambda customers also use ECS Fargate: Datadog said this indicates organizations are increasingly committed to serverless, while also pointing to a deep-seated belief in serverless’ ability to optimize workloads and operations.
  • Google Cloud Run is the fastest growing method of deploying serverless applications on Google Cloud: “Nearly 40 percent of Datadog customers running on Google Cloud have adopted Google Cloud Functions, making it the most popular serverless offering on that cloud. Yet this level of adoption is only 3 percent higher than Google Cloud Run, Google Cloud’s serverless container.This finding suggests that when it comes to serverless, a growing number of Google Cloud users are seizing the opportunity to launch containerized applications that require no infrastructure management “.
  • Azure Functions is the most popular serverless offering from Azure, but adoption of Azure Container Instances is growing rapidly: The service is used by more than 40 percent of Azure customers. Another product that has seen a significant increase in adoption is Azure Container Instances (ACI), which helps organizations run fully managed serverless containers and is now used by nearly 30 percent of Azure customers. “This fact echoes similar trends we identified across Google Cloud and AWS, namely that organizations are moving beyond the traditional FaaS paradigm and using serverless technology to launch containerized workloads. We also expect to see more increased adoption of other Azure serverless container technologies such as Azure Container Apps, which enables teams to build and deploy full containerized applications in managed serverless environments.”

Since this is the third edition of The state of serverless reports, the company is beginning to shed more light on trends in the space.

“Serverless technology has long been promised as a way to quickly scale and simplify operations without having to worry about infrastructure management,” said Ilan Rabinovitch, an executive at Datadog. “Since our last report in 2021, serverless has become pervasive in our customer base. Importantly, we are seeing serverless technologies being used in critical external and internal applications. This is in contrast to a couple of years ago when It first launched serverless monitoring and the usage leaned towards R&D scenarios.”

For the coverage of Datadog’s February 2020 report, see the Virtualization and cloud review article “Report: AWS Lambda is a Big Hit for Serverless Computing, Especially with Containers.”

About the Author

David Ramel is an editor and writer for Converge360.

Leave a Comment