Amazon Web Services (AWS) has announced the general availability of Amazon MSK Serverless, a new serverless option for Amazon Managed Streaming for Apache Kafka (Amazon MSK) that instantly scales resources to meet an application’s demand, vastly simplifying real-time data ingestion and streaming.
The announcement was made in an AWS news blog post.
According to AWS, organizations are increasingly adopting Apache Kafka to capture and analyze real-time data streams from IoT devices, website clickstreams, database logs, and many other sources where dynamic data is continuously generated. Now, with Amazon MSK Serverless, customers no longer have to worry about capacity planning—Amazon MSK Serverless provisions, manages, and scales Apache Kafka and Kafka Connect clusters automatically to provide on-demand streaming capacity and storage for even the most variable or unpredictable streaming workloads.
With Amazon MSK Serverless, customers can:
- Easily stream data:Amazon MSK Serverless automatically manages cluster capacity and Apache Kafka partitions, and customers can create an Amazon MSK Serverless cluster and stream data in just a few clicks.
- Instantly scale to meet demand:Amazon MSK Serverless scales capacity up and down instantly based on application requirements, so customers don't need to monitor cluster capacity or reassign Apache Kafka partitions.
- Pay only for the precise capacity needed for their workload:Amazon MSK Serverless offers throughput-based pricing, so customers pay only for the data volume they stream and retain, and don’t have to worry about overprovisioning for peak capacity.
In addition, Amazon noted, MSK Serverless provides additional secure features out of the box, such as private connectivity, so that the traffic doesn’t leave the AWS backbone, AWS Identity and Access Management (IAM) access control, and encryption of data at rest and in transit, which keeps it secure.
Amazon MSK Serverless is available in US East (Ohio), US East (N. Virginia), US West (Oregon), Europe (Frankfurt), Europe (Ireland), Europe (Stockholm), Asia Pacific (Singapore), Asia Pacific (Sydney), and Asia Pacific (Tokyo).