![\"Cutting](\"https:\/\/devoteam.info\/wp-content\/uploads\/2026\/01\/AWS-Lambda-Containers.jpg\")
<\/a><\/figure>\n\n\t\t\n\t\tThe biggest hurdle?<\/h2>\n\n\n\n
Containers are typically much bigger than traditional lambda functions, meaning a lot more data to transmit. The team at AWS came up with a cunning strategy for handling this, improving cold starts by up to 15 times.<\/p>\n\n\n\n
What\u2019s the secret sauce?<\/h2>\n\n\n\n
It turns out that most containers aren’t as unique as we might think. Many share common foundations, such as Alpine or AWS base images, with some libraries added on top. In fact, only about 1% of each container is truly unique! By breaking containers down into chunks, AWS achieves massive deduplication. Think of it like building with LEGOs. Many projects use the same basic bricks, and you only need to store those bricks once.<\/p>\n\n\n\n
The chunks are stored in S3 with multi-tier caching in data centers and local workers. This caching strategy significantly increases the probability that, even during a cold start, the vast majority of the necessary data is immediately available, leading to much faster function initialisation.<\/p>\n\n\n\n
Crucially, it turns out that, on average, less than 10% of a container’s data is actually needed at startup. This enables on-demand loading, where AWS Lambda only fetches the specific data required at that moment, dramatically accelerating cold starts for large container images (can be up to 10GB).<\/p>\n\n\n\n
Curious about the nitty-gritty? Here’s how AWS pulls it off:<\/p>\n\n\n\n
Deterministic Serialisation and Chunking<\/h3>\n\n\n\n
When you create or update a function, your container images (typically composed of multiple layers) are flattened into a single `ext4` filesystem for consistent processing. This flattened filesystem is then divided into fixed-size 512KiB chunks. This process ensures that identical files or even parts of files consistently always generate the same chunks. Consistency is fundamental, enabling powerful caching and massive deduplication.
<\/p>\n\n\n\n
Convergent Encryption for Secure Deduplication<\/h3>\n\n\n\n
AWS Lambda uses a sophisticated technique called Convergent Encryption. This allows them to securely deduplicate and share container image chunks across all<\/em> customers without compromising security. Each 512KiB chunk is hashed (using SHA256) to create a unique encryption key, which then encrypts the chunk. A manifest file, listing the hash and file offset of each chunk, has its key list encrypted with a unique, per-customer key managed by AWS KMS. What does this mean for you? Identical chunks can be stored and cached just once, enabling safe sharing even if they belong to different customers. Plus, a varying “salt” in the key derivation adds an extra layer of protection, limiting the “blast radius” if highly popular chunks ever encounter issues, by creating different keys for otherwise identical chunks.<\/p>\n\n\n\n Container-based Lambdas can now actually offer quicker cold starts than zip-based Lambdas, with performance tests<\/a> suggesting that this occurs in the 50MB-100MB range.<\/p>\n\n\n\n Lambda\u2019s per-millisecond billing model is ideal for sporadic workloads with long idle periods. One report highlights a 95% cost reduction<\/a> by migrating an AI Inference solution with very low traffic from ECS to Lambda.\u00a0<\/p>\n\n\n\n Want to learn more? Dive into the details with the official On-demand Container Loading in AWS Lambda white paper<\/a> and start rethinking your architecture.<\/p>\n\n\n\n Regardless of your current cloud adoption stage, our team will help you to streamline IT investments, enhance scalability, and drive innovation.<\/p>\n\n\n\nThe Cost-Cutting Edge<\/h2>\n\n\n\n
<\/div>\n\n\n\n\n\n\nHow will you transform your business with AWS solutions?<\/h2>\n<\/div>\n\n\n\n