Select your cookie preferences

We use essential cookies and similar tools that are necessary to provide our site and services. We use performance cookies to collect anonymous statistics, so we can understand how customers use our site and make improvements. Essential cookies cannot be deactivated, but you can choose “Customize” or “Decline” to decline performance cookies.

If you agree, AWS and approved third parties will also use cookies to provide useful site features, remember your preferences, and display relevant content, including relevant advertising. To accept or decline all non-essential cookies, choose “Accept” or “Decline.” To make more detailed choices, choose “Customize.”

Skip to main content

Why is persistent file storage important for modern application development?

Development teams are modernizing their applications by adopting containers, serverless, and microservices-based architectures. Because containers are transient in nature, long-running applications can benefit from keeping state in durable storage. Distributed applications like machine learning training, and web serving, benefit from a shared storage layer. Amazon Elastic File System (Amazon EFS)  is a simple, serverless, set-and-forget, cloud native file system, enabling you to build modern applications, persist and share data from your AWS containers and serverless applications, with zero management required.

Data persistence for your serverless applications

Serverless computing enables you to be more agile while spending less time dealing with the security, scalability and availability of your applications. At the same time, modern data-intensive applications require fast access to large volumes of shared data. AWS Lambda lets you run large-scale, and mission-critical serverless applications. Amazon EFS provides highly available and durable serverless storage for those applications, and simplifies the sharing of data that needs to persist beyond and between executions of Lambda functions and AWS Fargate tasks. This powerful combination is ideal for building machine learning applications, loading large models, libraries, and other reference data, processing and backing up large amounts of data, hosting web content, and developing internal build systems.

Benefits

Use Cases

Blog posts

Running WordPress on Amazon EKS with Amazon EFS Intelligent-tiering

Mount Amazon EFS file systems cross-account from Amazon EKS

Analyze terabyte-scale geospatial datasets with Dask and Jupyter on AWS

Choosing between storage mechanisms for ML inferencing with AWS Lambda

Johnson & Johnson reduces analysis time by 35% with their data science platform using Amazon EFS

Deploy multiple machine learning models for inference on AWS Lambda and Amazon EFS

Migrate Resources Between AWS Accounts

Virus scan S3 buckets with a serverless ClamAV based CDK construct

Manage your Digital Microscopy Data using OMERO on AWS

Blue/Green deployment with AWS Developer tools on Amazon EC2 using Amazon EFS to host application source code

Analyze controlled unclassified data with SAS Viya EKS on AWS GovCloud (US)

Persistent Storage using EFS for EKS on Bottlerocket

Deploy serverless Drupal applications using AWS Fargate and Amazon EFS

Event-driven data transfer to container-shared storage on AWS

Scaling RStudio/Shiny using Serverless Architecture and AWS Fargate

Introducing Amazon EFS CSI dynamic provisioning

Running stateful workloads with Amazon EKS on AWS Fargate using Amazon EFS

AWS re:Invent recap: Modernize your applications with Amazon EFS

Persistent storage for container logging using Fluent Bit and Amazon EFS

New - AWS Fargate for Amazon EKS now supports Amazon EFS

Deploying Jenkins on Amazon EKS with Amazon EFS

New – A Shared File System for Your Lambda Functions

Using Amazon EFS for AWS Lambda in your serverless applications

Developers guide to using Amazon EFS with Amazon ECS and AWS Fargate – Part 1

Developers guide to using Amazon EFS with Amazon ECS and AWS Fargate – Part 2

Developers guide to using Amazon EFS with Amazon ECS and AWS Fargate – Part 3

Digital transformation at Discover using AWS Storage solutions

Amazon Elastic Container Service & AWS Fargate, now support Amazon Elastic File System

Best Practices for Using Amazon EFS for Container Storage

Deploy Stateful Docker Containers with Amazon ECS and Amazon EFS
Read Docker's blog »

Read about the latest launches and best practices in the Storage blog »

Read about the latest launches and best practices in the Containers blog »

Resources

Learn more about Amazon EFS, scalable, elastic, cloud-native file system

Persistent storage on containers using Amazon EFS (Level 200)

Missing alt text value

Machine Learning Inference with AWS Lambda and Amazon EFS (Level 200)

Missing alt text value

AWS Online Tech Talk: Modernize Content Management Systems with Containers

Missing alt text value

Modernize Your Applications with Containers, Serverless, and Amazon Elastic File System, an on-demand webinar

Missing alt text value

Persistent Storage for Amazon ECS and AWS Fargate Using Amazon EFS, an on-demand webinar

Missing alt text value

Read the Tech Target white paper

Missing alt text value