-
|
Thank you for this innovative project, I've been postponing giving it a shot for a while - but it definitively sparks a lot of creative use case ideas! It appears this wasn't unnoticed by AWS engineers and they've kinda implemented their own (partial) ZeroFS alternative. It's called AWS S3 Files a native FS built on top of S3, to quote their pricing page:
at 60$ per TB, writes can be expensive - although retrieval and long term cost might offset that. Compared to EFS pricing of course is much more predictable, in particular for later reading. High-performance storage* $0.30/GB-mo |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
|
S3 Files is much closer to "a synchronisation service between EFS and S3", it literally is EFS under the hood (same pricing for the hot tier), with S3 as the backing store. So it's not really a "filesystem on top of S3" the way ZeroFS is. Compared to ZeroFS it'll always be more expensive (you pay EFS surcharge on top of S3 for any hot data), and it only runs on AWS compute. Performance-wise, I expect it to behave like EFS for cached data and much slower for data that is not cached. See https://www.zerofs.net/zerofs-vs-aws-efs Also worth noting: writes to S3 Files don't get S3's durability guarantees immediately, they land on the EFS tier first and sync to S3 asynchronously (AWS says "within minutes"). So there's a window where your write exists only on EFS, and readers hitting the S3 API directly won't see it yet. ZeroFS writes go straight to S3, so you get S3's durability from the moment the write is acknowledged. |
Beta Was this translation helpful? Give feedback.
S3 Files is much closer to "a synchronisation service between EFS and S3", it literally is EFS under the hood (same pricing for the hot tier), with S3 as the backing store. So it's not really a "filesystem on top of S3" the way ZeroFS is.
Compared to ZeroFS it'll always be more expensive (you pay EFS surcharge on top of S3 for any hot data), and it only runs on AWS compute. Performance-wise, I expect it to behave like EFS for cached data and much slower for data that is not cached. See https://www.zerofs.net/zerofs-vs-aws-efs
Also worth noting: writes to S3 Files don't get S3's durability guarantees immediately, they land on the EFS tier first and sync to S3 asynchronously (AWS says "with…