Walrus.

Post

Share your knowledge.

Pluto Dev👽.
May 10, 2025
Expert Q&A

Why does a small file get encoded to a larger size in Walrus?

I've been testing Walrus to upload files of various sizes, but noticed that a 16KiB file shows an encoded size of 62MiB. Is there a reason for this, and are there any settings or improvements on the horizon to help handle small files more efficiently?

  • Walrus
  • Typescript SDK
0
2
Share
Comments
.

Answers

2
skywinder.
May 11 2025, 03:24

The large encoded size for small files is due to the overhead from replicated metadata required for storage and authentication in Walrus. This can make the encoded size much larger than the original file size, particularly for small files since the fixed per-blob metadata size is significant relative to the data. For a file like your 16KiB example, this might appear as a 62MiB encoded size when the system assumes a large number of storage nodes.

0
Comments
.
elfDani.
May 11 2025, 10:46

Walrus is currently more efficient with larger files because the relative overhead for larger blobs decreases as file size increases. For smaller blobs, improvements are being developed, like support for tar balls and random-access reads. In terms of performance for saving small files, sub-second save times might be unrealistic at this point due to the complexity of operations required, such as encoding and sending transactions through Sui and to various storage nodes.

0
Comments
.

Do you know the answer?

Please log in and share it.

Walrus is a decentralized storage and data availability protocol designed specifically for large binary files, or "blobs"

83Posts149Answers
Sui.X.Peera.

Earn Your Share of 1000 Sui

Gain Reputation Points & Get Rewards for Helping the Sui Community Grow.

We use cookies to ensure you get the best experience on our website.
More info