About TODO Blog RSS Old blog Projects Gallery Notes

Thu, 11 Oct 2007

GoogleFS.

It sucks for the wast majority of users, here is number of reasons why I think so:

• designed only to efficiently handle sequential huge read/append
• it does not handle small files efficiently. Small is smaller than 64 MB
• it only reliably handles appends of chunk wich does not cross 64 MB boundary to the file
• dataflow is unreliable, but since it is mostly append, then old data will be returned instead of corrupted one
• it does not scale to random access at all
• it forces client to cache metadata
• reading bottlenecks (like starting a single application on huge number of clients) are handled by ostrich's method - increase number of nodes where block lives to the number, when bottleneck is not very visible
• there are no words 'low latency' in its design
• no (even remotely) POSIX API, clients has to be heavily dependant on vendor's helper libs, although following operations are supported: create, delete, open, close, read and write to file
• single master
• googlefs is built on top of usual files in some Linux filesystem

/devel/fs :: Link / Comments (0)

New release of the distributed storage subsystem.

This is a maintenance release, which includes small number of bug fixes, which sit in the tree, but were not yet released.
Check the homepage to get the latest release.

/devel/dst :: Link / Comments (2)

HIFN driver has been imported into cryptodev-2.6 tree.

Driver will be added either into 2.6.24 or 2.6.25 tree eventually.
I've also added a patch to export DES key extension to catch weak keys and use it in HIFN driver. Now it is ready.
Interested reader can find updated HIFN driver in archive.

/devel/acrypto/hifn :: Link / Comments (0)