logging - How does Facebook store it's log data? -


i started using scribe, facebooks solution transferring , collecting log data many different servers.

what not find how facebook stores huge amounts of log data gets (according presentation 25tb per day in 2009).

has facebook released information on how it? hadoop hdfs? cassandra?

they use hive on top of hadoop. cassandra used email/messaging, not logging. links:

https://developers.facebook.com/opensource/

http://highscalability.com/blog/2008/11/24/product-scribe-facebooks-scalable-logging-system.html

http://wiki.apache.org/hadoop/hive


Comments