Photos from the London MUG Meetup
10gen CEO and Co-Founder Dwight Merriman visited the London MongoDB User Group on January 31st, presenting Crazy Stuff: hacks, internals, and sneaky tricks.
Shutterfly, a leading Internet-based social expression and personal publishing service, safeguards more than six billion images for millions of customers. As the only photo sharing site that does not down-sample, compress, or force delete photos, Shutterfly faced massive data growth that pushed the performance limits of its existing Oracle database. After an extensive analysis of open source relational and non-relational alternatives, Shutterfly chose MongoDB as its persistent data store.
Before implementation of MongoDB, Shutterfly stored its more than 20 TB of photo metadata in an Oracle RDBMS, vertically partitioning the data by function. The complex infrastructure became hard to manage after a decade of development and made development of new features difficult to execute quickly or correctly. The situation was further exacerbated by the the high costs associated with licensing and hardware. These challenges compelled the Shutterfly team to look at open source options that would also provide improved performance and a simpler API at a reduced cost.
Shutterfly chose MongoDB as its new storage solution primarily because the data model matched common use cases. The rich JSON-based data structure was easy for the development team to use, reduced time to market for new features, and could be leveraged for many different projects. In addition, Shutterfly saw significant performance improvements with the more natural data model. Finally, the MongoDB solution was cost-efficient, providing an open source solution that would enable them to scale horizontally across commodity hardware.
Shutterfly's migration to MongoDB resulted in a 900% performance improvement when compared to their previous Oracle implementation. In terms of cost, Shutterfly realized a 500% reduction in moving from Oracle to MongoDB. Overall, MongoDB provided Shutterfly with a high performance solution at a significantly reduced cost.
To learn more, read the full case study, or for more resources, check out Shutterfly's Kenny Gorman's presentation at MongoSV 2010 ...Sharing Life’s Joy using MongoDB: A Shutterfly Case Studyâ€œ or the follow-up Q&A with Gorman hosted by NoSQLDatabases.com. More recently, at MongoSF 2011 Gorman presented on ...MongoDB Profiling and Tuning.â€œ