sharding

3 results

MongoDB workshop at the All Your Base conference

This November, 10gen will offer training at the ... All Your Base “ conference. Running on November 23, ...All Your Base“ aims to deliver a day of exploring NoSQL technologies, RDMS and client side technologies with talks from the worlds leading experts - and Alvin Richards, EMEA’s senior technical director for 10gen, will deliver an exclusive one-day workshop on MongoDB before the conference starts. Seats are limited for this introductory workshop where Alvin will walk attendees through MongoDB’s core concepts. Through a combination of demos and exercises to explore topics including schema design, querying, replication, sharding and basic administration, Alvin will bring you up to speed on everything you need to know to bring a MongoDB sample app into production. The course is intended to create a foundation that developers can build on in their applications. Workshop places must be purchased separately from conference tickets, and are available from the All Your Base website here . Having recently launched two free online MongoDB training courses - MongoDB for Developers and MongoDB for DBAs - the Introduction to MongoDB workshop at ...All Your Base“ provides a place to start for anyone new to MongoDB As well as the Intro to MongoDB workshop, Alvin will be delivering a presentation to the conference ...You’ve built your application, so what next?“. Drawing on over 20 years’ experience in startups in the archiving, SaaS and Java instrumentation domains Alvin will look at what happens when you build a product or feature that is wildly successful - and need to take the next step to scale it. Alvin will also explore how technologies like MongoDB, the leader in the NoSQL market, can be used to scale your data persistence and caching layer. 10gen’s “Introduction to MongoDB” workshop is on November 22, the day before the conference — get a discount of £25 by using promotional code “speaker”. You can find out more about the conference and get your ticket here . Tagged with: MongoDB, 10gen, Alvin Richards, Introduction to MongoDB, free online training, free online MongoDB training, online MongoDB training, All Your Base conference, All Your Base, scaling, sharding, replication, schema design, NoSQL, data persistence

October 25, 2012

MongoDB at OrderGroove

We recently chatted with VP of Engineering, J orge Escobar, about his experience using MongoDB for fast growing SaaS startup OrderGroove. Tell us a little about OrderGroove. Founded in 2008, OrderGroove is a platform that allows online consumers to subscribe to frequently purchased products via the website they're ordering from. When purchasing products from an e-commerce website, the OrderGroove platform injects, via JavaScript, content within the purchase flow that allows the consumer to receive the product with a specific frequency as well as fully control his subscription program via a personalized control panel. What technologies are you using and how does MongoDB fit into your stack: OrderGroove is a write-heavy application written in Python and Django. We started with a MySQL master and two slaves to allow for the rapid iterations we experienced initially as we developed and refined the platform. After we experienced a surge in new client signings (especially with clients that had significant traffic) we determined that the setup would prove to be insufficient if the growth trends continued at the pace we were experiencing. At that moment my team and I discussed the options that we could use to distribute writes horizontally. We were ready to write something from scratch that would involve application-level MySQL sharding. However, I had played with MongoDB a few years back and we decided to give the technology a second look. MongoDB proved to be the perfect fit. It allowed us to grow (or shrink) elastically as our merchant needs fluctuate, especially around seasonal events, without having us to develop and maintain custom data store layers. It sounds like you have a lot of data! Can you tell us about your experiences using sharding? More than just the amount of data, our challenge was how to write fast enough. Sharding was the perfect solution for that challenge. Setting up sharding took some analysis, as you want to have a horizontally spread sharding index. Thanks to a consultation with Sarah Branfman and one of the 10gen engineers, we quickly knew we were in the right track. Our sharding index is a combination of merchant, session id and a timestamp. Four months after we launched the first batch of clients on MongoDB, we faced an incredible growth in traffic with new merchants that had much higher levels of traffic than we had seen before. It was just a matter of adding new replica sets and modifying the sharding configuration, and our writes were once again under control. Now we are constantly monitoring our cluster using 10gen’s MMS so that we’re prepared ahead of time for traffic growth patterns. What advice would you give to other ecommerce startups using MongoDB? MongoDB is the right solution for OrderGroove’s needs. If you have write heavy applications, MongoDB is a no-brainer. One thing to take into consideration is that data is eventually consistent, so we use MongoDB mostly for our front end tracking, but still use MySQL for the transactional data processes and most probably will continue doing so. It's important to pick the right data store model for your needs (or a combination of them). I wrote about this on my jungleG blog ( http://jungleg.com/2011/11/20/sql-or-nosql-how-about-both/ ) Another strong recommendation I would give to any company that’s going to use MongoDB is to take the time to install the MMS agents. It doesn’t take more than 15 minutes and it allows you to keep an eye on everything that’s happening with your MongoDB nodes and also helps the 10Gen team to debug any issues you might be facing by just sharing the data with them using your client id. We’ve been able to identify potential issues before they became real ones just by monitoring MMS. Any exciting plans for the future that you would like to share? We are looking closely at the new aggregation framework in MongoDB as we still generate analytics using MySQL using regular computation. With the aggregation framework, we could potentially handle more data and accelerate delivery even further for clients. Tagged with: MMS, MongoDB, sharding, aggregation framework, MySQL

September 10, 2012