MongoDB Atlas: Connector for Apache Spark now Officially Certified for Azure Databricks
We are happy to announce that the MongoDB Connector for Apache Spark is now officially certified for Microsoft Azure Databricks. Databricks, founded by the original creators of Apache Spark, provides the Databricks Unified Analytics platform. MongoDB Atlas users can integrate Spark and MongoDB in the cloud for advanced analytics and machine learning workloads by using the MongoDB Connector for Apache Spark which is fully supported and maintained by MongoDB.
The MongoDB Connector for Apache Spark exposes all of Spark’s libraries, including Scala, Java, Python, and R. MongoDB data is materialized as DataFrames and Datasets for analysis with machine learning, graph, streaming, and SQL APIs. The MongoDB Connector for Apache Spark can take advantage of MongoDB’s aggregation pipeline and rich secondary indexes to extract, filter, and process only the range of data it needs – for example, analyzing all customers located in a specific geography. This is very different from simple NoSQL data stores that do not offer secondary indexes or in-database aggregations and require the extraction of all data based on a simple primary key, even if only a subset of that data is needed for the Spark process. This results in more processing overhead, more hardware, and longer time-to-insight for data scientists and engineers.
Additionally, MongoDB’s workload isolation makes it easy for users to efficiently process data drawn from multiple sources into a single database with zero impact on other business-critical database operations. Running Spark on MongoDB reduces operational overhead as well by greatly simplifying your architecture and increasing the speed at which analytics can be executed.
MongoDB Atlas, our on-demand, fully-managed cloud database service for MongoDB, makes it even easier to run sophisticated analytics processing by eliminating the operational overhead of managing database clusters directly. By combining Azure Databricks and MongoDB, Atlas users can make benefit of a fully managed analytics platform, freeing engineering resources to focus on their core business domain and deliver actionable insights quickly.
MongoDB Radio: Our New Podcast Project
Welcome to the inaugural post of MongoDB Radio, our new podcast project. We’re very excited to bring you great content about MongoDB, the people who build it, and the people who use it. Throughout this series we will feature interviews with MongoDB engineers, experts in the field of distributed computing and databases, stories from our community and trends in technology, and much more. The world of distributed systems and next generation applications is a fascinating place, and we can’t wait to share it with you.
In episode one we spent time with Luke Lovett, a software engineer on the driver’s integration team at MongoDB. Among many things, Luke is responsible for maintaining one of our most popular projects – the Hadoop connector for MongoDB. The connector allows you to plug MongoDB into the Hadoop ecosystem of tools and perform sophisticated processing against the data within MongoDB.
We spoke with Luke during our developer conference in San Jose, where he was delivering a talk on some of the new features available on the connector. We discussed the connector in depth, what it’s like to work on an open source project with the community, and how he got started at MongoDB.
Join us for two days of GIANT thinking.
About the Author - Bryan Reinero
Bryan is US Developer Advocate at MongoDB fostering understanding and engagement in the community. Previously Bryan was a Senior Consulting Engineer at MongoDB, helping users optimize MongoDB for scale and performance and a contributor to the Java Driver for MongoDB.
Earlier, Bryan was Software Engineering Manager at Valueclick, building and managing large scale marketing applications for advertising, retargeting, real-time bidding and campaign optimization. Earlier still, Bryan specialized in software for embedded systems at Ricoh Corporation and developed data analysis and signal processing software at the Experimental Physics Branch of Ames Research Center.
Parse Shutdown: How to Seamlessly Continue Operations with Azure and MongoDB Cloud Manager
It has now been a few months since Parse announced their shutdown, and we at MongoDB are working to develop resources and options for users interested in migrating to other environments. We previously announced our guide to migrating from Parse to AWS and MongoDB Cloud Manager and are now adding a comprehensive guide to migrating a Parse backend to Azure with Cloud Manager.
Along with Parse’s moving on announcement, they released Parse Server, an open source replacement for their hosted backend. Along with Parse Server, they have provided a practical migration path from their hosted solution to a private one. To use this solution, a team needs to
- provision a private MongoDB database,
- migrate their Parse data to that MongoDB,
- deploy the Parse Server into a hosting environment of their choosing, and
- update their client to issue API calls to their new Parse Server.
MongoDB Cloud Manager’s tight integration with Azure makes it easy to setup a MongoDB deployment.
This guide is for mobile developers and does not assume any prior experience with MongoDB, Node.js, or Azure. Each section provides a complete, high-level checklist with detailed, step-by-step directions. In addition, there are great jumping-off points to the specific MongoDB documentation relevant to those migrating from Parse, such as how to manage indexes and set up monitoring.
Announcing MongoDB's Giant of the Month, Doug Duncan of Alteryx
MongoDB customers and community members are the people who realize GIANT ideas. We are excited to begin highlighting some of our community members, our MongoDB Giants, who are tackling challenging problems and bringing solutions to life with MongoDB.
This month’s MongoDB Giant is Doug Duncan, a DBA at Alteryx, who is making a meaningful impact to the MongoDB community. Alteryx is a leader in data preparation, blending, and advanced analytics.
Doug has worked with RDBMSs for longer than he cares to admit, focusing in both development and administration. Through his experience, Doug grew to embrace new data storage technologies. He began working with MongoDB several years ago (starting with the MongoDB 1.8 release in early 2011) both professionally and recreationally. Doug acted as an online TA the first two years following MongoDB University’s founding, working closely with the team by answering students’ questions about the M101J, M101JS and M202 courses, as well as providing questions used in the courses. For his contributions to the education team Doug was awarded the first ever MongoDB DBA certification back in November of 2013.
In his spare time, if Doug’s not reading up on MongoDB, Hadoop, or other distributed data stores, you can find him walking around the foothills of Colorado with his wife, two boys and two dogs.
Become an important part of the MongoDB community. Join our Advocacy Hub and start getting involved today.
Call for Papers Open for MongoDB World 2016
Call for Papers open until December 18th.
Tell us your transformational story
We want to hear your GIANT ideas at MongoDB World 2016. Submit your papers now through December 18th and tell us how you’ve launched transformative projects, defeated technical obstacles, and achieved GIANT scale with MongoDB.
|12.18||Call for Papers Closes|
|03.11||1st Draft Due|
|04.15||2nd Draft Due|
|04.25||Speaker rehearsal completed|
|05.31||Final Slides Due|
What we’re looking for
We’re excited to include fascinating stories that stretch across a wide range of topics, from differing backgrounds and technical professions. These fields include:
- QA engineers
- System administrators
- Data analysts
- Business architects
- and more.
The selection process
We are accepting proposals until December 18, 2015. Our selection committee will review and reply to proposals by January 15, 2015. All proposals and speakers must abide by the conference Code of Conduct.
To learn more about submitting your talk to MongoDB World 2016 visit our information page.
The Ops Guide to a Peaceful Thanksgiving
Imagine a Thanksgiving holiday spent with your closest family and friends - enjoying turkey with gravy, mashed potatoes, green bean casserole, and old fashioned eggnog. For those of us on the operations team, a peaceful few days at home just isn’t a possibility. Ops is always on call, fixing the database at all hours, and over all holidays.
From RDBMS to MongoDB: Migration Stories Infographic
Data is growing annually at a rate of 40%, with 90% of that data being unstructured. How does this impact your organization? It means that your team must be able to deliver new applications that capitalize on modern data - faster, better, and more efficiently than ever before.
MongoDB Named in the InfoWorld Bossie Awards 2015: The best open source application development tools
InfoWorld recently recognized MongoDB with a “Bossie” award for its leadership in open source software in the category of ‘the best open source application development tools'.
Employee Spotlight: AJ Subat
AJ has been at MongoDB for nearly 3 years. We had the opportunity to learn more about why he joined MongoDB, his experience here, how AJ spends his weekends, and more.
What is your role at MongoDB?
I’m in Sales which becomes pretty obvious once you see my LinkedIn photo. I’m a Corporate Account Executive and I work with growing companies to make them successful with MongoDB.
How long have you been at the company?
Started as an intern now we here (two and a half years later).
What’s your Instagram?
Why did you join MongoDB?
I learned about MongoDB by attending a bunch of Meetups in Los Angeles. I was a broke musician at the time, so I went for the free pizza and beer. After listening to Paul Pederson give one of his signature talks about how easy it is to build apps on MongoDB, and after meeting other employees, I realized this was a company I wanted to be a part of. I applied for an internship on the Sales Operations team in the Palo Alto office and started a month later. After my internship I was brought on as a full-time salesperson, and shortly thereafter I moved to the NYC office in Times Square!!
What do you like to do with your coworkers outside of the office?
Lately I’ve been playing tennis and going kickboxing with a few coworkers. I also have a close knit group of friends who I go to dinner parties and comedy clubs with. All we can talk about is how we’re saving the world, one Mongod at a time.
What’s one of the most rewarding experiences you’ve had working here so far?
The most rewarding part about working at MongoDB is the friendships I’ve made across all departments in the company. I work with a lot of very smart, honest, funny, and weird people.
In my first year at MongoDB, I helped close a really important deal that was very beneficial to the customer. Being able to provide that kind of value to my company and to the customer made me feel like a real asset to the company.
Tell us about the most interesting customer that you are working with.
All of my customers are working on very compelling projects with MongoDB but one company that resonates with me is Apervita. They created a marketplace for medical knowledge transfer across health institutions, with the goal of making a positive contribution to the world by improving health for everyone.
What does your perfect weekend look like?
My perfect weekend involves a little nature, a good book, good friends, good food, good music, and a little spontaneity. I enjoy cooking, so having people over for dinner and drinks is always nice. But really, any weekend when I get to play my melodica is a good weekend.
Name one secret skill you have, unrelated to work.
I compose and produce music for film and TV. My work has been in Bones, Gotham, and The Witches of East End. I released an album, About You, in 2013. It took a lot of work and was mostly a solo project. I’m definitely really proud of the final product.
What is the best vacation you’ve been on?
Going to Afghanistan, though not a typical “vacation”, was a life changing experience. I’m a first generation Afghan-American and have always wanted to visit my parents’ birthplace. The trip was beautiful, sad, nostalgic, humbling, and more It helped me realize that although we have many problems of our own here in the United States, we still have it far better than most of the world. I always knew that but when I visited Afghanistan, it really hit me that we as Americans can pursue our different opportunities and have the opportunity to accomplish almost anything we want.
Where did you go to school?
I went to UCLA and studied History (Pre-Law)
I’m from Yorba Linda, California. Also known as, “The Land of Gracious Living”. Fun fact - Richard Nixon was also born there.
Snapchat or Instagram?
Both. Snapchat for the trivial stuff and Instagram for what my future kids might see.
Go-To Seamless lunch order?
Sophie’s Salmon lunch with Moro rice and extra green sauce.
Radiohead and José González
Interested in a career at MongoDB? Check out our careers page.
MongoDB World 2015 Recap
Thank you to our 2000+ attendees and 30+ sponsors who attended MongoDB World 2015.
Unable to make the event? We’ve put together our favorite highlights from this year’s conference.
MongoDB World Video Recap
5 New Capabilities in 3.2 Release
We previewed new capabilities coming in MongoDB 3.2, including a new connector for BI and Visualization tools (such as Tableau), encryption at rest, support for dynamic lookups, document validation, and mongoScout, a new graphical interface for MongoDB.
Announced Our Support of Girls Who Code
We’re excited to announce our support of Girls Who Code - a national non-profit organization that works to educate, inspire, and equip high school girls with the skills and resources to pursue opportunities in technical fields.
2015 Innovation Award Winners Honored
The annual MongoDB Innovation Awards recognize organizations and individuals that are creating groundbreaking applications. These projects represent the best and most innovative work in the industry over the last year.
A full list of the winners and a brief description of their projects is outlined in our blog post.
Scalability Benchmarks Released
United Software Associates, Inc., an independent benchmarking and performance testing organization, released a benchmark report showing that MongoDB offers up to 13x better, more predictable scaling than niche NoSQL alternatives. More information can be found in the full report.
10,000,000 MongoDB Downloads
We’re thankful to our users for making us a part of their community. Because of your continued support, we’ve reached some new milestones:
Thanks to our great attendees and speakers we were trending on Twitter. Here are some of our favorite conference tweets:
Could be the most informative tech conference I've been to in years. Looking forward to being part of the revolution. #MongoDBWorld— Mike Oltman (@mikeoltman) June 2, 2015
Take a look at our Facebook album for highlights of our favorite MongoDB World moments.
Miss MongoDB World or want to relive your favorite talk? Watch the videos below: