I recently spoke on an interesting panel at Red Hat Summit entitled "Big Data and Traditional Databases," along with representatives from the MySQL, PostgreSQL and Sybase/SAP communities. At one point, the moderator asked, "What features are your adding to your roadmap to make your database ready for Big Data."
I was stumped. Unlike the relational databases, MongoDB was born as a Big Data database.
This isn't a secret. Whether measured by how IT professionals talk about MongoDB on Twitter, Big Data-related job postings or other means, MongoDB is always rated one of the industry's top-two Big Data technologies.
Which isn't to suggest that 10gen and the MongoDB community are sitting still. We've been adding Big Data-relevant functionality like full-text indexing and continue to improve the already great performance, among other things. But the essential ability to handle a wide variety of data types and sources, in real time, at significant scale? That comes ready out of the box.
10gen has never intended for MongoDB to be solely a "Big Data database." That would be too narrow. MongoDB is a general-purpose database designed for and comfortable managing a broad and growing array of applications. Some will argue that all applications will be Big Data applications going forward. Perhaps. Regardless, MongoDB has it covered.
This Week in MongoDB June 10-16
Here's what's going on in the MongoDB community this week: Learn More Database shakedown: Five reasons why there’s a revolution Protect your data and reduce operational risk with MongoDB Backup Service - Now in Limited Release NoSQL Vs. Hadoop IBM and 10gen are collaborating to fashion a new standard for mobile computing within enterprise networks Considerations for rolling out a NoSQL strategy in the enterprise ComputerWeekly: IBM and 10gen collaborate on database standard for enterprise mobile New MongoDB User Group in Krakow, Poland Free Online Class, MongoDB for Developers, Begins June 17 Fill out the MongoDB Developer Survey Upcoming MongoDB Days June 16: MongoDB Israel June 21: MongoDB New York City July 2: An Evening with MongoDB Sao Paulo Upcoming Webinars: June 11: German Webinar: Was is neu in MongoDB 2.4 June 12: How Partners Can Benefit from our New Program (EMEA) June 13: General Technical Overview of MongoDB for Dev Teams June 18: MongoDB Migration Patterns - How Customers Start Using MongoDB June 20: Replication and Replica Sets Online Education: M101P: MongoDB for Developers (Python) begins June 17 (next Monday) M102: MongoDB for DBAs begins July 17 -- registration now open M101J: MongoDB for Java Developers begins July 29 -- registration now open User Groups and Events this Week June 11: Matt Asay will be giving his talk "NoSQL is the New Normal" at the Boston MUG June 12: Matt Asay will discuss Big Data & Traditional Databases at RedHat Summit & JBoss World June 12: Stockholm MUG June 12-14: Christian Kvalheim will present at the Norwegian Developers Conference Have something you'd like to share? Let us know
Australian Start-Up Ynomia Is Building an IoT Platform to Transform the Construction Industry and its Hostile Environments
The trillion dollar construction industry has not yet experienced the same revolution in technology you might have expected. Low levels of R&D and difficult working environments have led to a lack of innovation and fundamental improvements have been slow. But one Australian start-up is changing that by building an Internet of Things (IoT) platform to harness construction and jobsite data in real time. “Productivity in construction is down there with hunting and fishing as one of the least productive industries per capita in the entire world. It's a space that's ripe for people to come in and really help,” explains Rob Postill , CTO at Ynomia. Ynomia has already been closely involved with many prestigious construction projects, including the residential N06 development in London’s famous 2012 Olympic Village. It was also integral to the construction of the Victoria University Tower in Australia. Link to Podcast Episode Here “These projects involve massive outflow of money: think about glass facades on modern buildings, which can represent 20-30 percent of the overall project cost. They are largely produced in China and can take 12 weeks to get here,” says Postill. “Meanwhile, the plasterer, the plumber, the electrician are all waiting for those glass facades to be put on so it is safe for them to work. If you get it wrong, you can go in the deep red very quickly.” To tackle these longstanding challenges, Ynomia aims to address the lack of connectivity, transparency and data management on construction sites, which has traditionally resulted in the inefficient use of critical personnel, equipment and materials; compressed timelines; and unpredictable cash flows. To optimize productivity, Ynomia offers a simple end-to-end technology solution that creates a Connected Jobsite. Helping teams manage materials, tools, and people across the worksite in real time. IOT in a Hostile Environment The deployment of technology in construction is often fraught with risk. As a result, construction sites are still largely run on paper, such as blueprints, diagrams and models as well as the more traditional invoices and filing. At the same time, there is a constant need to track progress and monitor massive volumes of information across the entire supply chain. Engineers, builders, electricians, plumbers, and all the other associated professionals need to know what they need to do, where they need to be, and when they need to start. “The environment is hostile to technology like GPS, computers, and mobile phone reception because you have a lot of Faraday cages and lots of water and dust,” explains Postill. “You can't have somebody wandering around a construction site with a laptop; it'll get trashed pretty quickly." Enter MongoDB Atlas “On a site, you might be talking about materials, then if you add to that plant & equipment, or bins, or tools etc, you're rapidly getting into thousands and thousands of tags, talking all the time, every day,” said Postill. That means thousands of tags now send millions of readings on Ynomia building sites around the world. All these IoT data packets must be stored efficiently and accurately so Ynomia can reassemble the history of what has happened and track tagged inventory, personnel, and vehicles around the site. Many of the tag events are also safety critical so accuracy is a vital component and packets can't be missed. To address these needs Ynomia was looking for a database that was scalable, flexible, resilient and could easily handle a wide variety of fast-changing sensor data captured from multiple devices. The final component Postill was looking for in a database layer was freedom: a database that didn't lock them into a single cloud platform as they were still in the early stages of assessing cloud partners. The Commonwealth Scientific and Industrial Research Organisation , which Postill had worked with in the past, suggested MongoDB , a general purpose, document-based database built for modern applications. “The most important factor was that the database is event-driven, which I knew would be difficult in the traditional relational model. We deal with millions of tag readings a day, which is a massive wall of data,” said Postill. A Cloud Database Ynomia is using MongoDB Atlas , the global cloud database service, now hosted on Microsoft Azure. Atlas offers best-in-class automation and proven practices that combine availability, scalability, and compliance with the most demanding data security and privacy standards. “When we started we didn't know enough about the problem and we didn't want to be constrained," explained Postill. "MongoDB Atlas gives us a cloud environment that moves with us. It allows us to understand what is happening and make changes to the architecture as we go." Postill says this combination of flexibility and management tooling also allows his developers to focus on business value not undifferentiated code. One example Postill gave was cluster administration: "Cluster administration for a start-up like us is wasted work," he said. "We’re not solving the customer's problem. We're not moving anything on. We’re focusing on the wrong thing. For us to be able to just make that problem go away is huge. Why wouldn’t you?" Atlas also gives Ynomia the option to spin out new clusters seamlessly anywhere in the world. This allows customers to keep data local to their construction site, improving latency and helping solve for regional data regulations. Real Time Analytics The company has also deployed MongoDB Charts, which takes this live data and automatically provides a real time view. Charts is the fastest and easiest way to visualize event data directly from MongoDB in order to act instantly and decisively based on the real-time insights generated by event-driven architecture. It allows Ynomia to share dashboards so all the right people can see what they need to and can collaborate accordingly. “Charts enables us to quickly visualize information without having to build more expensive tools, both internally and externally, to examine our data,” comments Postill. “As a startup, we go through this journey of: what are we doing and how are we doing it? There's a lot of stuff we are finding out along the way on how we slice and re-slice our data using Charts.” A Platform for Future Growth Ynomia is targeting a huge market and is set for ambitious growth in the coming years. How the platform, and its underlying architecture, can continue to scale and evolve will be crucial to enabling that business growth. “We do anything we can to keep things simple,” concluded Postill. “We pick technology partners that save us from spending time we shouldn't spend so we can solve real problems. We pick technologies that roll with the punches and that's MongoDB.” When we started we didn't know enough about the problem and we didn't want to be constrained," explained Postill. "MongoDB Atlas gives us a cloud environment that moves with us. It allows us to understand what is happening and make changes to the architecture as we go. Rob Postill, CTO, Ynomia