Being a Technical Account Manager with MongoDB's Cloud Team often means getting an opportunity to meet great new people and reconnect with familiar faces. I was recently invited by the Google Dev Group in Washington DC to come and discuss MongoDB at DevFest DC 2016.
While the world is fairly knowledgeable of the explosive technology scenes in Silicon Valley and New York City, the DC area should be praised for drawing some of the best talent in the industry, evidenced by the caliber of the speakers and the attendees.
The Capital One HQ in McClean, VA was host to two days of developer and technology information sharing. Our friend Chida Sadayappan helped ensure that everyone was able to feed their minds, their bellies, and hopefully their bags with some neat swag.
Full houses were the norm in the auditoriums as a lineup of speakers from Google, Capital One, The Washington Post and, of course, MongoDB presented on a range of subjects.
Listening to experts from the DC area like Jessica Bell, Mark Brown and Lougenia Bailey discuss the more esoteric subjects of diversity in technology and imposter syndrome was tremendous. One of the encouraging aspects of events like this is the move beyond live demos and code samples to explore the human aspects of being a contributor in a team of developers.
As the day progressed, there were opportunities to eat snacks, meet people, and work in code labs. Technologies like Kubernetes took front and center in code labs as attendees looked for ways to best leverage the Google Compute Engine for their apps.
Later in the day, I got an opportunity to do my Jumpstart MongoDB: What You Need to Know talk for a full room of developers and technology enthusiasts. I did my best in about 40 minutes to give attendees a brief introduction to how they can begin using MongoDB quickly. The room stayed full until the very end as I finished my talk with a gift —each member of the audience received a $100 credit to use MongoDB Atlas, our fully hosted database as a service. I took a few questions which mostly centered around subjects like sharding and migrating from relational databases.
The day wrapped up for me and it was time to head back on the train for NYC. It was really a pleasure to get an opportunity to meet some new friends, run into some old ones, and share a little bit of the love we have for MongoDB Atlas.
We're always happy to meet current and future MongoDB users at various events across the globe. To get a full list of where we'll be next, check out our events page:
About the author - Jay Gordon
Jay is a Technical Account Manager with MongoDB and is available via our chat to discuss MongoDB Cloud Products at https://cloud.mongodb.com
Announcing the MongoDB 3.4 Bug Hunt
We are pleased to announce the availability of MongoDB 3.4.0-rc1, our first 3.4 release candidate. This release comes packed with new features and improvements; see the development release notes for more details. We’ve put the release through rigorous correctness, performance, and usability testing, and now it’s time to extend that rigor to as many application environments as we can. We are inviting you to help us ensure the quality of this release, and we want to give away some great prizes to those who do. Download 3.4.0-rc1 now The Bug Hunt The Bug Hunt rewards community members who help test and improve MongoDB releases during the release candidate period. We always welcome the community’s involvement in testing our release candidates and this year we’ll be providing you with resources for testing with our toolkit. New features include: Sort by collation SERVER-1920 Case-insensitive indices SERVER-90 Wire protocol compression for intra-cluster communication SERVER-3018 Faceted search SERVER-23654 Read-only views SERVER-142 Don’t Hunt Alone! Join or Organize a MongoDB User Group This year we are bringing the Bug Hunt from an online competition to an in-person, collaborative experience. We are encouraging our network of 100 MongoDB User Groups to meet over the next 8 weeks to hunt for bugs together. Find a MongoDB User Group in your town or city to join the hunt. The New York City, Dublin, and Sydney MUGs have already run very engaged Bug Hunts in anticipation of this wider event. A non-exhaustive list of MUGs that are planning an upcoming hunt include: Tel Aviv MUG - Wed, Oct 26 San Diego MUG - Thu, Oct 27 Philadelphia MUG - Wed, Nov 9 Austin MUG - Thu, Nov 10 Resources for MUG Organizers To help you organize an effective Bug Hunt, we offer several helpful resources. They include instructional material for testing, some sample code, and sticker packs for all participating MUG organizers: Instructional Video for Testing Presentation from the MongoDB Release Manager, Ramón Fernández, at NYC MongoDB User Group that you can use as a starting point for your MUG Github Repo with example code for new features and links to other resources Exclusive sticker pack for all MUG organizers running a Bug Hunt Prizes & Judging Your Tickets There will be one overall winner of the Bug Hunt, as well as honorable mentions. The winners will be judged on three criteria: user impact, severity, and prevalence. All valid submissions will be recognized on social media through the @mongodb Twitter handle. The grand prize winner for the Bug Hunt will be announced on the MongoDB blog and mongodb-user forum on the date of the Server Release. This year, we’re adding a prize for the most engaged user community. The organizers of the MUG with the highest participation will win a prize (see below) and bragging rights to the title “Most Engaged MongoDB User Group.” The community’s efforts have consistently been instrumental in improving the quality of MongoDB releases. You can view past winners for the 2.6 , 3.0 , and 3.2 Bug Hunts. First Prize $1,500 Amazon Gift Card $100 MongoDB Atlas credit Complimentary admission to MongoDB World 2017 or MongoDB Europe 2017 2 Professional Certification exam vouchers Recognition on our blog and in social media Honorable Mentions $500 Amazon Gift Card $100 MongoDB Atlas credit Complimentary admission to MongoDB World 2017 or MongoDB Europe 2017 1 Professional Certification exam voucher Recognition on our blog and in social media Most Engaged MUG 1 box of assorted MongoDB branded swag Recognition on our blog and in social media How to Get Started In order to make the most of our upcoming Bug Hunt meetup, it would be helpful to have the following items preinstalled in the environment you are going to use: MongoDB https://www.mongodb.com/download-center#community Download and install the latest available development release for your platform (currently 3.4.0-rc1). You can find installation instructions here . At the start of each testing session, you should check the link above to make sure you’re using the latest version. Always test with the most current version. A dataset https://www.citibikenyc.com/system-data CityBike, the New York City public bicycle system, makes available ride information datasets. Download one of the Citi Bike trip history datasets and use mongoimport to import this into your MongoDB installation. mtools https://github.com/rueckstiess/mtools While not required, mtools can help to quickly start up MongoDB deployments to test different configurations. The mtools scripts are written in Python and can be installed using pip install mtools . The mtools wiki has some O/S specific install tips and there is also an ubuntu-mtools Docker image available. What to Do Next After you have configured your computer for testing, do the following: Join the MongoDB Advocacy Hub Sign in to the MongoDB Advocacy Hub to take take guided challenges for testing MongoDB 3.4 (currently 3.4.0-rc1) and its drivers. By using the Advocacy Hub, you’ll earn points, and we’ll use it to keep track of your progress during the hunt. Find a MUG & Attend the Meetup Once you’re ready to hunt, it’s time to find a place to gather with other hunters. Your local MUG meetup is a natural option. MUGs that have committed to hosting upcoming Bug Hunts include: Tel Aviv MUG - Wed, Oct 26 San Diego MUG - Thu, Oct 27 Philadelphia MUG - Wed, Nov 9 Austin MUG - Thu, Nov 10 If you don’t see yours there, reach out to your local MUG organizers to see if they’re able to hold one. Deploy in Your Test Environment It is best to test software in a real environment with realistic data volumes and load. Help us see how the latest MongoDB works with your environment, code, and data so that others can build and run applications on MongoDB 3.4 successfully. Track the Bug Hunt To stay abreast of progress in the hunt, use the MongoDB 3.4 Bug Hunt Dashboard to view all reported issues. It will show you what others have discovered already so you don’t accidently file an already-reported bug. Test out New Database Features Check out the development release notes to see all the new features coming to MongoDB 3.4, and to find inspiration on where to hunt for bugs! The Github repository we’ve provided is a good starting point for writing test programs. Test the Drivers Too! The drivers for MongoDB have also been upgraded to take advantage of the new database features. They are meant to be backward compatible and so, should work with existing code. Test with your code with your current drivers against MongoDB 3.4, and then with the 3.4 drivers against MongoDB 3.4. Test the Documentation MongoDB 3.4 introduces several new features, including faceted search, read-only views, and language-sensitive collations. It improves on other features such as additions to the aggregation pipeline and sharded cluster behavior. Testing the documentation for readability, clarity, and completeness is as much a goal of the bug hunt as is testing the server code. Errors or omissions found here also warrant tickets to be filed for review and resolution. The same requirements for filing a server or driver ticket apply here too. Monitor Everything The latest version of the server should offer overall performance improvements, but certain edge cases can often cause performance degradations. Monitoring the performance of your cluster during testing of your workload is vital to flushing out and documenting issues. You can find more information on how to monitor your MongoDB instances from the command line in the user documentation . Although MongoDB Cloud Manager is mentioned here, we don’t recommend using it for the Bug Hunt as it adds an unnecessary layer of complexity to this project. Question the Details Little things matter; no issue is too small. Clarifying confusing log messages or new command parameter names is important to making a great final product. When in doubt, check with the MongoDB User Group first. Log a Ticket Once you find an issue, create a report in Jira-Core Server project . See the documentation for a guide to submitting well written bug reports or discuss in the MongoDB User Group . If you need a refresher, watch the Bug Hunt video presentation prepared by Ramón Fernández to guide the MongoDB 3.4 Bug Hunts. You may find the presentation here helpful if you have difficulty seeing the details on the slides in the video or if you want something to keep open as you work. If you need assistance, you can ask for help in the MongoDB User Group . Good luck hunting! Legal In connection with your participation in this program you agree to comply with all applicable local and national laws. You must not disrupt or compromise any data that is not your own. MongoDB reserves the right to discontinue this program or change or modify its terms at any time. The ultimate decision over an award -- whether to give one and in what amount -- is entirely within MongoDB’s discretion. You may not participate in this program if you are a resident or individual located within a country appearing on any U.S. sanctions lists or if you are on the U.S. Department of the Treasury’s Specially Designated Nationals List. You alone are responsible for paying any taxes on any reward you receive. Vulnerabilities obtained by exploiting MongoDB users or instances on the Internet are not eligible for a bounty and will result in immediate disqualification from the program.
How DataSwitch And MongoDB Atlas Can Help Modernize Your Legacy Workloads
Data modernization is here to stay, and DataSwitch and MongoDB are leading the way forward. Research strongly indicates that the future of the Database Management System (DBMS) market is in the cloud, and the ideal way to shift from an outdated, legacy DBMS to a modern, cloud-friendly data warehouse is through data modernization. There are a few key factors driving this shift. Increasingly, companies need to store and manage unstructured data in a cloud-enabled system, as opposed to a legacy DBMS which is only designed for structured data. Moreover, the amount of data generated by a business is increasing at a rate of 55% to 65% every year and the majority of it is unstructured. A modernized database that can improve data quality and availability provides tremendous benefits in performance, scalability, and cost optimization. It also provides a foundation for improving business value through informed decision-making. Additionally, cloud-enabled databases support greater agility so you can upgrade current applications and build new ones faster to meet customer demand. Gartner predicts that by 2022, 75% of all databases will be on the cloud – either by direct deployment or through data migration and modernization. But research shows that over 40% of migration projects fail. This is due to challenges such as: Inadequate knowledge of legacy applications and their data design Complexity of code and design from different legacy applications Lack of automation tools for transforming from legacy data processing to cloud-friendly data and processes It is essential to harness a strategic approach and choose the right partner for your data modernization journey. We’re here to help you do just that. Why MongoDB? MongoDB is built for modern application developers and for the cloud era. As a general purpose, document-based, distributed database, it facilitates high productivity and can handle huge volumes of data. The document database stores data in JSON-like documents and is built on a scale-out architecture that is optimal for any kind of developer who builds scalable applications through agile methodologies. Ultimately, MongoDB fosters business agility, scalability and innovation. Key MongoDB advantages include: Rich JSON Documents Powerful query language Multi-cloud data distribution Security of sensitive data Quick storage and retrieval of data Capacity for huge volumes of data and traffic Design supports greater developer productivity Extremely reliable for mission-critical workloads Architected for optimal performance and efficiency Key advantages of MongoDB Atlas , MongoDB’s hosted database as a service, include: Multi-cloud data distribution Secure for sensitive data Designed for developer productivity Reliable for mission critical workloads Built for optimal performance Managed for operational efficiency To be clear, JSON documents are the most productive way to work with data as they support nested objects and arrays as values. They also support schemas that are flexible and dynamic. MongoDB’s powerful query language enables sorting and filtering of any field, regardless of how nested it is in a document. Moreover, it provides support for aggregations as well as modern use cases including graph search, geo-based search and text search. Queries are in JSON and are easy to compose. MongoDB provides support for joins in queries. MongoDB supports two types of relationships with the ability to reference and embed. It has all the power of a relational database and much, much more. Companies of all sizes can use MongoDB as it successfully operates on a large and mature platform ecosystem. Developers enjoy a great user experience with the ability to provision MongoDB Atlas clusters and commence coding instantly. A global community of developers and consultants makes it easy to get the help you need, if and when you need it. In addition, MongoDB supports all major languages and provides enterprise-grade support. Why DataSwitch as a partner for MongoDB? Automated schema re-design, data migration & code conversion DataSwitch is a trusted partner for cost-effective, accelerated solutions for digital data transformation, migration and modernization through a modern database platform. Our no-code and low-code solutions along with cloud data expertise and unique, automated schema generation accelerates time to market. We provide end-to-end data, schema and process migration with automated replatforming and refactoring, thereby delivering: 50% faster time to market 60% reduction in total cost of delivery Assured quality with built-in best practices, guidelines and accuracy Data modernization: How “DataSwitch Migrate” helps you migrate from RDBMS to MongoDB DataSwitch Migrate (“DS Migrate”) is a no-code and low-code toolkit that leverages advanced automation to provide intuitive, predictive and self-serviceable schema redesign from a traditional RDBMS model to MongoDB’s Document Model with built-in best practices. Based on data volume, performance, and criticality, DS Migrate automatically recommends the appropriate ETTL (Extract, Transfer, Transform & Load) data migration process. DataSwitch delivers data engineering solutions and transformations in half the timeframe of the existing typical data modernization solutions. Consider these key areas: Schema redesign – construct a new framework for data management. DS Migrate provides automated data migration and transformation based on your redesigned schema, as well as no-touch code conversion from legacy data scripts to MongoDB Atlas APIs. Users can simply drag and drop the schema for redesign and the platform converts it to a document-based JSON structure by applying MongoDB modeling best practices. The platform then automatically migrates data to the new, re-designed JSON structure. It also converts the legacy database script for MongoDB. This automated, user-friendly data migration is faster than anything you’ve ever seen. Here’s a look at how the schema designer works. Refactoring – change the data structure to match the new schema. DS Migrate handles this through auto code generation for migrating the data. This is far beyond a mere lift and shift. DataSwitch takes care of refactoring and replatforming (moving from the legacy platform to MongoDB) automatically. It is a game-changing unique capability to perform all these tasks within a single platform. Security – mask and tokenize data while moving the data from on-premise to the cloud. As the data is moving to a potentially public cloud, you must keep it secure. DataSwitch’s tool has the capability to configure and apply security measures automatically while migrating the data. Data Quality – ensure that data is clean, complete, trustworthy, consistent. DataSwitch allows you to configure your own quality rules and automatically apply them during data migration. In summary: first, the DataSwitch tool automatically extracts the data from an existing database, like Oracle. It then exports the data and stores it locally before zipping and transferring it to the cloud. Next, DataSwitch transforms the data by altering the data structure to match the re-designed schema, and applying data security measures during the transform step. Lastly, DS Migrate loads the data and processes it into MongoDB in its entirety. Process Conversion Process conversion, where scripts and process logic are migrated from legacy DBMS to a modern DBMS, is made easier thanks to a high degree of automation. Minimal coding and manual intervention are required and the journey is accelerated. It involves: DML – Data Manipulation Language CRUD – typical application functionality (Create, Read, Update & Delete) Converting to the equivalent of MongoDB Atlas API Degree of automation DataSwitch provides during Migration Schema Migration Activities DS Automation Capabilities Application Data Usage Analysis 70% 3NF to NoSQL Schema Recommendation 60% Schema Re-Design Self Services 50% Predictive Data Mapping 60% Process Migration Activities DS Automation Capabilities CRUD based SQL conversion (Oracle, MySQL, SQLServer, Teradata, DB2) to MongoDB API 70% Data Migration Activities DS Automation Capabilities Migration Script Creation 90% Historical Data Migration 90% 2 Catch Load 90% DataSwitch Legacy Modernization as a Service (LMaas): Our consulting expertise combined with the DS Migrate tool allows us to harness the power of the cloud for data transformation of RDBMS legacy data systems to MongoDB. Our solution delivers legacy transformation in half the time frame through pay-per-usage. Key strengths include: ● Data Architecture Consulting ● Data Modernization Assessment and Migration Strategy ● Specialized Modernization Services DS Migrate Architecture Diagram Contact us to learn more.