The quanitity of the world's available data doubles every 4 years. Simultaniously, the performance of Artificial Intelligence algorythms is growing exponentially. As a result, there are 4x more positions for Data Scientists than qualified applicants to fill them. Assuming Moore's law continues to hold this trend will continue to acceletate. With the projected market value of Artificial Intelligence based applications set to $60 billion in 2025 & 1 trillion by 2030, the ability to hire and enable skilled Data Scientists is becoming more and more difficult, just as it becomes more and more important. Today, 43% of firms rank lack of analytical skills as a top 3 challenge.
Most data scientists, and data science teams, have problematic practices for collaboration. The current default workflows have grown organically and are extremely inefficient. Without proper tooling, solving these issues inhouse is time consuming and labor intensive; however, improved collaboration workflows yield large gains in productivity and reduces painful frictions. There’s a single principle you should be aiming for: make everything you do easily reproducible, both for yourself and others.