How Many Data Scientists are There and is There a Shortage?

Recently saw this article on KDnuggets (check them out if you aren’t already subscribed) and thought it was worth using to update some of my slides about the current talent shortage for Data Science & Analytics (DSA) skills.

This shortage is definitely acute here in the Philippines.

The 2011 McKinsey report on Big Data said that “The United States alone faces a shortage of 140,000 to 190,000 people with analytical expertise and 1.5 million managers and analysts with the skills to understand and make decisions based on the analysis of Big Data.”


In 2014, KDnuggets examined “How Many Data Scientists are out there?” and came with an estimate of 50-100,000, and did not see much evidence of a massive shortage then. In 2014, we found only about 1,000 job ads for “Data Scientist” on indeed.com. 


Now that we reached 2018, KDnuggets has examined how accurate were those predictions and tried to answer three questions:

1. Is there a shortage of Data Scientists now?
2. How many “Data Scientists” are there , both in name and in function ?
3. What are the future prospects for Data Scientists?

 

The answer to the first question is a resounding YES!
  • LinkedIn Workforce Report for US (August 2018) says “Demand for data scientists is off the charts  … data science skills shortages are present in almost every large U.S. city. Nationally, we have a shortage of 151,717 people with data science skills.
  • Note that LinkedIn reports shortages for people with “Data Science Skills”, not necessarily people with “Data Scientist” title.
  • We can estimate the demand for “Data Scientists” from two popular job search sites – indeed and Glassdoor.
  • Search on indeed.com for “data scientist” (in quotes) in USA finds only about 4,800 jobs. However, in a search for data scientist without quotes, about 30,000 jobs.
US is the largest but not the only market for Data Scientists. We can also see strong demand for Data Scientists elsewhere:
  • UK: 1,100 jobs
  • Germany: 900 jobs
  • France: 718 jobs
  • Philippines: 599 jobs  — You Read That Right! More than India.
  • India: 500 jobs
Glassdoor search for “Data Scientist” finds about 26,000 jobs in USA (same results if quotes are removed).
19989649_1487790424576061_5172679695012103031_n-2
Question 2: How Many “Data Scientists” are There, Both in Name and in Function?

Google search defines a data scientist as “a person employed to analyze and interpret complex digital data, such as the usage statistics of a website, especially in order to assist a business in its decision-making.”

There are many people in the industry and academia who do this work without having the formal title of a data scientist, since Data Science is an interdisciplinary field at the intersection of Statistics, Computer Science, Machine Learning, and Business. We can estimate the current population of Data Scientist by examining popular data science platforms.

Kaggle (now part of Google) is a platform for data science  and analytics competitions. It claims to be the world’s largest community of active data scientists.

While not all Data Scientists take part in Kaggle competitions or have a Kaggle account, and not all Kagglersdo work of data science, it is reasonable to assume a large overlap.

On Sep 19, 2018 Kaggle says they surpassed 2 million members in August 2018.

Since not all Kaggle members are active, Kaggle membership is probably a global upper bound for people engaged in data science.

KDnuggets is now reaching over 500,000 unique visitors per month.

KDnuggets now has about 240,000 subscribers/followers over Twitter, LinkedIn, Facebook, RSS, and email.

On LinkedIn, there are many groups dedicated to data science, and although the engagement in those groups has been falling, we can use their membership as a rough estimate. Here are three of the largest groups

  • Big Data and Analytics  –  339,000
  • Data Science Central – 278,000
  • Data Mining, Statistics, Big Data, Data Visualization, and Data Science – 170,000

Searching LinkedIn for “data scientist”  (quotes are important) we find over 100,000 people with that actual title.  So if globally between 200,000 and 1,000,000 people are doing some Data Science related work, then a majority of them does not have a Data Scientist title.

Screen Shot 2018-09-23 at 10.20.35 AM.png

We can also estimate the by looking at activities related to languages and platforms most connected to Data Science: R, Python, Machine Learning libraries, Spark, and Jupyter.

  • Apache Spark Meetups had 225K members recently and growing every month.
  • Intel Capital estimated that there 1 million R programmers worldwide.
  • Based on the public data on python.orgwebsite, there have been around 2.75 million downloads.
  • Jupyterproject has around 3 million users at present.

These numbers can give us a rough upper limit on the number of data analysts/data scientists around the world.

So yeah, to answer the question, there are at least 200,000

Screen Shot 2018-09-23 at 10.25.53 AM

Question 3: What are the Future Prospects for Data Scientists?

The near-term future for Data Scientists looks bright.

LinkedIn 2017 emerging jobs report claims that machine learning engineers working today has increased by 9.8 times as compared to 5 years ago.

Machine Learning Engineers, Data Scientists, and Big Data Engineers rank among the top emerging jobs on LinkedIn. Data scientist roles have grown over 650% since 2012.

Job growth in the next decade is expected to outstrip growth during the previous decade, creating 11.5M jobs in the Data Science/Analytics area by 2026, according to the U.S. Bureau of Labor Statistics.

IBM recently claimed that by 2020 the number of Data Science and Analytics job listings is projected to grow by nearly 364,000 listings to approximately 2,720,000. No matter what the true number of data professionals out there currently, their number is likely to grow in the near future.

So What are the Future Prospects for Data Scientists in the Philippines?

APEC_500K

Based on Data from APEC (Asia Pacific Economic Cooperation), there is both a huge demand here in the Philippines as well as in the jobs where the Philippines already has an outsourcing pipeline too.

SO what does that mean for you?

You Need to Know Exactly What You Need to Hire/Learn how to have/be a Data Scientist?

And it’s not easy.

Eco_Picture1

To assemble a team of DSA Practitioners, you need to make sure you have the right combination of talent.

Here is how I would start.

Eco_Picture2

Make sure you have people who can do these functions.

And if you want to learn how to be one of these key players, I’m betting you need to know where to start.

So wether you want to be a DSA enabled professional or you want to assemble a DSA team, here is a better understanding of how that looks.

Eco_Picture3

Yeah I know. It is a lot!

So, what now?

Connect with DMAIPH and we will get you started!

42309040_572124856542481_6576071598531411968_n

DMAIPH – Decision-making, Analytics & Intelligence Philppines

Over the past few years businesses in the Philippines have invested heavily in big data, analytics and data science, but still have not achieved the expected outcomes of data-driven companies.

Based on our learnings from the 100’s of Filipino businesses and 10,000s of Filipinos who have taken part in DMAIPH Analytics trainings all across the country, we have crafted a proven,  non-technical approach to upskilling your team in analytics.

In 2019, we will be launching two new training programs: (1) Our DMAIPH Applied Analytics Master Class series for executives, leaders and decision-makers and our (2) DMAIPH Applied Analytics Boot Camp series for practicing analysts.

We will feature case studies of real Filipino run business, exercises based on actual analytics challenges being solved by Filipino analysts, and provide you with a copy of my book, Putting Your Data to Work, an analytics guidebook for the Filipino professional

Connect with us via our marketing partner, http://www.sonicanalytics.com to learn about upcoming analytics trainings and events. 

Advertisements

The Hardest Part of Training Analysts? Fitting the Content to fit the Clock

I get asked a lot about what is the hardest part of teaching people to use analytics and training analysts.

The biggest challenge is really trying to fit content into a timeline.

Analytics is not something you can box up an mass train on.

That’s why so many analytics training approaches fail.

Trainers are forced to either spend too much time on a few parts of analytics or spend too little time on a lot of important concepts.

It is really more art than science when it comes to using analytics because every data source is unique, every analyst has their own individual background, and every business question has a distinct answer.

Take a recent talk I gave at an event for HR professionals covering topics related to Compensation and Benefits.

I had 60 minutes to really introduce an audience of over 200 to analytics knowing they are generally unfamiliar with analytics terminology and mostly just use excel for basic reporting and analysis.

Before getting to a case study full of analytics jargon, I spent a few minutes given an extremely high level of some of the key concepts they need to now to fully related to the case study.

Here is a key slide:

Screen Shot 2018-09-22 at 9.12.42 AM

I then went into a 3 minute cruise at 30,000 feet over the landscape that is analytics.

Did my best to make sure the audience was able at the very least attach a definition and an example to each of the concepts.

Later on in the presentation, I wanted to leave the audience with some guidance on how to solve CompenBen questions with analytics, so I walked them through this slide:

Screen Shot 2018-09-22 at 9.17.47 AM

Based on lessons from my book, Putting Your Data to Work, I covered six steps for them to take back to work the next day.

If you are interested in owning your own copy of the book, please check out this link https://www.sonicanalytics.com/analytics-book

One of the reasons I have been so successful in my 7 years here in the Philippines, is that I am blessed with the ability to take some fairly complex and often intimidating concepts and turn them into tangible, layman friendly learnings.

If you are interested in learning more about how to attend a future public training on analytics or book me for a tailored in-house training designed specifically for your business, please contact me here or via my marketing partner, www.sonicanalytics.com 

42309040_572124856542481_6576071598531411968_n.jpg

DMAIPH – Decision-making, Analytics & Intelligence Philppines

Over the past few years businesses in the Philippines have invested heavily in big data, analytics and data science, but still have not achieved the expected outcomes of data-driven companies.

Based on our learnings from the 100’s of Filipino businesses and 10,000s of Filipinos who have taken part in DMAIPH Analytics trainings all across the country, we have crafted a proven,  non-technical approach to upskilling your team in analytics.

In 2019, we will be launching two new training programs: (1) Our DMAIPH Applied Analytics Master Class series for executives, leaders and decision-makers and our (2) DMAIPH Applied Analytics Boot Camp series for practicing analysts.

We will feature case studies of real Filipino run business, exercises based on actual analytics challenges being solved by Filipino analysts, and provide you with a copy of my book, Putting Your Data to Work, an analytics guidebook for the Filipino professional

Connect with us via our marketing partner, http://www.sonicanalytics.com to learn about upcoming analytics trainings and events. 

 

The Key Ingredients of Impactful Analytics Trainings – Plan Your 2019 Analytics Trainings Now

When I first started conducting analytics trainings in the Philippines back in 2012, I was pretty much the only game in town.

There were very few companies offering any kind of big data management training, the terms data scientist and data storytelling were not part of the lexicon and 90+% of companies operating in the Philippines were pretty much just using MS Excel for their analysis and reporting.

You want to know what has changed in the past six years?

Not much, except that there are now at least a dozen companies offering analytics themed trainings, courses and certifications.

Sure they all sound like they are going to teach you cutting edge techniques to finally get a handle on all your big data, but in the end I keep hearing the same thing… the training I went to didn’t really give me anything I can use.

The training was too abstract, to high level, to dependent on one type of software, etc are the constant feedback I here from executives and managers who have been spending on outside training for their teams.

That plus it’s gotten quite expensive.

Analytics Executive Masterclasses, Big Data Boot Camps, Master’s Degrees in Data Science… they cost a lot when most companies are having to tighten their training budgets.

So the risk of wasting time and money on something that is not really going to move the needle is becoming a problem with all these analytics trainings.

With all the efforts of so many people to “help” the Filipino people level up their organizations analytics talent, you’d think by now we should be really competent when it comes to the use of advanced analytics techniques.

Unfortunately, that is just not been the case. There are definitely some pockets here and there were some world class analytics is happening, but for the most part we have to accept the reality that we have a long way to go to be on the level of Singapore, Viet Nam or China when it comes to analytics.

The one thing that has no changed at all since I started all this back in 2012, is the fact that most companies are still relying mostly on MS Excel for 90+% of their analytics.

Everyone wanted to run before they could walk. They through money at high priced trainings with cool sounding names promising to supercharge your business.

I think it’s time to face the reality, that while a few of our companies can do the big stuff, they are also sucking up all the available talent. It’s really, really hard to build a solid analytics team in your business without breaking the bank.

Unless you do what I do.

Get back to the basics.

Make sure everyone is able to really optimize the use of Excel.

Build a solid foundation in analytics that starts with aligning the data gathers, data managers, analysis builders and data presenters.

Make sure your dats is clean, easy to access, fresh, and shared.

Focus on what’s most important to the business.

Then you add on.

UNADJUSTEDNONRAW_thumb_1dd4

 

So when you go out to find an analytics training for your team, look for some basic ingredients.

The 4 Key Content Ingredients to Analytics Training are:

  1. Data Sourcing
  2. Data Management
  3. Data Analysis
  4. Data Presentation

If its missing one or more of these ingredients, the training is going to leave you with a sense that something is missing. You will likely struggle to implement what you learned in class.

The 3 Key Trainer Ingredients to Analytics Training are:

  1. Knowledge
  2. Engagement
  3. Hands on Practice

 

Over the next couple of weeks I’ll be blogging about each of these ingredients, so that we you and your team sit down to plan your analytics upskill strategy for 2019 you’ve got all the angles covered.

https://www.facebook.com/pg/dmaiph/photos/?tab=album&album_id=1316439141834859

 

 

NOW HIRING! DMAIPH is looking for office staff/OJT for our Ortigas office

DMAIPH is looking for office staff/OJT for our Ortigas office.

We are looking for candidates who are able to handle a variety of office roles, provide marketing and training support, assist with HR and Operations functions and/or asset with Finance and Accounting functions.

Preferably currently enrolled in or graduates of Business Management, Business Administration, Accountancy, Business Economics, Management Engineering, Hotel, Restaurant and Institutional Management, Mathematics, and Management Information Systems are likely candidates.

Requirements include:

  • Analytical mind, problem solving, well organized and can be trusted to pay attention to detail.
  • Good communication skills, ability to effectively communicate with senior management.
  • Conversational English spoken and written.
  • At least beginning skill level with MS Excel.

DMAIPH is the leading analytics training and consulting company in the Philippines.

Duties May Include:

  • Assisting with Payroll and making Payments
  • Delivering documents to government entities and notary/legal offices
  • Assisting with processing and filing HR paperwork
  • Attend job fairs. conferences and special events to represent DMAIPH
  • Assisting with office operations including coordinating with building management
  • Conduct social media marketing campaigns as directed by the Marketing Manager
  • Assisting with finance and accounting functions as needed by Finance Manager
  • Provide basic reporting using MS Excel

To find out more about this paid internship and training program, please checkout our blog http://www.dmaiph.com or our training partner page http://www.sonicanalytics.com

Include your resume and put DMAIPH Intern/Trainee in the subject line.

Job Types: Internship, New-Grad

Job Type: Full-time

 

4.6

Apply via indeed.com

 

https://www.indeed.com.ph/viewjob?t=office+staff+ojt&jk=6f15c7896bf366d3&_ga=2.32287163.422507143.1535732709-1274046262.1535404486

Or please send your updated resume to meyerdan@dmaiph.com for consideration.

Application Questions

You are requested to answer the following questions in your submission:
  • How many years of Office Administration experience do you have?
  • What is the highest level of education you have completed?
  • Are you in Pasig?
  • Do you speak English?