Sourcing for Big Data Engineers

Created: May 09, 2016 10:37AM PDT      Updated: May 16, 2016 02:46PM PDT
“2016 will be exciting for Big Data – Big Data will go even more mainstream. 2016 will also be the year when companies without solid big data strategies will start to fall behind. In terms of technology, I see particular growth in real-time data analytics and increasing use of machine-learning algorithms.”

Bernard Marr, Big Data Guru and Best Selling Author  

Back in 2011, Fortune Magazine predicted that Data Science would be the next new gig in tech, and with each passing year their prediction holds more and more true. We've certainly seen this trend increase with the needs of our customers, especially in the last year. Unfortunately, recruiting for Big Data Engineers proves more difficult than sourcing for your average software developer. Fortunately, TalentBin can help!

Before we begin sourcing for these engineers, it's important to know exactly what we're looking for. So what is Data Science, anyways?

Data Scientists make sense of all of the digital information a company collects every day, ranging from anything between sales reports and customer tweets. To take this a step further, Data Engineers develop solutions to make sense of all of this information. It's a job that requires knowledge of scripting languages, but also databases and other technologies.

What else should we keep in mind before we begin our search?

  • Specific skill sets needed for data engineers varies from company to company. Make sure you have a clear idea from your hiring manager or client of the specific skills this job will require. 
  • Job titles also vary between companies. Focus on doing a skill-based search. (You can include the role as a nice to have if necessary). (See Figure 1)

Figure 1: Making the role a "nice to have" will help broaden your search results. 
  • Good Big Data engineers are already employed. This is a role that requires passive recruiting, and taking the time to build these relationships will pay off in the end. 
  • Big Data roles require extensive knowledge of Hadoop technologies and platforms. Make sure you are familiar with these tools (see Figure 2).  

Commonly Used Big Data Technologies

(Click on any of the tabs below to learn more.)

  • Java
  • Linux
  • C++
  • PHP
  • Ruby
  • Python
  • R
  • NoSQL
  • MongoDB
  • Redis
  • Hadoop
  • MapReduce
  • Hive
  • MongoDB
  • Cassandra
Figure 2: Familiarize yourself with these terms before beginning your search.
Searching for Big Data Engineers

Creating a search for a Big Data Engineer is similar to creating any other search in TalentBin. First, you want to use an advanced search. You also want to be sure to search by keywords instead of job titles. This will allow you to find candidates who have the skills you are looking for, and ensures that you won't miss out on any unicorns who call themselves anything besides a Big Data Engineer. 

To help you even more, we've created some explode tags in TalentBin to help you in your search. An explode tag is a search term with an automatic set of "or terms" that help you make sure you're catching every qualified candidate in your search. See Figure 3 for the full list of Big Data-specific explode tags. 

We recommend starting with the Big Data and Data Frameworks explode tags, and narrowing your search from there as needed. Of course, if you need help setting up a search, we're here to help! Feel free to contact us at the information on the right and we can help you get started. 

Big Data Explode Tags

(Click on any of the tabs below to learn more.)

  • Palantir
  • Ayasdi
  • Quid
  • Enigma
  • Digital Reasoning
  • Orbital Insight
  • Guavus
  • Datameer
  • Interana
  • Apigee
  • Cask
  • Keen IO
  • Typesafe
  • Concurrent
  • Hadoop
  • Hive
  • Map-reduce
  • Mapreduce
  • Nutch
  • Pig
  • ZooKeeper
  • CipherCloud
  • Tanium
  • Illumio
  • Code42
  • DataGravity
  • Vectra
  • Sqrrl
  • BlueTalon
  • MapReduce
  • Yarn
  • Hadoop Hops
  • Hadoop Mapreduce
  • Spark
  • Mesos
  • Tez
  • Flink
  • CDAP
Figure 3: Big Data-specific explode tags that will help you with your search.


Contacting Big Data Engineers

Much like other software developers, Big Data Engineers prefer to be contacted by email. Using this as a contact tool instead of InMail, phone, or other contact methods will definitely help you quickly engage with the candidate.

The second step to successfully engage with the candidate is to personalize your messaging. We talk about this a lot at TalentBin because it works! Tweaking your subject line to fit the candidate and referencing specific candidate skills and experience in the first paragraph will lead to a much higher response rate. Take this a step further by explaining the highlights and responsibilities of the role without including a job description. 


See Also:

Q​uestions? Thoughts? Either c​ontact your Product Specialist, reach out to us at anytime, or leave a comment below!
Comment Form is loading comments...

Contact Us