Top 13 data engineer and data architect certifications
Data and big data analytics are the lifeblood of any successful business. Getting the technology right can be challenging but building the right team with the right skills to undertake big data initiatives can be even harder.
Successfully deploying big data initiatives requires more than data scientists and data analysts. It requires data architects who design the "blueprint" for your enterprise data management framework, and it requires data engineers who can build that framework and the data pipelines to bring in, process, and create business value out of data.
[ Get ahead with the top certs for big data, project management, agile, data science, IT management and the cloud, as well as the top-paying certs and emerging certifications for today’s hottest skills. | Get weekly career tips by signing up for our CIO Leader newsletter. ]
Data architects typically have years of experience in data design, data management and data storage, while data engineers typically have skills around Hadoop, Spark, and the open source big data ecosystem, complemented with programming skills in Java, Scala, or Python.
If you're looking for a way to get an edge, certification is a great option. Certifications measure your knowledge and skills against industry- and vendor-specific benchmarks to prove to employers that you have the right skillset.
Below is our guide to the most sought after data engineer and data architect certifications to help you decide which cert is right for you.
If you would like to submit a big data certification to this directory, please email us.
The AWS Certified Big Data – Specialty certification validates technical skills and experience in designing and implementing AWS services to derive value from data. It is intended to validate the ability to:
Organization: Amazon Web Services
Price: $300 registration fee for exam
How to prepare: Eligible candidates should have the AWS Certified Cloud Practitioner or current Associate-level certification (AWS Certified Solutions Architect – Associate, AWS Certified Developer – Associate, or AWS Certified SysOps Administrator – Associate). Candidates should also have five years of hands-on experience in data analytics, a background in defining and architecting AWS Big Data services, and experience designing a scalable, cost-effective architecture to process data.
The CCA Spark and Hadoop Developer credential certifies core skills for ingesting, transforming and processing data using Apache Spark and core Cloudera enterprise tools. It requires passing the remote-proctored CCA Spark and Hadoop Developer Exam (CCA175), which consists of eight to 12 performance-based, hands-on tasks on a Cloudera Enterprise cluster. Each question requires the candidate to solve a particular scenario. Some cases may require a tool such as Impala or Hive, others may require coding. Candidates have 120 minutes to complete the exam.
Organization: Cloudera
Price: $295
How to prepare: There are no prerequisites required, but Cloudera says the exam follows the same objectives as the Cloudera Developer Training for Spark and Hadoop course, making it excellent preparation for the exam.
The CCP: Data Engineer credential certifies the ability to perform core competencies required to ingest, transform, store and analyze data in Cloudera's CDH environment. It requires passing the remote-proctored CCP: Data Engineer Exam (DE575), a hands-on, practical exam in which each user is given five to eight customer problems each with a unique, large data set, a CDH cluster and four hours. For each problem, the candidate must implement a technical solution with a high degree of precision that meets all the requirements.
Organization: Cloudera
Price: $400
How to prepare: Cloudera suggests professionals seeking this certification have hands-on experience in the field and take the Cloudera Developer Training for Spark and Hadoop course.
The vendor-neutral DASCA Associate Big Data Engineer certification demonstrates knowledge of popular big data platforms, including Hadoop and Spark, and knowledge of proprietary and open source developer tools (including HBase, Hive, Pig, and HiveQL). It requires passing a 75-question online exam. There are three candidacy tracks that vary based on level of education and work experience.
Organization: Data Science Council of America
Price: $520 for the exam
How to prepare: Registration for the program includes a full DASCA Certification Preparation Kit.
DASCA's Senior Big Data Engineer certification is a step up from the associate credential, intended for experienced professionals. It requires passing an 85-question online exam. There are four candidacy tracks that vary based on level of education and work experience.
Organization: Data Science Council of America
Price: $575 for the exam
How to prepare: Registration for the program includes a full DASCA Certification Preparation Kit.
The Google Professional Data Engineer credential certifies the ability to design, build, operationalize, secure, and monitor data processing systems. It requires passing a two-hour, multiple-choice and multiple-select certification exam. The exam has no prerequisites but must be taken in-person at a Google testing center location. The exam is available in English, Japanese, Spanish, and Portuguese.
Organization: Google
Price: $200 registration fee
How to prepare: Google offers an exam guide and on-demand or instructor-led training.
The HDP Apache Spark Developer certification is intended to validate an individual's understanding of Spark Core and Spark SQL applications in Scala or Python. The exam consists of a series of tasks that must be performed successfully on a live cluster.
Organization: Hortonworks
Price: $250 for exam
How to prepare: Hortonworks offers courses on its website with options that include live training, self-paced e-learning or a blended experience.
The HDP Certified Developer Big Data Hadoop certification validates a developer's proficiency in Pig, Hive, Sqoop and Flume. The exam consists of a series of data ingestion, data transformation and data analysis tasks that must be performed on an HDP 2.4 cluster.
Organization: Hortonworks
Price: $250 for exam
How to prepare: Hortonworks offers courses on its website with options that include live training, self-paced e-learning or a blended experience.
The Hortonworks Certified Associate (HCA) certification is a foundational credential that validates that an individual understands the technologies and can recognize the business use cases for Hortonworks Data Platform (HDP) frameworks. Candidates must pass a multiple-choice exam that consists of questions from the following five categories:
Organization: Hortonworks
Price: $100 for exam
How to prepare: Hortonworks offers courses on its website with options that include live training, self-paced e-learning or a blended experience.
Designed for data architects, the IBM Certified Data Architect – Big Data certification requires passing a test that consists of five sections containing a total of 55 multiple-choice questions. It demonstrates a data architect can work closely with customers and solutions architects to translate customers' business requirements into a big data solution.
Organization: IBM Professional Certification Program
Price: $200
How to prepare: IBM recommends a series of seven multi-day courses on SPSS Modeler to InfoSphere BigInsights to prepare for the test.
The IBM Certified Data Engineer – Big Data certification is intended for big data engineers, who work directly with data architects and hands-on developers to convert an architect's big data vision into reality. Data engineers understand how to apply technologies to solve big data problems and have the ability to build large-scale data processing systems for the enterprise. They develop, maintain, test and evaluate big data solutions within organizations, providing architects with input on needed hardware and software. This certification requires passing a test that consists of five sections containing a total of 53 multiple-choice questions.
Organization: IBM Professional Certification Program
Price: $200
How to prepare: IBM recommends a series of nine multi-day courses to prepare for the test.
The Oracle Business Intelligence Foundation Suite 11g Certified Implementation Specialist certification demonstrates skills in implementing solutions based on Oracle Business Intelligence Suite. It covers installing Oracle Business Intelligence Enterprise Edition (OBIEE), building the BI Server metadata repository, building BI dashboards, constructing ad hoc queries, defining security settings, and configuring and managing cache files. The certification is intended for intermediate-level implementation team members with up-to-date training and field experience. Earning the certification requires passing the Oracle Business Intelligence (OBI) Foundation Suite 11g Essentials exam (1Z0-591). It's a multiple choice exam that consists of 75 questions. Candidates have 120 minutes to complete the exam.
Organization: Oracle University
Price: $245
How to prepare: Oracle recommends candidates complete one of two training courses: Oracle Business Intelligence Enterprise Edition Plus Implementation Boot Camp (only available to partners), or Oracle Business Intelligence Foundation 11g Implementation Specialist.
The SAS Certified Big Data Professional certification program is for individuals seeking to build on their basic programming knowledge by learning how to gather and analyze big data in SAS. The program focuses on SAS programming skills; accessing, transforming and manipulating data; improving data quality for reporting and analytics; fundamentals of statistics and analytics; working with Hadoop, Hive, Pig and SAS; and exploring and visualizing data. The program includes two certification exams, both of which the participants must pass.
Organization: SAS Academy for Data Science
Price: $9,000 for classroom (Cary, NC); $299/month or $2,250/year for self-paced e-learning.
How to prepare: At least six months of programming experience in SAS or another programming language is required to enroll.
More on IT certifications:
This story, "Top 13 data engineer and data architect certifications" was originally published by CIO.