This content originally appeared on Level Up Coding - Medium and was authored by Nitesh Chaudhry
Preparing for Data Engineering interviews is tricky. It doesn’t have to be.I’ll share my learnings from giving 15+ Jr. Data Engineer interviews in Mid-2021.
Data Engineering is one of the fastest growing jobs in 2021.The hard part, You do not know where to start — and you also cannot find many real interview questions & experiences Online.
Below I’ll be sharing with you the general interview process so that you can get an idea of what to expect :
The Data Engineering interview process:
This is the general process most companies follow :
- Screening round : Online Test (1–2 Coding problem : Leetcode Easy-Medium + 2–4 SQL (Advanced)).
- Round 2 :Face2Face interview : DS Algo + SQL Advanced + Spark Basics.
- Round 3 : DS Algo + SQL Advanced + Distributed system design OR Spark + Project discussion.
- Round 4 : Final round (Project Discussion / Design Patterns Knowledge + Spark + Scala/Python + Hive questions).
- Round 5 : HR Discussion.
Data Engineer VS Software Developer interviews :
As a data engineer , you don’t have to focus on HARD Leetcode questions. Also, coding the problems tend to be more like data engineering work than hardcore algo questions.
Save yourself the effort and only prepare for LC easy & medium.
Sounds like a cakewalk, right ? WRONG.
Comes in the dreaded Advanced SQL + Spark :
As a data engineer , writing complex SQL queries must be your strength. That means that not just INSERT , DELETE , WHERE statements , you need to know things like :
- Window functions.
- Subqueries
- Recursive Subqueries
- CTEs (Common table expressions)
- Using joins to answer questions.
Learn & Practice advanced SQL from : HackerRank(Do all the problems), Leetcode(Free ones are good enough). I’ll be posting SQL + Interview experiences soon. Stay tuned for those or follow me on Li/Medium.
Learn Spark and Hadoop Concepts :
Best resources :
Spark Coding Practice: The content on this is not very widely available. Only a few websites provide you with Spark interview questions. I’ll compile some questions in the coming days.
Data Engineer Coding Rounds look something like this :
- DS & Algo question : LC Easy / medium : often involving reading out data and processing using dictionaries.
- SQL Problems : 2–3 : Definitely expect to be quizzed upon window functions and working knowledge of advanced joins.
- Spark coding : Convert the above SQL code to spark/ word count type of problems. MUST KNOW : map, flatmap, reduce, reduceByKey, joining, collect_list/collect_set and wordcount type problems.
- Spark Concepts : Concepts related to general spark and optimization.
That’s all for now.
I’ll be adding more interview questions & experiences you can learn data engineering from , soon.
Please follow me here & on LinkedIn to not miss out on the content. I hope that would help you a lot.
Ultimate Guide to Data Engineer Interviews in 2021 was originally published in Level Up Coding on Medium, where people are continuing the conversation by highlighting and responding to this story.
This content originally appeared on Level Up Coding - Medium and was authored by Nitesh Chaudhry
Nitesh Chaudhry | Sciencx (2021-08-17T18:36:05+00:00) Ultimate Guide to Data Engineer Interviews in 2021. Retrieved from https://www.scien.cx/2021/08/17/ultimate-guide-to-data-engineer-interviews-in-2021/
Please log in to upload a file.
There are no updates yet.
Click the Upload button above to add an update.