This role is to build very large, scalable platforms using cutting edge data technologies, from the ground up and plan to leverage the most recent Big Data technologies, working closely with product engineering teams and data scientists. 

Responsibilities:

  • Design and implement data infrastructure and processing workflows required to support data science, machine learning, BI and reporting 
  • Build robust, efficient and reliable data pipelines consisting of diverse data sources
  • Design and develop real time streaming and batch processing pipeline solutions
  • Own the data expertise and data quality for the pipelines
  • Drive the collection of new data and refinement of existing data sources

Requirements:

  • A minimum of 2 years of experience in data engineering, ETL or work in SQL
  • Bachelor's degree in Computer Engineering or a related field
  • Proficiency in Python, Java, Scala, or any two.
  • Strong command of SQL
  • Proficient understanding of distributed computing principles
  • Experience with schema design and dimensional data modeling
  • Experience working with either a Map Reduce or a MPP system on any size/scale
  • Knowledge of NoSQL databases will be a plus
  • Knowledge of Talend 
  • Good understanding of Lambda / Kappa Architecture, along with its advantages and drawbacks.
  • Familiarity or experience in Cloudera/Hortonworks
  • Experience with multiple data technologies and concepts such as Airflow, Kafka, Hadoop, Hive, Spark, MapReduce, SQL, NoSQL, and Columnar databases.

Job Details

Functional Area:
Total Positions:
1 Post
Job Shift:
First Shift (Day)
Job Type:
Job Location:
Gender:
No Preference
Minimum Education:
Bachelors
Degree Title:
BS in Computer Science or related field
Career Level:
Experienced Professional
Experience:
2 Years - 4 Years
Apply Before:
Nov 07, 2020
Posting Date:
Oct 07, 2020

Addo Ai

Information Technology · 11-50 employees - Islamabad, Lahore

Addo Ai

What is your Competitive Advantage?

Get quick competitive analysis and professional insights about yourself
Talk to our expert team of counsellors to improve your CV!
Try Rozee Premium

Similar Job Titles

Data Engineer

Musharp, Lahore, Pakistan
Posted Apr 19, 2024

Data Engineer

Easy Consulting, Lahore, Pakistan
Posted Apr 17, 2024

Data Integration Engineer

Posted Apr 05, 2024

Data Modeler / Data Architect

MetaSol Pk, Rawalpindi, Pakistan
Posted Apr 23, 2024
View All
I found a job on Rozee!