Job Summary:

We are seeking an experienced Data Engineer to join our team. The Data Engineer will be responsible for extracting, transforming, and loading data from various sources into data lakes and data warehouses using AWS Glue, while ensuring the efficiency and alignment of data systems with business goals. The ideal candidate should have strong analytical skills, familiarity with programming languages such as Python and R, SQL, and experience in building ETL/ELT pipelines.

Duties and Responsibilities:

• Extract data from multiple sources (Cloud/On-Prem) and ingest it into a data lake (AWS S3) through different AWS Services or APIs or connection protocols such as ODBC, JDBC, etc.

• Cleanse, transform, and maintain data quality in data lakes and data warehouses.

• Build and maintain data lakes, data warehouses, and data marts on AWS as per the business requirements.

• Build data catalogs on AWS Glue.

• Build data pipelines and workflows to ingest raw data and transform/clean data into data lakes and data warehouses respectively using AWS Glue.

• Conduct complex data analysis and report on results.

• Explore ways to enhance data quality and reliability.

• Evaluate business needs and objectives.

• Interpret trends and patterns.

Required Skills and Abilities:

• Previous experience as a data engineer or in a similar role.

• Technical expertise with data models, data scraping, data cleansing, and segmentation techniques.

• Knowledge and understanding of Amazon Web Services such as AWS Glue (Crawler, Job, Database, Workflow), AWS S3, AWS App flow, AWS Athena, AWS Lambda, etc.

• Knowledge and experience in connecting with multiple data sources using different AWS Services or APIs or connection protocols such as ODBC, JDBC, etc.

• Knowledge and experience of Python and PySpark.

• Knowledge and experience in SQL and SparkSQL queries.

• Knowledge of MS Excel and ability to build various views using pivot tables.

• Great numerical, statistical, and analytical skills.

• Data engineering certification will be a plus.

• Knowledge and experience in Beautiful Soup/Selenium/Scrappy will be a plus.

• Knowledge and experience on Terraform will be a plus.

Education and Experience:

• Bachelor’s degree in Computer Science or equivalent required.

• 2+ years of progressive experience in working on AWS services.

Job Timings:

• 6:00 PM to 3:00 AM (Mon to Fri)

Job Location:

Baloch Colony, Karachi

Language Requirement:

• Fluent in spoken English

نوکری کی تفصیلات

کل عہدے:
1 اشاعت
نوکری کی شفٹ:
دوپہر
نوکری کی قسم:
نوکری کا مقام:
جنس:
کوئی ترجیح نہیں
کم از کم تعلیم:
بیچلرز
کیریئر کی سطح:
تجربہ کار پیشہ ور
کم از کم تجربہ:
2 سال
اس سے پہلے درخواست دیجیۓ:
اپریل ۱۲, ۲۰۲۳
تاریخِ اِشاعت:
مارچ ۱۱, ۲۰۲۳

Work Environment

Supervisor’s gender:
Male
Percentage of female coworkers:
1-9%

Horizon Technologies

انفارمیشن ٹیکنالوجی · 101-200 ملازمین - کراچی

Horizon Technologies is an established IT services company having years of experience providing high-quality and cost-effective web development, IT Support and Surveillance solutions. Our expertise lie in Custom Web, mobile & Software Development, Surveillance (CCTV), Time Attendance and Access Control, IT consultancy & infrastructure, BPO & contact center work along with recruitment & IT Maintenance services. We are an one stop IT & office automation service provider where all your IT & business augmentation requirements are met under one umbrella of Horizon Technologies.

آپ کو کس حوالے سے برتری حاصل ہے؟

اپنے بارے میں ہماری پیشہ ورانہ رائے اور تقابلی جائزہ حاصل کیجیۓ
اپنی سی وی کو موءثر بنانے کیلئے ہماری ماہرانہ مشاورتی ٹیم سے رابطہ کریں
روزی پریمیئم کو آزمائیں

ملتی جلتی نوکریاں

Machine Learning Engineer

AirCod Technologies, لاہور, پاکستان
اپریل ۲۴, ۲۰۲۴ شائع ہوئی
I found a job on Rozee!