Role Summary

As a Big Data engineer you will be responsible for data-related implementation tasks that include provisioning of data storage services, ingesting, streaming and batch data, transforming data, implementing security requirements, implementing data retention policies, identifying performance bottlenecks, and accessing external data. You will develop and implement data Lake solutions for company-wide applications and manage large sets of structured, semi structured and unstructured data. You will work in a modern cloud-based data lakehousing environment alongside a team of diverse, intense, and interesting co-workers.

Job Responsibilities

  • Performing analysis of large data stores and derive insights using Big Data querying
  • Design and develop code, scripts, and data pipelines that leverage structured, semi-structured and unstructured data
  • Should be able to manage Data ingestion pipelines and stream processing
  • Perform computations using Azure functions
  • Responsible for the documentation, design, development of Hadoop applications
  • Perform day to day tasks to accuracy with minimal directions while meeting deadlines

Qualification & Skillset

  • Bachelor/master’s degree in computer science
  • At least 2-5 years of relevant working experience with Cloud Computation
  • Hands-on experience on Azure/AWS
  • Experience working with Apache Spark, Apache Hive, Apache HBase
  • Hands-on experience on:
  • Azure/AWS Architectures
  • SQL, Scala, Node.js, JS, Java
  • Python with Pandas, NumPy, TensorFlow
  • ETL

Preferred Requirement

  • Implementing Lambda Architecture with stream processing and batch processing
  • Implement security standards and practices in Architecture of Cloud Solution
  • Training/Certification on Data Lake HDFS
  • Training/Certification on Azure Data Lake Gen 2
  • Training/Certification on Data Bricks
  • Experience with Azure/AWS Data Explorer and Kusto query language would be plus.
  • Experience with Azure/AWS Data Factory would be plus.

نوکری کی تفصیلات

صنعت:
کل عہدے:
1 اشاعت
نوکری کی شفٹ:
پہلا پہر
نوکری کی قسم:
محکمہ:
Information Technology
نوکری کا مقام:
جنس:
کوئی ترجیح نہیں
کم از کم تعلیم:
بیچلرز
کیریئر کی سطح:
تجربہ کار پیشہ ور
کم از کم تجربہ:
2 سال
اس سے پہلے درخواست دیجیۓ:
جون ۱٦, ۲۰۲۳
تاریخِ اِشاعت:
مئی ۱۵, ۲۰۲۳
Diversity Inclusion:
We value diversity of our employees. All qualified applicants will receive fair consideration without regard to genders or socio-economic backgrounds.

AMS - Power & Industrial Engineering Private Limited

انجینرنگ · 51-100 ملازمین - لاہور

AMS-Power undertakes Fabrication & Construction Works for major projects in Power Generation Plants, Process and Petro-Chemical, and related industries. Our services extend through the Mechanical, Electrical and Automation works, including High & Low Speed Rotary Machines, Plant Piping, Pressure Vessels & Parts and Structural Steel Works, Pre-calibration and Field Tests of the Plant Equipment and various systems. We also provide back-up supervision and skilled assistance for Commissioning as well as for Maintenance Works of the Plants. AMS IoT is based in Pakistan and Canada. We are a group of young and passionate engineers and professional obsessive with latest technology trends with the mission to help bring change in people lives and their interaction with technology. Our aim is to provide our customers with solutions that will enable a highly effective, secure and flexible provisioning and management of their devices and assets. We are really passionate about latest trends in the field of IoT and our mission is to help people regarding the related projects. We focus on complete solution development from ideas to working prototypes.

آپ کو کس حوالے سے برتری حاصل ہے؟

اپنے بارے میں ہماری پیشہ ورانہ رائے اور تقابلی جائزہ حاصل کیجیۓ
اپنی سی وی کو موءثر بنانے کیلئے ہماری ماہرانہ مشاورتی ٹیم سے رابطہ کریں
روزی پریمیئم کو آزمائیں

ملتی جلتی نوکریاں

Data Engineer

Horizon Technologies, کراچی, پاکستان
مارچ ۰۹, ۲۰۲۴ شائع ہوئی

Data Integration Engineer

Professional Employers (Pvt) Ltd, اسلام آباد, پاکستان
مارچ ۱۳, ۲۰۲۴ شائع ہوئی

Data Processor

Research and Development Solutions, اسلام آباد, پاکستان
مارچ ۲٦, ۲۰۲۴ شائع ہوئی

Data Analyst

BlueEX, کراچی, پاکستان
مارچ ۱۹, ۲۰۲۴ شائع ہوئی
تمام دیکھیں
I found a job on Rozee!