Posted May 15, 2023 161 views
Role Summary
As a Big Data engineer you will be responsible for data-related implementation tasks that include provisioning of data storage services, ingesting, streaming and batch data, transforming data, implementing security requirements, implementing data retention policies, identifying performance bottlenecks, and accessing external data. You will develop and implement data Lake solutions for company-wide applications and manage large sets of structured, semi structured and unstructured data. You will work in a modern cloud-based data lakehousing environment alongside a team of diverse, intense, and interesting co-workers.
Job Responsibilities
- Performing analysis of large data stores and derive insights using Big Data querying
- Design and develop code, scripts, and data pipelines that leverage structured, semi-structured and unstructured data
- Should be able to manage Data ingestion pipelines and stream processing
- Perform computations using Azure functions
- Responsible for the documentation, design, development of Hadoop applications
- Perform day to day tasks to accuracy with minimal directions while meeting deadlines
Qualification & Skillset
- Bachelor/master’s degree in computer science
- At least 2-5 years of relevant working experience with Cloud Computation
- Hands-on experience on Azure/AWS
- Experience working with Apache Spark, Apache Hive, Apache HBase
- Hands-on experience on:
- Azure/AWS Architectures
- SQL, Scala, Node.js, JS, Java
- Python with Pandas, NumPy, TensorFlow
- ETL
Preferred Requirement
- Implementing Lambda Architecture with stream processing and batch processing
- Implement security standards and practices in Architecture of Cloud Solution
- Training/Certification on Data Lake HDFS
- Training/Certification on Azure Data Lake Gen 2
- Training/Certification on Data Bricks
- Experience with Azure/AWS Data Explorer and Kusto query language would be plus.
- Experience with Azure/AWS Data Factory would be plus.
Skills
Job Details
Diversity Inclusion:
AMS - Power & Industrial Engineering Private Limited
AMS-Power undertakes Fabrication & Construction Works for major projects in Power Generation Plants, Process and Petro-Chemical, and related industries. Our services extend through the Mechanical, Electrical and Automation works, including High & Low Speed Rotary Machines, Plant Piping, Pressure Vessels & Parts and Structural Steel Works, Pre-calibration and Field Tests of the Plant Equipment and various systems. We also provide back-up supervision and skilled assistance for Commissioning as well as for Maintenance Works of the Plants. AMS IoT is based in Pakistan and Canada. We are a group of young and passionate engineers and professional obsessive with latest technology trends with the mission to help bring change in people lives and their interaction with technology. Our aim is to provide our customers with solutions that will enable a highly effective, secure and flexible provisioning and management of their devices and assets. We are really passionate about latest trends in the field of IoT and our mission is to help people regarding the related projects. We focus on complete solution development from ideas to working prototypes.
What is your Competitive Advantage?
Similar Job Titles
Ali Aziz
CEO
Shopistan
Usman Habib
Recruitment & Training Executive
ACS Synergy (Pvt) Ltd.
Zohaib Ali
Marketing Manager
Digital Online Devices
Sehrish Azhar
Motivational Speaker & Blogger
Living Upbeat
Ayesha Shaukat
Social Media Marketing Manager
Ivoke
Muzammil Baig
Digital Marketing Manager
IT Services Group
Mona Sharif
Senior Team Lead
Konext PVT. LTD
Aqib Irshad
Head of HR, Training & OD
FINCA
Babar Ahmed Khan
Territory Sales Manager
Engro Foods
Zubair Anjum
Business Excellence Specialist
Nestle Pakistan
