。该工作已被公司管理人员暂停申请，不再接受简历投递

Software Developer / Spark / ML Engineer

Rapidev Pvt Ltd

Apply Now

PKR. 45,000 - 70,000/Month

Job Requirements

Detailed knowledge of Spark deployments
Detailed knowledge of Spark tuning and best practice
Experience with moving code from a notebook into structured code for spark submit
Experience developing Spark jobs/processes
Experience with spark, hadoop integration
Strong experience working in Spark for data and parallel processing centric projects
ETL work to automate creation of data marts
Understanding of Data modelling and schema design
Experience with AWS or Azure (preferred) development
Knowledge of AWS Lambda or Azure Functions (serverless compute)
Experience with CI/CD pipelines and unit test
Experience with SQL, especially in context of Spark and Hive
Experience with performance tuning of Spark
Experience with Spark ML and Spark Pipelines
Experience in using a Unix style development stack
Experience using Source Code and Version Control systems like SVN, Git, etc
Knowledge of SQL/NoSQL databases
Must have Spark MLlib experience, prior Data Science and Hadoop experience is a big bonus

Qualification required

Minimum education required: Bachelors in Computer Science/Data Science/Software Engineering
Experience should be between 6 months and 1 year or must have done 2-3 complete projects in Spark