Cypexsoft is looking for a Data Engineer to work with our Web Scraping team. In carrying out the objective of this position, the successful candidate will be committed to our values by working to bless the customer, bless the employee and bless the shareholder.
Core Responsibilities:
· Create and improve processes, tools, workflows, and resilient data architecture to scrape web content.
· Manage data accuracy and quality.
· Identify and rectify any issues with breaks as well as scale scrapers as needed.
Knowledge, Skills, and Abilities:
· Web scraping experience (Scrappy, Selenium, or similar technologies)
· Solid understanding of web technologies (HTML, JavaScript, CSS, XPath, JSON, etc)
· Experience with ETL and creating data pipelines.
· Basic Linux and Git experience
· Python.
· C#
· AWS/AWS Batch
· Familiarity with data processing tools (pandas, regex, SQL)
Traits:
· Attention to detail
· Self-starter
· Curious
· Customer Oriented
· Organized
· Problem-solving