Primary Job Responsibilities: We are looking for an architect to join our Big Data and Machine Learning platform team for our sales/crm enrichment product and help build next generation platforms. This highly motivated individual needs to be a self-starter, hands-on with code, highly technical and not afraid to get into existing code. This is great opportunity for the right individual.
Build world class big data & machine learning platform to handle high-volume real-time data ingestion and analytics with prime focus at scalability, performance, stability and superior quality.
Research, develop, optimize and innovate frameworks and related components for enterprise scale data processing, analysis and computations.
Collaborate with cross-functional team to design and architect enterprise solutions.
Own the end-to-end development life cycle with high quality of enterprise solution/code you develop and evangelize the test driven development - (tests, code coverage, etc.)
Develop Data Adapters/processors to ingest/process large volume of Unstructured, Semistructured and Structured data from various data sources and types.
Develop workflow/pipelines for a considerable amount of machine operations with a large dataset.
Develop validation frameworks, proactive monitoring solutions to detect failures in platform and take appropriate remedies.
Follow a customer centric approach, and ensure the solutions developed actually meet the customer requirements.
Collaborate with the product development team to make sure the clean and plugable approach is being used.
8+ years of experience in requirements analysis, design, development and testing of distributed, enterprise-class applications/platforms with particular attention to scalability and high performance, with demonstrable experience
Exceptional hands on server side programming experience (Python preferred)
Experience with Hadoop, Spark and big data technologies
Hands on with ZooKeeper, Kafka, Celery, Storm.
Experience with Rules Engines, Workflow systems, Messaging and Queuing systems.
Experience in design, architecting and delivering enterprise software solutions at scale.
Experience in capitalizing enterprise data.
Experience with NoSQL databases : Mongo, HBase
Experience with RDBMS, O-R mapping, and application of distributed caching technologies
Experience in implementing high volume web applications or large transactional client-server systems in Python or other languages is a huge plus
API and REST based Web services development
Agile development practices is a plus
Sales and CRM domain knowledge is a plus
Web service (REST)
AWS services (EC2, S3, etc)
Containers ( Docker, Kubernetes etc )
AWS ( preferred ), Google Cloud Platform or Azure experience.