World Business Lenders (WBL) specializes in providing flexible, short-term commercial loans secured by real estate to support small and medium-sized businesses across the United States, especially those encountering challenges with traditional financing. We are seeking a skilled Data Engineer for a contract/consultant role. This position requires availability Monday through Friday, from 9:00 AM to 6:00 PM Eastern Standard Time. Candidates must have excellent spoken and written English skills, and all applications should be submitted in English.
Key Responsibilities
- Enhance data pipelines through automation and implement quality checks to ensure accuracy, consistency, and reliability across the data processing workflow. This reduces manual efforts and minimizes errors.
- Lead the migration of legacy systems to new platforms by conducting thorough analyses, ensuring seamless data transfer, and integrating systems to improve performance without disrupting ongoing operations.
- Develop and maintain ETL/ELT processes and data workflows using Python, particularly within notebook environments.
- Manage data warehouses used by reporting and business teams, ensuring data models and SQL queries are optimized.
- Utilize Git/GitHub for version control in collaborative development settings.
- Apply best practices in data engineering, including pipeline orchestration, dependency management, and data quality monitoring.
- For migration-focused tasks: perform schema mapping, data reconciliation, validation, integrity checks, issue resolution, backfills, historical data handling, and cutover planning.
- For automation-focused tasks: build and maintain automated data pipelines with scheduling, orchestration, failure handling, and ensure workflow reliability and monitoring.
Required Qualifications
- Bachelor’s degree in Computer Science, Engineering, Information Systems, or a related field is preferred; however, equivalent hands-on experience is highly valued.
- 4 to 7 years of practical experience as a Data Engineer, emphasizing applied skills over theoretical knowledge.
- Strong proficiency in SQL, including data modeling for data warehouses.
- Advanced Python skills, especially for building and maintaining data workflows.
- Experience working with cloud-based data platforms and environments.
- Proven expertise in developing and maintaining ETL/ELT processes.
- Familiarity with Git/GitHub for version control.
- Solid understanding of data engineering best practices such as pipeline orchestration, data validation, and monitoring.
- Hands-on experience with data migration, including schema mapping, data reconciliation, quality checks, and cutover execution.
- Experience building automated data pipelines with scheduling, failure handling, and workflow monitoring.
Preferred Qualifications and Benefits
- Experience with Microsoft Fabric or the broader Microsoft Azure data ecosystem.
- Familiarity with orchestration tools like Apache Airflow, Azure Data Factory, or Fabric pipelines.
- Knowledge of data quality and observability practices, including validation frameworks, alerting, SLAs, and monitoring.
- Skills in optimizing data environment performance through query tuning, partitioning, indexing, and cost optimization.
- Experience with modern data formats and large-scale processing such as Parquet, Delta, and incremental processing patterns.
- Integration experience with external systems via REST APIs, including authentication, retries, and error handling.
- Exposure to CI/CD practices for data workflows, including Git-based deployments, pull request workflows, and environment promotion.
Key Soft Skills
- Clear communication skills to explain data issues, tradeoffs, and outcomes to both technical and business stakeholders.
- Strong ownership and accountability for end-to-end pipeline management, data quality, and results.
- Problem-solving mindset with the ability to debug complex data issues and work independently in ambiguous situations.
- Collaborative approach to working across engineering, analytics, and business teams.
- Adaptability to evolving environments, including migrations, changing requirements, and new tools.
Work Requirements
- Availability to work Monday through Friday, 9:00 AM to 6:00 PM Eastern Time.
- Stable internet connection and a professional remote working setup.
- Submission of resume in English is mandatory for consideration.
Benefits
- Competitive compensation paid in USD.
- Paid time off (PTO).
- Fully remote work environment.
If you meet these qualifications and are interested in contributing to a dynamic team supporting businesses nationwide, please submit your CV in English to apply.