Data Engineer

Job Summary:

We are seeking a Data Engineer to support the Operations & Maintenance (O&M) of a cloud-based data platform built on Databricks and AWS. The role focuses on non-production data pipeline development, log analysis, technical investigation, documentation, and backend operational support. The engineer will work with sample data and test environments, collaborating closely with the core engineering team.

Key Responsibilities:

  • Develop and maintain ETL/ELT data pipelines in development and test environments
  • Implement data transformations and validation logic based on defined specifications
  • Analyze logs to identify failures, anomalies, and performance issues
  • Provide technical findings, code deliverables, and documentation to the core team
  • Support testing, schema changes, data onboarding, and regression validation
  • Maintain operational runbooks, documentation, and change logs
  • Collaborate with distributed engineering teams and participate in regular sync meetings

Skills and Qualifications:

  • Educational Background:
    • Bachelor’s degree in computer science, Engineering, Information Systems, or a related field (or equivalent practical experience)
  • Experience:
    • 5+ years of experience in data engineering or ETL/ELT development.
    • Hands-on experience building and supporting data pipelines.
  • Technical & Analytical Skills:
    • Strong proficiency in SQL and Python
    • Experience with at least one cloud platform (AWS, Azure, or GCP)
    • Solid troubleshooting and log analysis skills
    • Familiarity with workflow orchestration or data pipeline tools
    • Strong attention to detail and ability to follow defined processes
  • Preferred:
    • Experience with Databricks, Apache Spark, or Delta Lake
    • Exposure to CI/CD or development workflow tools
    • Experience supporting data integration or onboarding projects
    • Experience working with distribution or offshore teams

Employment Status:

  • Full-time
  • After the onboarding period, the role will transition to offshore work, operating remotely while collaborating with the domestic team.

Job Location:

  • Offshore role with an initial onsite onboarding period in Japan (approximately 4–6 months), followed by remote/offshore work.

Salary & Benefits:

  • Competitive salary, commensurate with experience. Benefits package provided in accordance with company policy.

Interested candidates are requested to apply through this email address hr@egeneration.co within May 5 ,2026.

Please mention “Data Engineer” in the subject line of your email.