Projects Overview
  • Date Posted: 03-Jul-2026
  • Job Type: Full Time
  • Job Exp: 3 Year
  • Salary: ₹15000 / MONTH
  • Location: PUNE
  • Education Req: Bachelor's degree
Job description

Job Details

Work Type: Full-time
Location: Pune, Maharashtra

Full Job Description

Role Overview:

We are seeking a Software Development Engineer in Test (SDET) with expertise in automation testing for ETL processes and data pipelines on Google Cloud Platform (GCP). The ideal candidate will have strong programming skills, experience with Apache Spark, SQL, and cloud-based data processing frameworks, and a passion for test automation in big data environments.

Key Responsibilities:

  • Design & Implement Automated Test Frameworks for ETL jobs running on Google Cloud Dataflow and Dataproc.
  • Develop Test Suites for data pipelines written in Java, Scala, Spark, and SQL.
  • Automate Cloud Composer (Apache Airflow) workflows for testing.
  • Write Shell Scripts for test coordination and environment setup.
  • Validate Data Transformations, Reconciliation, and Business Logic across different pipeline stages.
  • Implement Mock Services & Test Data Generation for pipeline testing.
  • Develop Performance Testing Frameworks to evaluate ETL job efficiency.
  • Maintain CI/CD Pipelines for test automation.

Required Experience & Skills:

3+ years of experience in SDET / Automation Testing roles.
✔ Strong programming skills in Java or Scala.
✔ Expertise in testing ETL processes and data pipelines.
✔ Experience with Apache Spark & SQL.
✔ Proficiency in Google Cloud Platform (GCP) services, including:

  • Dataflow, Dataproc, Cloud Storage, and BigQuery.
    ✔ Knowledge of Apache Airflow (Cloud Composer).
    ✔ Strong Shell scripting skills (Bash/Shell).
    ✔ Familiarity with Apache Hive & HiveQL.
    ✔ Hands-on experience with test automation frameworks & tools.
    ✔ Experience with CI/CD implementations.

Preferred Skills & Additional Qualifications:

???? Experience with Data Quality Testing & Validation.
???? Understanding of Distributed Computing Concepts.
???? Python programming skills.
???? Knowledge of Data Privacy & Security Compliance.
???? Prior experience in Financial Services Industry.
???? Cloud Certification (GCP Professional Data Engineer preferred).

Technical Stack:

  • Cloud: Google Cloud Platform (GCP)
  • Languages: Java, Scala, Python, SQL
  • Big Data & ETL Tools: Apache Spark, Apache Beam, Apache Hive
  • Workflow Orchestration: Cloud Composer / Apache Airflow
  • Scripting: Bash / Shell
  • Version Control: Git
  • CI/CD Tools: Jenkins, GitLab CI/CD, or similar

If you are passionate about test automation, big data, and cloud-based ETL pipelines, we encourage you to apply! ????

Recent Added Jobs

DISCLAIMER

Welcome to Job4intern.com We provide job seekers with information gathered from various publicly available job posting websites, including but not limited to Google, Indeed, LinkedIn, and other well-known job platforms. Our mission is to help individuals find employment opportunities by offering up-to-date job listings and career-related resources. We do not charge any fees for accessing or using our website, and all job information is provided free of charge.

Job4intern.com does not directly offer, manage, or engage in the hiring process for any of the job listings featured on our website. All listings are sourced from third-party job posting platforms such as Indeed, LinkedIn, and other recognized job websites.

By using our website, you acknowledge and accept the above terms and conditions. Thank you for visiting Job4intern.com, and we wish you success in your job search.

For any inquiries or to raise a complaint, please contact us at jobpostingcustomercare@gmail.com.