Senior Data Engineer – CL10

Gratitude Inc

12 Views

13 hours ago

Senior Data Engineer – CL10

2-3 Year(s)

Manila

Quick Apply Apply

Job Description

Key Skills

Java Python SQL Data engineer Google Cloud Platform (GCP)

4 candidate(s) have already applied for this Job. Apply now

We are looking for a highly skilled Senior Data Engineer to design, develop, maintain, and optimize scalable data solutions on Google Cloud Platform (GCP). The successful candidate will be responsible for building reliable batch and real-time data pipelines, implementing ETL/ELT processes, managing data ingestion and transformation, ensuring data quality, and supporting the reliability and scalability of the overall data ecosystem.

The ideal candidate will have strong hands-on experience with GCP Dataflow, Cloud Composer, BigQuery, SQL, Python or Java, Apache Beam, Airflow, Pub/Sub, data modeling, ETL/ELT, monitoring, logging, and cloud-based data engineering.

Key Responsibilities

Data Engineering & Pipeline Development

Design, develop, and maintain scalable and reliable data pipelines.
Build batch and streaming pipelines for data collection, processing, transformation, and integration.
Implement ETL/ELT processes across different systems and environments.
Optimize pipelines for performance, scalability, reliability, and maintainability.
Support data migration, deployment, and production activities.

Google Cloud Platform

Develop and manage data engineering solutions using Google Cloud Platform.
Work with BigQuery, Dataflow, Cloud Composer, Pub/Sub, and Cloud Spanner where applicable.
Design cloud-based data processing solutions capable of handling high-volume workloads.
Optimize cloud resources and workflows for performance and reliability.

Batch & Real-Time Data Processing

Develop and maintain batch and real-time/streaming data pipelines.
Build event-driven data workflows using Pub/Sub and Dataflow.
Process high-throughput data while maintaining accuracy and reliability.
Troubleshoot pipeline failures, processing delays, and data inconsistencies.

SQL, Python/Java & Data Frameworks

Develop complex and optimized SQL queries for extraction, transformation, aggregation, validation, and analysis.
Develop reusable and production-ready components using Python or Java.
Use Apache Beam for scalable data processing.
Use Apache Airflow / Cloud Composer for workflow orchestration.
Troubleshoot and optimize pipeline and application-level issues.

Data Ingestion & File Processing

Design and implement data ingestion pipelines for multiple source systems.
Handle structured and semi-structured data formats such as Avro, Parquet, JSON, and CSV.
Validate incoming data for completeness, consistency, accuracy, and integrity.
Troubleshoot file ingestion and data processing failures.

Data Quality & Reliability

Implement data validation and reconciliation mechanisms.
Identify and resolve data quality issues across source, processing, and target systems.
Ensure pipelines are reliable and capable of supporting production workloads.
Monitor data processing activities and proactively address failures and anomalies.

Monitoring & Troubleshooting

Monitor data pipelines using Google Cloud Monitoring and Cloud Logging.
Develop and maintain monitoring, alerting, and operational mechanisms.
Investigate system errors, pipeline failures, performance issues, and data anomalies.
Perform root-cause analysis and implement corrective actions.

Data Modeling & Architecture

Apply strong data engineering and data modeling principles.
Design scalable data structures and processing architectures.
Support analytical and transactional data solutions.
Ensure data solutions meet performance, security, scalability, and maintainability requirements.

Required Qualifications & Experience

Minimum 2 years of relevant experience in Data Engineering or related roles.
Hands-on experience with Google Cloud Platform (GCP).
Strong experience with BigQuery, Dataflow, and Cloud Composer.
Experience with batch and real-time/streaming data processing.
Strong command of SQL.
Proficiency in Python or Java.
Experience with Apache Beam and/or Apache Airflow.
Strong understanding of ETL/ELT and data modeling.
Experience working with Avro, Parquet, JSON, and CSV.
Strong debugging, troubleshooting, and problem-solving capabilities.
Experience with cloud monitoring, logging, and alerting.

Preferred Skills

Cloud Spanner
Google Cloud Certified Professional Data Engineer
CI/CD for data infrastructure
Terraform / Infrastructure as Code
GitHub Actions
Data Governance
GCP Security
IAM, KMS, and DLP
Cloud Infrastructure Automation

Education & Certification

Bachelor's degree in Computer Science, Information Technology, Engineering, Data Science, or a related technical field is preferred.
Equivalent technical qualifications and relevant professional experience may be considered.
Google Cloud Certified Professional Data Engineer certification is preferred.

Soft Skills

Strong analytical and problem-solving skills.
Excellent troubleshooting and debugging abilities.
Strong attention to detail.
Good communication and stakeholder management skills.
Ability to work independently and collaboratively.
Ability to manage multiple technical priorities.
Strong ownership, accountability, and proactive problem-solving approach.
Ability to work effectively in a fast-paced technology environment.
Willingness to work in a shifting schedule.

Work Location & Eligibility

Work Mode: Onsite
Location: Manila / Taguig, Philippines
Candidates must currently be located in the Philippines.
Candidates must have the legal right to live and work in the Philippines.
Candidates must be willing to work from the office and follow a shifting schedule.
Candidates without the required work authorization are not eligible.
Candidates should not have an active or recent application with the hiring organization.
Candidates should not be currently or recently employed by the hiring organization.

Recruitment Process

The recruitment process may include initial CV screening, CV validation, technical assessment, evaluation of relevant experience and qualifications, and client review/selection.

Pre-Screening Questions

How many years of relevant Data Engineering experience do you have?
How many years of hands-on experience do you have with GCP?
Please share your relevant technical and soft skills.
What was your last drawn salary?
What is your expected salary?
Are you comfortable working onsite in Manila/Taguig with a shifting schedule?
Are you currently located in the Philippines and legally authorized to work there?
Do you currently have an active application or Workday account with the hiring organization?
Have you been currently or recently employed by the hiring organization?

Role

Computer Operators

Timings

Day Shift (Contract To Hire)

Industry

IT-Software / Software Services

Work Mode

Work from office

Process

Non-Voice

Functional Area

IT Software/Hardware

Note: Myglit doesn't charge any money from candidates. If you have been asked to pay money to get this job then report to us immediately at support@myglit.com.

Ali Mulla

Recruiter - Gratitude Inc

NA, india

0+ Followers

500+ Posts

View Profile

Interview Tips

Giving the VNA round?
What are the most important skills you acquired as a Soft Skills/VNA trainer?
How would you handle an irate customer?

Get the Best Jobs
on your Fingertips

Confidential

Manila, Philippines

Details