Azure Data Engineer

Gratitude Inc

754 Views

2 months ago

Azure Data Engineer

5-6 Year(s)

Manila (Cubao Quezon City)

Job Description

Key Skills

Java python programming Technical leadership Azure Data Engineer

0 candidate(s) have already applied for this Job. Apply now

Qualifications:

• Bachelor’s degree in Computer Science, Engineering, or a related field (or equivalent experience) and able to demonstrate high proficiency in programming fundamentals.

• Proven experience as a Data Engineer or similar role dealing with data and ETL processes.

• Strong knowledge of Microsoft Azure services, including Azure Data Factory, Azure Synapse, Azure Databricks, Azure Blob Storage and Azure Data Lake Gen 2.

• Experience utilizing SQL DML to query modern RDBMS in an efficient manner (e.g., SQL Server, PostgreSQL).

Strong understanding of Software Engineering principles and how they apply to Data Engineering (e.g., CI/CD, version control, testing).

• Experience with big data technologies (e.g., Spark).

• Strong problem-solving skills and attention to detail.

• Excellent communication and collaboration skills.

• Not a job hopper

Job Description Summary:

Utilizes software engineering principles to deploy and maintain fully automated data transformation pipelines that combine a large variety of storage and computation technologies to handle a distribution of data types and volumes in support of data architecture design. A Data Engineer designs data products and data pipelines that are resilient to change, modular, flexible, scalable, reusable, and cost effective.

Responsibilities:

• Design, develop, and maintain data pipelines and ETL processes using Microsoft Azure services (e.g., Azure Data Factory, Azure Synapse, Azure Databricks, Azure Fabric).

• Utilize Azure data storage accounts for organizing and maintaining data pipeline outputs. (e.g., Azure Data Lake Storage Gen 2 & Azure Blob storage).

• Collaborate with data scientists, data analysts, data architects and other stakeholders to understand data requirements and deliver high-quality data solutions.

• Optimize data pipelines in the Azure environment for performance, scalability, and reliability.

Ensure data quality and integrity through data validation techniques and frameworks.

• Develop and maintain documentation for data processes, configurations, and best practices.

Skills:

Learning agility

Technical Leadership

Consulting and managing business needs

Strong experience in Python is preferred but experience in other languages such as Scala, Java, C#, etc is accepted.

Experience building spark applications utilizing PySpark.

Experience with file formats such as Parquet, Delta, Avro.

Experience efficiently querying API endpoints as a data source.

Understanding of the Azure environment and related services such as subscriptions, resource groups, etc

Recruitment Process:

Paper Screening (endorsing profile to Operations team to identify if candidate meets the basic requirement/qualification for the position)

KINDLY take note to respond to screening questions

Pre-screening Notes:

• Highest Educational Attainment?

• How many years of experience do you have as a Data Engineer or similar role dealing with data and ETL processes?

• How much is your last drawn salary?

• How much is your salary expectation?

• Are you amenable to work Hybrid in Quezon City with a Night Shift schedules?

• When are you available to start once hired?

Role

Any Other

Timings

Night Shift (Permanent)

Industry

IT-Software / Software Services

Work Mode

Hybrid

Functional Area

Any Other

Note: Myglit doesn't charge any money from candidates. If you have been asked to pay money to get this job then report to us immediately at support@myglit.com.

Eyo Asuquo

Recruiter - Gratitude Inc

NA, nigeria

0+ Followers

500+ Posts

View Profile

Interview Tips

Giving the VNA round?
What are the most important skills you acquired as a Soft Skills/VNA trainer?
How would you handle an irate customer?

Get the Best Jobs
on your Fingertips

Confidential

Manila, Philippines

Details