Senior Azure Data Engineer

Gratitude Inc

315 Views

1 month ago

Senior Azure Data Engineer

5-10 Year(s)

90 - 120 Thousand p.m

Manila (Taguig)

Job Description

Key Skills

Python SQL CI/CD Power BI Modern Enterprise JAVA or Scala Azure Data factory Azure SQL

0 candidate(s) have already applied for this Job. Apply now

Non-negotiables:

• 5+ years Azure Data Engineer with at least 1 year of experience in both Databricks and PySpark

• Strong experience in Azure Functions, Azure Data Factory, Azure SQL, Azure Key Vault

• Strong Experience in Azure Databricks, Azure Databricks Notebooks, Azure Data Lake, Azure Data Lake Storage

• Working experience in migration and modernization projects

• Experience in building data pipelines and analysis tools using Python, PySpark, Scala, SQL

• Should be amenable to work onsite on a hybrid setup in Taguig

• Amenable to mid to night shift schedule

Position Description:

We are currently looking for an Azure senior developer with Databricks and Pyspark skills, having at least 3 or more years of experience and who is willing to work late shift to night shift work schedule.

We are looking for a Senior Azure Data Engineer to join the Digitalization & Automation Services Team.

You will work alongside our Dev Team and will report to the following: Technical Lead, Service Delivery Manager.

Your main tasks will include performing application development with exposure on Azure Databricks and PySpark.

To succeed in this role, you should be able to fit into the technical requirement need and pass the overall technical assessment.

Your future duties and responsibilities:

Design and implement storage solutions using Azure services such as Azure SQL and Azure Data Lake Storage.

Design and implement ETL using ADF data pipelines to move and transform data from various sources into cloud-based data warehouses.

Implement a business solution using Azure Databricks.

Align with the DevOps strategy to promote code into Production.

Participate in solutioning and delivery optimization (identifying/creating reusable Databricks components).

Participate in and define steps to transform requirements into an implementation plan.

Required qualifications to be successful in this role:

Must have 3-5 years of relevant experience

Strong experience in Azure Functions, Azure Data Factory, Azure SQL, and Azure Key Vault.

Strong Experience in Azure Databricks, Azure Databricks Notebooks, Azure Data Lake, Azure Data Lake Storage.

Working experience in migration and modernization projects.

Experience in building data pipelines and analysis tools using Python, PySpark, Scala, SQL.

Proficient in integrating, transforming, and consolidating data from various structured and unstructured data.

Knowledge of Autosys jobs, Batch scripts.

Experience with Agile methodology, Azure DevOps(CI/CD Pipeline).

Knowledge of streaming platforms (Kafka, Solace queue), Azure App Services, Azure Stream Analytics, Power BI.

Strong communication skills.

Ability to work independently and effectively within a team.

Must be amenable to working onsite 2-3 days a week in McKinley, Taguig, on a late mid-shift to a night-shift schedule

Role

Engineering - Software

Timings

Day Shift (Contract To Hire)

Industry

IT-Software / Software Services

Work Mode

Hybrid

Functional Area

IT Software/Hardware

Note: Myglit doesn't charge any money from candidates. If you have been asked to pay money to get this job then report to us immediately at support@myglit.com.