Job Description:
Candidate must have at least 6 yrs. experience in design and development of ETL solutions in Azure stack
Strong understanding of Azure service components like SQL DB, SQL Server, Data Bricks, Blob storage, AAS
Strong experience in Azure Data Bricks using PySpark. This includes experience in development as well as performance tuning of ADB notebooks, Delta tables, ADB SQL warehouse etc.
Should be experienced in migrating on-prem and legacy DWH to Azure stack
Candidate should have proven experience in Data integration and migration projects
Candidate must be familiar with Azure security model and Storage accounts
Must have a working experience in Azure DevOps and CI/CD tools at each phase of the SDLC cycle
Should be experienced in developing data ingestion using Logic Apps / Azure functions to call APIs for extracting data from Sharepoint and other applications
Should understand application development in Azure stack and should be able to guide front-end developers for making required changes as per project requirements.
Should have a deep understanding of end-to-end infrastructure and services setup in Azure stack to ensure that the platform is optimally configured. Will need to guide and work with Cloud infra team for infra changes.
Experience in defining data quality rules and designing ETL frameworks to execute these DQ rules as part of the ingestion process
Should have experience in designing metadata driven generic frameworks tracking ETL audit information
Candidate needs to work independently with the clients and, therefore, must have excellent communication skills and should be adept at project planning, execution and status tracking.
Should have proven experience in working in an onshore-offshore model