Position: Azure Data Engineer
Location: New Jersey
Job type: Long Term Contract
Key skill Azure Modern Data Warehouse platform (e.g., Azure Data Lake,
Azure Data Factory, Azure Databricks, Databricks Delta Lake, Synapse Analytics, etc)
Long term-
Data Engineer, will be part of the Development team which designs and develops the data platform to
provide new business intelligence products and features. The team is responsible for keeping the products at
cutting edge, creating competitive USP’s for the company.
Key Responsibilities
? Analyse and ingest new datasets from varied sources
? Design and build modern, metadata driven data pipelines and data streams
? Design and build data service APIs
? Transform and cleanse complex datasets
? Expose data to Azure API Apps or other modern technologies
? Analyse current business practices, processes and procedures and leveraging Microsoft Azure data
and analytics services
? Implement effective metrics and monitoring processes
? A commitment to learning and sharing knowledge
Required Skills/Experience
? 2 or more years’ experience working as a Data Engineer
? Experience of developing in the Azure Modern Data Warehouse platform (e.g., Azure Data Lake,
Azure Data Factory, Azure Databricks, Databricks Delta Lake, Synapse Analytics, etc)
? SQL
? PySpark and Spark SQL
? Experienced in real-time and batch mode data ingestion
? Experience in Data Warehouse development (e.g., Kimball or Inmon methodologies)
? Experience with JSON, flat file, and XML data structures
? Experience handling structured and unstructured datasets
? Good knowledge of DevOps tools and processes
? Strong in data Governance, including Master Data Management (MDM) and Data Quality tools and
processes
? Self-motivated and quick learner
? A pragmatic approach to solving problems
Desirable Skills
? Experience with Databricks Delta Lake/Hive Hadoop
? Programming knowledge (Python, C#, Scala etc.)
? Good working knowledge of the Scrum framework and the value of Scrum
? Experience of data visualisation tools (e.g., PowerBI, QlikView, Tableau etc.)
? Experience in the other PowerPlatform tools (PowerApps, Dataverse etc.)
? Working knowledge and experience with general Property & Casualty concepts
? Experience in AI and Machine Learning "