Data Engineer
Back to All Jobs
[social_share]
our client requires an data engineer to provide data analysis and technical expertise in designing, developing, deploying, and testing end-to-end data pipelines and models. The diverse systems and technologies involved are legacy and new modern data warehouses that involvesAzure, Big Data and Rest services. The objective is to build an end-to-end ETL and STAR schema development services for a BI solution in Azure, and a new data mart using data from various sources. Key responsibilities include developing data pipelines, building data models, and creating Power BI reports.
Duties include development of end-to-end data pipelines, data models, Power BI reports, design specifications, use cases, and various documentation supporting the project.
This position is designated as a ‘hybrid position’ with the flexibility of working on-site (at least one day a week) and remotely within BC (other remote locations can be considered). An expectation to work at the New Westminster location and travel to other client locations in the Greater Vancouver Area as requested at consultant’s expense.
Mandatory Requirements
- Hands-on experience with a range of Azure Services, including ADF, Azure Databricks, Delta Lake, Azure Data Lake Storage, Azure Synapse, Power BI Report and Crystal Report.
- Hands-on experience with authoring Power BI reports, exposure to Power BI Cloud.
- Experience designing, building, and maintaining ETL/ELT data pipelines, (preferably Azure Data Factory).
- Demonstrated ability to interact professionally with a diverse group of executives, managers, supervisors, subject matter experts and end users.
- Skilled at facilitating and managing consultation processes with a wide range of stakeholder groups.
- Proven experience with gathering and analyzing functional and technical requirements and information from key business areas and stakeholder groups.
- Excellent interpersonal skills combined with highly developed communication skills, both verbal and written, are a must.
Desirable Requirements
- 4+ years of experience with Business Intelligence (or related).
- Hands-on experience with Spark (PySpark/Python) in Azure.
- Experience with data migration from on-prem to cloud (preferably Azure Data Factory).
- Strong knowledge and experience designing Data Lakes and Data Warehouses.
- Strong knowledge of Azure data ecosystem for compute and storage.
- Hands on experience with developing BI reports with Power BI.
- Ability to negotiate and influence, multi-task, analyze and improve processes.
- Hands-on knowledge of Azure SQL Data Warehouse architecture and best practices.
- Extensive knowledge of Dimensional Modelling and Kimball EDW principles Understanding of Azure Managed Instance.
- Experience working with Data Lakes and Data Marts.
- Ability to work with large volumes of data from multiple sources.
- Microsoft SQL Server SSIS/SSRS/ETL.
- Experience in Azure IaaS, PaaS and Database migration.
- Experience with design, development, deployment and testing data pipelines and data models using technologies such as REST services, ADF, Azure Databricks, Delta Lake, and Azure Data Lake Storage, Azure Blob storage, Azure Synapse, and Azure Databricks
- Experience working with external vendors.
- Experience working in a unionized environment.
Job Posting ID: 55889
Location: Greater Vancouver, British Columbia (Hybrid)
Estimated Starting Date: Immediately
Estimated End Date: 8 months + pos. extension
Posting Closing Date: November 14, 2024
Apply for this Job Posting
Fill in the form below to submit your application for this position.