Role Description As a senior member of the Data Engineer team, you will be responsible for leading the design, development, and optimization of enterprise-grade data solutions within the Microsoft Fabric ecosystem. This role requires deep technical expertise, strategic thinking, and the ability to mentor junior engineers while collaborating with cross-functional teams. You will work closely with data scientists, analysts, and other stakeholders to ensure seamless data integration, transformation, and storage, enabling data-driven decision-making across the organization. What you’ll do: - Pipeline Development: Design, develop, and maintain data pipelines to move data between Microsoft Fabric (Lakehouse/Warehouse) and Snowflake, often utilizing Fabric Data Factory. - Integration Implementation: Set up connectors, mirroring, or Spark notebooks to sync data from OneLake to Snowflake, including handling incremental loads. - Data Modeling & Transformation: Build and optimize data models (Star Schema/Data Vault) within Snowflake and Fabric for high-performance querying. - Performance Tuning: Monitor and optimize Fabric to Snowflake compute usage and ensure efficient data movement. - Data Governance & Security: Ensure data security during transfer, using tools like Snowflake RBAC, Dynamic Data Masking, and Fabric's security features. - Design and orchestrate complex integrations across Data Factory, REST APIs, and other enterprise data services. - Lead scalable ELT strategies using Spark Notebooks, Data Factory, and Synapse Pipelines. - Develop reusable, optimized Spark jobs and configure compute pools for cost-efficient performance. - Establish naming conventions, workspace governance, and CI/CD deployment strategies across Fabric. - Build monitoring dashboards, alerts, and automated testing for pipelines and operations. - Leverage AI coding agents and AI-assisted development tools (e.g., GitHub Copilot, Windsurf, or similar) to accelerate data engineering workflows, automate repetitive tasks, and improve code quality across the Fabric ecosystem. Qualifications - Proficient in SnowSQL, stored procedures, tasks, and data loading/unloading (COPY INTO). - Experience with Data Factory pipelines, Dataflow Gen2, and OneLake integration. - Expertise in Spark/Python (PySpark) for data transformation, or ELT tools. - Advanced SQL knowledge is essential for complex transformations. - 5+ years of experience working on complex data integration and pipeline development across a variety of systems. - Proven ability to design and orchestrate complex data integrations, leveraging Data Factory, REST APIs, and other enterprise data sources. - Leadership in defining and executing scalable ELT strategies using Spark notebooks, Data Factory, and Synapse pipelines. - Advanced knowledge of data pipeline optimization, including performance tuning and workload configuration. - Experience establishing naming conventions, workspace governance, and CI/CD deployment strategies. - Leadership in data governance, including sensitivity classifications, security models, and access control frameworks. - Ability to build and maintain monitoring, alerting, and automated testing for ADF pipelines and data assets. - Ability to align Microsoft Fabric implementations with enterprise data strategy and long-term growth plans. - Hands-on experience using AI coding agents and AI-assisted development tools in a data engineering context; comfort integrating AI into daily development workflows and evangelizing adoption across the team. - Preferred Microsoft Fabric certification – DP600, DP700. - Strong problem-solving skills and ability to work in a collaborative environment. - Excellent verbal, written, communication, presentation, organizational, and interpersonal skills. Compensation A reasonable estimate of the current base pay range for this position in Ontario is $91,200 to $114,000 annually. Actual salary will be based on a variety of factors, including location, experience, skill set, education, and related certification. The range for this position in other geographic locations may differ. Benefits - You’ll thrive in our collaborative environment, surrounded by incredible colleagues who foster support and innovation, driving our collective success. - At Softchoice, we are dedicated to achieving our goals and committed to success for our customers and each other. - Plan your workdays in a way that suits you best. - Proudly recognized as a Great Place to Work for 20 consecutive years. - We are committed to an inclusive culture where every team member can be their authentic self. Inclusion & Equal Opportunity Employment We are an equal opportunity employer committed to diversity, inclusion & belonging. People seeking employment at Softchoice are considered without regard to any protected category including but not limited to, race, color, religion, national origin, age, sex, marital status, ancestry, disability, veteran status, gender identity, or sexual orientation. Require Accommodation? We are proud to provide interview & employment accommodation during the recruitment and hiring process. If you require any accommodation to apply or interview for a position, please reach out directly to asktalentacquisition@softchoice.com . We are committed to working with you to best meet your needs. Our Commitment to Your Experience We are committed to the safety of all applicants and team members. With that in mind, we have implemented digital interviewing for everyone. We understand that you may need to interview with distractions around you (such as children or furry friends) and we will be doing the same. Before you start with us, we will conduct a criminal record check, verify your education, and check your references. When you join Softchoice, we will onboard you remotely. Don't worry. It's quick, simple and you'll be connected with your new team in no time. Job Requisition ID 7445 EoE/M/F/Vet/Disability #LI-MM1