Building digital businesses, together.
Lead Azure Data Engineer
Location
Canada
Posted
4 days ago
Salary
0
Seniority
Senior
Job Description
Lead Azure Data Engineer
3Pillar Global
• Understand client requirements and lead the creation of robust data platforms leveraging Data Lakehouse architectures, serving as the primary subject matter expert for the Azure data ecosystem (Microsoft Fabric, Azure SQL, and Power BI). • Design and implement scalable data models, ETL/ELT pipelines, and analytics layers using modern cloud ecosystems. • Architect Microsoft Fabric reporting solutions, establishing medallion layering, managing capacity planning, ensuring freshness governance, and configuring CDC/mirroring from Azure SQL into Fabric. • Enforce strict data-layer segregation ensuring PII is excluded by construction, maintaining multi-tenant isolation within the analytics layer, and strictly adhering to 10+ year regulated data retention policies. • Lead complex migration efforts off legacy systems (e.g., AirTable, Smartsheet) to Microsoft Fabric, effectively managing mid-program form and rule drift, and establishing reliable, per-client export channels. • Lead end-to-end analytics projects — from requirement gathering to deployment. • Mentor junior team members, perform code reviews, and ensure adherence to quality standards. • Work closely with cross-functional teams (engineering, product, business) to align data strategy with business goals. • Develop and optimize complex SQL queries, Power BI semantic models, dashboards, and reports (transitioning from legacy LookML/BigQuery paradigms). • Troubleshoot performance bottlenecks, data inconsistencies, and integration challenges. • Stay up to date with advancements in the analytics and cloud data ecosystem. • Drive innovation in reporting and analytics capabilities. • Recommend and implement new tools, frameworks, and practices to enhance the data platform. • Define best practices, coding standards, and governance for analytics projects. • Monitor data systems performance and implement optimization strategies. • Ensure data accuracy, integrity, privacy, security, and compliance through quality control procedures. • Build and oversee AI-ready data pipelines, focused on feeding scrubbed, segmented data to assistive AI and integrating GenAI into analytics and data products. • Drive adoption of AI-assisted data engineering across the team: copilots for SQL/transformation/pipeline code, plus automated testing and documentation. • Define governance and quality standards for data consumed by LLMs and agents.
Job Requirements
- Demonstrated expertise with a minimum of 7 - 10 years of relevant experience in data engineering and business intelligence domain.
- Strong primary expertise in the **Azure Data Stack, specifically Azure SQL, Microsoft Fabric**, and Power BI (semantic layer design, robust dashboard development), with a minimum of two years of hands-on experience in these specific tools.
- Advanced SQL skills and a solid understanding of modern data architecture, including **Data Lakehouse** concepts, medallion architecture, star/snowflake schemas, and dimensional modeling.
- Proficiency in Python** for data engineering, ETL/ELT workflows, and automation tasks.
- Experience designing and maintaining enterprise-grade **data pipelines** — specifically in Azure environments.
- Proven track record of **leading analytics projects** and delivering scalable data solutions.
- Ability to function as a **player-coach** — leading while also contributing hands-on.
- Solid understanding of **data governance, security** (especially around PII and multi-tenant architectures), and **performance optimization** practices.
- Strong communication skills and ability to translate complex technical concepts for business stakeholders.
Benefits
- Medical & dental insurance - with employee contributions
- LTD, Life & AD&D insurance - employee paid
- Paid time off
- 10 Paid Holidays
- RRSP with Employer Matching
- Flexible work policy
Related Guides
Related Categories
Related Job Pages
More Cloud Engineer Jobs
OCI Cloud Engineer
Bright Vision TechnologiesBright Vision Technologies is a forward-thinking software development company dedicated to building innovative solutions that help businesses automate and optimize their operations. We leverage cutting-edge technologies to create scalable, secure, and user-friendly applications. We recognize that our people are our strength. We are an equal opportunity employer and place a high value on diversity and inclusion. We do not discriminate on the basis of any protected attribute. We make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Bright Vision Technologies is an Equal Opportunity Employer, including Disability/Veterans.
Role Description We are seeking an experienced OCI Cloud Engineer to architect, deploy, and operate large-scale, secure, and resilient cloud environments on Oracle’s next-generation public cloud. In this role you will own the full OCI engineering lifecycle, from landing-zone design and infrastructure-as-code, through workload migration and ongoing operations, including cost optimization and observability. The ideal candidate will combine deep technical knowledge of OCI services with strong DevOps and automation fundamentals, and will partner with database, application, and security teams to deliver well-engineered cloud platforms that support mission-critical Oracle and non-Oracle workloads. Key Responsibilities - Architect, deploy, and operate enterprise-grade OCI landing zones, compartments, and tenancy structures aligned with internal governance and compliance standards. - Design and implement OCI networking topologies, including VCNs, subnets, gateways, FastConnect, IPSec VPN, and DRG-based hub-and-spoke architectures. - Build and maintain OCI infrastructure-as-code using Terraform and OCI Resource Manager, with version control, peer review, and automated validation. - Implement IAM policies, federation with corporate identity providers, and strong RBAC patterns using OCI Identity Domains. - Design and operate OCI compute (VMs, bare-metal, OKE for Kubernetes) and storage services (Object, Block, File, Archive) optimized for workload patterns. - Operate OCI database services, including Autonomous Database, Exadata Cloud, MySQL HeatWave, and Base Database, in close partnership with DBA teams. - Build CI/CD pipelines on OCI DevOps service or external platforms (Jenkins, GitHub Actions) for both infrastructure and applications. - Implement observability using OCI Monitoring, Logging, APM, and integrations with third-party observability stacks. - Drive ongoing cost optimization through right-sizing, lifecycle management, and architectural simplification. - Design disaster-recovery and business-continuity solutions across OCI regions and availability domains. - Strengthen security posture using OCI Cloud Guard, Security Zones, Vault, and Data Safe, and lead remediation of findings. - Advise application development teams on OCI-native design patterns and best practices. - Develop automation tooling in Python, Bash, and Terraform to reduce operational toil. - Mentor junior engineers and contribute to internal cloud communities of practice. Qualifications - Bachelor’s degree in Computer Science, Engineering, or a related technical discipline. - Five or more years of cloud engineering experience, with strong hands-on time on OCI. - Production-level experience with infrastructure-as-code using Terraform. - Solid experience with OCI compute, networking, storage, identity, and database services. - Hands-on experience with Oracle Container Engine for Kubernetes (OKE). - Experience with CI/CD pipelines for cloud workloads. - Strong scripting skills in Python and Bash. - Deep understanding of cloud security, IAM, and compliance requirements. - Experience with observability tooling and incident response. - Excellent troubleshooting, communication, and documentation skills. Preferred Qualifications - Oracle Cloud Infrastructure Architect Professional certification. - Experience operating Oracle Exadata Cloud or Autonomous Database at scale. - Exposure to multi-cloud architectures spanning OCI and AWS/Azure/GCP. - Familiarity with FinOps practices on OCI. - Experience operating regulated workloads on OCI. How to Apply Would you like to know more about this opportunity? For immediate consideration, please send your resume to [email protected] or contact us at (908) 505-3544. Learn more about Bright Vision Technologies at www.bvteck.com .
• Develop software applications according to business needs • Involved in all phases of SDLC based on Agile framework • Plan, develop and implement projects or features of large-scale projects • Develop solutions to improve performance and scalability of systems • Assisting in Production issues • Share knowledge about your area of expertise, best practices and provide functional support
• Design and implement scalable, secure, and high-performance Azure environments • Lead network transformation initiatives • Manage landing zone design • Oversee cloud migrations • Ensure enterprise-grade availability, security, and compliance
Role Description En Initium Software, no somos una consultora tradicional; somos socios estratégicos que conectamos al mejor talento con los proyectos más desafiantes del mercado. Como Genesys Cloud Software Engineer, tu misión no será solo picar código; serás la mente maestra detrás de la arquitectura, automatización e integración de soluciones críticas dentro de nuestra plataforma de cloud contact center. Colaborarás mano a mano con Program Directors, Product Owners y equipos de arquitectura para transformar requisitos complejos en sistemas escalables de alto impacto. Si buscas un lugar donde tu trabajo deje huella, este es tu sitio. Qualifications - Más de 5 años desarrollando soluciones sólidas en Genesys Cloud (especialmente en flujos de Architect e integraciones API). - Dominio de REST APIs y desarrollo/scripting con JavaScript y Python (ETL). - Nivel de inglés intermedio-alto (B2 mínimo) y español fluido, con capacidad para comunicarte de manera efectiva en entornos internacionales. - Capacidad analítica para traducir requerimientos de negocio en soluciones técnicas estables y escalables. Requirements - Experiencia en integraciones basadas en eventos (como EventBridge). - Experiencia o exposición previa a sistemas CRM, específicamente Microsoft Dynamics. - Conocimientos en bots, herramientas de automatización o plataformas de IA conversacional. - Certificaciones oficiales de Genesys Cloud o de proveedores Cloud (AWS). - Pasión por aprender, compartir ideas y evolucionar junto al equipo. Benefits - Salario fijo acorde a tu experiencia técnica y de mercado. - Modalidad 100% remota desde España para que manejes tu propio balance de vida. - Un entorno dinámico guiado por la autonomía, la colaboración mutua y un equipo de alto desempeño que te inspirará a superarte. - Un espacio donde se valora tu iniciativa, se reconoce tu impacto real y se apuesta firmemente por tu evolución y plan de carrera.
