Role Description We are looking for a Middle Data Engineer specialized in Azure Databricks to join our data platform team. The candidate will design and develop modern data pipelines and Lakehouse architectures, leveraging Azure Databricks, Spark, and Azure Data Factory, while integrating with existing SQL Server-based data warehouse environments, also evolving our data platform towards scalable, cloud-based data architectures, enabling advanced analytics and business intelligence. - Design, develop, and maintain data pipelines using Azure Databricks - Build and optimize data transformations using PySpark and SQL in Databricks - Implement and maintain Lakehouse architectures using Delta Lake - Develop ETL/ELT pipelines orchestrated through Azure Data Factory - Integrate data from multiple sources into the data platform and analytical layers - Design and maintain data models and data warehouse structures for analytics - Ensure data quality, scalability, and performance of large-scale data processing pipelines - Collaborate with BI teams to support Power BI and reporting platforms - Support and evolve existing SQL Server data platforms and ETL solutions (SSIS) when required - Contribute to the design of modern cloud-based data architectures Qualifications - 3+ years of experience in Data Engineering or Data Warehouse development - Strong experience with Azure Databricks - Experience developing data pipelines using PySpark and Spark SQL - Solid understanding of distributed data processing and big data concepts - Experience working with Delta Lake and Lakehouse architectures - Strong SQL skills and experience with SQL Server relational databases - Experience building data pipelines using Azure Data Factory - Experience handling large datasets and performance optimization Requirements - Experience with Spark optimization techniques (partitioning, caching, cluster tuning) - Experience with structured streaming in Databricks - Knowledge of CI/CD pipelines for data platforms (Azure Devops) - Familiarity with Power BI - Experience in migrating from traditional ETL process to cloud architectures Benefits - Culture of Relentless Performance: join an unstoppable technology development team with a 99% project success rate and more than 30% year-over-year revenue growth. - Competitive Pay and Benefits: enjoy a comprehensive compensation and benefits package, including health insurance, and a relocation program. - Work From Anywhere Culture: make the most of the flexibility that comes with remote work. - Growth Mindset: reap the benefits of a range of professional development opportunities, including certification programs, mentorship and talent investment programs, internal mobility and internship opportunities. - Global Impact: collaborate on impactful projects for top global clients and shape the future of industries. - Welcoming Multicultural Environment: be a part of a dynamic, global team and thrive in an inclusive and supportive work environment with open communication and regular team-building company social events. - Social Sustainability Values: join our sustainable business practices focused on five pillars, including IT education, community empowerment, fair operating practices, environmental sustainability, and gender equality.

IMEO Data Engineer Location: Paris Job Opening ID: 278117 Job Network : - Job Family : Engineering Category and Level : Consultants, CON Duty Station : PARIS Department/Office : United Nations Environment Programme Job Description: Result of Service The IMEO Data Engineer consultant will integrate satellite data into the main data system and develop tools to facilitate the analysis and management of geospatial data. Work Location Remote Expected duration 12 months Duties and Responsibilities The United Nations Environment Programme (UNEP) is the leading global environmental authority that sets the global environmental agenda, promotes the coherent implementation of the environmental dimension of sustainable development within the United Nations system, and serves as an authoritative advocate for the global environment. The UN Environment Programme's International Methane Emissions Observatory (IMEO) is a data-driven, action-focused initiative that drives deep reductions in methane emissions- the second biggest contributor to global climate change and a key opportunity to reduce warming in the near-term. IMEO's mission is to provide the open, reliable, and actionable methane data needed to cut emissions at the speed and scale necessary to achieve the Paris Agreement goals. To do this, IMEO is harnessing a methane data revolution under way thanks to rapidly advancing technology and momentum for methane action. IMEO collects, integrates, and reconciles data from methane-detecting satellites, scientific measurement studies, rigorous industry reporting through the Oil and Gas Methane Partnership 2.0 (OGMP 2.0), and national emissions inventories. These initiatives are game-changers for climate action - and as a core implementing partner of the Global Methane Pledge, IMEO is shaping the future of methane mitigation. The IMEO Data Engineer will support IMEO in implementing the Methane Alert and Response System (MARS), which connects near-real-time satellite methane detections with notifications to stakeholders. The consultant will focus on integrating new satellite data sources, including NNSFC, CarbonMapper, and GOSAT-GW into MARS. This includes making necessary adjustments to the database schema to ensure smooth data ingestion, processing, and storage. The consultant will also develop tools for automated notification report generation based on validated satellite detections. In addition, he will assist with the re-training and deployment of AI models to improve methane emissions detection, ensuring the models are integrated with the MARS system and optimized for current data workflows. While the primary focus will be on data integration and AI model improvements, the consultant will also provide backend support for the PlumeViewer and IMEO Data Portal applications. This includes ensuring accurate data is displayed on both applications and keeping timely updates to the IMEO Data Portal updated. The consultant will report to MARS Programme Manager. Qualifications/special skills Masters or Equivalent in computer science, data engineering, remote sensing or related field. Or a related field (optional) • Minimum of 3 years of proven experience in the development of data processing, analysis, and visualization tools, preferably focused on high-resolution satellite remote sensing data • Knowledge and experience with PostgreSQL, Azure cloud, Python, and CI/CD tools such as Jenkins. • Demonstrated scientific expertise in Remote Sensing Languages Fluency in oral and written English. English is the working language of UNEP's IMEO. Knowledge of additional languages is an asset. Additional Information - MARS analysis tools: at the beginning of the contract, the consultant will be provided with a list of tasks to be implemented, including developing specific data analysis functions, creating tables and connections for the integration and interconnection of new satellite and space sensor data, and optimizing the data stream between the different tools that IMEO-MARS uses. • Export internal data: the consultant shall provide the different IMEO members not experts in satellite data or without access to the internal MARS databases with the information they need in the required formats, e.g., time series of emissions in a particular region, plume figures, location of identified emission sources, etc. Specific tasks and responsibilities: O Improve internal MARS tools for geospatial data management and analysis. O Create new functions to exploit and store satellite data efficiently O Support the ingestion of new satellite and spatial sensor data O Assist different IMEO groups that need internal MARS data O Enhance CI/CD and automate deployments for the core MARS technical stack, and improve the accuracy of annual point source estimations. O Coordinate technical data dissemination, by creating reproducible workflows for methane retrievals and maintaining MARS public data pipelines for plumes, sources and top 50 emitters. No Fee THE UNITED NATIONS DOES NOT CHARGE A FEE AT ANY STAGE OF THE RECRUITMENT PROCESS (APPLICATION, INTERVIEW MEETING, PROCESSING, OR TRAINING). THE UNITED NATIONS DOES NOT CONCERN ITSELF WITH INFORMATION ON APPLICANTS' BANK ACCOUNTS.

Technical Data Migration Consultant AUS - Melbourne Hybrid Job Description: RLDatix (RLD) is on a mission to help raise the standard of care…everywhere. Trusted by over 10,000 healthcare organizations around the world, our solutions help improve health and care. Our applications ensure that patients receive the best and safest care while supporting the providers who deliver it. Joining TeamRLD means being part of a global effort of over 2,000 team members in making a difference in healthcare…every day. We're searching for a Melbourne-based Technical Data Migration Consultant to join our Data Services Group team, so that we can successfully deliver high-quality healthcare data migration projects for our clients. The Technical Data Migration Consultant will extract, transform, and load healthcare data while collaborating with stakeholders to ensure seamless system transitions and accurate data outcomes. How You'll Spend Your Time - Develop, test, and execute data conversions using SQL and ETL techniques to ensure seamless migration between healthcare systems - Analyse healthcare data in formats such as HL7, CDA, CSV, and SQL in order to support accurate extraction, transformation, and loading - Create and maintain complex SQL scripts to convert data from multiple source systems to target EHR platforms - Facilitate stakeholder meetings to gather requirements, provide updates, and ensure successful delivery of data migration projects - Perform quality assurance checks on data to validate integrity, identify issues, and reconcile converted datasets for accuracy What Kind of Things We're Most Interested in You Having - 3+ years' experience working with healthcare data and EHR/EMR systems - Proven success in delivering data migration or data conversion projects within healthcare environments - In-depth knowledge of SQL Server, T-SQL scripting, and data transformation processes - Ability to commute to our Melbourne office on a hybrid basis - Sincere interest in improving healthcare outcomes through data accuracy and system transformation - A knack for working collaboratively with stakeholders while managing tasks independently in a fast-paced environment By enabling flexibility in how we work and prioritising employee wellness, we empower our team to do and be their best. Key benefits include private health and group accident insurance, an Employee Assistance Program (EAP) for confidential support, and Loyalty Awards for long-service employees. RLDatix is an equal opportunity employer, and our employment decisions are made without regard to race, colour, religion, age, gender, national origin, disability, handicap, marital status or any other status or condition protected by law. We welcome applications from people of all backgrounds and strongly encourage Aboriginal and Torres Strait Islander peoples to apply. As part of RLDatix's commitment to the inclusion of all qualified individuals, we ensure that persons with disabilities are provided reasonable accommodation in the job application and interview process. If reasonable accommodation is needed to participate in either step, please don't hesitate to send a note to accessibility@rldatix.com. Salary offers are based on a wide range of factors including location, relevant skills, training, experience, education, and, where applicable, licensure or certifications obtained. Market and organisational factors are also taken into consideration.

Title: PL Ops - Data Engineer ) Location: Worcester, MA, USA United States Remote Req #19719 Job Description: Our Personal Lines Operations team is currently seeking a Data Engineer II in our Worcester office. This is a full-time, exempt role. Fully remote arrangement will be considered for candidates with strong qualifications. POSITION OVERVIEW: The Hanover Insurance Group is hiring a Personal Lines Operations Data Engineer to own the day-to-day reliability and enhancement of our Azure Data Factory (ADF) pipelines and on-prem SQL Server data environment. This role builds and improves ETL workflows that populate SQL tables used by analysts to create Power BI semantic models and reports. The position is split approximately 50/50 between production operations/support and new development/enhancement, while also advancing platform maturity through improved monitoring/alerting, data quality validation, and formalized release practices. What You'll Own: Production support and daily health of scheduled ADF pipelines. Build new pipelines and enhance existing pipelines to improve resiliency, maintainability, and scalability. Implement data validation controls, improve monitoring/alerts, and help define SLAs for data freshness and availability. Establish foundational SDLC practices for data engineering (Git usage, Dev→Prod promotion practices, and a more formal release process). Coordinate cross-team dependencies where upstream internal ETL timelines affect downstream pipeline completion; design dependency-aware orchestration and readiness checks. Contribute to future-state Azure data strategy recommendations (e.g., Data Lake/Blob Storage, notebooks) and support long-term migration planning from on-prem SQL Server to cloud databases (timeline not yet defined). KEY RESPONSIBILITIES: Azure/Fabric Data Factory Engineering Design and maintain curated SQL tables/views used for analytics and reporting; optimize for refresh performance and downstream usability. Develop and maintain ADF pipelines (Copy activities and Data Flows) with consistent patterns for logging, error handling, retries, and notifications. Implement parameterization and reusable components to reduce duplication and speed enhancements. Implement incremental load and backfill strategies appropriate to volume. Production Support & Reliability Monitor daily pipeline execution and triage incidents quickly to restore successful processing. Perform root-cause analysis for failures and recurring issues; implement preventative controls and standardized patterns. Create and maintain operational documentation/runbooks for critical pipelines and common support scenarios. Data Quality, Validation & Trust Build automated validation routines and reconciliation checks (row counts, totals, null/duplicate thresholds, schema drift detection, anomaly flags). Partner with analysts and stakeholders to define key business rules and quality thresholds for trusted reporting datasets. Document data definitions, transformations, and lineage to improve transparency and troubleshooting. Stakeholder Collaboration & Dependency Management Work directly with internal Operations Data Analysts, business stakeholders and external partner analysts to gather requirements and deliver datasets that enable robust Power BI semantic models, reporting and other analytical solutions. Coordinate with upstream internal teams to align dependency readiness signals and timelines; implement orchestration controls to prevent downstream failures. Provide technical coaching and mentoring to less experienced team members; including the usage of best practices. KEY MEASURES OF SUCCESS: Pipelines meeting SLA / on-time delivery Pipeline success rate and reduced manual intervention Time-to-detect/time-to-resolve ETL failures (MTTD/MTTR) Improvements in query/runtime performance and cost efficiency Reduction in recurring data quality defects; completeness/accuracy checks passing Documentation coverage (runbooks for critical pipelines, data dictionary completeness) Required Qualifications Bachelor's Degree preferred in a related field. 6+ years of experience in data engineering, ETL/ELT, or related roles. Hands-on experience building and supporting production pipelines in Azure Data Factory. Strong SQL/T-SQL skills and experience with SQL Server environments supporting analytics/reporting workloads. Advanced data modeling Experience integrating data from multiple sources including databases, flat files/SFTP, and APIs/vendor feeds. Familiarity with Azure data platform components (Data Lake/Blob Storage, notebooks) and/or cloud migration planning, or similar platforms. Strong troubleshooting, root-cause analysis, and operational ownership mindset. Ability to work directly with stakeholders to gather requirements and translate them into technical solutions. Strong communication and documentation skills: Data engineers are often called to present their findings or translate the data into an understandable document. You will need to write and speak clearly, easily communicating complex ideas. Preferred Qualifications Experience establishing SDLC practices for data teams (Git, CI/CD, release management). Experience implementing monitoring/alerting and operational dashboards for data pipelines. Python and/or PowerShell for automation, data validation, and operational tooling. Insurance or operations/customer service experience Familiarity with prompt-based programming and tools (GitHub CoPilot) This job posting provides cursory examples of some of the job duties associated with this position. The examples provided are not complete, and the position may entail other essential and job-related functions and responsibilities that employees will be required to perform.