United Nations

The United Nations is an international affairs peace and security organization established in 1945 at the end of WWII. Comprised of 193 member states, the Unite

Data Engineer

Location

France

Posted

1 day ago

Salary

0

Seniority

Senior

Job Description

Data Engineer

United Nations

IMEO Data Engineer Location: Paris Job Opening ID: 278117 Job Network : - Job Family : Engineering Category and Level : Consultants, CON Duty Station : PARIS Department/Office : United Nations Environment Programme Job Description: Result of Service The IMEO Data Engineer consultant will integrate satellite data into the main data system and develop tools to facilitate the analysis and management of geospatial data. Work Location Remote Expected duration 12 months Duties and Responsibilities The United Nations Environment Programme (UNEP) is the leading global environmental authority that sets the global environmental agenda, promotes the coherent implementation of the environmental dimension of sustainable development within the United Nations system, and serves as an authoritative advocate for the global environment. The UN Environment Programme's International Methane Emissions Observatory (IMEO) is a data-driven, action-focused initiative that drives deep reductions in methane emissions- the second biggest contributor to global climate change and a key opportunity to reduce warming in the near-term. IMEO's mission is to provide the open, reliable, and actionable methane data needed to cut emissions at the speed and scale necessary to achieve the Paris Agreement goals. To do this, IMEO is harnessing a methane data revolution under way thanks to rapidly advancing technology and momentum for methane action. IMEO collects, integrates, and reconciles data from methane-detecting satellites, scientific measurement studies, rigorous industry reporting through the Oil and Gas Methane Partnership 2.0 (OGMP 2.0), and national emissions inventories. These initiatives are game-changers for climate action - and as a core implementing partner of the Global Methane Pledge, IMEO is shaping the future of methane mitigation. The IMEO Data Engineer will support IMEO in implementing the Methane Alert and Response System (MARS), which connects near-real-time satellite methane detections with notifications to stakeholders. The consultant will focus on integrating new satellite data sources, including NNSFC, CarbonMapper, and GOSAT-GW into MARS. This includes making necessary adjustments to the database schema to ensure smooth data ingestion, processing, and storage. The consultant will also develop tools for automated notification report generation based on validated satellite detections. In addition, he will assist with the re-training and deployment of AI models to improve methane emissions detection, ensuring the models are integrated with the MARS system and optimized for current data workflows. While the primary focus will be on data integration and AI model improvements, the consultant will also provide backend support for the PlumeViewer and IMEO Data Portal applications. This includes ensuring accurate data is displayed on both applications and keeping timely updates to the IMEO Data Portal updated. The consultant will report to MARS Programme Manager. Qualifications/special skills Masters or Equivalent in computer science, data engineering, remote sensing or related field. Or a related field (optional) • Minimum of 3 years of proven experience in the development of data processing, analysis, and visualization tools, preferably focused on high-resolution satellite remote sensing data • Knowledge and experience with PostgreSQL, Azure cloud, Python, and CI/CD tools such as Jenkins. • Demonstrated scientific expertise in Remote Sensing Languages Fluency in oral and written English. English is the working language of UNEP's IMEO. Knowledge of additional languages is an asset. Additional Information - MARS analysis tools: at the beginning of the contract, the consultant will be provided with a list of tasks to be implemented, including developing specific data analysis functions, creating tables and connections for the integration and interconnection of new satellite and space sensor data, and optimizing the data stream between the different tools that IMEO-MARS uses. • Export internal data: the consultant shall provide the different IMEO members not experts in satellite data or without access to the internal MARS databases with the information they need in the required formats, e.g., time series of emissions in a particular region, plume figures, location of identified emission sources, etc. Specific tasks and responsibilities: O Improve internal MARS tools for geospatial data management and analysis. O Create new functions to exploit and store satellite data efficiently O Support the ingestion of new satellite and spatial sensor data O Assist different IMEO groups that need internal MARS data O Enhance CI/CD and automate deployments for the core MARS technical stack, and improve the accuracy of annual point source estimations. O Coordinate technical data dissemination, by creating reproducible workflows for methane retrievals and maintaining MARS public data pipelines for plumes, sources and top 50 emitters. No Fee THE UNITED NATIONS DOES NOT CHARGE A FEE AT ANY STAGE OF THE RECRUITMENT PROCESS (APPLICATION, INTERVIEW MEETING, PROCESSING, OR TRAINING). THE UNITED NATIONS DOES NOT CONCERN ITSELF WITH INFORMATION ON APPLICANTS' BANK ACCOUNTS.

Related Categories

Related Job Pages

More Data Engineer Jobs

Technical Data Migration Consultant

RLDatix

RLDatix is an integrated healthcare operations platform combining data-driven insights with advanced technology to improve patient safety, compliance, and workf

Data Engineer1 day ago

Technical Data Migration Consultant AUS - Melbourne Hybrid Job Description: RLDatix (RLD) is on a mission to help raise the standard of care…everywhere. Trusted by over 10,000 healthcare organizations around the world, our solutions help improve health and care. Our applications ensure that patients receive the best and safest care while supporting the providers who deliver it. Joining TeamRLD means being part of a global effort of over 2,000 team members in making a difference in healthcare…every day. We're searching for a Melbourne-based Technical Data Migration Consultant to join our Data Services Group team, so that we can successfully deliver high-quality healthcare data migration projects for our clients. The Technical Data Migration Consultant will extract, transform, and load healthcare data while collaborating with stakeholders to ensure seamless system transitions and accurate data outcomes. How You'll Spend Your Time - Develop, test, and execute data conversions using SQL and ETL techniques to ensure seamless migration between healthcare systems - Analyse healthcare data in formats such as HL7, CDA, CSV, and SQL in order to support accurate extraction, transformation, and loading - Create and maintain complex SQL scripts to convert data from multiple source systems to target EHR platforms - Facilitate stakeholder meetings to gather requirements, provide updates, and ensure successful delivery of data migration projects - Perform quality assurance checks on data to validate integrity, identify issues, and reconcile converted datasets for accuracy What Kind of Things We're Most Interested in You Having - 3+ years' experience working with healthcare data and EHR/EMR systems - Proven success in delivering data migration or data conversion projects within healthcare environments - In-depth knowledge of SQL Server, T-SQL scripting, and data transformation processes - Ability to commute to our Melbourne office on a hybrid basis - Sincere interest in improving healthcare outcomes through data accuracy and system transformation - A knack for working collaboratively with stakeholders while managing tasks independently in a fast-paced environment By enabling flexibility in how we work and prioritising employee wellness, we empower our team to do and be their best. Key benefits include private health and group accident insurance, an Employee Assistance Program (EAP) for confidential support, and Loyalty Awards for long-service employees. RLDatix is an equal opportunity employer, and our employment decisions are made without regard to race, colour, religion, age, gender, national origin, disability, handicap, marital status or any other status or condition protected by law. We welcome applications from people of all backgrounds and strongly encourage Aboriginal and Torres Strait Islander peoples to apply. As part of RLDatix's commitment to the inclusion of all qualified individuals, we ensure that persons with disabilities are provided reasonable accommodation in the job application and interview process. If reasonable accommodation is needed to participate in either step, please don't hesitate to send a note to accessibility@rldatix.com. Salary offers are based on a wide range of factors including location, relevant skills, training, experience, education, and, where applicable, licensure or certifications obtained. Market and organisational factors are also taken into consideration.

Australia
Hanover Insurance Group logo

Pipelines Operations - Data Engineer

Hanover Insurance Group

Hanover Insurance Group has consistently been named one of America’s Best Midsized Employers by Forbes magazine and one of Business Insurance magazine's Best Places to Work in In

Data Engineer1 day ago

Title: PL Ops - Data Engineer ) Location: Worcester, MA, USA United States Remote Req #19719 Job Description: Our Personal Lines Operations team is currently seeking a Data Engineer II in our Worcester office. This is a full-time, exempt role. Fully remote arrangement will be considered for candidates with strong qualifications. POSITION OVERVIEW: The Hanover Insurance Group is hiring a Personal Lines Operations Data Engineer to own the day-to-day reliability and enhancement of our Azure Data Factory (ADF) pipelines and on-prem SQL Server data environment. This role builds and improves ETL workflows that populate SQL tables used by analysts to create Power BI semantic models and reports. The position is split approximately 50/50 between production operations/support and new development/enhancement, while also advancing platform maturity through improved monitoring/alerting, data quality validation, and formalized release practices. What You'll Own: Production support and daily health of scheduled ADF pipelines. Build new pipelines and enhance existing pipelines to improve resiliency, maintainability, and scalability. Implement data validation controls, improve monitoring/alerts, and help define SLAs for data freshness and availability. Establish foundational SDLC practices for data engineering (Git usage, Dev→Prod promotion practices, and a more formal release process). Coordinate cross-team dependencies where upstream internal ETL timelines affect downstream pipeline completion; design dependency-aware orchestration and readiness checks. Contribute to future-state Azure data strategy recommendations (e.g., Data Lake/Blob Storage, notebooks) and support long-term migration planning from on-prem SQL Server to cloud databases (timeline not yet defined). KEY RESPONSIBILITIES: Azure/Fabric Data Factory Engineering Design and maintain curated SQL tables/views used for analytics and reporting; optimize for refresh performance and downstream usability. Develop and maintain ADF pipelines (Copy activities and Data Flows) with consistent patterns for logging, error handling, retries, and notifications. Implement parameterization and reusable components to reduce duplication and speed enhancements. Implement incremental load and backfill strategies appropriate to volume. Production Support & Reliability Monitor daily pipeline execution and triage incidents quickly to restore successful processing. Perform root-cause analysis for failures and recurring issues; implement preventative controls and standardized patterns. Create and maintain operational documentation/runbooks for critical pipelines and common support scenarios. Data Quality, Validation & Trust Build automated validation routines and reconciliation checks (row counts, totals, null/duplicate thresholds, schema drift detection, anomaly flags). Partner with analysts and stakeholders to define key business rules and quality thresholds for trusted reporting datasets. Document data definitions, transformations, and lineage to improve transparency and troubleshooting. Stakeholder Collaboration & Dependency Management Work directly with internal Operations Data Analysts, business stakeholders and external partner analysts to gather requirements and deliver datasets that enable robust Power BI semantic models, reporting and other analytical solutions. Coordinate with upstream internal teams to align dependency readiness signals and timelines; implement orchestration controls to prevent downstream failures. Provide technical coaching and mentoring to less experienced team members; including the usage of best practices. KEY MEASURES OF SUCCESS: Pipelines meeting SLA / on-time delivery Pipeline success rate and reduced manual intervention Time-to-detect/time-to-resolve ETL failures (MTTD/MTTR) Improvements in query/runtime performance and cost efficiency Reduction in recurring data quality defects; completeness/accuracy checks passing Documentation coverage (runbooks for critical pipelines, data dictionary completeness) Required Qualifications Bachelor's Degree preferred in a related field. 6+ years of experience in data engineering, ETL/ELT, or related roles. Hands-on experience building and supporting production pipelines in Azure Data Factory. Strong SQL/T-SQL skills and experience with SQL Server environments supporting analytics/reporting workloads. Advanced data modeling Experience integrating data from multiple sources including databases, flat files/SFTP, and APIs/vendor feeds. Familiarity with Azure data platform components (Data Lake/Blob Storage, notebooks) and/or cloud migration planning, or similar platforms. Strong troubleshooting, root-cause analysis, and operational ownership mindset. Ability to work directly with stakeholders to gather requirements and translate them into technical solutions. Strong communication and documentation skills: Data engineers are often called to present their findings or translate the data into an understandable document. You will need to write and speak clearly, easily communicating complex ideas. Preferred Qualifications Experience establishing SDLC practices for data teams (Git, CI/CD, release management). Experience implementing monitoring/alerting and operational dashboards for data pipelines. Python and/or PowerShell for automation, data validation, and operational tooling. Insurance or operations/customer service experience Familiarity with prompt-based programming and tools (GitHub CoPilot) This job posting provides cursory examples of some of the job duties associated with this position. The examples provided are not complete, and the position may entail other essential and job-related functions and responsibilities that employees will be required to perform.

Massachusetts
Sleek logo

Data Engineer

Sleek

One-stop-shop for entrepreneurs to start & grow their business in Australia, Hong Kong, Singapore and the UK.

Data Engineer1 day ago
Full TimeRemoteTeam 51-200Since 2017H1B No Sponsor

• You will design, build, and maintain robust data pipelines on databricks and AWS infrastructure that power analytics and reporting capabilities across the organization. • Design and implement scalable ETL/ELT pipelines using both batch and streaming patterns • Build and maintain ingestion workflows from diverse sources (databases, APIs, event streams) • Implement Change Data Capture (CDC), full-load, and incremental ingestion strategies. • Develop and manage data workflows using Apache Airflow for orchestration. • Configure and manage data ingestion connectors using Airbyte. • Work with Databricks to build and optimize data engineering workloads on the Lakehouse platform. • Write and optimize complex SQL queries. • Solid hands-on experience on dbt with databricks, build modular, testable dbt models for data transformation. • Develop and maintain data models in staging, intermediate, and mart layers following data warehousing best practices. • Containerize data services and applications using Docker & EKS. • Ensure data quality, observability, and reliability across the data platform. • Document pipelines, models, and data dictionaries to maintain platform knowledge.

India
Apex Systems logo

Senior Data Engineer - Databricks

Apex Systems

Apex Systems, an IT staffing and workforce solutions firm, provides recruiting and staffing services to large and small companies alike. Founded in 1995 by thre

Data Engineer1 day ago

Senior Data Engineer - Databricks Location: Charlotte, NC, US Employee Type: Contract Job Type: Pay Range: $65 - $75 per hour Job Description: Job#: 3035030 Job Description: Sr. Data Engineer - Databricks Location: Charlotte, North Carolina- 3X A WEEK HYBRID Employment Type: Contract Role Overview We are seeking a Sr. Data Engineer with expertise in Databricks. This role involves the design, development, and maintenance of scalable data pipelines and solutions. The position requires a focus on workflow orchestration, performance optimization, and data governance within the Databricks ecosystem. Key Responsibilities - Build and schedule jobs using Databricks Workflows, Asset Bundles, or orchestrators like Airflow. - Optimize Spark jobs for performance, including cluster sizing, caching, AQE, and broadcast joins, reduce costs, and troubleshoot via the Spark UI. - Design and implement dimensional models, slowly changing dimensions (SCDs), and curated datasets for BI and Databricks SQL consumption. - Implement data governance and security using Unity Catalog, including schemas, lineage, access controls, and row/column-level security, and manage secrets. - Manage CI/CD pipelines and infrastructure using version control (Git) and deployment tools like Asset Bundles or Terraform. - Establish data quality frameworks using tools such as DLT or Great Expectations, along with monitoring and alerting systems. Required Qualifications Technical Skills: Databricks Compensation & Benefits The anticipated pay range for this position is $65.00 to $75.00 per hour. Please note that the final pay rate will be determined by a variety of factors, including the candidate's experience and qualifications. Benefits may be available to eligible employees. This employer is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, or protected veteran status and will not be discriminated against on the basis of disability. Everforth Apex is a world-class IT services company that serves thousands of clients across the globe. When you join Everforth Apex, you become part of a team that values innovation, collaboration, and continuous learning. We offer quality career resources, training, certifications, development opportunities, and a comprehensive benefits package. Everforth Apex Benefits Overview: Everforth Apex offers a range of supplemental benefits, including medical, dental, vision, life, disability, and other insurance plans that offer an optional layer of financial protection. We offer an ESPP (employee stock purchase program) and a 401K program which allows you to contribute typically within 30 days of starting, with a company match after 12 months of tenure. Everforth Apex also offers a HSA (Health Savings Account on the HDHP plan), a SupportLinc Employee Assistance Program (EAP) with up to 8 free counseling sessions, a corporate discount savings program and other discounts. In terms of professional development, Everforth Apex hosts an on-demand training program, provides access to certification prep and a library of technical and leadership courses/books/seminars once you have 6+ months of tenure, and certification discounts and other perks to associations that include CompTIA and IIBA.

North Carolina
$65 - $75 / hour