PartnerOne logo
PartnerOne

We are the leaders in Big Data management through hyper-automation, virtualized cloud tiering, metadata and AI

Data Engineer

Data EngineerData EngineerContractRemoteSeniorTeam 201-500H1B No SponsorCompany SiteLinkedIn

Location

Brazil

Posted

3 days ago

Salary

0

Seniority

Senior

Bachelor DegreeEnglishETLInformaticaPythonSQL

Job Description

Data Engineer

PartnerOne

**Data Pipeline Development:** - Design and build ETL pipelines using Microsoft Fabric (Dataflow Gen2, Notebooks, or equivalent tools) - Write optimized SQL queries and transformations for data ingestion from designated source systems - Apply data quality rules and validation logic at each pipeline stage - Implement incremental loads and manage refresh schedules for performance - Escalate to Lead for architectural decisions or complex transformation patterns **Data Quality & Validation:** - Define and implement data quality checks at ingestion, transformation, and output stages - Perform ongoing data validation to ensure pipeline outputs align with business logic and source system expectations - Identify, document, and escalate data quality issues with root cause analysis - Maintain data quality dashboards and SLA monitoring - Support UAT for new data sources or transformation logic **Transformation & Modeling:** - Build and maintain data transformations using Power Query, SQL, or Python as appropriate - Develop dimensional models and define aggregation logic aligned with analytics requirements - Optimize data structures for performance and maintainability - Document transformation logic, lineage, and assumptions per team standards - Collaborate with Lead to define semantic **Operational Support:** - Troubleshoot pipeline failures and performance issues; coordinate resolution with IT/Engineering - Respond to data discrepancy reports from business users and analysts - Maintain documentation of data sources, data dictionaries, and transformation specifications - Support capacity planning and optimization of Fabric environments and pipelines models and calculated metrics

Job Requirements

  • Technical**
  • Advanced SQL** - query optimization, window functions, performance tuning, debugging complex transformations
  • Proficient with Microsoft Fabric** - (Dataflow Gen2, Notebooks, Lakehouse) OR equivalent ETL tools (Python, dbt, Talend, Informatica)
  • Strong understanding of relational database design and dimensional modeling
  • Power Query / M** - complex data shaping, merging, error handling, and transformation logic
  • Python or similar scripting language** - data manipulation, pipeline automation
  • Git/version control basics** - able to collaborate on code and track changes
  • Data quality and testing frameworks** - unit tests, assertions, validation rules
  • Non-Technical**
  • Ability to interpret business requirements and design efficient data solutions
  • Data governance mindset - understands data lineage, documentation, and quality standards
  • Proactive about identifying edge cases and potential data issues
  • Mortgage/lending domain familiarity preferred; willingness to learn domain required
  • Works effectively within defined standards and escalates architectural questions to Lead
  • Able to balance speed with quality; advocates for technical excellence

Related Categories

Related Job Pages

More Data Engineer Jobs

Full TimeRemoteTeam 1,001-5,000H1B No Sponsor

• Drive execution against the product roadmap for core retail platforms, integrations, and data foundations; contribute to roadmap prioritization in partnership with the Director of Product. • Translate complex operational and business needs into scalable, reusable platform capabilities rather than bespoke solutions. • Lead product execution for OMS-adjacent capabilities including order lifecycle management, inventory visibility, fulfillment orchestration, routing, splits, cancellations, and returns. • Define and evolve integration patterns, APIs, and data contracts across OMS, POS, ERP, WMS, CEP, CDP, and analytics platforms. • Own requirements for eventing, instrumentation, and data quality standards; define and maintain the governance model for core data domains (customer, order, product, inventory). • Partner with Data and Analytics teams to enable reliable reporting, agent-enabled insights, self-serve analytics, and downstream activation for experimentation, measurement, and AI use cases. • Research, evaluate, and scorecard platform and vendor solutions with a critical eye on architecture, scalability, integration complexity, and total cost of ownership; provide feasibility analysis to inform build-vs-buy decisions. • Identify where AI or automation can reduce operational cost, improve data quality, or accelerate fulfillment outcomes. Evaluate solutions pragmatically and make the case for prioritizing them.

Canada
$130K - $140K / year

• Own the end-to-end integration strategy across CAD, RMS, jail records, public records, LPR, video, mapping, alerts, evidence, and other agency and third-party systems, while creating a scalable integration model powered by automation and AI. • Define how public safety data is modeled, governed, and trusted, establishing standards for data quality, source attribution, permissions, reliability, auditability, and downstream usability. • Accelerate customer workflows by building intuitive search, mapping, and investigative experiences that help agencies make faster, more informed decisions. • Partner cross-functionally with engineering, GTM, customer-facing teams, executive leadership, and third-party vendors to deliver scalable platform capabilities and shape the future of Flock's integrations platform.

United States
$160K - $190K / year
Fusion Consulting logo

Functional Data Owner - WM & EWM

Fusion Consulting

Shaping the Future of Life Science Consulting Worldwide

Data Engineer4 days ago
Full TimeRemoteTeam 501-1,000Since 2012H1B Sponsor

Role Description We are looking for an experienced SAP Warehouse Management (WM)/Extended Warehouse Management (EWM) Functional Consultant with strong data migration experience to support a global SAP transformation program within the life sciences sector. In this role, you will serve as the global focal point for Warehouse Management data objects during migration, partnering with functional, technical, and business teams to ensure successful data readiness and migration execution. - Act as the global focal point for SAP WM and EWM data objects in scope for migration, collaborating with Global Template BDOs, Functional Streams, Data Migration Developers, and Legacy Experts. - Gather and validate functional specifications for data migration tools. - Provide test data sets for migration tool testing and validation. - Offer guidance on SAP ECC standard data extractions and data structures where applicable. - Own and maintain global templates and scripts (e.g., FSs (DDT), SATs, DVSs) including validation and verification approaches and authorization designs. - Review and approve System Acceptance Testing (SAT) for data migration tools. - Advise business teams on data readiness and cleansing activities based on technical and functional requirements. - Review and confirm defect resolution testing related to global template migration tool design. - Conduct knowledge transfer sessions with deployment and local Functional Data Owners. Qualifications - Minimum 5 years of hands-on SAP WM/EWM experience. - Proven data migration experience in large-scale or global SAP programs. - Strong knowledge of SAP ECC data models, especially within the PM module. - Experience collaborating with cross-functional and technical teams in a global template environment. - Excellent communication, coordination, and stakeholder management skills. Benefits - Workflex: Enjoy 25 days of flexibility to work from your preferred global location. - Flexible Time Off: Take the time you need to recharge and maintain a healthy work-life balance, with flexibility beyond standard holiday allowances. - Annual Training Budget: Access CHF 1,500 to invest in your professional development and skill enhancement. - Continuous Learning: Thrive in an environment that encourages ongoing learning, with opportunities to develop new skills and broaden your expertise. - Global Mobility Support: Gain assistance with international assignments, visa/permit support, and relocation services. - Unity Scheme: Benefit from loyalty rewards starting after 3 years of service. - Referral Program: Earn a referral fee for every successfully hired referee. - Local Benefits: Access a range of country-specific benefits tailored to your location. - People Focus: Unite with the best global talent in life sciences, empowered to grow and collaborate in a vibrant environment. - Truly Global: Join a truly global organization where mutual support, teamwork, and diversity drive our collective success.

Worldwide
EXL logo

Lead Data Engineer

EXL

We make sense of data to drive your business forward. #MakeSenseofData #DriveYourBusinessForward #PartnerYourWay

Data Engineer4 days ago
Full TimeRemoteTeam 10,001+H1B No Sponsor

Role Description - Must have 7+ years of relevant experience in Data Engineering and delivery. - 5+ years of relevant work experience in Big Data Concepts. Worked on cloud implementations. - Strong experience with SQL, Python, and Pyspark. - Good understanding of Data ingestion and data processing frameworks. - Good experience in Snowflake, SQL, AWS (Glue, EMR, S3, Aurora, RDS, AWS architecture). - Good aptitude, strong problem-solving abilities, analytical skills, and ability to take ownership. Company Description EXL (NASDAQ: EXLS) is a leading data analytics and digital operations and solutions company. We partner with clients using a data and AI-led approach to reinvent business models, drive better business outcomes and unlock growth with speed. - EXL harnesses the power of data, analytics, AI, and deep industry knowledge to transform operations for the world’s leading corporations in industries including insurance, healthcare, banking and financial services, media, and retail. - Founded in 1999 with core values of innovation, collaboration, excellence, integrity, and respect. - Headquartered in New York with more than 54,000 employees spanning six continents. - EXL never requires or asks for fees/payments or credit card or bank details during any phase of the recruitment or hiring process. - EXL will only extend a job offer after a candidate has gone through a formal interview process with members of EXL’s Human Resources team and hiring managers. - EXL is the indispensable partner for leading businesses in data-led industries such as insurance, banking and financial services, healthcare, retail, and logistics. - We bring a unique combination of data, advanced analytics, digital technology, and industry expertise to help our clients turn data into insights, streamline operations, improve customer experience, and transform their business. - Our partnerships with clients are built on a foundation of collaboration. - Chosen as a partner by nine of the top ten leading US insurance companies, nine of the top 20 global banks, and six of the top ten US health care payers. - Clients choose EXL as their transformation partner for many reasons, including geographic diversity, digital accelerators, and our dedicated team of data scientists.

United States
$130K - $150K / year
Job Closed