Job Closed

This listing is no longer active.

AWS Data Engineer – Specialist

Data EngineerData EngineerFull TimeRemoteSeniorTeam 10,001+H1B SponsorCompany SiteLinkedIn

Location

Brazil

Posted

82 days ago

Salary

0

Seniority

Senior

Bachelor DegreePortugueseAWSPythonApache Spark

Job Description

AWS Data Engineer – Specialist

Compass

• Support and evolve a Lakehouse data platform on AWS based on the Medallion model (raw, trusted, and refined), with a focus on data originating from SAP systems; • Responsible for ensuring the reliability, scalability, and operational efficiency of data pipelines, driving continuous improvements in performance, security, governance, and cost optimization; • Technical leadership in the design and implementation of ingestion and processing pipelines using services such as AWS Glue, EMR, and Lambda, ensuring adherence to cloud-native architecture patterns and data engineering best practices; • Lead modernization and migration initiatives for legacy workloads to AWS, focusing on resilience, scalability, and reduced operational complexity; • Work across multiple projects with strong interaction with business, architecture, security, and operations teams, contributing to strategic alignment, requirements definition, and the evolution of the corporate data platform.

Job Requirements

  • AWS: S3, Glue, Athena, EMR, Lambda, Step Functions;
  • Data engineering with Python and Spark;
  • Analytical data modeling and pipeline optimization;
  • Experience with legacy environments and migration strategies to AWS;
  • Consultative attitude, clear communication, strong ability to translate business needs, and focus on delivering value.

Benefits

  • Persons with disabilities (PwD)

Related Categories

Related Job Pages

More Data Engineer Jobs

Full TimeRemoteTeam 5,001-10,000Since 2001H1B Sponsor

• Monitor and troubleshoot data pipeline and warehouse quality and performance issues, ensuring smooth operation and proactively addressing potential bottlenecks • Design, build, and maintain scalable ETL/ELT pipelines to transfer data to and from clients from diverse sources, such as APIs, cloud storage, and databases • Collaborate with client engineering teams to understand their data structures, identify source systems, and contribute to technical integration requirements • Stay updated with industry trends and advancements in data engineering and bring innovative ideas to continuously improve our data processes • Ensure data security, privacy, and compliance by implementing appropriate Azure policies, procedures, and encryption methods • Monitor and optimize the performance, scalability, and cost-efficiency of data storage and processing solutions on Azure

United States
$100K / year
Job Closed
ActBlue logo

Senior Data Engineer II

ActBlue

ActBlue is a fundraising software tool geared towards liberal people and organizations. The company offers fundraising tools, technology, and software designed

Data Engineer82 days ago

WHO WE ARE ActBlue is a nonprofit organization dedicated to creating cutting-edge technology that fuels Democratic victories and enables progressive causes to thrive. Our vision is simple: building change through the power of people. Since our founding, we’ve been building innovative solutions to revolutionize grassroots fundraising – if you’ve donated to a Democratic campaign or a progressive organization online, you’ve probably used our platform! We believe in putting power in the hands of small-dollar donors by helping thousands of groups — from local candidates to national movements — mobilize their communities and create a lasting impact. Every member of our team is deeply committed to advancing our shared mission and core values. Together, we are shaping the future of democracy. THE OPPORTUNITY We’re looking for a Senior Data Engineer II to join ActBlue’s Data Department and contribute to building and evolving the data products that power our platform. As part of the Data Product Team, you'll help integrate our internal data platform with user-facing applications and infrastructure. You’ll work across the data lifecycle—from ingestion and modeling to deploying machine learning pipelines—focused on unlocking insights, personalization, and automation that support political campaigns, organizations, and donors. This is a hands-on role for someone who thrives in a collaborative environment and brings deep Python engineering expertise along with a pragmatic, product-minded approach to data systems. WHAT YOU WILL DO - Design, build, and maintain scalable, reliable, and secure data pipelines using Python, with a focus on enabling data access and insight across product teams, engineering, and entities. - Develop reusable data services and frameworks that support high-quality data ingestion, transformation, and ML model deployment — accelerating analytics and experimentation across the organization. - Collaborate with data scientists and ML engineers to productionize machine learning workflows using SageMaker, Vertex AI, or other MLOps tools - Implement monitoring, testing, and CI/CD automation for data pipelines and ML services - Own and evolve real-time and batch data integrations between ActBlue’s core systems and user-facing applications — influencing design decisions and architecture across multiple teams including Product, Engineering, and Analytics. - Develop, optimize and support reverse ETL workflows using tools like Hightouch - Participate in code reviews, mentor junior engineers, and help foster a high-trust engineering culture. - Demonstrate technical leadership through writing documentation, establishing effective monitoring, and fostering clear and audience-oriented communication. WHAT YOU BRING - 5+ years of relevant professional experience in data engineering or backend development with a strong focus on Python. - Expertise in writing clean, modular, tested, and production-ready Python code. - Strong understanding of data architecture, distributed systems, and security best practices. - Experience deploying and supporting production ML workflows (e.g., SageMaker, Vertex AI, or equivalent). - Familiarity with ELT tools such as Fivetran and data modeling frameworks like DBT. - Solid command of SQL and experience working with large analytical databases (e.g., Redshift, PostgreSQL). - Experience with monitoring and observability using Datadog or similar tools. - A team player mentality. You keep the end user in mind and enjoy hearing feedback from your teammates, yet know when and how to defend your own ideas in a respectful manner. - Commitment to ActBlue’s mission and values, including equity, accessibility, and civic engagement BONUS POINTS - Experience with ML platforms like SageMaker, Vertex AI, TensorFlow, or Modelbi. - Experience with real-time data systems or streaming platforms. - Experience contributing to internal platforms or tooling used across engineering teams. - Experience implementing robust testing frameworks for data workflows (e.g., Pytest, dbt tests) WORK & BENEFITS SNAPSHOT This posting is for a full-time, remote, salaried position. Travel may be required on a limited basis to attend all-staff and departmental retreats (1-2 times per year). Additional travel may be required for select positions. Registered States*: Arizona, California, Colorado, Connecticut, Florida, Georgia, Hawaii, Illinois, Maryland, Massachusetts, Michigan, Minnesota, Missouri, New Hampshire, New Jersey, New York, North Carolina, North Dakota, Ohio, Oregon, Pennsylvania, Rhode Island, South Carolina, Texas, Utah, Vermont, Virginia, Washington, Wisconsin, and Washington D.C. *While ActBlue is currently registered to support remote work in the states listed above, we possess the ability to register in additional states as needed. If you are located in a state not listed, we may still be able to proceed with your application, but please note that the offer process may take longer to accommodate registration requirements. Work Schedule: This role requires availability during established, regular business hours (Mon-Fri) and is expected to be a part of an on-call rotation which will result in working nontraditional hours as needed. Work Environment: Employees can expect to work with distributed teams across all U.S. time zones. Our roles require extended technology usage, and proficiency with virtual communication tools such as Zoom and Slack. Regular attendance in virtual meetings is inherent to every position. Salary Range Details: Salary Range: $173,676 - $192,209 - $210,741 ActBlue is committed to consistent compensation practices across our organization. Final salary offers will take into account factors such as candidate experience, interview performance and current team salary parity. Benefits: - Flexible work schedules and an unlimited time-off policy - Fully paid and trans-inclusive health, dental, and vision insurance for employees and their families; plus fully-paid health reimbursement arrangement to use for out of pocket expenses and fully-paid short- and long-term disability - Fully paid basic and AD&D life insurance and a voluntary supplemental life insurance option - Dependent and health care flexible spending account options - Employee Assistance Program (EAP) benefits for employees - Automatic 2% Employer-paid 401K contribution, plus up to an additional 6% match on employee contributions - A minimum of three months paid medical, family and parental leave (for all new parents, adoptions included) - Commuter or home-office benefits, including a $1,000 home-office setup allowance for all new full-time remote employees - Additional perks including quarterly snack deliveries and digital subscriptions to the Boston Globe & New York Times ActBlue is unable to sponsor work visas at this time. UNION INFORMATION The terms and conditions of this position are subject to a collective bargaining agreement with the Communications Workers of America, the exclusive bargaining agent of covered ActBlue Technical Services employees. BACKGROUND CHECKS As part of our hiring process, ActBlue will conduct a background check at the time of offer. This will be completed in compliance with applicable laws and will not be initiated without your consent. INCLUSION STATEMENT FROM ACTBLUE ActBlue is committed to equal employment opportunities and fostering a diverse, inclusive workplace. We celebrate unique perspectives, honor the dignity of all individuals, and recognize that diverse backgrounds and identities strengthen our mission. If you’re passionate about our work and see yourself in this role, we encourage you to apply—even if you don’t meet every requirement. We also provide reasonable accommodations for individuals with disabilities throughout the hiring process and employment. To request an accommodation, email recruitment@actblue.com. *ActBlue will never ask candidates to buy equipment, nor will we email from anything other than an actblue.com or actbluetech.com email address.

United States
$173.7K - $210.7K / year
Job Closed
NMI logo

Cloud Data Engineer

NMI

Full commerce is the future — we get you there now.

Data Engineer82 days ago
Full TimeRemoteTeam 201-500H1B Sponsor

• Design, build, and enhance features across multiple Gateway Portal applications used by NMI staff, partners, and merchants • Develop and maintain front-end and back-end functionality using technologies such as PHP, C#, JavaScript, React, and Angular • Develop and maintain MySQL queries aligned with best practices for performance and scalability • Write unit, integration, and end-to-end tests to ensure code quality and reliability • Document business logic, application workflows, and technical design decisions • Collaborate with Product Managers to refine requirements and contribute to technical solution design • Participate in code reviews to maintain high engineering standards and share best practices • Work with Site Reliability Engineering and QA teams to ensure software is observable, resilient, secure, and production-ready • Diagnose and resolve incidents, defects, and performance bottlenecks in collaboration with cross- functional teams • Contribute to continuous improvement of development processes, tooling, and engineering practices

Canada
Job Closed
GovCIO logo

DW/BI Architect (Remote)

GovCIO

GovCIO is a service-disabled-veteran-owned small business (SDVOSB) that offers technology services to improve business performance for government organizations.

Data Engineer82 days ago

Overview GovCIO is looking for a highly skilled and experienced Senior Data Engineer / Data Architect to join our team. In this role, you will be responsible for architecting and developing enterprise data models, metadata governance frameworks, ETL pipelines, and analytics platforms to support data governance, performance measurement, and business intelligence solutions for VA client. Your expertise in data modeling, ETL development, cloud data services, and metadata-driven architecture will be critical to the success of federal data platforms and analytics systems. This position will be a fully remote within the United States. Responsibilities - Design, build, and maintain relational data models in SQL Server 2019-2022 Enterprise to support metadata governance, request submissions, audit tracking, version control, and production publishing pipelines. - Architect multi-stage relational models for metadata lifecycle management, including intake submissions, staging, review, audit trail snapshots, approval tracking, and final publishing structures. - Develop and maintain SSIS packages and ETL pipelines for metadata ingestion, transformation, validation, auditing, staging, and publishing processes supporting multi-layered data warehouse architectures. - Apply hybrid cloud integration expertise utilizing Azure SQL, Azure Data Factory, Databricks, Synapse Analytics, and Azure Fabric to develop and support scalable data pipelines and platform modernization initiatives. - Collaborate closely with business analysts, Power BI developers, Power Apps developers, and VA stakeholders to gather requirements and translate functional business needs into scalable technical data solutions. - Build Power Platform integrations (Power BI, PowerApps, Power Automate) connecting to SQL Server and cloud data services; implement identity-based row-level filtering using Power Platform user context for submission-level security and role-based access control. - Maintain fully auditable data models including metadata change tracking, approval lineage, governance version control, and compliance documentation to support ATO certification, PMO audit packages, and federal regulatory standards. - Conduct advanced query tuning, stored procedure optimization, index management, query plan evaluation, blocking and deadlock resolution, and performance troubleshooting across large relational data platforms. - Develop and maintain comprehensive technical documentation including data dictionaries, entity-relationship diagrams (ERDs), data flow diagrams, process workflows, swimlane diagrams, system architecture diagrams, metadata catalogs, data lineage models, dependency mappings, and PMO governance documentation packages. - Provide full lifecycle production support including ETL pipeline monitoring, SSIS failure remediation, long-running job resolution, scheduled job support, SQL Server troubleshooting, and incident management across on-premises and hybrid data environments. Qualifications Required Skills and Experience - Bachelor’s degree in Computer Science, Information Technology, or related field with 15+ years (or commensurate experience) - 10+ years of experience in SQL Server database development, data architecture, and ETL design. - 8+ years of experience in data warehouse architecture, metadata governance, and analytics platforms. - Deep hands-on experience with SQL Server 2019-2022 Enterprise (on-prem), SSIS, T-SQL, and relational database design. - Cloud experience with Azure or AWS platforms. - Proficiency in Azure Data Factory, Databricks, Synapse Analytics, and hybrid cloud integration for modernizing ETL pipelines. - Experience with Azure DevOps for version control, CI/CD pipeline automation, and release management. - Experience with additional RDBMS platforms including Oracle, PostgreSQL, MySQL. - Power Platform experience integrating Power BI, PowerApps, and Power Automate into enterprise reporting and data governance solutions. - SharePoint Online experience supporting integrated metadata governance processes. - Knowledge of metadata-driven design patterns, audit trail frameworks, and enterprise governance architecture aligned to federal PMO standards. - Strong technical documentation skills, including ERDs, data dictionaries, data flows, and process mapping. - Strong experience in performance tuning, query optimization, and long-running job remediation. - Excellent troubleshooting, problem-solving, and analytical skills across full data pipeline lifecycle. - Familiarity with federal compliance frameworks (ATO, FISMA, NIST 800-53, FedRAMP). - Clearance Required: Suitability/Public Trust Skills Considered a Plus: - Microsoft Fabric platform (Power BI Premium, Data Warehousing, RLS security models). - Additional experience with MongoDB or NoSQL stores. - Python, PowerShell, or other scripting for ETL and automation. - IT security certifications (e.g., CISSP, CISM, GIAC) helpful. - Prior experience working within federal data governance or VA PMO environments. Company Overview GovCIO is a team of transformers--people who are passionate about transforming government IT. Every day, we make a positive impact by delivering innovative IT services and solutions that improve how government agencies operate and serve our citizens.But we can't do it alone. We need great people to help us do great things - for our customers, our culture, and our ability to attract other great people. We are changing the face of government IT and building a workforce that fuels this mission. Are you ready to be a transformer? What You Can Expect Interview & Hiring Process If you are selected to move forward through the process, here’s what you can expect: - During the Interview Process - Virtual video interview conducted via video with the hiring manager and/or team - Camera must be on - A valid photo ID must be presented during each interview - During the Hiring Process - Enhanced Biometrics ID verification screening - Background check, to include: - Criminal history (past 7 years) - Verification of your highest level of education - Verification of your employment history (past 7 years), based on information provided in your application Employee Perks At GovCIO, we consistently hear that meaningful work and a collaborative team environment are two of the top reasons our employees enjoy working here. In addition, our employees have access to a range of perks and benefits to support their personal and professional well-being, beyond the standard company offered health benefits, including: - Employee Assistance Program (EAP) - Corporate Discounts - Learning & Development platform, to include certification preparation content - Training, Education and Certification Assistance* - Referral Bonus Program - Internal Mobility Program - Pet Insurance - Flexible Work Environment *Available to full-time employees Our employees’ unique talents and contributions are the driving force behind our success in supporting our customers, which ultimately fuels the success of our company. Join us and be a part of a culture that invests in its people and prioritizes continuous enhancement of the employee experience. We are an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, disability, or status as a protected veteran. EOE, including disability/vets. Posted Pay Range The posted pay range, if referenced, reflects the range expected for this position at the commencement of employment, however, base pay offered may vary depending on multiple individualized factors, including market location, job-related knowledge, skills, education, experience, and internal equity. The total compensation package for this position may also include other compensation elements, to be discussed during the hiring process. If hired, employee will be in an “at-will position” and the GovCIO reserves the right to modify base salary (as well as any other discretionary payment or compensation program) at any time, including for reasons related to individual performance, GovCIO or individual department/team performance, and market factors. Posted Salary Range USD $160,000.00 - USD $164,000.00 /Yr.

United States
$160K - $164K / year
Job Closed