Candid.org is a 501(c)(3) nonprofit organization that formed when The Foundation Center joined forces with GuideStar. For a combined 80+ years, The Foundation Center and GuideStar
Associate Data Engineer
Location
Worldwide
Posted
41 days ago
Salary
$70K - $95K / year
Seniority
Senior
Job Description
Associate Data Engineer
Candid.org
Title: Associate Data Engineer Location: United States, Remote Department: Data Science Job Category: Data Science Requisition Number: ASSOC001075 Full-Time Remote Remote - General (United States) Job Description: Position summary Candid is a nonprofit that provides the most comprehensive data and insights about the social sector. We get you the information you need to do good. Candid currently has an opportunity for an Associate Data Engineer. The Associate Data Engineer supports the day-to-day operations of Candid’s cloud data platform. This role is responsible for maintaining ingestion and transformation pipelines built on Apache Iceberg, validating data outputs through schema and structural changes, and assisting with storage management, platform observability, and metadata operations. The Associate Data Engineer develops foundational skills across the modern data lakehouse stack while taking direct ownership of pipeline maintenance, documentation, and validation activities. Position: Associate Data Engineer Reporting to: Data Operations Manager Supervises: N/A Schedule: 35-hour work week, Monday through Friday Compensation: $70,000 - $95,000 (this range is for the NYC area and will be adjusted for other localities; additionally, factors like skills and experience will be considered). Location: Remote. In-person attendance is expected twice per year during our annual, weeklong all-staff summits. Additional in-person meeting participation is expected at least once per quarter for senior leaders and at least once per month for the executive team. Staff not located in the NYC area are expected to travel for these meetings. Benefits: Health insurance (medical, dental, vision), retirement contribution with additional option for a match, paid life insurance and AD&D, paid leave time (PTO, compassionate leave, volunteer, holiday, parental), short-term and long-term disability, pre-tax transit, flexible spending accounts, supplemental insurance, summer hours, and Public Service Loan Forgiveness (PSLF) program eligible employer. Responsibilities - Pipeline Maintenance, Documentation, & Validation: Serve as the primary owner of ingestion pipelines and transformation table adjustments. Ensure continued, reliable data delivery and apply routine changes as business and schema needs evolve. Validate transformation outputs against expected results after schema or structural changes, documenting findings and escalating anomalies to the appropriate teams. - Storage & Platform Support: Assist with scheduling compaction and cleanup jobs to maintain Iceberg table health and query performance. Support partition evolution and snapshot retention management to control storage growth. - Observability & Metadata: Assist in implementing and maintaining CloudWatch metrics, alarms, and dashboards to ensure pipeline visibility. Contribute to tracking and reporting on platform performance metrics. Help maintain AWS Glue metadata refresh and statistics jobs that support query planning and optimization within the data platform. - Schema Coordination: Assist with coordinating schema changes across ingestion and transformation layers to maintain consistency end to end. Collaborate with the Data Operations Engineer to communicate impacts and sequence changes safely. - Infrastructure & Security: Support and maintain RBAC and ABAC (least privilege, standardized roles, and consistent tagging). Participate in access reviews and audits, documenting changes and escalating risks as needed. Requirements - 1– 3 years of experience in data engineering, analytics engineering, or a closely related technical role; internships and relevant academic project work considered. - Solid SQL skills, including writing, reading, and debugging queries against relational or columnar data stores. - Familiarity with cloud data concepts: object storage (Amazon S3), columnar file formats (i.e. Parquet), data-interchange formats (JSON, XML), or open table formats (i.e. Apache Iceberg). - Experience with or exposure to distributed SQL query engines such as Trino or Starburst - Familiarity with AWS services such as S3 and Glue. - Exposure to Apache Airflow, SSIS or another workflow orchestration platform - Experience writing or maintaining data pipelines in Python. - Familiarity with on-prem relational data systems (i.e. Microsoft SQL Server). - Strong attention to detail, especially around data validation and output accuracy. - Strong analytical and problem-solving skills. - Excellent written and verbal communication skills; ability to document findings clearly for both technical and non-technical audiences. - Ability to work independently and collaboratively as part of a distributed team. - Willingness to perform other duties and special projects as needed/requested. - Sensitivity and respect for racial, gender, sexual orientation, and cultural differences. - Champions and represents Candid’s core values: We’re driven, direct, accessible, curious, and inclusive. About Candid Candid’s mission is to get you the information you need to do good. The world’s problems are only growing, and change can’t wait. Nonprofits are needed now more than ever, but all too often their work goes without adequate support. Candid makes it easier and faster for nonprofits and funders to connect in pursuit of solutions to change the world. Candid is where nonprofits find grants, donors find nonprofits that inspire them, and all can gain insights about the work being done for good. Candid is a qualifying nonprofit organization as defined by the Public Service Loan Forgiveness Program. As such, Candid employees may claim their employment time on their PSLF application. We offer a competitive salary and excellent benefits. Due to the high volume of applicants we typically receive, we regret that we can only contact candidates we would like to interview. Candid is an equal opportunity employer. Candid provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Staff Engineer Data
Arbor EducationArbor MIS helps schools and MATs work more easily and collaboratively. Join a free webinar: http://bit.ly/Arbor-webinars
Title: Staff Engineer (Data) Location: GB, United Kingdom Job Description: Location: Remote Salary: Competitive, dependent on experience About us At Arbor Education, we are dedicated to transforming the way schools operate to create happier, more efficient working environments for school staff. Our innovative Management Information System (MIS) and school management tools are currently used by over 7,000 schools and trusts across the UK, helping to turn data into actionable insights and improve the daily working lives of educators. About the role We are seeking a highly skilled and visionary Staff Engineer to join our dynamic Engineering team. In this role, you will play a critical part in driving technical excellence, architecture strategy, and cross-team collaboration. You will work closely with product teams, engineering leads, and other stakeholders to develop scalable solutions that align with our mission of improving education through technology. This position offers an excellent opportunity for a technical leader who thrives on challenges and enjoys mentoring peers. Core responsibilities - Lead the architectural design and technical direction for key product domains within Arbor Education. - Collaborate with Technical Leads and product teams to ensure high-quality delivery of features and infrastructure improvements. - Drive architectural reviews and promote best practices in software development and engineering excellence. - Mentor and coach engineers and technical leads, facilitating professional growth and knowledge sharing. - Partner with leadership to shape the technology strategy and contribute to long-term product roadmaps. - Promote a culture of ownership, quality, security, and observability across engineering teams. Requirements About you - Proven experience as a senior or staff engineer with strong technical leadership skills. - Demonstrated expertise in software architecture, system design, and scalable solutions. - Excellent communication skills, capable of influencing both technical and non-technical stakeholders. - Experience mentoring and coaching engineering teams to elevate their technical skills and deliver business value. - Proficient in relevant technologies such as PHP, Node.js, TypeScript, MySQL, and cloud platforms like AWS. - A strong understanding of API design, identity management, and SaaS platforms is desirable. - Experience working within a fast-paced, collaborative environment with a focus on quality and security. Bonus skills - Experience in the education technology sector or other regulated SaaS domains. - Knowledge of workflow automation, API gateways, or intelligent tooling within the software development lifecycle. - Familiarity with cloud infrastructure, deployment strategies, and observability tools. Benefits What we offer The chance to work alongside a team of hard-working, passionate people in a role where you’ll see the impact of your work everyday. We also offer: - A dedicated wellbeing team who champion initiatives such as mindfulness, lunch n learns, manager training, mental health first aid training and much more! - 32 days holiday (plus Bank Holidays). This is made up of 25 days annual leave plus 7 extra company wide days given over Easter, Summer & Christmas - Life Assurance paid out at 3x annual salary - Comprehensive wellness benefit provided by AIG Smart Health, which provides a 24/7 virtual GP service, Mental health support, Counselling, and personalised Health Checks - Private Dental Insurance with Bupa - Salary sacrifice Pension provided by Scottish Widows - Enhanced maternity and adoption leave (20 weeks full pay) and paternity (6 weeks full pay) pay - 5 free return to work maternity coaching sessions, helping you adapt to this new exciting time of life! - Access to services such as Calm and Bippit (financial wellbeing coaching) - All of our roles champion flexible working and we are happy to discuss what this means to you - Social committees that plan team, office and company wide events to bring people together and celebrate success - Dedicated professional development training budget (CPD courses, upskilling resources, professional memberships etc) - Volunteer with a charity of your choice for a day each year - Dog friendly offices! Arbor Education is an equal opportunities organisation Our goal is for Arbor to be a workplace which represents, celebrates and supports people from all backgrounds, and which gives them the tools they need to thrive - whatever their ambitions may be so we support and promote diversity and equality, and actively encourage applications from people of all backgrounds.
• Playing a key role in creating, migrating, and maintaining regulatory reporting systems on Google Cloud Platform (GCP) • Developing and maintaining regulatory data submission systems, both existing on-premise and new cloud-based solutions in GCP/BigQuery • Supporting the migration of legacy SQL Server solutions to BigQuery • Building and maintaining automated data pipelines for ingestion, transformation, and loading of regulatory data • Implementing data validation, monitoring, and alerting to ensure accuracy, consistency, and reliability of regulatory submissions • Participating in code reviews and adhering to departmental standards
Senior Data Engineer
NTT DATA ServicesNTT DATA is a $30 billion business and technology services leader, serving 75% of the Fortune Global 100. We are committed to accelerating client success and positively impacting society through responsible innovation. We are one of the world's leading AI and digital infrastructure providers, with unmatched capabilities in enterprise-scale AI, cloud, security, connectivity, data centers, and application services. Our consulting and Industry solutions help organizations and society move confidently and sustainably into the digital future. As a Global Top Employer, we have experts in more than 50 countries. We also offer clients access to a robust ecosystem of innovation centers as well as established and start-up partners. NTT DATA is a part of NTT Group, which invests over $3 billion each year in R&D.
Role Description We are currently seeking a Senior Data Engineer to join our team in Remote, Karnātaka (IN-KA), India. - Implement enhancements - Manage the team - Meet with the client daily and coordinate the work Qualifications - Pyspark - Databricks - SQL - PowerBI reports Company Description NTT DATA is a $30 billion business and technology services leader, serving 75% of the Fortune Global 100. We are committed to accelerating client success and positively impacting society through responsible innovation. - One of the world's leading AI and digital infrastructure providers - Unmatched capabilities in enterprise-scale AI, cloud, security, connectivity, data centers, and application services - Global Top Employer with experts in more than 50 countries - Access to a robust ecosystem of innovation centers and established/start-up partners - Part of NTT Group, investing over $3 billion each year in R&D
Senior Data Engineer, DBT Focus
NagarroNagarro (Frankfurt: NA9) is a leader in digital product engineering and drives technology-led business breakthroughs.
• Lead the design, development, and implementation of data models using DBT • Own and drive DBT best practices (modularization, testing, documentation, performance optimization) • Translate business requirements into scalable and efficient data models • Collaborate with data engineers, analysts, and stakeholders across the organization • Ensure data quality and reliability through robust testing and validation frameworks • Optimize SQL queries and DBT pipelines for performance and scalability • Manage deployment workflows, CI/CD pipelines, and version control (Git) • Troubleshoot and resolve data pipeline and transformation issues • Mentor and guide team members on DBT and modern data engineering practices


