• Lead the design, development, and scaling of complex data pipelines and platforms • Partner with business leaders to translate requirements into production-ready data solutions • Own end-to-end data solutions including modeling, performance, reliability, and cost optimization • Implement CI/CD, testing, monitoring, and data quality best practices • Provide technical mentorship to junior team members

• Design, build, and maintain backend services and REST APIs that serve data from various SQL subsystems and other data sources • Develop well-tested, production-grade Python services with clean API contracts, proper authentication, versioning, and error handling • Work closely with the Analytics Engineering team to expose modeled data (billing, settlement, finance) through APIs that downstream consumers can rely on • Build internal tooling and services that enable the broader organization to self-serve their data needs without writing SQL • Participate in code reviews, system design discussions, and engineering best practices across the Infrastructure org • Contribute to service observability: logging, metrics, alerting, and on-call practices for the services you own • Maintain and improve existing data pipelines that move data from source systems into Snowflake (Airflow, Airbyte) • Contribute to the dbt project alongside the Analytics Engineering team — model improvements, test coverage, and data quality • Support data governance practices including access controls, lineage documentation, and data quality standards

AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards. WHY JOIN US If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you! ABOUT THE ROLE As a Data Engineer, you’ll be part of a small, senior team building a cloud-native data platform on AWS from the ground up — moving raw data through Bronze, Silver, and Gold layers into clean, trusted, analytics-ready datasets that directly power business decisions. Working closely with the Data Architect and Head of Data, you’ll have real visibility into the full data lifecycle: pipeline design, data quality, governance, and delivery. If you want a role where your engineering work is foundational rather than incremental, and where the stack — S3, Glue, Redshift, dbt, Airflow, PySpark — is genuinely modern, this is it. WHAT YOU WILL DO - Build and maintain scalable ETL and ELT pipelines across AWS services; - Implement medallion architecture for data ingestion, transformation, and delivery; - Collaborate with data architects on data modeling and schema design; - Develop ingestion frameworks for structured, semi-structured, and streaming data; - Integrate data quality, lineage, and observability into pipelines; - Work with analytics and business teams to deliver consistent and well-documented data; - Write clean and testable Python and SQL code following best practices; - Support data governance and security standards including compliance requirements; - Monitor pipeline performance, troubleshoot issues, and optimize scalability and cost efficiency. MUST HAVES - 5+ years of experience as a Data Engineer working with AWS data ecosystems; - Strong experience with AWS services (S3, Glue, Lambda, Kinesis, Redshift, Athena, Step Functions); - Proficiency in Python, PySpark, and SQL for data transformation; - Strong understanding of ETL design patterns, batch and streaming data processing; - Knowledge of data modeling (star schema, snowflake schema, incremental processing); - Experience with orchestration tools (Airflow, Step Functions, dbt); - Understanding of data governance, data quality frameworks, and CI/CD for pipelines; - Experience working in agile, cross-functional environments; - Upper-intermediate English level. PERKS AND BENEFITS - Professional growth: Mentorship, TechTalks, and personalized growth roadmaps. - Competitive compensation: USD-based pay with education, fitness, and team activity budgets. - Exciting projects: Modern solutions with Fortune 500 and top product companies. - Flextime: Flexible schedule with remote and office options.

Company Description CRB's over 1,100 expert professionals drive innovative, life-changing and life-saving solutions for manufacturers in the life sciences and food and beverage industries. Our mission, vision, and core values put client satisfaction and employee experience at the center of everything we do. As an AEC Firm we proudly specialize in industries that inherently carry important social responsibility - we recognize our impact and influence in the communities we serve and pursue corporate responsibility through the lens of people, community, and planet. From oncology and rare disorders to COVID-19 or alternative proteins, our design and construction projects are pioneering solutions addressing important issues such as food scarcity and global health. Job Description CRB is looking for an energetic, self-motivated, pro-active, organized, and well-rounded individual that has a good understanding of Microsoft’s data, reporting, and business intelligence tools to assist in delivering on our internal data and business intelligence initiatives. The successful candidate must possess the skills required to successfully execute project tasks, have a strong work ethic, and be a dynamic team player. This person will be expected to plan and execute multiple, simultaneous, large or long duration projects. In addition to project work, this individual will work with peers to assist in the identification, planning, and delivery of strategic infrastructure and analytical capabilities that will provide actionable information to the business. - Elicit data related business requirements from stakeholders and develop or approve associated technical specifications.  - Design, implement, and maintain ETL processes to facilitate warehousing and systems integration needs.  - Develop and enhance data models to deliver value to the organization.  - Maintain, monitor, optimize, and troubleshoot/resolve issues with existing processes.  - Contribute to the development of standard methods and best practices for the transformation and preparation of data for reporting, analytics, and self-service activities.  - Contribute to reporting and visualization projects as needed.  - Apply data team best practices regarding documentation, access, and security.  - Participate in discipline related internal and external project communication and coordination.  - Implement data quality checks and validation processes.  - Incorporate data classification into ETL processes and data masking techniques to ensure model security.  - Elicit and participate in code reviews with other members of the team.  - Ensure the accuracy, completeness, and reliability of data used for analysis. - Design and implement robust data architectures to support scalable and maintainable data pipelines. - Research and adopt new technologies and methodologies to keep the data infrastructure modern and efficient. - Develop strategies for integrating data from disparate sources into a cohesive and comprehensive data ecosystem. - Automate data processes to improve efficiency and reduce manual intervention. - Ensure compliance of data protection regulations and ensure confidentiality of sensitive information. - Mentor junior data engineers and contribute to their professional growth within the organization. - Travel as required for project development and execution. Qualifications - Bachelor’s Degree or equivalent experience.  - 7+ years of experience working with Microsoft SQL databases and warehousing tools, including SQL Server, Azure SQL, and Synapse SQL.  - 2+ years' recent experience with Microsoft Fabric. - 7+ years of experience developing ETL processes using Microsoft technologies, such as SSIS, Azure Data Factory, Azure Synapse Analytics, and Microsoft Fabric.  - 7+ years’ experience developing Microsoft Analysis Services Tabular, Power BI, or Fabric semantic data models.  - Experience leveraging medallion architecture design patterns.  - Proficiency using Azure Gen2 Storage, Synapse, Fabric, Spark Notebooks, REST API’s, Databricks and related technologies.  - Expert proficiency in Data Warehousing methodologies and concepts to store and model the data (Kimball).  - Expert proficiency authoring SQL queries, tables, views, stored procedures, and functions.  - Experience using software development management tools such as Azure DevOps.  - Experience using Python and PowerShell required.  - Experience with provisioning data related resources and components in Azure preferred.  - Experience with Redgate Monitoring or Azure Log Analytics is a plus.  - Familiarity with D365 ERP modules (e.g., Finance and Operations, Customer Engagement) preferred.  - Understanding of D365 data structures, entities, and integration points preferred.  - Experience with R language preferred.  - Extreme attention to detail and accuracy a must.  - Excellent verbal/written communication skills required.  - Comfortable working and collaborating within a fully remote team.  - Microsoft DP-700 Certification is a plus. Additional Information All your information will be kept confidential according to EEO guidelines. CRB is committed to hiring and retaining a diverse workforce. We are proud to be an Equal Opportunity Employer and it is our policy to provide equal opportunity to all people without regard to race, color, religion, national origin, ancestry, marital status, veteran status, age, disability, pregnancy, genetic information, citizenship status, sex, sexual orientation, gender identity or any other legally protected category. Employment is contingent on background screening. CRB does not accept unsolicited resumes from search firms or agencies. Any resume submitted to any employee of CRB without a prior written search agreement will be considered unsolicited and the property of CRB. Please, no phone calls or emails. CRB offers a complete and competitive benefit package designed to meet individual and family needs. If you are unable to complete this application due to a disability, contact this employer to ask for an accommodation or an alternative application process. - Compensation: USD 100000 - USD 140000 - yearly