Senior Data Engineer
Location
Mexico
Posted
64 days ago
Salary
0
Seniority
Senior
Job Description
Senior Data Engineer
Instructure
• End-to-End Pipeline Engineering: Design, build, and deploy scalable ETL/ELT pipelines from diverse source systems into our Snowflake Data Cloud. • Cloud Infrastructure: Manage and optimize data flows within an AWS environment (S3, Lambda, IAM), ensuring high availability, security, and cost-efficiency. • High-Scale Processing: Leverage Databricks and Python (PySpark) to handle complex data transformations and high-volume workloads. • Implement the Semantic Layer: Collaborate with the team to define, implement, and scale our Semantic Layer (via dbt Semantic Layer, MetricFlow, or similar) to standardize business logic, metrics, and dimensions for all downstream consumers. • Model for Truth: Use dbt to build modular, version-controlled, and tested data models that serve as the definitive foundation for business intelligence. • Data Governance & Quality: Implement automated testing and monitoring to ensure the integrity and reliability of finished data marts.
Job Requirements
- Expert-level proficiency in Snowflake (clustering, Snowpipe, streams, and tasks) or similar cloud data warehouses.
- Advanced mastery of dbt and complex SQL transformation logic, with specific experience building semantic models and metric definitions.
- Strong Python skills and hands-on experience with Databricks for Spark-based orchestration.
- Practical experience managing data workloads within AWS.
- Deep understanding of Git-based workflows and CI/CD for data.
- A Data Quality Champion: You believe data is a liability until it’s governed, and you have a passion for data modeling and reducing "metric drift" across the organization.
- Scale-Oriented & Efficient: You design for the long term, building streamlined, cohesive data environments that eliminate redundancy and fragmentation. By focusing on modular design and automation, you ensure our infrastructure is stable and easy to navigate as data complexity and volume grow.
- A Problem Solver: You find the root cause of data discrepancies and build automated solutions to prevent them from recurring.
Benefits
- Competitive compensation, plus all full-time employees participate in our ownership program - because everyone should have a stake in our success.
- Flexible work culture. Our remote, hybrid and in-office collaboration spaces vary by role, team and location.
- Generous time off, including local holidays and our annual “Dim the Lights” period in late December, when teams are encouraged to step back and recharge based on departmental needs.
- Comprehensive wellness programs and mental health support
- Learning and development resources, including professional development tools and tuition reimbursement, to support your growth
- The technology and tools you need to do your best work
- Motivosity employee recognition program
- A culture rooted in inclusivity, support, and meaningful connection
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
• Contribute to architectural vision for Fortrea’s data architecture, data integration and master data management strategies. • Design and implement core ETL workflows for Fortrea’s information integration and reporting infrastructure. • Participate in the design and development of high-performing, scalable and maintainable data repositories for analytic purposes. • Participate in the full development cycle from product inception, research and prototyping to release in production. • Measurably impact company performance by delivering high quality, scalable data products. • Supervise external resources. • All other duties as needed or assigned.
Role Description We are seeking an experienced Clinical Data Engineer/EDC Specialist to join our growing team full-time. This remote-friendly role is central to how we help research teams collect, manage, and maintain high-quality data across complex, large-scale studies. You’ll be responsible for the configuration of electronic data capture (EDC) systems, including REDCap, Qualtrics, and EnrollNow, ensuring data collection workflows are reliable, scalable, and aligned with the rigorous standards of clinical and research environments. This is a role for someone who understands that well-designed data capture is foundational to good science and who takes pride in building systems that researchers can trust. Key Responsibilities - Design, build, and maintain REDCap and Enroll Now projects including instruments, branching logic, calculated fields, data validation rules, and longitudinal event structures. - Develop and manage Qualtrics surveys and integrate them with broader data collection pipelines. - Configure and support other electronic data capture platforms as study needs require, evaluating tools for fit and recommending solutions to research teams. - Collaborate with study coordinators, investigators, and data teams to translate scientific protocols into reliable, user-friendly data capture workflows. - Implement and enforce data quality standards across EDC platforms, including field validation, missing data protocols, and audit trail practices. - Support REDCap API integrations, automated data exports, and connections to downstream data management and analysis systems. - Maintain clear technical documentation of instrument design, data dictionaries, codebooks, and system configurations. - Provide training and technical support to research staff on REDCap and related platforms. - Stay current with REDCap versioning, new modules (e.g., REDCap Mobile App, Survey Queue, Randomization), and emerging EDC technologies. Qualifications - Bachelor's degree in Computer Science, Informatics, Neuroscience, Psychology, Public Health, or an equivalent combination of education and experience. - 2+ years of full-time hands-on experience designing and administering REDCap projects in a research or clinical setting. - Demonstrated proficiency with Qualtrics or other EDC platforms (e.g., OpenClinica, Medidata Rave, Castor, REDCap Cloud). - Strong understanding of data collection best practices including instrument design, validation logic, and data dictionary management. - Experience supporting longitudinal study designs with complex event structures, repeating instruments, or multi-arm configurations. - Familiarity with REDCap API and basic scripting ability (R, Python, or equivalent) for data export automation and integration tasks. - Familiarity with data privacy regulations (HIPAA, GDPR) and research ethics standards relevant to human subjects data. - Experience using version control systems (e.g., GitHub) for configuration management and documentation. Preferred - Experience in neuroscience, child development, developmental psychology, or a related life sciences field. - Familiarity with multi-modal research data including behavioral assessments, cognitive instruments, caregiver-report measures, or biosample tracking. - Experience working with IRB protocols and translating consent and data use requirements into system-level configurations. - Knowledge of HL7/FHIR standards or experience integrating EDC systems with EHR platforms. - REDCap certification or completion of a formal REDCap training program. - Experience with survey design principles and validated psychometric instruments commonly used in developmental or clinical research. Skills and Attributes - Systems thinker with a detail-oriented mindset. You have an understanding of complex datasets. - Self-directed and comfortable working autonomously in a distributed remote environment, managing multiple study timelines simultaneously. - Strong technical writing skills with the ability to produce clear data dictionaries, SOPs, and user-facing documentation. - Excellent communication skills; able to work fluidly between research scientists, study coordinators, and technical team members. - Collaborative by nature, with a genuine interest in supporting the scientists and coordinators who depend on well-functioning data systems. - Committed to data integrity, research ethics, and responsible stewardship of sensitive human subjects data. Benefits - Competitive full-time compensation and benefits package. - Meaningful contribution to research with real-world scientific and clinical impact. - Opportunity to work across a diverse portfolio of large-scale, multi-modal studies at the cutting edge of research data management. - Grow with an innovative, mission-driven company shaping the future of scientific data infrastructure. - Collaborative environment within a diverse, multidisciplinary team of researchers, engineers, and data professionals.
Title: Clinical Data Team Lead - Veeva Location: Bangalore Karnātaka India Full time Remote As part of our expert team, you’ll have the opportunity to ensure operational excellence that makes a real difference in organizational performance. As a Clinical Data Team Lead, you will act as the lead data manager for one or more projects or provide support to the lead data manager. You may lead all data management activities for individual, limited volume/complexity studies with support from senior team members. Additionally, you will act as an interdepartmental and client liaison for all data management study activities. What You’ll Do: • Applies relevant components of the project protocol to daily tasks and directs others on how to apply to their daily tasks. • Acts as a liaison to the Project Lead and/or client as required and communicates with management regarding all data management (DM) activities within their studies. • Develops and maintains data management project documentation files; performs independent reviews of data management deliverables following documented CDM guidelines. • Develops and delivers study specific training for DM project staff. • Produces project-specific status reports for management, Project Lead and/or clients on a regular basis. Monitors study metrics. • May participate in business development activities by assisting with bid preparation and/or representing data management at bid defense meetings, where required. • Assists with project forecasting of hours and identification of resource requirements and identifies potential out of scope activities to Project Lead and management and assists with the Contract Modification process. • Mentors junior level staff on all associated tasks within a study. • Assists with the administrative and financial management of allocated projects. Performs all assigned data management activities independently and efficiently, with attention to quality. Education and Experience Requirements: - Bachelor's degree or equivalent and relevant formal academic / vocational qualification - 6+ Years of experience in Clinical Data Manager Role - Must have working experience in Veeva EDC - Should have End to End Data Management Experience (Set Up, Conduct, Close Out) - Working on Oncology Trials are Preferred. In some cases an equivalency, consisting of a combination of appropriate education, training and/or directly related experience, will be considered sufficient for an individual to meet the requirements of the role. Knowledge, Skills and Abilities: • Ability to effectively apply knowledge and skills in a highly organized fashion while adhering to regulatory guidelines, SOPs and client expectations • Ability to use interactive computer programs • Good written/ verbal communication skills with a strong command of English language and grammar; good organizational, analytical/problem solving skills and attention to detail • Ability to work productively with minimal supervision • Ability to maintain a high degree of confidentiality with clinical data and client's proprietary data • Strong customer focus and excellent interpersonal skills • Proven flexibility and adaptability • Ability to work in a team environment and independently as needed • Ability to train and direct study team • Ability to set and meet timelines or be able to recognize and schedule changes in response to project demands
• Lead the design and evolution of scalable data platform infrastructure • Drive complex, cross-functional initiatives with broad scope • Mentor and guide engineers across the team • Facilitate technical discussions and architecture decisions • Partner closely with stakeholders to translate ambiguous business needs into scalable solutions • Design and maintain reliable, observable, and reusable data workflows • Establish and evolve standards for testing, monitoring, and operational reliability • Review and guide code, infrastructure, and architectural decisions



