Job Closed
This listing is no longer active.
Your competitors' favorite marketing platform used by 10,000,000 marketers
Senior Data Engineer, Pistachio Team
Location
Spain
Posted
99 days ago
Salary
0
Seniority
Senior
Job Description
Senior Data Engineer, Pistachio Team
Semrush
• Implementation of the Data Science models delivery pipeline to Production in collaboration with Data Science • Integration and collection of data from different internal and external sources into a single Data Warehouse (ETL procedures) • Improving infrastructure for experimentation, storage of results, retraining of models, quality monitoring, and alerting • Automation of data collection and analysis processes • Making architectural decisions when developing a data storage and processing system • Monitoring of data sources • Interaction with analysts and programmers in the process of designing and implementing tasks
Job Requirements
- Over three years of experience with Clickhouse as Data Engineer
- Experience in collecting, processing, and transforming data
- Experience with ClickHouse
- Experience working with large datasets
- Python development experience
- Experience with Airflow
- Delivering results, balancing speed of execution with adherence to established engineering standards, best practices, and quality requirements
- Ownership of tasks with minimal supervision and a strong sense of accountability
- Actively fostering a collaborative team environment, thoughtfully review peer contributions, and provide clear, constructive feedback to elevate overall engineering quality
- Not required, but a plus: Experience with any cloud, such as AWS, GCP, or Azure
- Not required, but a plus: Experience with Docker, K8S
- Not required, but a plus: Desire to monitor everything
Benefits
- Flexible working hours
- Unlimited PTO
- Flexi Benefit for your hobby
- Employee Support Program
- Loss of family member financial aid
- Employee Resource Groups
- Meals, snacks, and drinks at the office
- Corporate events
- Teambuilding
- Training, courses, conferences
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Data Engineer
BizimplyAll-in-One Workforce Management Software to make every shift run like clockwork.
• Build and maintain robust, scalable data pipelines using Airflow, Python, and SQL. • Design, build, optimize data pipelines using dbt, or sqlmesh. • Develop and manage the ODS and support the eventual rollout of a modern Data Warehouse. • Integrate data from internal systems and external APIs to create clean, reliable datasets. • Work closely with engineers to operationalize machine learning workflows. • Ensure high data quality through monitoring, validation, and error handling. • Provide guidance to less experienced team members and champion data engineering best practices. • Deploy and manage infrastructure in the cloud (AWS, GCP, or Azure) using modern DevOps tooling. • Implement monitoring and alerting to ensure data pipelines are reliable and maintainable.
• Conduct a comprehensive review of the existing data ecosystem, including spreadsheets, CRM platforms, and operational systems • Define and design a “single source of truth” for employee/agent data and associated business metrics • Architect a scalable data framework, including core data models, system integrations and data flows, governance, ownership, and data quality standards • Provide recommendations on appropriate technologies (databases, data warehouses, integration tools, and SaaS vs custom solutions) • Produce clear and robust documentation, including target-state architecture diagrams, data models and definitions, integration and migration roadmap • Act as a strategic advisor to senior leadership and technical teams throughout the transformation journey
Senior Data Engineer
Gradient AIAI underwriting + claims solutions that power a better return on risk for Group Health, Work Comp and other P&C insurers
• Design, build, and implement data systems to support ML and AI models for our health insurance clients, ensuring strict compliance with healthcare data privacy and security regulations (e.g., HIPAA). • Develop tools for extracting, processing, and profiling diverse healthcare data sources, including EHRs, medical claims, pharmacy data, and genomic data. • Collaborate with data scientists to transform large volumes of health-related and bioinformatics data into modeling-ready formats, prioritizing data quality, integrity, and reliability in healthcare applications. • Build and maintain infrastructure for the extraction, transformation, and loading (ETL) of data from a variety of sources using SQL, AWS, and healthcare-specific big data technologies and analytics platforms. • Ensure data pipelines meet the unique requirements of health, medical, and bioinformatics data processing, including translating complex medical and biological concepts into actionable data requirements.
Senior Data Engineer
Centene CorporationTransforming the health of the communities we serve, one person at a time.
You could be the one who changes everything for our 28 million members by using technology to improve health outcomes around the world. As a diversified, national organization, Centene's technology professionals have access to competitive benefits including a fresh perspective on workplace flexibility. Position Purpose: Develops and operationalizes data pipelines to make data available for consumption (reports and advanced analytics), including data ingestion, data transformation, data validation / quality, data pipeline optimization, and orchestration. Engages with the DevSecOps Engineer during continuous integration and continuous deployment. Helps guide the design and implementation of complex data management procedures around data staging, data ingestion, data preparation, data provisioning, and data destruction (scripts, programs, automation, assisted by automation, etc.) Provides guidance to data engineers in the design, development, implementation, testing, documenting, and operating of large-scale, high-volume, high-performance data structures for business intelligence analytics Designs, develops, and maintains real-time processing applications and real-time data pipelines Ensure quality of technical solutions as data moves across Centene’s environments Provides senior level knowledge and insight into the changing data environment, data processing, data storage, and utilization requirements for the company and drives the team toward viable solutions Benefits may be subject to program eligibility. Centene is an equal opportunity employer that is committed to diversity, and values the ways in which we are different. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or other characteristic protected by applicable law. Qualified applicants with arrest or conviction records will be considered in accordance with the LA County Ordinance and the California Fair Chance Act




