Job Closed
This listing is no longer active.
We make sense of data to drive your business forward. #MakeSenseofData #DriveYourBusinessForward #PartnerYourWay
Senior Data Engineer
Location
Mexico
Posted
150 days ago
Salary
0
Seniority
Senior
Job Description
Senior Data Engineer
EXL
• Build and optimize data systems that power batch processing, real-time streaming, pipeline orchestration, data lake management, and data cataloging. • Use expertise in solving big data problems and apply design thinking, coding and analytical skills to develop data pipelines that support marketing data products. • Integrate services directly with Lending Club’s products and with external vendors. • Work with modern data technologies such as Hadoop, Spark, DBT, Dagster/Airflow, Atlan, Trino, etc., and cloud technologies across AWS stack. • Identify, design, and implement automation of manual processes, optimizing data delivery, reducing Cloud cost, etc. • Implement processes and systems to monitor Data Quality, Observability, Governance and Lineage. • Support operations to manage the production environment and help in resolving production issues with RCA. • Write unit/integration tests, adopt Test-driven development, contribute to engineering wiki, and document design/implementation etc.
Job Requirements
- 9+ years of experience and a bachelor’s degree in computer science or a related field, or equivalent work experience
- In-depth working experience of distributed systems Hadoop, Spark, Hive, DBT and Airflow/Dagster
- At least 5 years of solid production quality coding experience in data pipeline implementation in Python
- Experience working with public cloud platforms, preferably AWS
- Experience working with Databricks and/or Snowflake
- Experience in Git, JIRA, Jenkins, shell scripting
- Familiarity with Agile methodology, test-driven development, source control management and test automation
- Experience supporting and working with cross-functional teams in a dynamic environment
- Excellent collaborative problem solving and communication skills
- Track record of building fast, reliable, and high-quality data pipelines
- Experience building Data pipelines for Digital Marketing will be a big plus
Benefits
- Health insurance
- Retirement plans
- Paid time off
- Flexible work arrangements
- Professional development
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Senior Data Engineer
Centene CorporationTransforming the health of the communities we serve, one person at a time.
You could be the one who changes everything for our 28 million members by using technology to improve health outcomes around the world. As a diversified, national organization, Centene's technology professionals have access to competitive benefits including a fresh perspective on workplace flexibility. Position Purpose: Develops and operationalizes data pipelines to make data available for consumption (reports and advanced analytics), including data ingestion, data transformation, data validation / quality, data pipeline optimization, and orchestration. Engages with the DevSecOps Engineer during continuous integration and continuous deployment. - Helps guide the design and implementation of complex data management procedures around data staging, data ingestion, data preparation, data provisioning, and data destruction (scripts, programs, automation, assisted by automation, etc.) - Provides guidance to data engineers in the design, development, implementation, testing, documenting, and operating of large-scale, high-volume, high-performance data structures for business intelligence analytics - Designs, develops, and maintains real-time processing applications and real-time data pipelines - Ensure quality of technical solutions as data moves across Centene’s environments - Provides senior level knowledge and insight into the changing data environment, data processing, data storage, and utilization requirements for the company and drives the team toward viable solutions - Develops, constructs, tests, and maintains architectures using advanced programming language and tools - Drives ways to improve data reliability, efficiency, and quality and deploys a solution; use data to discover tasks that can be automated - Performs other duties as assigned - Complies with all policies and standards Education/Experience: A Bachelor's degree in a quantitative or business field (e.g., statistics, mathematics, engineering, computer science) and Requires 4 – 6 years of related experience. Or equivalent experience acquired through accomplishments of applicable knowledge, duties, scope and skill reflective of the level of this position. Technical Skills: - One or more of the following skills are desired. - - Python - SQL - Snowflake Pay Range: $87,000.00 - $161,300.00 per year Centene offers a comprehensive benefits package including: competitive pay, health insurance, 401K and stock purchase plans, tuition reimbursement, paid time off plus holidays, and a flexible approach to work with remote, hybrid, field or office work schedules. Actual pay will be adjusted based on an individual's skills, experience, education, and other job-related factors permitted by law, including full-time or part-time status. Total compensation may also include additional forms of incentives. Benefits may be subject to program eligibility. Centene is an equal opportunity employer that is committed to diversity, and values the ways in which we are different. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or other characteristic protected by applicable law. Qualified applicants with arrest or conviction records will be considered in accordance with the LA County Ordinance and the California Fair Chance Act
Data Engineer II
Centene CorporationTransforming the health of the communities we serve, one person at a time.
You could be the one who changes everything for our 28 million members by using technology to improve health outcomes around the world. As a diversified, national organization, Centene's technology professionals have access to competitive benefits including a fresh perspective on workplace flexibility. Position Purpose: Develops and operationalizes data pipelines to make data available for consumption (reports and advanced analytics), including data ingestion, data transformation, data validation / quality, data pipeline optimization, and orchestration. Engages with the DevSecOps Engineer during continuous integration and continuous deployment. - Designs and implements standardized data management procedures around data staging, data ingestion, data preparation, data provisioning, and data destruction (scripts, programs, automation, assisted by automation, etc.) - Designs, develops, implements, tests, documents, and operates large-scale, high-volume, high-performance data structures for business intelligence analytics - Designs, develops, and maintains real-time processing applications and real-time data pipelines - Ensure quality of technical solutions as data moves across Centene’s environments - Provides insight into the changing data environment, data processing, data storage, and utilization requirements for the company and offers suggestions for solutions - Develops, constructs, tests, and maintains architectures using programming language and tools - Identifies ways to improve data reliability, efficiency, and quality; use data to discover tasks that can be automated - Performs other duties as assigned - Complies with all policies and standards Education/Experience: A Bachelor's degree in a quantitative or business field (e.g., statistics, mathematics, engineering, computer science) and requires 2 – 4 years of related experience. Or equivalent experience acquired through accomplishments of applicable knowledge, duties, scope and skill reflective of the level of this position. Technical Skills: - One or more of the following skills are desired. - - SQL - Python - Teradata - Snowflake Pay Range: $63,600.00 - $114,600.00 per year Centene offers a comprehensive benefits package including: competitive pay, health insurance, 401K and stock purchase plans, tuition reimbursement, paid time off plus holidays, and a flexible approach to work with remote, hybrid, field or office work schedules. Actual pay will be adjusted based on an individual's skills, experience, education, and other job-related factors permitted by law, including full-time or part-time status. Total compensation may also include additional forms of incentives. Benefits may be subject to program eligibility. Centene is an equal opportunity employer that is committed to diversity, and values the ways in which we are different. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or other characteristic protected by applicable law. Qualified applicants with arrest or conviction records will be considered in accordance with the LA County Ordinance and the California Fair Chance Act
Senior Data Engineer
Centene CorporationTransforming the health of the communities we serve, one person at a time.
You could be the one who changes everything for our 28 million members by using technology to improve health outcomes around the world. As a diversified, national organization, Centene's technology professionals have access to competitive benefits including a fresh perspective on workplace flexibility. Position Purpose: Develops and operationalizes data pipelines to make data available for consumption (reports and advanced analytics), including data ingestion, data transformation, data validation / quality, data pipeline optimization, and orchestration. Engages with the DevSecOps Engineer during continuous integration and continuous deployment. - Helps guide the design and implementation of complex data management procedures around data staging, data ingestion, data preparation, data provisioning, and data destruction (scripts, programs, automation, assisted by automation, etc.) - Provides guidance to data engineers in the design, development, implementation, testing, documenting, and operating of large-scale, high-volume, high-performance data structures for business intelligence analytics - Designs, develops, and maintains real-time processing applications and real-time data pipelines - Ensure quality of technical solutions as data moves across Centene’s environments - Provides senior level knowledge and insight into the changing data environment, data processing, data storage, and utilization requirements for the company and drives the team toward viable solutions - Develops, constructs, tests, and maintains architectures using advanced programming language and tools - Drives ways to improve data reliability, efficiency, and quality and deploys a solution; use data to discover tasks that can be automated - Performs other duties as assigned - Complies with all policies and standards Education/Experience: A Bachelor's degree in a quantitative or business field (e.g., statistics, mathematics, engineering, computer science) and Requires 4 – 6 years of related experience. Or equivalent experience acquired through accomplishments of applicable knowledge, duties, scope and skill reflective of the level of this position. Technical Skills: - One or more of the following skills are desired. - - Snowflake - AWS - SQL - Python Pay Range: $87,000.00 - $161,300.00 per year Centene offers a comprehensive benefits package including: competitive pay, health insurance, 401K and stock purchase plans, tuition reimbursement, paid time off plus holidays, and a flexible approach to work with remote, hybrid, field or office work schedules. Actual pay will be adjusted based on an individual's skills, experience, education, and other job-related factors permitted by law, including full-time or part-time status. Total compensation may also include additional forms of incentives. Benefits may be subject to program eligibility. Centene is an equal opportunity employer that is committed to diversity, and values the ways in which we are different. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or other characteristic protected by applicable law. Qualified applicants with arrest or conviction records will be considered in accordance with the LA County Ordinance and the California Fair Chance Act
Data Engineer
CoDevThe Premier Source for Quickly Hiring Skilled, Professional Offshore Development Teams. CoDev.com
• Build and maintain scalable data pipelines for structured (CSV) data ingestion • Build and optimize pipelines for data lakes and warehouses (Azure Data Lake, Synapse) • Develop and maintain REST API integrations and system connectors • Implement data validation, integrity, and deduplication processes • Work closely with engineers to align data & application architecture • Help shape cloud and data architecture decisions


