Job Closed

This listing is no longer active.

EXL logo
EXL

EXL is a global company providing business process solutions engineered to help companies streamline operations, simplify compliance, prepare for change, and cr

Senior Data Engineer

Location

Mexico

Posted

94 days ago

Salary

0

Seniority

Senior

Bachelor Degree9 yrs expExperience acceptedEnglishAirflowAWSDistributed SystemsHadoopJenkinsPythonShellApache Spark

Job Description

Senior Data Engineer

EXL

• Build and optimize data systems that power batch processing, real-time streaming, pipeline orchestration, data lake management, and data cataloging. • Use expertise in solving big data problems and apply design thinking, coding and analytical skills to develop data pipelines that support marketing data products. • Integrate services directly with Lending Club’s products and with external vendors. • Work with modern data technologies such as Hadoop, Spark, DBT, Dagster/Airflow, Atlan, Trino, etc., and cloud technologies across AWS stack. • Identify, design, and implement automation of manual processes, optimizing data delivery, reducing Cloud cost, etc. • Implement processes and systems to monitor Data Quality, Observability, Governance and Lineage. • Support operations to manage the production environment and help in resolving production issues with RCA. • Write unit/integration tests, adopt Test-driven development, contribute to engineering wiki, and document design/implementation etc.

Job Requirements

  • 9+ years of experience and a bachelor’s degree in computer science or a related field, or equivalent work experience
  • In-depth working experience of distributed systems Hadoop, Spark, Hive, DBT and Airflow/Dagster
  • At least 5 years of solid production quality coding experience in data pipeline implementation in Python
  • Experience working with public cloud platforms, preferably AWS
  • Experience working with Databricks and/or Snowflake
  • Experience in Git, JIRA, Jenkins, shell scripting
  • Familiarity with Agile methodology, test-driven development, source control management and test automation
  • Experience supporting and working with cross-functional teams in a dynamic environment
  • Excellent collaborative problem solving and communication skills
  • Track record of building fast, reliable, and high-quality data pipelines
  • Experience building Data pipelines for Digital Marketing will be a big plus

Benefits

  • Health insurance
  • Retirement plans
  • Paid time off
  • Flexible work arrangements
  • Professional development

Related Categories

Related Job Pages

More Data Engineer Jobs

Centene Corporation logo

Senior Data Engineer

Centene Corporation

Transforming the health of the communities we serve, one person at a time.

Data Engineer94 days ago
OtherRemoteTeam 10,001+Since 1984H1B No Sponsor

You could be the one who changes everything for our 28 million members by using technology to improve health outcomes around the world. As a diversified, national organization, Centene's technology professionals have access to competitive benefits including a fresh perspective on workplace flexibility. Position Purpose: Develops and operationalizes data pipelines to make data available for consumption (reports and advanced analytics), including data ingestion, data transformation, data validation / quality, data pipeline optimization, and orchestration. Engages with the DevSecOps Engineer during continuous integration and continuous deployment. - Helps guide the design and implementation of complex data management procedures around data staging, data ingestion, data preparation, data provisioning, and data destruction (scripts, programs, automation, assisted by automation, etc.) - Provides guidance to data engineers in the design, development, implementation, testing, documenting, and operating of large-scale, high-volume, high-performance data structures for business intelligence analytics - Designs, develops, and maintains real-time processing applications and real-time data pipelines - Ensure quality of technical solutions as data moves across Centene’s environments - Provides senior level knowledge and insight into the changing data environment, data processing, data storage, and utilization requirements for the company and drives the team toward viable solutions - Develops, constructs, tests, and maintains architectures using advanced programming language and tools - Drives ways to improve data reliability, efficiency, and quality and deploys a solution; use data to discover tasks that can be automated - Performs other duties as assigned - Complies with all policies and standards Education/Experience: A Bachelor's degree in a quantitative or business field (e.g., statistics, mathematics, engineering, computer science) and Requires 4 – 6 years of related experience. Or equivalent experience acquired through accomplishments of applicable knowledge, duties, scope and skill reflective of the level of this position. Technical Skills: - One or more of the following skills are desired. - - Python - SQL - Snowflake Pay Range: $87,000.00 - $161,300.00 per year Centene offers a comprehensive benefits package including: competitive pay, health insurance, 401K and stock purchase plans, tuition reimbursement, paid time off plus holidays, and a flexible approach to work with remote, hybrid, field or office work schedules. Actual pay will be adjusted based on an individual's skills, experience, education, and other job-related factors permitted by law, including full-time or part-time status. Total compensation may also include additional forms of incentives. Benefits may be subject to program eligibility. Centene is an equal opportunity employer that is committed to diversity, and values the ways in which we are different. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or other characteristic protected by applicable law. Qualified applicants with arrest or conviction records will be considered in accordance with the LA County Ordinance and the California Fair Chance Act

United States
$87K - $161K / year
Job Closed
Centene Corporation logo

Data Engineer II

Centene Corporation

Transforming the health of the communities we serve, one person at a time.

Data Engineer94 days ago
OtherRemoteTeam 10,001+Since 1984H1B No Sponsor

You could be the one who changes everything for our 28 million members by using technology to improve health outcomes around the world. As a diversified, national organization, Centene's technology professionals have access to competitive benefits including a fresh perspective on workplace flexibility. Position Purpose: Develops and operationalizes data pipelines to make data available for consumption (reports and advanced analytics), including data ingestion, data transformation, data validation / quality, data pipeline optimization, and orchestration. Engages with the DevSecOps Engineer during continuous integration and continuous deployment. - Designs and implements standardized data management procedures around data staging, data ingestion, data preparation, data provisioning, and data destruction (scripts, programs, automation, assisted by automation, etc.) - Designs, develops, implements, tests, documents, and operates large-scale, high-volume, high-performance data structures for business intelligence analytics - Designs, develops, and maintains real-time processing applications and real-time data pipelines - Ensure quality of technical solutions as data moves across Centene’s environments - Provides insight into the changing data environment, data processing, data storage, and utilization requirements for the company and offers suggestions for solutions - Develops, constructs, tests, and maintains architectures using programming language and tools - Identifies ways to improve data reliability, efficiency, and quality; use data to discover tasks that can be automated - Performs other duties as assigned - Complies with all policies and standards Education/Experience: A Bachelor's degree in a quantitative or business field (e.g., statistics, mathematics, engineering, computer science) and requires 2 – 4 years of related experience. Or equivalent experience acquired through accomplishments of applicable knowledge, duties, scope and skill reflective of the level of this position. Technical Skills: - One or more of the following skills are desired. - - SQL - Python - Teradata - Snowflake Pay Range: $63,600.00 - $114,600.00 per year Centene offers a comprehensive benefits package including: competitive pay, health insurance, 401K and stock purchase plans, tuition reimbursement, paid time off plus holidays, and a flexible approach to work with remote, hybrid, field or office work schedules. Actual pay will be adjusted based on an individual's skills, experience, education, and other job-related factors permitted by law, including full-time or part-time status. Total compensation may also include additional forms of incentives. Benefits may be subject to program eligibility. Centene is an equal opportunity employer that is committed to diversity, and values the ways in which we are different. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or other characteristic protected by applicable law. Qualified applicants with arrest or conviction records will be considered in accordance with the LA County Ordinance and the California Fair Chance Act

United States + 1 moreAll locations: United States | Tunisia
$63.6K - $114K / year
Job Closed
Centene Corporation logo

Senior Data Engineer

Centene Corporation

Transforming the health of the communities we serve, one person at a time.

Data Engineer94 days ago
OtherRemoteTeam 10,001+Since 1984H1B No Sponsor

You could be the one who changes everything for our 28 million members by using technology to improve health outcomes around the world. As a diversified, national organization, Centene's technology professionals have access to competitive benefits including a fresh perspective on workplace flexibility. Position Purpose: Develops and operationalizes data pipelines to make data available for consumption (reports and advanced analytics), including data ingestion, data transformation, data validation / quality, data pipeline optimization, and orchestration. Engages with the DevSecOps Engineer during continuous integration and continuous deployment. - Helps guide the design and implementation of complex data management procedures around data staging, data ingestion, data preparation, data provisioning, and data destruction (scripts, programs, automation, assisted by automation, etc.) - Provides guidance to data engineers in the design, development, implementation, testing, documenting, and operating of large-scale, high-volume, high-performance data structures for business intelligence analytics - Designs, develops, and maintains real-time processing applications and real-time data pipelines - Ensure quality of technical solutions as data moves across Centene’s environments - Provides senior level knowledge and insight into the changing data environment, data processing, data storage, and utilization requirements for the company and drives the team toward viable solutions - Develops, constructs, tests, and maintains architectures using advanced programming language and tools - Drives ways to improve data reliability, efficiency, and quality and deploys a solution; use data to discover tasks that can be automated - Performs other duties as assigned - Complies with all policies and standards Education/Experience: A Bachelor's degree in a quantitative or business field (e.g., statistics, mathematics, engineering, computer science) and Requires 4 – 6 years of related experience. Or equivalent experience acquired through accomplishments of applicable knowledge, duties, scope and skill reflective of the level of this position. Technical Skills: - One or more of the following skills are desired. - - Snowflake - AWS - SQL - Python Pay Range: $87,000.00 - $161,300.00 per year Centene offers a comprehensive benefits package including: competitive pay, health insurance, 401K and stock purchase plans, tuition reimbursement, paid time off plus holidays, and a flexible approach to work with remote, hybrid, field or office work schedules. Actual pay will be adjusted based on an individual's skills, experience, education, and other job-related factors permitted by law, including full-time or part-time status. Total compensation may also include additional forms of incentives. Benefits may be subject to program eligibility. Centene is an equal opportunity employer that is committed to diversity, and values the ways in which we are different. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or other characteristic protected by applicable law. Qualified applicants with arrest or conviction records will be considered in accordance with the LA County Ordinance and the California Fair Chance Act

United States
$87K - $161K / year
Job Closed
Contact Government Services logo

Senior Relativity Archiving Analyst

Contact Government Services

Contact Review prides itself on finding high-quality, high-accountability, barred attorneys specifically tailored to the needs of our project. Assists with document review, privilege review, expert testimony, legal research, and foreign language translation Fosters a culture where every team member sees themselves as an extension of the project's team Looks for ways to improve efficiency and streamline workflows

Data Engineer94 days ago

This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more. Role Description CGS is seeking a Senior Relativity Archiving Analyst, who will be responsible for vetting Relativity workspaces and file share folders and archiving or purging them. File shares will be moved to archive locations. Relativity workspaces will be archived using both Relativity ARM and a flat format which can be fully restored in Relativity or another system. - Collaborating with DOJ management, lead attorneys, and Section Chiefs on the disposition of data/files - Archiving older file shares - Archiving full Relativity workspaces using ARM - Archiving images, natives, text - Archiving in flat format the metadata, coding fields, choices/tags - Documenting user interface - Documenting the archiving process for approval by the Senior IT Manager - Evaluating and resolving any archiving issues Qualifications - At least 3 years of hands-on experience with backend Relativity 2022 and prior - At least 3 years of hands-on experience with archiving Relativity workspaces - At least 3 years of hands-on experience with restoring Relativity archives workspaces - Knowledge of Windows permissions and file transfer utilities - Excellent written and oral communication skills required - Experience working in a collaborative environment - Must be a US Citizen - Must be able to obtain a Public Trust security clearance Requirements - An undergraduate degree is strongly preferred; preferably in the computer science or management information/technology disciplines - Experience in storage technology planning, performance capacity planning, and modeling applications Benefits - Health, Dental, and Vision - Life Insurance - 401k - Flexible Spending Account (Health, Dependent Care, and Commuter) - Paid Time Off and Observance of State/Federal Holidays

United States
Job Closed