Job Closed

This listing is no longer active.

NIR-YU logo
NIR-YU

Take Control of Your Business and Execute Your Vision with Ease - Hire Affordable and Qualified Nearshore Staff

Senior Data Engineer

Data EngineerData EngineerFull TimeRemoteSeniorTeam 201-500H1B No SponsorCompany SiteLinkedIn

Location

Latin America

Posted

77 days ago

Salary

0

Seniority

Senior

Job Description

Senior Data Engineer

NIR-YU

• Design, develop, and maintain scalable, high-performance data infrastructure to support the collection, storage, and processing of large datasets in real time and batch modes. • Build reliable, reusable services and APIs that allow teams to interact with the data platform for ingestion, transformation, and querying of data. • Build software tools, products and systems to monitor and manage the ML infrastructure and services efficiently. • Responsible for ensuring our ML systems are operating and running efficiently for model development, training, evaluation, and inference. • Collaborate with senior management, product management, and other engineers in the development of data products. • Develop tools to monitor, debug, and analyze data an ML pipelines. • Design and implement data schemas and models that can scale. • Mentor team members to build the company's overall expertise. • Work to make The RealReal an innovator in the space by bringing passion and new ideas to work every day.

Job Requirements

  • At least 5 years of proven experience as a Data Engineer or MLOps Engineer in developing platform level capabilities for a data-driven midsize to large corporations.
  • Strong programming skills in languages such as Python, Java or Scala, with experience building large-scale, fault-tolerant systems.
  • Experience with cloud platforms (GCP, AWS, AZURE) with strong preference to GCP.
  • Experience with BigQuery or similar (Redshift, Snowflake, other MPP databases).
  • Hands-on experience with ML frameworks (TensorFlow, PyTorch) and ML deployment patterns.
  • Practical experience with containerization and orchestration tools (Docker, Kubernetes).
  • Experience building data pipelines & ETL.
  • Experience with command line, version control software (git).
  • Excellent communication and collaboration skills.
  • Ability to work independently and quickly become productive after joining.

Related Categories

Related Job Pages

More Data Engineer Jobs

Manpower/itec logo

Informatica Developer

Manpower/itec

Since 1999, ITEC has delivered mission-critical support to the DoD and Intelligence Community. Now part of ManpowerGroup Public Sector (MGPS), we continue that work with expanded capabilities.

Data Engineer77 days ago

Role Description The Informatica Developer will be responsible for the following: - Work with Client, Accenture, and Teaming Partner team members and executives on and across the project team. - Plan, drive, and execute all required process steps as defined in Accenture/Client Agile delivery methodologies. - Direct interaction with customer business representatives and Agile team members to complete user story refinement and detailed task breakdowns. - Design and code in SAP HANA, Data Services, and BusinessObjects adhering to SAP best practices. - Analyze, design, code and test break/fix requests and enhancements to data model and reporting components. - Develop system interfaces using ODP DataSources, Data Services, and file transfers. Execute component and unit testing, support UAT, and resolve defects. Qualifications - Must have a Tier 3 active DoW investigation. - Must have Informatica certification. - Must have Informatica ETL development experience. - Must have Informatica ETL administration experience. - Must have Informatica console installation, configuration and management experience. - Experience supporting product evaluation and selection. - Experience installing, configuring and developing capabilities leveraging Informatica for data pipeline and transformation. Company Description Since 1999, ITEC has delivered mission-critical support to the DoD and Intelligence Community. Now part of ManpowerGroup Public Sector (MGPS), we continue that work with expanded capabilities. Employees hired through this process will join MGPS and receive a comprehensive benefits package and competitive pay. U.S. Citizenship Mandatory: Due to our US federal government contract, candidates for this position are required to be a US Citizen and will be subject to a background investigation.

United States
Job Closed
Centene Corporation logo

Senior Data Engineer

Centene Corporation

Transforming the health of the communities we serve, one person at a time.

Data Engineer77 days ago
OtherRemoteTeam 10,001+Since 1984H1B No Sponsor

You could be the one who changes everything for our 28 million members by using technology to improve health outcomes around the world. As a diversified, national organization, Centene's technology professionals have access to competitive benefits including a fresh perspective on workplace flexibility. Position Purpose: Develops and operationalizes data pipelines to make data available for consumption (reports and advanced analytics), including data ingestion, data transformation, data validation / quality, data pipeline optimization, and orchestration. Engages with the DevSecOps Engineer during continuous integration and continuous deployment. - Helps guide the design and implementation of complex data management procedures around data staging, data ingestion, data preparation, data provisioning, and data destruction (scripts, programs, automation, assisted by automation, etc.) - Provides guidance to data engineers in the design, development, implementation, testing, documenting, and operating of large-scale, high-volume, high-performance data structures for business intelligence analytics - Designs, develops, and maintains real-time processing applications and real-time data pipelines - Ensure quality of technical solutions as data moves across Centene’s environments - Provides senior level knowledge and insight into the changing data environment, data processing, data storage, and utilization requirements for the company and drives the team toward viable solutions - Develops, constructs, tests, and maintains architectures using advanced programming language and tools - Drives ways to improve data reliability, efficiency, and quality and deploys a solution; use data to discover tasks that can be automated - Performs other duties as assigned - Complies with all policies and standards Education/Experience: A Bachelor's degree in a quantitative or business field (e.g., statistics, mathematics, engineering, computer science) and Requires 4 – 6 years of related experience. Or equivalent experience acquired through accomplishments of applicable knowledge, duties, scope and skill reflective of the level of this position. Technical Skills: - One or more of the following skills are desired. - Experience with Big Data; Data Processing - Experience with Other: diagnosing system issues, engaging in data validation, and providing quality assurance testing - Experience with Data Manipulation; Data Mining - Experience working in a production cloud infrastructure - Experience with one or more of the following C# (Programming Language); Java (Programming Language); Programming Concepts; Programming Tools; Python (Programming Language); SQL (Programming Language) - Knowledge of Microsoft SQL Servers; SQL (Programming Language) Soft Skills: - Intermediate - Seeks to acquire knowledge in area of specialty - Intermediate - Ability to identify basic problems and procedural irregularities, collect data, establish facts, and draw valid conclusions - Intermediate - Ability to work independently - Intermediate - Demonstrated analytical skills - Intermediate - Demonstrated project management skills - Intermediate - Demonstrates a high level of accuracy, even under pressure - Intermediate - Demonstrates excellent judgment and decision making skills Pay Range: $87,000.00 - $161,300.00 per year Centene offers a comprehensive benefits package including: competitive pay, health insurance, 401K and stock purchase plans, tuition reimbursement, paid time off plus holidays, and a flexible approach to work with remote, hybrid, field or office work schedules. Actual pay will be adjusted based on an individual's skills, experience, education, and other job-related factors permitted by law, including full-time or part-time status. Total compensation may also include additional forms of incentives. Benefits may be subject to program eligibility. Centene is an equal opportunity employer that is committed to diversity, and values the ways in which we are different. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or other characteristic protected by applicable law. Qualified applicants with arrest or conviction records will be considered in accordance with the LA County Ordinance and the California Fair Chance Act

United States + 1 moreAll locations: United States | Tunisia
$87K - $161K / year
Job Closed
Centene Corporation logo

Senior Data Engineer

Centene Corporation

Transforming the health of the communities we serve, one person at a time.

Data Engineer77 days ago
OtherRemoteTeam 10,001+Since 1984H1B No Sponsor

You could be the one who changes everything for our 28 million members by using technology to improve health outcomes around the world. As a diversified, national organization, Centene's technology professionals have access to competitive benefits including a fresh perspective on workplace flexibility. Position Purpose: Develops and operationalizes data pipelines to make data available for consumption (reports and advanced analytics), including data ingestion, data transformation, data validation / quality, data pipeline optimization, and orchestration. Engages with the DevSecOps Engineer during continuous integration and continuous deployment. - Helps guide the design and implementation of complex data management procedures around data staging, data ingestion, data preparation, data provisioning, and data destruction (scripts, programs, automation, assisted by automation, etc.) - Provides guidance to data engineers in the design, development, implementation, testing, documenting, and operating of large-scale, high-volume, high-performance data structures for business intelligence analytics - Designs, develops, and maintains real-time processing applications and real-time data pipelines - Ensure quality of technical solutions as data moves across Centene’s environments - Provides senior level knowledge and insight into the changing data environment, data processing, data storage, and utilization requirements for the company and drives the team toward viable solutions - Develops, constructs, tests, and maintains architectures using advanced programming language and tools - Drives ways to improve data reliability, efficiency, and quality and deploys a solution; use data to discover tasks that can be automated - Performs other duties as assigned - Complies with all policies and standards Education/Experience: A Bachelor's degree in a quantitative or business field (e.g., statistics, mathematics, engineering, computer science) and Requires 4 – 6 years of related experience. Or equivalent experience acquired through accomplishments of applicable knowledge, duties, scope and skill reflective of the level of this position. Technical Skills: - One or more of the following skills are desired. - - Snowflake - SQL - Informatica IDMC Pay Range: $87,000.00 - $161,300.00 per year Centene offers a comprehensive benefits package including: competitive pay, health insurance, 401K and stock purchase plans, tuition reimbursement, paid time off plus holidays, and a flexible approach to work with remote, hybrid, field or office work schedules. Actual pay will be adjusted based on an individual's skills, experience, education, and other job-related factors permitted by law, including full-time or part-time status. Total compensation may also include additional forms of incentives. Benefits may be subject to program eligibility. Centene is an equal opportunity employer that is committed to diversity, and values the ways in which we are different. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or other characteristic protected by applicable law. Qualified applicants with arrest or conviction records will be considered in accordance with the LA County Ordinance and the California Fair Chance Act

United States
$87K - $161K / year
Job Closed
Horizon Industries logo

Databricks Data Engineer

Horizon Industries

Horizon Industries Limited was founded in 1996 and is based in Vienna, Virginia. Horizon is a dynamic, SBA-certified Small Disadvantaged Business (SDB) with professional and talented strategists, technologists, and consultants across diverse domains. Expertise in IT, analysis and evaluation, data analytics, business process management Acquisition and financial management, cost and risk assessments Independent Verification & Validation, program management, systems engineering and design Database management, logistical warehouse services, and administrative support Capabilities in financial, operational, and technology consulting Risk management services, strategic planning, leadership effectiveness Anti-fraud waste and abuse programs, financial and operational assessments Regulatory compliance, workflow automation, and audit readiness services Equal Employment Opportunity Horizon is an Equal Employment Opportunity employer. It is our policy to consider all applicants for employment without regard to sex, race, color, creed, religion, national origin, sexual orientation, marital status, age, disability, veteran status, alienage, ancestry, citizenship status, or any other factor prohibited by law. Horizon will not discharge or discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant, consistent with applicable law.

Data Engineer77 days ago
OtherRemoteTeam 201-500

Role Description We are seeking a Databricks Data Engineer for a full-time position supporting our various clients. We are committed to your growth and success in the IT software development industry. We are looking for a Databricks Data Engineer ready to assume leadership responsibilities in a supportive team environment focused on your success as a function of client success. - Build end-to-end implementation of multiple ETL/ELT pipelines, demonstrating efficient data transformation and ingest patterns to move raw data from data producers to an enterprise data ecosystem, with a focus on performance and reliability. - Assess and understand the ETL jobs, workflows, BI tools, and reports. - Address technical inquiries concerning customization, integration, enterprise architecture and general feature/functionality of data products. - Experience in crafting database/data warehouse solutions in the cloud (Preferably AWS, Azure, Alternatively GCP). - Key must-have skill sets – Python, SQL, Databricks, AWS Data Services. - Experience with message queuing, stream processing, and highly scalable ‘big data’ data stores. - Experience manipulating, processing, and extracting value from large, disconnected datasets. - Experience manipulating structured and unstructured data for analysis. - Experience with data modeling tools and processes. - Experience aggregating and transforming data from multiple datasets to create data products. - Support an Agile software development lifecycle. Qualifications - Ability to hold a position of public trust with the US government. - B.S. in Computer Science or equivalent. - 4+ years' experience in data engineering and big data. At least 2 years' of professional services experience interacting directly with clients. - Big data tools: Hadoop, Spark, Kafka, etc. - Relational SQL and NoSQL databases and experience working with relational databases. - AWS cloud services: EC2, S3, RDS, Glue, Step Functions, Lambda, EMR, DynamoDB, DocumentDB, Redshift, Aurora, Athena. - Data Platforms: Databricks. - Data streaming systems: Batch, Kafka, Storm, Spark-Streaming, etc. - Languages: Python, R, Scala, Go. - Ability to inspect existing data pipelines, discern their purpose and functionality, and re-implement them efficiently in Databricks. - Extensive knowledge of data warehousing concepts and hands-on experience deploying pipelines using Databricks. - Data modeling and database design skills and knowledge of version control. - Excellent verbal and written communication skills. - Experience architecting scalable and fault-tolerant data solutions across Azure, AWS, and Databricks. - Databricks Data Engineer Professional certification a plus. - Preference for candidates with Databricks Professional certifications. Requirements - Bachelor’s degree in a technical field such as software engineering, engineering, computer science, etc. Benefits - A comprehensive benefits package including healthcare (medical, dental, vision and disability). - A 401k program where you are 100% vested from day one with an employer match after 90 days. - An Educational Assistance program. - A Student Loan Repayment Program. - Gym Reimbursement Program. - Paid Time off. - Dynamics, passionate, multi-disciplinary team of creative minds to work with, and many more.

United States