Delivering Talent. Driving Results
Senior Data Engineer- US Citizen
Location
United States
Posted
75 days ago
Salary
0
Seniority
Senior
Job Description
Senior Data Engineer- US Citizen
Vytwo Technologies Inc
Role: Senior Data Engineer- US Citizen Location: Minneapolis, MN Rate: Depends on experience Additional Requirements - Must be a U.S. Citizen - Must be currently located in Minnesota (MN), or willing to relocate Description We are looking for Senior Data Engineer to join our dynamic team! With our extensive knowledge in application, data, and cloud engineering services, we strive to create groundbreaking solutions that provide real value to our clients. Key Responsibilities - Design, develop, and maintain scalable data pipelines using Apache Spark (PySpark and/or Scala) - Build and optimize data workflows on Databricks, including Delta Lake, notebooks, and scheduled jobs - Ingest, transform, and curate large-scale structured and semi-structured datasets - Perform performance tuning and cost optimization of Spark workloads and Databricks clusters - Implement data quality checks, monitoring, and error handling - Collaborate with analytics and business stakeholders to deliver well-modeled, analytics-ready data - Support batch processing and, where applicable, streaming data pipelines - Follow best practices for testing, documentation, security, and version control Required Qualifications - 5+ years of experience in Data Engineering or related roles - Strong hands-on experience with Apache Spark (PySpark or Scala) - Proven experience working in Databricks environments - Strong SQL skills and experience with relational and analytical databases - Experience building and maintaining ETL/ELT pipelines at scale - Familiarity with modern data lake architectures (Delta Lake preferred) - Experience with Git-based version control Flexible work from home options available.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Senior Data Engineer
NIR-YUTake Control of Your Business and Execute Your Vision with Ease - Hire Affordable and Qualified Nearshore Staff
• Design, develop, and maintain scalable, high-performance data infrastructure to support the collection, storage, and processing of large datasets in real time and batch modes. • Build reliable, reusable services and APIs that allow teams to interact with the data platform for ingestion, transformation, and querying of data. • Build software tools, products and systems to monitor and manage the ML infrastructure and services efficiently. • Responsible for ensuring our ML systems are operating and running efficiently for model development, training, evaluation, and inference. • Collaborate with senior management, product management, and other engineers in the development of data products. • Develop tools to monitor, debug, and analyze data an ML pipelines. • Design and implement data schemas and models that can scale. • Mentor team members to build the company's overall expertise. • Work to make The RealReal an innovator in the space by bringing passion and new ideas to work every day.
Data Engineer, Reporting/Analytics Focused
NIR-YUTake Control of Your Business and Execute Your Vision with Ease - Hire Affordable and Qualified Nearshore Staff
• Perform querying, data extraction, and reporting work • Support business intelligence dashboards and reporting requirements • Focus on the reporting/warehousing side of data engineering
Informatica Developer
Manpower/itecSince 1999, ITEC has delivered mission-critical support to the DoD and Intelligence Community. Now part of ManpowerGroup Public Sector (MGPS), we continue that work with expanded capabilities.
Role Description The Informatica Developer will be responsible for the following: - Work with Client, Accenture, and Teaming Partner team members and executives on and across the project team. - Plan, drive, and execute all required process steps as defined in Accenture/Client Agile delivery methodologies. - Direct interaction with customer business representatives and Agile team members to complete user story refinement and detailed task breakdowns. - Design and code in SAP HANA, Data Services, and BusinessObjects adhering to SAP best practices. - Analyze, design, code and test break/fix requests and enhancements to data model and reporting components. - Develop system interfaces using ODP DataSources, Data Services, and file transfers. Execute component and unit testing, support UAT, and resolve defects. Qualifications - Must have a Tier 3 active DoW investigation. - Must have Informatica certification. - Must have Informatica ETL development experience. - Must have Informatica ETL administration experience. - Must have Informatica console installation, configuration and management experience. - Experience supporting product evaluation and selection. - Experience installing, configuring and developing capabilities leveraging Informatica for data pipeline and transformation. Company Description Since 1999, ITEC has delivered mission-critical support to the DoD and Intelligence Community. Now part of ManpowerGroup Public Sector (MGPS), we continue that work with expanded capabilities. Employees hired through this process will join MGPS and receive a comprehensive benefits package and competitive pay. U.S. Citizenship Mandatory: Due to our US federal government contract, candidates for this position are required to be a US Citizen and will be subject to a background investigation.
Senior Data Engineer
Centene CorporationTransforming the health of the communities we serve, one person at a time.
You could be the one who changes everything for our 28 million members by using technology to improve health outcomes around the world. As a diversified, national organization, Centene's technology professionals have access to competitive benefits including a fresh perspective on workplace flexibility. Position Purpose: Develops and operationalizes data pipelines to make data available for consumption (reports and advanced analytics), including data ingestion, data transformation, data validation / quality, data pipeline optimization, and orchestration. Engages with the DevSecOps Engineer during continuous integration and continuous deployment. - Helps guide the design and implementation of complex data management procedures around data staging, data ingestion, data preparation, data provisioning, and data destruction (scripts, programs, automation, assisted by automation, etc.) - Provides guidance to data engineers in the design, development, implementation, testing, documenting, and operating of large-scale, high-volume, high-performance data structures for business intelligence analytics - Designs, develops, and maintains real-time processing applications and real-time data pipelines - Ensure quality of technical solutions as data moves across Centene’s environments - Provides senior level knowledge and insight into the changing data environment, data processing, data storage, and utilization requirements for the company and drives the team toward viable solutions - Develops, constructs, tests, and maintains architectures using advanced programming language and tools - Drives ways to improve data reliability, efficiency, and quality and deploys a solution; use data to discover tasks that can be automated - Performs other duties as assigned - Complies with all policies and standards Education/Experience: A Bachelor's degree in a quantitative or business field (e.g., statistics, mathematics, engineering, computer science) and Requires 4 – 6 years of related experience. Or equivalent experience acquired through accomplishments of applicable knowledge, duties, scope and skill reflective of the level of this position. Technical Skills: - One or more of the following skills are desired. - Experience with Big Data; Data Processing - Experience with Other: diagnosing system issues, engaging in data validation, and providing quality assurance testing - Experience with Data Manipulation; Data Mining - Experience working in a production cloud infrastructure - Experience with one or more of the following C# (Programming Language); Java (Programming Language); Programming Concepts; Programming Tools; Python (Programming Language); SQL (Programming Language) - Knowledge of Microsoft SQL Servers; SQL (Programming Language) Soft Skills: - Intermediate - Seeks to acquire knowledge in area of specialty - Intermediate - Ability to identify basic problems and procedural irregularities, collect data, establish facts, and draw valid conclusions - Intermediate - Ability to work independently - Intermediate - Demonstrated analytical skills - Intermediate - Demonstrated project management skills - Intermediate - Demonstrates a high level of accuracy, even under pressure - Intermediate - Demonstrates excellent judgment and decision making skills Pay Range: $87,000.00 - $161,300.00 per year Centene offers a comprehensive benefits package including: competitive pay, health insurance, 401K and stock purchase plans, tuition reimbursement, paid time off plus holidays, and a flexible approach to work with remote, hybrid, field or office work schedules. Actual pay will be adjusted based on an individual's skills, experience, education, and other job-related factors permitted by law, including full-time or part-time status. Total compensation may also include additional forms of incentives. Benefits may be subject to program eligibility. Centene is an equal opportunity employer that is committed to diversity, and values the ways in which we are different. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or other characteristic protected by applicable law. Qualified applicants with arrest or conviction records will be considered in accordance with the LA County Ordinance and the California Fair Chance Act


