Simple Technology Solutions logo
Simple Technology Solutions

8(a) HUBZone IT consultancy w/ advanced partnerships w/ Amazon Web Services, Microsoft Azure & Google Cloud Platform

Senior Data Engineer

Data EngineerData EngineerFull TimeRemoteSeniorTeam 51-200H1B No SponsorCompany SiteLinkedIn

Location

United States

Posted

10 hours ago

Salary

0

Seniority

Senior

Job Description

Senior Data Engineer

Simple Technology Solutions

• design, build, and maintain well-architected ETL pipelines • work at enterprise scale and process terabytes of financial data • ensure data is timely, accurate, and stored within contractually required timelines • build and maintain ingestion pipelines using AWS Glue • process and ingest large-volume XML filings • store curated zone data in Apache Iceberg tables • prevent duplicate data loads across target destinations • integrate the agency's ETL Common Library into Glue jobs • ensure all ETL jobs populate ETL Load Reports in real-time • implement technical data quality standards • develop and maintain the semantic layer • deploy ETL resources using CloudFormation templates • create and maintain documentation suite for each dataset • support operationalization of statistical outputs and derived data products

Job Requirements

  • US Citizenship is required
  • Bachelor's Degree is required
  • minimum of 6 years' position related experience is required
  • strong expertise in AWS Glue (Spark-based), PySpark, and Python (PEP 8)
  • direct experience building large-scale ETL pipelines on AWS
  • experience with Apache Iceberg, Parquet, ORC, and Avro file formats
  • experience with PostgreSQL, Redshift, and Oracle; familiarity with NoSQL, knowledge bases, and vector stores
  • experience with Trino, Athena, and Hive
  • experience parsing and ingesting large-volume XML datasets with schema evolution handling using PySpark
  • proficiency with CloudFormation, GitHub branching workflows, CI/CD pipelines
  • demonstrated ability to produce complete ETL documentation

Benefits

  • flexibility to help them thrive personally and professionally
  • collaboration, continuous learning, and excellence
  • special incentives for team members living in qualified HUBZones

Related Categories

Related Job Pages

More Data Engineer Jobs

Milliman logo

Data Engineer – MedInsight

Milliman

Solutions for a world at risk™

Data Engineer10 hours ago
Full TimeRemoteTeam 1,001-5,000Since 1947H1B Sponsor

• Build & Enhance Pipelines: Design, develop, and maintain scalable data pipelines to ingest, transform, and enrich complex healthcare data using Databricks and Spark. • Optimize Data Workflows: Analyze and improve data intake processes and optimize SparkSQL/Python workloads for performance, scalability, reliability, and cost efficiency. • Design Data Models: Develop and maintain data marts, semantic models, and curated datasets that support analytics products, reporting, and business intelligence initiatives. • Ensure Data Quality & Reliability: Monitor pipeline health, troubleshoot production issues, implement data validation frameworks, and maintain high standards for data quality and governance. • Collaborate Across Teams: Partner with product, analytics, and engineering teams to understand business requirements and deliver scalable data solutions. • Drive Continuous Improvement: Contribute to architecture decisions, engineering standards, automation efforts, and best practices across the data platform.

California + 13 moreAll locations: California | Connecticut | District Of Columbia | Idaho | Illinois | New Jersey | New York | Maryland | Massachusetts | Pennsylvania | Vermont | Virginia | Washington | Wisconsin
$93.7K - $177.7K / year
Astrana Health, Inc. logo

Supervisor - Electronic Data Interchange

Astrana Health, Inc.

Astrana Health is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, gender (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. All employment is decided on the basis of qualifications, merit, and business need. If you require assistance in applying for open positions due to a disability, please email us at humanresourcesdept@astranahealth.com to request an accommodation. The job description does not constitute an employment agreement between the employer and employee and is subject to change by the employer as the needs of the employer and requirements of the job change.

Data Engineer10 hours ago
Full TimeRemoteTeam 1,001-5,000

Role Description Supervisor - Electronic Data Interchange (Astrana Health Management Inc.; Alhambra, CA): Develop data structure and software applications, and improve software platforms and systems to support business needs. Design, test, deploy, improve, and maintain software that will be used internally and externally by physicians and patients. Key Responsibilities - Apply expertise on emerging or existing massive data to create and scale insights. - Develop large-scale models to support specific business needs and enhance the company's efficiency. - Improve system design and architecture to ensure performance and high stability of services. - Troubleshoot, debug, and upgrade large-scale distributed systems by systematic problem-solving approach to improve product performance and the whole lifecycle of software services. - Monitor system scalability and reliability and understand the importance of experimentation framework, monitoring, and alerting. - Produce specifications and determine operational feasibility, document and maintain software functionality, and integrate software components into a fully functional software system. - Manage project requirements, priorities, and deliverable timelines effectively. - Collaborate with different functional teams to integrate software applications and technical solutions. - Work with business users, engineers, and other stakeholders to execute mission-critical projects. - Identify high priority engineering tasks/projects and review, analyze, and deliver technical requirements. - Understand product objectives to align with user demands. - Collaborate with engineering teams, customers, and PM and PSO teams to fulfill fast-growing technical demand. - Supervise EDI Analyst I & II (2). - Telecommuting permitted from within the U.S. Qualifications - Bachelor’s degree or foreign equivalent in Computer Science, Computer Engineering, Information Systems, or related field. - Two (2) years of experience as a Software Engineer, Software Developer, or related occupation. Requirements - Experience with designing and building large-scale distributed systems. - Improving software system scalability, performance, and reliability. - Applying data structures, algorithms, and software engineering principles. - Object-oriented programming language: Java, Python, or C#. - Debugging and optimizing complex systems. - Software Development Life Cycle (SDLC), including testing, deployment, and maintenance. - Collaborating with cross-functional teams to deliver technical solutions. Benefits - Compensation: $129,667 - $140,000 / year. - Employment Type: Full Time. - Location: Remote.

United States
$129.7K - $140K / year

Role Description Join a team where your work truly makes an impact. In this role, you’ll leverage your expertise in Data Warehousing and Business Intelligence to design scalable, flexible, and resilient data solutions that support the continued growth and mission of TWIA/TFPA. You’ll play a key role in transforming data from multiple sources into meaningful insights, powering critical decision-making across the organization. Working closely with teams throughout our Property & Casualty insurance business, you’ll help deliver accurate, actionable intelligence to a wide range of stakeholders—turning complex data into real business value. If you’re passionate about building data-driven solutions and collaborating across the enterprise, this is an opportunity to make a lasting impact. Candidates selected for the Data Warehouse Developer position with TWIA/TFPA will be placed at a level that aligns with their demonstrated skills, competencies, and professional experience. Qualifications - Four-year college degree, preferably in CS, engineering or other technical field, or equivalent experience. - 7-12 years of directly relevant experience in Data Warehouse/Business Intelligence. - 3-8 years of hands-on experience in building ETL, reporting, and Data Visualization solutions using tools (Ex: SAP Data Services, Informatica, Data Stage, Microsoft SSIS packages, QlikView, Tableau etc.). - 1-5 years of work experience in Guidewire Data Management tools. - Experience in building conceptual, logical, and physical data modeling; dimensional modeling preferred. - Significant experience in software development processes and best practices. - Understanding of business operations - preferably property and casualty insurance. - Clear, effective verbal and written communication skills including the ability to actively listen, problem solve, and communicate with both technical and business users. - Demonstrated experience working both as an individual contributor and as part of a team. - Experience in providing guidance to junior developers, quality assurance, and business analysts. - Attention to detail with self-discipline, strong ownership and accountability and drive for results. Requirements - Develops recommendation and conducts analysis in support of department and business line strategic efforts. - Confers with client, technical staff, and team members to plan, design, develop, implement, and enhance applications, scripts, procedures, and metadata for relational databases. - Champion enterprise data management best practices & provides recommendations for data architecture structure and standards. - Participate in end-to-end architecture & data warehouse life cycle management activities & provides recommendations. - Manage numerous requests concurrently and strategically, prioritizing when necessary. - Designs, develops, and implements the data architecture for a data warehouse, including high-performance ETL (Extract, Transform, and Load) tools and routines and the infrastructure. - Recognize and leverage data sources both internally and externally to enhance the analysis capabilities. - Reverse Engineers data specifications from source systems through data discovery, analysis, and other techniques. - Develops and maintains Data Models, including Enterprise Data Dictionary. - Establishes methods and procedures for tracking data quality, completeness, redundancy, and improvement. - Participates with application and infrastructure design architects to provide guidance for development and releases. - Influences technology direction and/or adjustments to incorporate into business plans. - Influences the selection of hardware and software product standards and the design of standard configurations; makes significant contributions to market-centric technology roadmaps and architectural principles and frameworks. - Reviews and ensures major architectural designs are consistent, maintainable, flexible and cost effective solutions. - Leads retrospectives and defines opportunities for experiments and POC`s. - Perform troubleshooting on all ETL processes and resolve issues effectively within IT service level agreements. - Lead by example, engaging hands-on in complex data challenges and Information Management projects to derive deep insights from data. - Oversee business intelligence/data warehouse security and data load and implementation strategies. - Lead enterprise projects through all phases of System Development Life Cycle (SDLC)/ Agile process. - Perform other duties as assigned. Benefits - Comprehensive medical, dental, vision, group life, AD&D, and dependent life insurance coverage. - Flexible Spending Accounts (FSA) and Health Savings Accounts (HSA) with a generous annual HSA employer contribution. - A 401(k) retirement plan with employer matching contributions up to 6%, in addition to a pension plan that begins vesting at 5 years of employment. - Active support for professional growth, including ongoing training and professional development opportunities sponsored by TWIA, support to obtain professional certifications, and a tuition reimbursement program. - Generous paid time off, including vacation, sick leave, paid holidays, and personal days. - Flexible scheduling to support work-life balance.

United States
Samsara logo

Senior Data Engineer

Samsara

Pioneer of the Connected Operations Cloud

Data Engineer11 hours ago
Full TimeRemoteTeam 1,001-5,000Since 2015H1B Sponsor

• Build and maintain highly reliable computed tables, incorporating data from various sources. • Access, manipulate, and integrate external datasets with internal data. • Deliver high-quality data with strong uptime and reliability requirements. • Collaborate closely with cross-functional teams such as Data Science & Analytics, AI/ML, and other Data Engineers. • Champion and embed Samsara's cultural principles as we scale globally.

Canada
$135.6K - $159.5K / year