Job Closed
This listing is no longer active.
Data Engineer
Location
South Carolina
Posted
101 days ago
Salary
0
Seniority
Mid Level
Job Description
Data Engineer
qode.world
Job Summary: We are looking for a skilled Data Engineer with strong hands-on experience in AWS to design, build, and maintain scalable data pipelines and cloud-based data platforms. The ideal candidate will have expertise in modern data warehousing, ETL/ELT development, and distributed data processing while ensuring data quality, performance, and security. Key Responsibilities: · Design, develop, and maintain scalable data pipelines using AWS services. · Build and optimize ETL/ELT workflows for structured and unstructured data. · Implement data lakes and data warehouses on AWS. · Work with large datasets to ensure high performance, reliability, and data integrity. · Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements. · Perform data modeling for analytical and operational use cases. · Ensure data quality, governance, and security best practices. · Monitor and troubleshoot data workflows and production issues. · Support CI/CD and automation for data platform deployments. Required Skills & Experience: · Strong hands-on experience with AWS services such as S3, Glue, Redshift, Lambda, EMR, Athena, and RDS. · Proficiency in Python and SQL for data processing and analysis. · Experience in building and optimizing ETL/ELT pipelines. · Solid understanding of data warehousing and data lake architecture. · Experience with Apache Spark / PySpark. · Knowledge of workflow orchestration tools (Airflow or similar). · Familiarity with streaming frameworks (Kinesis/Kafka) is a plus. · Experience with data modeling and performance tuning. · Understanding of DevOps, CI/CD, and infrastructure as code (Terraform/CloudFormation). · Experience working in Agile/Scrum environments. Good to Have: · Experience with Snowflake on AWS. · Exposure to real-time data processing. · AWS certification (e.g., AWS Certified Data Analytics / Solutions Architect). Soft Skills: · Strong problem-solving and analytical skills. · Excellent communication and stakeholder management. · Ability to work in a fast-paced, collaborative environment.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
• Design and build robust data pipelines and feature stores that powers our AI products. • Analyse data requirements, understand complex data sources, and partner with architects to determine the best methods to extract, transform, and load data into data platform. • Lead conversations with business or functional teams to translate user requirements into reusable and cost-efficient data acquisition methodologies for AI products. • Be the key anchor for data extraction, preparation and hosting processes representing the AI team. Data expert for engineering datasets used by data scientists working on various use cases. • Perform functional and stress testing on data models and extraction jobs to ensure that design is optimized for performance, scale, and reusability. • Manage foundational data administration tasks such as scheduling jobs, troubleshooting job errors, identifying issues with job windows, assisting with database backups and performance tuning. • Ensure data quality throughout entire development process, including audits and feedback loops to sources of truth. • Create or update technical documentation for transition to support teams. • Mentor junior data engineers
Data Engineer
OceansOceans hires incredible operational talent, matching them with world-class startups around the globe.
• Architect and implement the full data foundation powering an internal LLM-driven analytics platform integrated directly with Amazon Seller Central. • Own ingestion, normalization, warehousing, semantic modeling, and query-ready access across commerce, advertising, operational, and financial datasets spanning multiple client brands. • Establish and manage authenticated SP-API connections across client brands. • Ingest data from Orders, Reports, Advertising, Inventory, and Financial endpoints. • Handle throttling, pagination, retries, and rate-limit constraints reliably. • Implement incremental loads, historical backfills, and failure recovery. • Continuously expand usable Amazon dataset coverage. • Design and implement scalable ELT/ETL pipelines from raw ingestion to analytics-ready schemas. • Stand up and operate a centralized warehouse (e.g., Snowflake, BigQuery, Redshift, Postgres, or equivalent). • Normalize multi-client, multi-brand datasets with historical retention and versioning. • Model core domains including sales, advertising performance, inventory/FBA, and profitability. • Ensure long-term maintainability, observability, and scale readiness. • Define standardized ecommerce metrics (sales, net revenue, ad spend, TACoS, and related drivers). • Create curated semantic or mart layers suitable for deterministic LLM querying. • Implement guardrails for filters, date logic, and metric definitions. • Ensure query outputs are reproducible, traceable, and grounded in source-of-truth tables. • Partner with founders on LLM model and architecture decisions. • Implement validation, anomaly detection, and freshness SLAs. • Maintain logging, alerting, and incident-response readiness across pipelines. • Ensure auditability and accuracy of analytics outputs. • Proactively resolve reliability risks and operational gaps. • Document API integrations, schemas, refresh cadences, and assumptions. • Produce clear handoff materials enabling internal continuity. • Prepare architecture for secure multi-tenant, external-facing product evolution. • Maintain a documentation-first, long-term ownership mindset. • Work directly with the client’s founders as the primary technical owner of the data platform, collaborating on architecture, LLM strategy, and product readiness. • Receive guidance from the Operations Manager to support delivery excellence, professional growth, and long-term success in the role.
Marketing & CRM Data Engineer
Smart WorkingEmpowering companies to work with the best engineers in the world
- Own CRM data hygiene and maintain high-quality contact and account data. - Audit and optimise CRM properties, lifecycle stages, and deduplication processes. - Build and maintain scalable enrichment workflows in Clay. - Run enrichment waterfalls (email, phone, LinkedIn, firmographics). - Manage scraping workflows using Bright Data and Apollo exports. - Prepare outbound lists and ensure they are campaign-ready with low bounce rates. - Reduce duplicate and stale records across CRM and data sources. - Implement and manage email validation workflows. - Maintain reporting on list health, data completeness, and coverage metrics. - Document workflows and create repeatable, scalable processes. - Run light scripts or technical executions where needed.
Senior Data Engineer - Remote
OptumOptum, part of the UnitedHealth Group family of businesses, is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together. At Optum, we support your well-being with an understanding team, extensive benefits and rewarding opportunities. By joining us, you’ll have the resources to drive system transformation while we help you take care of your future. We recognize the power of connection to drive change, improve efficiency and make a difference in health care. Join a team where your skills and ideas can make an impact and where collaboration is key to creating technology that produces healthier outcomes.
Requisition Number: 2338897 For those who want to invent the future of health care, here's your opportunity. We're going beyond basic care to health programs integrated across the entire continuum of care. Join us to start Caring. Connecting. Growing together. You'll enjoy the flexibility to work remotely * from anywhere within the U.S. as you take on some tough challenges. For all hires in the Minneapolis or Washington, D.C. area, you will be required to work in the office a minimum of four days per week. Primary Responsibilities: Design, develop, and maintain scalable data pipelines using Python, PySpark, and other modern programming languages to support both batch and streaming workloads Build and optimize data processing frameworks on cloud platforms such as Databricks or Snowflake, ensuring performance, reliability, and cost efficiency Design and implement robust data models, including transactional (OLTP) and dimensional (OLAP) schemas, to support analytics, reporting, and application integration Develop high quality SQL code including complex queries, stored procedures, and views, with a focus on performance tuning and efficient data access patterns Create and manage workflow orchestration using Apache Airflow or similar tools, ensuring reliable scheduling, dependency management, and monitoring Implement and enforce data governance and metadata standards through tools such as Microsoft Purview, including data lineage, classification, cataloging, and security policies Build automated data quality and validation frameworks to ensure accuracy, completeness, and reliability of production datasets Collaborate with cross functional teams including data architects, analysts, scientists, and business stakeholders to understand requirements and deliver scalable, well designed data solutions Required Qualifications: 7+ years of experience in data engineering, software engineering, or similar disciplines Hands-on experience with Databricks or Snowflake Experience with orchestration tools such as Apache Airflow Experience working with cloud ecosystems (Azure preferred; AWS/GCP acceptable) Advanced SQL skills and experience with OLTP and OLAP data modeling Solid understanding of modern data warehousing, data lake, and ELT/ETL design patterns Familiarity with data governance tools, especially Microsoft Purview Solid programming expertise in Python, PySpark, or similar languages If you are offered this position, you will be required to provide extensive personal information to obtain and maintain a suitability or determination of eligibility for a Confidential/Secret or Top Secret security clearance as a condition of your employment United States Citizenship Preferred Qualifications: Healthcare industry experience, including claims, clinical, FHIR, HL7, or provider data Experience with containerization (Docker, Kubernetes) for data workloads Experience supporting machine learning workflows or analytical data science pipelines Knowledge of distributed computing concepts and performance tuning *All employees working remotely will be required to adhere to UnitedHealth Group's Telecommuter Policy Pay is based on several factors including but not limited to local labor markets, education, work experience, certifications, etc. In addition to your salary, we offer benefits such as, a comprehensive benefits package, incentive and recognition programs, equity stock purchase and 401k contribution (all benefits are subject to eligibility requirements). No matter where or when you begin a career with us, you'll find a far-reaching choice of benefits and incentives. The salary for this role will range from $91,700 to $163,700 annually based on full-time employment. We comply with all minimum wage laws as applicable. Application Deadline: This will be posted for a minimum of 2 business days or until a sufficient candidate pool has been collected. Job posting may come down early due to volume of applicants. At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone-of every race, gender, sexuality, age, location and income-deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission. OptumCare is an Equal Employment Opportunity employer under applicable law and qualified applicants will receive consideration for employment without regard to race, national origin, religion, age, color, sex, sexual orientation, gender identity, disability, or protected veteran status, or any other characteristic protected by local, state, or federal laws, rules, or regulations. OptumCare is a drug-free workplace. Candidates are required to pass a drug test before beginning employment.




