Job Closed

This listing is no longer active.

Astro Sirens LLC logo
Astro Sirens LLC

Find the right job. Right now.

Senior Data Engineer

Data EngineerData EngineerFull TimeRemoteSeniorTeam 1-10H1B No SponsorCompany SiteLinkedIn

Location

India

Posted

75 days ago

Salary

0

Seniority

Senior

Job Description

Senior Data Engineer

Astro Sirens LLC

• Design, implement, and maintain robust and scalable data pipelines using AWS, Azure, and containerization technologies. • Develop and maintain ETL/ELT processes to extract, transform, and load data from various sources into data warehouses and data lakes. • Collaborate with data scientists, analysts, and other engineers to ensure seamless data flow and availability across the organization. • Optimize data storage and retrieval performance by utilizing cloud services like AWS Redshift, Azure Synapse, or other relevant technologies. • Work with containerization tools like Docker and Kubernetes to ensure smooth deployment, scalability, and management of data pipelines. • Monitor, troubleshoot, and optimize data processing pipelines for performance, reliability, and cost-efficiency. • Automate manual data processing tasks and improve data quality by implementing data validation and monitoring systems. • Implement and maintain CI/CD pipelines for data workflow automation and deployment. • Ensure compliance with data governance, security, and privacy regulations across all data systems. • Participate in code reviews and ensure the use of best practices and documentation for data engineering solutions. • Stay up-to-date with the latest data engineering trends, cloud services, and technologies to continuously improve system performance and capabilities.

Job Requirements

  • Excellent communication skill, specifically fluent verbal English is mandatory to explain complex technical concepts to non-technical stakeholders and collaborate across teams.
  • Proven experience as a Data Engineer, with hands-on experience building and managing data pipelines.
  • Strong proficiency in cloud technologies, specifically AWS (e.g., S3, Redshift, Glue) and Azure (e.g., Data Lake, Azure Synapse).
  • Experience working with containerization and orchestration tools such as Docker and Kubernetes.
  • Proficient in data engineering programming languages, such as Python, Java, or Scala.
  • Solid experience with SQL and NoSQL databases (e.g., PostgreSQL, MongoDB, Cassandra).
  • Familiarity with data processing frameworks like Apache Spark, Apache Kafka, or similar tools.
  • Experience with workflow orchestration tools like Apache Airflow, DBT, or similar.
  • Knowledge of data warehousing concepts and technologies (e.g., Snowflake, Amazon Redshift, or Google BigQuery).
  • Strong understanding of ETL/ELT processes and best practices.
  • Experience with version control systems like Git.
  • Strong problem-solving skills and a proactive approach to troubleshooting and optimization.

Benefits

  • Competitive salary and flexible payment method.
  • Opportunities for growth and professional development.
  • Flexible working hours and full remote work opportunity.
  • Work in a collaborative, innovative and inclusive environment.
  • Be a part of a data-driven culture that is at the forefront of innovation.

Related Categories

Related Job Pages

More Data Engineer Jobs

Full TimeRemoteTeam 5,001-10,000Since 1995H1B No Sponsor

• Lead the design and evolution of the client's lakehouse/data lake architecture • Provide technical direction for the design and deployment of AI agents aimed at enabling the sales team to rapidly access fund performance insights • Define and drive the roadmap for Large Language Model adoption and Generative AI integration within the client's data ecosystem • Act as the primary technical point of contact for client leadership and senior business stakeholders • Implement and enforce DataOps principles across the data platform • Mentor and develop team members, fostering a culture of continuous learning

Brazil
Avenga logo

Senior Data Engineer – Streaming, Big Data Platform

Avenga

A global IT engineering and consulting company specializing in custom software development.

Data Engineer75 days ago
Full TimeRemoteTeam 5,001-10,000H1B No Sponsor

• Design, develop and maintain streaming data pipelines and transformations • Build and operate a big data platform used for real-time network observability and alerting • Ensure platform availability, reliability and performance • Design and implement monitoring solutions for data pipelines and platform components • Support platform evolution, upgrades and infrastructure improvements • Collaborate with internal stakeholders and translate business requirements into technical solutions • Troubleshoot complex platform and data processing issues • Create and maintain technical documentation and operational standards

Poland
Job Closed
CloudPay logo

Team Lead, DataOps

CloudPay

The High-Performance Payroll People

Data Engineer75 days ago
Full TimeRemoteTeam 1,001-5,000Since 1996H1B No Sponsor

• Lead, mentor, and develop a high-performing DataOps team • Set technical direction, priorities, and operating standards for DataOps • Own the operational health, performance, and availability of CloudPay’s data platforms • Design and implement monitoring, alerting, and incident management for data pipelines • Implement robust CI/CD processes for data pipelines and analytics assets • Ensure strong data access controls, auditability, and regulatory compliance (e.g., GDPR) • Act as a bridge between Data Engineering, Analytics, Product, and Operations

Spain
Job Closed
Clorox Company logo

Financial Data Engineer

Clorox Company

The Clorox Company, or simply Clorox, is an industry-leading and recognizable household brand, as well as a portfolio of other diverse brands. Headquartered in

Data Engineer75 days ago

• Assist in identifying and resolving QA bugs related to data pipelines and processes • Validate data accuracy, completeness, and consistency • Participate in designing, building, and maintaining data pipelines • Implement data transformations, data cleansing, and ETL processes • Collaborate with senior engineers to enhance pipeline efficiency • Take ownership of small features within the data pipeline • Write code to handle data ingestion, processing, and storage • Lead a small independent project related to data engineering • Choose a topic of interest (e.g., optimizing pipeline performance, automating data validation) • Present your findings and recommendations to the team

California
Job Closed