Job Closed
This listing is no longer active.
ETL Data Engineer
Location
India
Posted
165 days ago
Salary
0
Seniority
Senior
Job Description
ETL Data Engineer
Empower
• Design, build, and maintain ETL pipelines and backend data workflows using Python and SQL • Develop and optimize data processing solutions on AWS using services such as Glue, EMR, Lambda, and S3 under guidance from senior engineers and architects • Implement and support CI/CD pipelines to automate build, test, and deployment processes • Collaborate with data engineers, architects, product owners, and business partners to understand requirements and translate them into clear technical tasks • Write clean, maintainable, and well-tested code that aligns with team standards and architectural guidelines • Troubleshoot and resolve data, performance, and reliability issues in lower and production environments with support from senior team members as needed • Participate in code reviews to provide and receive feedback and help uphold coding and quality standards • Contribute to design and technical discussions by sharing ideas and raising risks or improvement opportunities • Continuously learn and adopt tools, technologies, and development practices relevant to data engineering and cloud platforms
Job Requirements
- Bachelor’s degree in Computer Science or related field, or equivalent practical experience
- 3+ years of experience in software development, with a focus on backend or data engineering
- Proficiency in Python for backend development and data processing tasks
- Strong SQL skills, including working with large datasets and query optimization
- Hands-on experience with AWS services, ideally including Glue, EMR, Lambda, and S3, and Kafka topics
- Experience working with CI/CD pipelines and tools that support automated build, test, and deployment
- Solid understanding of software development methodologies and best practices, including version control and automated testing
- Strong problem-solving, debugging, and troubleshooting skills
Benefits
- flexible work environment
- fluid career paths
- celebrate internal mobility
- importance of purpose, well-being, and work-life balance
- welcoming and inclusive environment
- volunteering for causes
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
• Create and edit logical and physical data models, XML schemas, and file formats using ER/Studio, XML Spy, or equivalent tools. • Build tables, define columns and data types, and perform database scripting (DDL, inserts, updates, data movement). • Analyze and profile data sources; develop source-to-target mappings with detailed transformations and business rules using Erwin Mapping Manager or similar. • Collaborate with business and technical stakeholders to define transformation rules and data flow, ensuring mapping rules and data governance are followed. • Write SQL scripts to analyze, validate, or correct data, including complex stored procedures, views, and functions. • Monitor data quality, investigate issues, and execute remediation plans. • Provide guidance to teams on solutions, enterprise architecture best practices, and standards. • Review project deliverables for quality and compliance; recommend improvements.
Data Engineer
Centific Global SolutionsCentific, founded in 2020, is a technology company specializing in artificial intelligence and digital transformation services, focusing on developing scalable
• Develop and optimize PySpark-based ETL pipelines for processing large-scale data • Develop, test, and maintain robust Python applications • Collaborate with data engineers, analysts, and other developers to design and implement data solutions • Work with Azure Data Lake, Azure Databricks, and Azure Data Factory to build scalable data solutions • Implement data classification, policy enforcement, and metadata extraction within Purview • Collaborate with data engineers and business teams to ensure smooth data flow across systems • Troubleshoot performance bottlenecks in Spark jobs and improve data pipeline efficiency • Ensure data security, compliance, and quality following best practices.
• Perform Data Warehouse Architecture at an intermediate level • Focus on design and development of data models and ETL specifications • Conduct data analysis, system design and architecture, standards and policy administration • Coordinate vendor relations and conduct product/vendor research • Create moderate to advanced data models and ETL specifications • Maintain documentation on design and operation • Analyze data sources and recommend solutions • Participate in long-term data warehouse and dashboard architecture planning • Manage existing systems compliance with established standards
• Develop repeatable ETL pipelines to feed team dashboards, reports, and analytics • Investigate underlying data to assist in production support efforts • Assist platform engineering team with in-app reporting and dashboard development • Work with adjacent teams to develop reliable data extracts that support their work • Implement validation checks and monitoring to maintain data integrity and consistency • Build tools to fabricate data sets for standing up product demos and to assist QA efforts • Perform other duties as assigned



