Zencore logo
Zencore

Premier Google Cloud partner created by ex-Google Cloud architects and engineers

Senior Data Engineer

Data EngineerData EngineerFull TimeRemoteSeniorTeam 11-50H1B No SponsorCompany SiteLinkedIn

Location

Argentina

Posted

57 days ago

Salary

0

Seniority

Senior

Job Description

Senior Data Engineer

Zencore

• Design, build, and optimize large-scale distributed data pipelines using Apache Beam / Google Cloud Dataflow, Apache Spark, or Apache Flink. • Develop ETL/ELT workflows on GCP integrating multiple structured and unstructured data sources. • Address schema, type conversion, and performance optimization challenges when migrating data warehouses to BigQuery. • Implement observability, monitoring, logging, and error-handling within pipelines. • Collaborate with Data Analysts to integrate validation rules, QA checks, and automated testing into the pipeline lifecycle. • Support large-scale data migrations and performance tuning for high-volume workloads.

Job Requirements

  • 4+ years working as a Data Engineer in modern cloud environments.
  • 2+ years hands-on experience in GCP (BigQuery, Dataflow, Dataform, Composer, Dataproc, Pub/Sub).
  • Strong experience with distributed data processing frameworks (experience in at least one is required)
  • Apache Beam / Google Cloud Dataflow
  • Apache Spark
  • Apache Flink
  • Proficiency in Python (pipeline development)
  • Proficiency in SQL (Oracle + BigQuery dialects ideal)
  • Experience with Apache Airflow (orchestration)
  • Experience with big data workloads, batch/streaming pipelines, and large-scale data migrations.
  • Experience with data warehousing (BigQuery, Snowflake, Databricks a plus).

Benefits

  • Competitive compensation
  • Fully remote work
  • Commitment to a diverse and inclusive workplace

Related Categories

Related Job Pages

More Data Engineer Jobs

Full TimeRemoteTeam 201-500

Hello and thank you for your interest! We're looking for folks nationwide who are great at data entry and typing. We offer a flexible work from home remote position that allows you to stay home with the family! The pay range is flexible from $16/ph to $30/ph DOE and level of experience. You'll meet these requirements to work from home remotely • Stable Internet connection • Work can be done using the following: Phone device, laptap or computer • Must be able to type accurately with a minimum speed of 30 words per minute • Able to focus on tasks without being distracted • Must be resident of the US • Not afraid of emailing clients as needed We're looking for folks who we can depend on who can work from home remotely without distraction and are go-getters. Pay range from 16 to 30 hourly depending on the role, level of experience and proven ability to work from home at the same level as from an office. Data entry clerks come from all different backgrounds including, data entry, telemarketing, customer service, sales, clerical, secretary, administrative assistant, warehouse, inventory, receptionist, call center, part-time, retail fields & more • Must be 16 years of age or older • Must be proficient with basic PC skills • Must have an internet connection • Basic english written language • Basic english spoken language Thank you for your interest!

United States
$16 - $30 / hour
Gorilla Commerce logo

Data Engineer II

Gorilla Commerce

Gorilla Commerce is an e-commerce product development platform dedicated to launching and growing powerful brands.

Data Engineer57 days ago
Full TimeRemoteTeam 51-200Since 2014H1B No Sponsor

Position Snapshot Reporting to the Senior Manager of Business Intelligence, this position plays a key role in supporting Gorilla Commerce’s analytics and data engineering capabilities; enabling cross-functional, enterprise-wide access to reliable, scalable data. As a Data Engineer, you will assist with both strategic initiatives and day-to-day operational data needs, collaborating with internal teams and external vendors to help maintain modern data pipelines. This role supports a hybrid data architecture that blends large-scale parquet datasets from external partners with daily transactional CSV sources, leveraging Azure data services and Power BI to support insight and decision-making across the organization. The ideal candidate thrives in a fast-paced environment, brings strong technical aptitude, attention to detail, and is eager to grow experience building efficient, cost-effective, and reliable data solutions. About Gorilla Commerce What We Do: We’re a leading e-commerce company focused on creating high-quality, affordable products that make everyday life easier. Scale & Footprint: Headquartered in the United States, Gorilla Commerce is a Top 10 Amazon U.S. seller with rapid growth and expanding into an omnichannel presence. Industry Differentiator: Known for our flagship brand, Gorilla Grip, we combine creativity with data-driven insights to deliver obsession-worthy products. Culture Highlights: Fast-paced, collaborative, and customer-focused environment where innovation and growth thrive. Impressive Growth: We’re a rapidly growing e-commerce company with ambitious plans to expand our reach and evolve into a true omnichannel business. What You'll Do - Assist in the development and maintenance of data pipelines across Azure Data Factory, Azure SQL Database, and Azure Synapse Analytics, following established patterns and standards. - Support the building and upkeep of Azure-based data assets, including Blob Storage, SQL tables and procedures, and Synapse serverless views. - Participate in ETL/ELT processes, applying data normalization, transformation, and data quality checks under guidance. - Help maintain Power BI semantic models and datasets, ensuring accurate reporting and assisting with performance troubleshooting for hybrid SQL + parquet datasets. - Monitor data pipeline performance, investigate issues, and escalate or resolve them according to predefined procedures. - Learn and apply emerging Azure data platform features under the mentorship of senior engineers, contributing to improvements in pipeline performance, reliability, and scalability. What You'll Bring - Exposure to Microsoft Fabric or broader data fabric technologies. - Bachelor’s Degree in Computer Science, Information Systems, or a related field; or equivalent professional experience. - 2–4 years of experience in data engineering, data integration, or analytics engineering, or equivalent professional experience. - Proficiency in Python for data processing, scripting, and API integrations. - Strong SQL skills and familiarity with Azure SQL Database, including schema design, stored procedures, indexing, and query tuning. - Experience building or assisting with Azure Data Factory pipelines and working with Azure Synapse Analytics (serverless SQL pools, materialized views). - Familiarity with Azure Blob Storage management, Azure Function Apps, and modern ETL/ELT and data warehousing concepts. - Experience supporting or assisting with Power BI semantic models. - Exposure to hybrid data architectures. What We Offer At Gorilla Commerce, we believe great work deserves great rewards. Here’s what you can expect when you join our team: ✔ International Contractor Benefits - Competitive Compensation: Market-aligned pay for your region. - Flexible Work Arrangement: Remote-first approach with collaboration tools to stay connected. - Professional Development: Access to virtual learning resources and growth opportunities. Equal Opportunity Statement We welcome teammates from all backgrounds, identities, and experiences. If you think you’re a great fit, we encourage you to apply.

Philippines
ICF logo

Senior Data Engineer (Python/Scala)

ICF

Founded in 1969, ICF is a global advisory and technology services company headquartered in Reston, Virginia. It delivers data-driven solutions across energy, environment, infrastru

Data Engineer57 days ago

The company: ICF is a mission-driven company filled with people who care deeply about improving the lives of others and making the world a better place. Our core values include Embracing Difference; we seek candidates who are passionate about building a culture that encourages, embraces, and hires dimensions of difference. The Team: Our Health Engineering Systems (HES) team works side by side with customers to articulate a vision for success, and then make it happen. We know success doesn't happen by accident. It takes the right team of people, working together on the right solutions for the customer. We are looking for a seasoned Senior Data Engineer who will be a key driver to make this happen. Responsibilities: - Design, develop, and maintain scalable data pipelines using Spark, Hive, and Airflow - Develop and deploy data processing workflows on the Databricks platform - Data orchstration tools like NiFi, Airflow, Step Functions, etc - Work with serverless or cloud-native analytics platforms - Familiarity with data profiling, data catalogs, lineage tools, or observability platforms - Develop API services to facilitate data access and integration - Create interactive data visualizations and reports using AWS QuickSight - Builds required infrastructure for optimal extraction, transformation and loading of data from various data sources using AWS and SQL technologies - Monitor and optimize the performance of data infrastructure and processes - Develop data quality and validation jobs - Assembles large, complex sets of data that meet non-functional and functional business requirements - Write unit and integration tests for all data processing code - Work with DevOps engineers on CI, CD, and IaC - Read specs and translate them into code and design documents - Perform code reviews and develop processes for improving code quality - Improve data availability and timeliness by implementing more frequent refreshes, tiered data storage, and optimizations of existing datasets Minimum Qualifications: - Bachelor's degree in computer science, engineering, or related field - 5+ years of hands-on software or data development experience - 5+ years of data pipeline experience in a cloud-based environment - 2+ years of Python and Scala ETL engineering experience - 2+ years working in Spark and Hive or similar large data environments - Candidate must be able to obtain and maintain a Public Trust clearance - Candidate must reside in the US, be authorized to work in the US, and work must be performed in the US - Must have lived in the US 3 full years out of the last 5 years - Travel of up to once a quarter US domestically is required Preferred Qualifications: - "U.S. Citizenship or Green Card is highly prioritized due to federal contract requirements" - Experience with data orchstration tools like NiFi, Airflow, Step Functions, etc - Experience with serverless or cloud-native analytics platforms - Familiarity with data profiling, data catalogs, lineage tools, or observability platforms - Prior experience or knowledge in contributing to or leading federated data governance model - Strong understanding of AWS products including S3, Redshift, RDS, EMR, AWS Glue, AWS Glue DataBrew, Jupyter Notebooks, Athena, QuickSight, EMR, and Amazon SNS - Experienced in data governance process to ingest (batch, stream), curate, and share data with upstream and downstream data users. - Experienced in data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. - Familiar with DevOps methodologies, including CI/CD pipelines (Github Actions) and IaC (Terraform) - Experience with Agile methodology, using test-driven development. Job Location: This position requires that the job be performed in the United States. If you accept this position, you should note that ICF does monitor employee work locations and blocks access from foreign locations/foreign IP addresses and also prohibits personal VPN connections. #DMX-HES #Li-cc1 #Indeed Working at ICF ICF is a global advisory and technology services provider, but we’re not your typical consultants. We combine unmatched expertise with cutting-edge technology to help clients solve their most complex challenges, navigate change, and shape the future. We can only solve the world's toughest challenges by building a workplace that allows everyone to thrive. We are an equal opportunity employer. Together, our employees are empowered to share their expertise and collaborate with others to achieve personal and professional goals. For more information, please read our EEO policy. We will consider for employment qualified applicants with arrest and conviction records. Reasonable Accommodations are available, including, but not limited to, for disabled veterans, individuals with disabilities, and individuals with sincerely held religious beliefs, in all phases of the application and employment process. To request an accommodation, please email Candidateaccommodation@icf.com and we will be happy to assist. All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations.  Read more about workplace discrimination rights or our benefit offerings which are included in the Transparency in (Benefits) Coverage Act. Candidate AI Usage Policy At ICF, we are committed to ensuring a fair interview process for all candidates based on their own skills and knowledge. As part of this commitment, the use of artificial intelligence (AI) tools to generate or assist with responses during interviews (whether in-person or virtual) is not permitted. This policy is in place to maintain the integrity and authenticity of the interview process.  However, we understand that some candidates may require accommodation that involves the use of AI. If such an accommodation is needed, candidates are instructed to contact us in advance at candidateaccommodation@icf.com. We are dedicated to providing the necessary support to ensure that all candidates have an equal opportunity to succeed.   Pay Range - There are multiple factors that are considered in determining final pay for a position, including, but not limited to, relevant work experience, skills, certifications and competencies that align to the specified role, geographic location, education and certifications as well as contract provisions regarding labor categories that are specific to the position. The pay range for this position based on full-time employment is: $98,614.00 - $167,644.00 Nationwide Remote Office (US99)

United States
$98.6K - $167K / year
Job Closed
Empower logo

VP of Data Architecture

Empower

We are an equal opportunity employer with a commitment to diversity. All individuals, regardless of personal characteristics, are encouraged to apply. All qualified applicants will receive consideration for employment without regard to age, race, color, national origin, ancestry, sex, sexual orientation, gender, gender identity, gender expression, marital status, pregnancy, religion, physical or mental disability, military or veteran status, genetic information, or any other status protected by applicable state or local law.

Data Engineer57 days ago
Full TimeRemoteTeam 10,001+H1B Sponsor

• Lead the enterprise data architecture function, including hiring, developing, and retaining architecture talent, and setting expectations for how architecture work is produced, reviewed, and adopted across delivery organizations. • Own Empower’s enterprise data architecture strategy and direction and hold the organization accountable for maintaining the target state, roadmaps, and guidance needed to execute modernization priorities. • Direct the architecture team’s definition of enterprise patterns for data movement, processing, storage, and consumption across operational, analytical, and advanced analytics/AI use cases. • Communicate enterprise data architecture direction to executives and delivery leaders, making tradeoffs explicit (risk, cost, stability, speed) and driving decisions that improve outcomes. • Sponsor and oversee modernization of legacy data capabilities, ensuring the team drives migration sequencing, platform evolution guidance, and decommissioning plans that reduce complexity and technical debt. • Partner with platform leadership to advance AWS-based cloud maturity and scalable platform patterns, ensuring the architecture team provides guardrails that enable automation, repeatability, and delivery speed. • Own the enterprise approach to integration evolution and reusable integration capabilities, ensuring the team reduces point-to-point complexity and improves enterprise data access through consistent patterns. • Ensure the team defines and drives API-first and event-driven patterns (including streaming where appropriate), with clear expectations for latency, scalability, resiliency, and consumer experience. • Promotes the creation of architecture that conforms to enterprise standards. • Oversee the definition of enterprise consumption standards across BI/reporting, APIs/data services, and analytics workbenches, including performance practices, traceability, and compliance/audit readiness. • Sponsor architectural direction for ETL/ELT performance and cost optimization, ensuring the team establishes practices for tuning, workload design, capacity planning, and pipeline reliability instrumentation. • Establish an architecture engagement model and operating rhythm that provides timely guidance and reduces late-cycle rework.

United States
$166.9K - $242.1K / year
Job Closed