Senior Data Pipeline Developer

Data EngineerData EngineerFull TimeRemoteSeniorTeam 10,001+H1B No SponsorCompany SiteLinkedIn

Location

Bulgaria

Posted

3 days ago

Salary

0

Seniority

Senior

Job Description

Senior Data Pipeline Developer

Apex Group Ltd

• Help break down large problems into smaller iterative steps • Contribute to defining the prioritisation of your squad’s backlog • Build the modern data platform (data pipelines, data integrations, data preparation, data models, analytical and reporting marts) based on business requirements using agreed design patterns • Determine the most appropriate tools, methods, and design patterns to meet business requirements • Proactively identify and suggest improvements • Prepare data for exposure through APIs • Document, support, manage, and maintain the modern data platform built within your squad • Provide guidance and training to downstream data consumers on best practices • Support and build new data APIs • Promote the effective use and value of data across the organisation • Comply with all company policies • Perform any other duties assigned by management.

Job Requirements

  • Experience with Data Warehousing and Data Modelling
  • Experience with Data Lakes (AWS Lake Formation, Azure Data Lake)
  • Experience with Cloud Data Warehouses (AWS Redshift, Azure Synapse, Snowflake)
  • Experience with ETL/ELT/Pipeline tools (AWS Glue, Azure Data Factory, Fivetran, Stitch)
  • Knowledge of messaging systems (AWS SNS & SQS, Azure ASQ, Kafka, RabbitMQ)
  • Programming skills in SQL, Python, Scala, or Java
  • Experience with cloud workflow services (AWS Step Functions, Azure Logic Apps, Camunda)
  • Experience with event and schedule management (AWS Lambda, Azure Functions)
  • Knowledge of the Microsoft BI Stack (SQL Server, SSIS, SSAS, SSRS)
  • Experience with reporting and visualisation tools such as Power BI, QuickSight, or Mode
  • Knowledge of NoSQL and Graph Databases (AWS Neptune, Azure Cosmos DB, Neo4j) – desirable
  • API Management experience – desirable
  • Excellent communication and interpersonal skills
  • Strong critical thinking, analytical, and problem-solving skills
  • Ability to prioritise and manage workload independently
  • Ability to work both independently and collaboratively within a team
  • Working knowledge of Agile Software Development Lifecycles.

Benefits

  • Opportunities to learn and upskill
  • Freedom to be a positive disrupter

Related Categories

Related Job Pages

More Data Engineer Jobs

Hireframe logo

Data Quality Specialist

Hireframe

Specialized assistants for B2B SaaS sales, customer success, and marketing teams

Data Engineer3 days ago
ContractRemoteTeam 51-200H1B No Sponsor

Role Description We're seeking a detail-oriented Data Quality Specialist to help review, validate, and update business records, ensuring accurate and reliable data for the team. This is a 3-month contract role with the opportunity for additional hours and a project extension. Duties and Responsibilities - Review and validate account records for accuracy. - Confirm company websites are active and associated with the correct business. - Verify business phone numbers, mailing addresses, and contact information. - Research companies with outdated or inactive websites to locate current information. - Identify and document every modification or addition made to each record. - Maintain organized, accurate spreadsheets and deliver completed work in a clean CSV format. - Follow established workflows while maintaining a high level of quality and consistency. Project Scope - Approximately 5,000 company records to review (not every record will require updates). - Initial quality assurance batch of 200–500 records before scaling. - Three-month project with work assigned in phases. - Opportunity for additional hours based on project pace and quality. Qualifications - Exceptional attention to detail. - Experience conducting online research and validating business information. - Strong written English communication skills. - Comfortable working with spreadsheets, including filtering, sorting, and maintaining clean data. - Able to work independently once processes are established. - Highly organized with the ability to perform repetitive tasks accurately. Requirements - Previous experience with data enrichment, lead research, CRM cleanup, or data quality projects. - Familiarity with LinkedIn and business directory research. - Experience working with CSV files and large datasets. - Experience supporting B2B sales or operations teams. Benefits - Permanent remote work flexibility. - Paid Time Off. - Health Maintenance Organization (HMO) coverage. - Annual performance bonuses. - Dedicated coaches offer an extra channel of support and skill-building. - Opportunities for professional growth.

Philippines

Business Data Engineer

Nex Team Inc.

Nex Team Inc. creates a variety of games and gaming experiences designed to help people rediscover the joy of movement, providing fun and engaging opportunities

Data Engineer3 days ago

Business Data Engineer San Jose, California or Remote Location: Seattle, WA or Remote Annual salary: $140,000 - $170,000 USD Type: Full-time Reports to: Director, Analytics About this Role Nex’s user base is growing quickly, and the amount of data we’re working with is growing even faster. We are seeking an experienced and dedicated Data Engineer to join our Analytics department and help us streamline, future-proof, and automate our reporting processes as well as our data backend as we move into the next phase of the company’s growth. The ideal candidate for this role loves problem solving and tinkering, and feels the thrill of accomplishment when a long-standing issue or project is resolved. Strong attention to detail and dedicated follow-through are key. If you want to work on a small team, for a growing company, laying down framework that will be used and appreciated by teams across multiple disciplines, we want to hear from you! Core Responsibilities - Connect with cross-functional teams: The data environment we’re building will be used by members of the Accounting, Finance, Supply Chain, and Publishing teams, among others. Meet with them and get to know their needs so we can build things they’ll use for years. - Project Management: Keep track of & prioritize short-term and long-term projects. - Build & Support: Build new and improved ways for us to access & view data, and see to their steady functioning over time. - Investigate & Iterate: Keep an eye on how small improvements can be made to improve the cost and reliability of our data pipeline. Required Qualifications - 3+ years of experience as a Data Engineer or 5+ years of experience as a Business Intelligence Engineer. - Experience with the AWS suite of tools and solutions to run a data environment end-to-end. - Proven ability to work independently, without constant guidance. - Comfortable working in ambiguous environments that require iteration & investigation. - Strong track record of working with cross-functional teams across disciplines such as marketing, product, engineering, and finance/accounting. Preferred Qualifications - Experience automating complex datasets, using SQL, Python, or another similar tool. - Experience with building and maintaining APIs to connect data environments and pull raw data from various sources. - Previous experience with data environments for digital gaming platforms or subscription services. - Ability to thrive and create without the use of AI tools as a baseline. What Sets You Apart - Creative solutions to complex problems - Proactive approach to projects - Ability to thrive in a fast-paced environment - Experience working with teams from different cultures and backgrounds - You’re an expert on your own work & can back up your results - Good-natured and easy to work with #LI-Remote We Offer - Competitive compensation package. - Flexible working hours and vacation policy. - Product-driven culture that treasures talents and individual growth. - Front-row seat and hands-on experience with cutting edge technologies in the evolving gaming field

Washington + 1 moreAll locations: Washington | California
$140K - $170K / year

Role Description Client is seeking an experienced Data Spoke Technical Lead to support the People Data domain within a federated enterprise data organization. This role will serve as the primary liaison between business stakeholders, IT, data engineering, and data governance teams, ensuring successful delivery of People Data initiatives while driving governance adoption and technical alignment. This is primarily a technical leadership and coordination role (70%), with a focus on governance execution (20%) and limited hands-on technical support (10%). Responsibilities - Data Spoke Leadership & Delivery - Support execution of the People Data roadmap and priorities. - Manage intake, triage, prioritization, and tracking of data-related work requests. - Maintain and govern backlogs, ensuring alignment with business priorities and enterprise strategy. - Coordinate across business, IT, data engineering, and governance stakeholders. - Facilitate Agile ceremonies including backlog reviews, sprint planning, and status updates. - Provide visibility into delivery progress, risks, and dependencies. - Data Governance - Drive adoption of governance practices within the People domain. - Support metadata management, data ownership, stewardship, classification, and retention activities. - Partner with Data Owners and Data Stewards to execute governance responsibilities. - Monitor and report on governance and data quality KPIs. - Technical Leadership - Provide technical leadership for People Data solutions and assets. - Support SQL-based data modeling, including dimensional modeling and Slowly Changing Dimensions (SCD). - Guide data pipeline and integration initiatives using Azure Data Factory or similar technologies. - Support data warehouse and semantic model design. - Assist with troubleshooting and solution design in partnership with engineering teams. - Contribute to DevOps processes including backlog management, epics, and user stories. Qualifications - 10+ years of experience in Data Management, Data Engineering, Analytics, or Business Intelligence. - Experience working within enterprise data governance frameworks. - Proven experience leading or supporting a data domain or business-facing data function. - Strong experience operating within a hub-and-spoke or federated data model. - Demonstrated success coordinating across business, IT, data engineering, and governance teams. - Advanced SQL and data modeling expertise, including dimensional modeling and SCD concepts. - Experience with data pipelines and ingestion frameworks such as Azure Data Factory or equivalent. - Experience with data warehouse and semantic model design. - Strong stakeholder management, communication, and delivery coordination skills. - Experience with Agile delivery methodologies and DevOps backlog management. Preferred Qualifications - Experience supporting HR, People, Workforce, or Human Capital data domains. - Experience with Power BI, including data modeling, DAX, and reporting. - Familiarity with Azure Databricks and the broader Azure Data Platform ecosystem. - Working knowledge of C# or similar programming languages. - Experience with Collibra or other metadata management and data catalog tools. - Experience implementing data ownership, stewardship, and governance operating models. - Master's degree in Information Systems, Computer Science, Data Analytics, or a related discipline.

EST (UTC-5)

Data Scientist Architect

Navtech, Inc.

NAVTECH INC 1600 Golf Road. Suite 1200, Rolling Meadows, IL 60008 Ph: (224) 348-1340 Email: alex@navtechusa.com Website: www.navtechusa.com E-Verified Company

Data Engineer3 days ago

Role Description Designs and develops scalable solutions using AI tools and machine-learning models. - Performs research and testing to develop machine learning algorithms and predictive models. - Utilizes big data computation and storage tools to create prototypes and datasets. - Conducts model training and evaluation. - Integrates, tests, tunes, and monitors solutions. - Proficient with multiple AI tools such as Python, Java, or R and machine learning frameworks like Spark, TensorFlow, or scikit-learn. Requires a master's degree in computer science, mathematics, engineering or equivalent. Typically reports to a manager or head of a unit/department. - P05-Expert: Works autonomously. Goals are generally communicated in "solution" or project goal terms. - May provide a leadership role for the work group through knowledge in the area of specialization. - Works on advanced, complex technical projects or business issues requiring state of the art technical or industry knowledge. - Typically requires 10+ years of related experience. Qualifications - Master's degree in computer science, mathematics, engineering or equivalent. - 10+ years of related experience. Requirements - Proficient with AI tools such as Python, Java, or R. - Experience with machine learning frameworks like Spark, TensorFlow, or scikit-learn. Company Description

United States