Big Data, Machine Learning, Data Science, AI, MLOps and DataOps Services
Data Engineer, Azure Data Factory
Location
Poland
Posted
100 days ago
Salary
0
Seniority
Senior
Job Description
Data Engineer, Azure Data Factory
Addepto
• Design, develop, and maintain Azure Data Factory pipelines, including orchestration, parameterization, and trigger management. • Configure and manage linked services and datasets within ADF. • Monitor, troubleshoot, and optimize ADF pipelines to ensure performance and reliability. • Develop and maintain ETL/ELT processes and support the evolution of the data warehouse layer (Azure SQL Database or Synapse). • Translate business requirements into technical solutions in close collaboration with the Product Owner and Architect. • Develop and maintain Python-based components (e.g., Azure Functions, API integrations, automation scripts). • Contribute to CI/CD processes in Azure DevOps, including pipelines, releases, and environment promotion. • Support occasional Power BI reporting and dashboarding needs. • Ensure proactive communication, stakeholder alignment, and visibility of risks and impacts. • Take ownership of assigned tasks and actively contribute to continuous platform improvement.
Job Requirements
- Strong hands-on experience with Azure Data Factory (must-have), including: pipeline and orchestration design, linked services, datasets, triggers, and parameterization, operational monitoring, troubleshooting, and performance tuning, and deployment-aware ADF development in enterprise environments.
- Excellent knowledge of Python (Azure Functions, REST APIs, automation).
- Strong SQL skills and solid understanding of data modeling for ETL/ELT and warehouse workloads.
- Experience with CI/CD processes in Azure DevOps (pipelines, releases, multi-environment deployments).
- Solid understanding of Azure services and cloud-based data solutions (e.g., Azure SQL Database, Azure Key Vault).
- Experience with Power BI for occasional dashboarding and reporting.
- Experience working with modern development practices and tools.
- Consulting mindset with proactive communication and strong stakeholder alignment skills.
- Ability to effectively collaborate with Product Owner and Architect during planning and delivery.
- Independent and responsible approach to delivering high-quality solutions.
- Excellent command of English (at least C1 level).
Benefits
- Work in a supportive team of passionate enthusiasts of AI & Big Data.
- Engage with top-tier global enterprises and cutting-edge startups on international projects.
- Enjoy flexible work arrangements, allowing you to work remotely or from modern offices and coworking spaces.
- Accelerate your professional growth through career paths, knowledge-sharing initiatives, language classes, and sponsored training or conferences, including a partnership with Databricks, which offers industry-leading training materials and certifications.
- Choose your preferred form of cooperation: B2B or a contract of mandate, and make use of 20 fully paid days off.
- Participate in team-building events and utilize the integration budget.
- Celebrate work anniversaries, birthdays, and milestones.
- Access medical and sports packages, eye care, and well-being support services, including psychotherapy and coaching.
- Get full work equipment for optimal productivity, including a laptop and other necessary devices.
- With our backing, you can boost your personal brand by speaking at conferences, writing for our blog, or participating in meetups.
- Experience a smooth onboarding with a dedicated buddy, and start your journey in our friendly, supportive, and autonomous culture.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Salesforce Data Architect
Orion Global SolutionsExpertise at every stage of your Salesforce, digital transformation, AI, and sustainability journey!
• Design and own Salesforce data models across core clouds (Sales, Service, Financial Services, Consumer Goods) • Define object models, relationships, field strategy, and data lifecycle management • Ensure scalability, performance, and alignment with Salesforce best practices • Lead data governance, naming conventions, and standards • Architect and oversee data migrations from legacy systems (ERP, CRM, custom databases) • Define strategies for data synchronization, deduplication, and master data management • Establish and enforce data quality frameworks (validation, deduplication, enrichment) • Partner with stakeholders on data ownership, stewardship, and compliance • Support regulatory and security requirements (PII, GDPR, role-based access) • Design data structures optimized for Salesforce reporting, dashboards, and analytics • Enable downstream use cases for Einstein, AI, and advanced analytics • Support Data Cloud and Customer 360 initiatives where applicable
Software/Data Engineer – EU Taxonomy
Clarity Innovations, Inc.We are your trusted partner for edtech strategy, content, and engineering.
• Designing, developing, and maintaining data pipelines and services with a focus on simplicity, scalability, reliability, and performance. • Writing high-quality, well-tested code using Python and SQL. • Building and maintaining data pipelines (ETL/ELT) using tools like Airflow. • Implementing comprehensive automated testing to ensure the quality and reliability of our data products. • Collaborating with cross-functional teams to deliver impactful features. • Participating in the design and architecture of our evolving data platform. • Troubleshooting and resolving bugs and issues in a timely manner. • Championing best practices for code and data quality and testing. • Driving improvements in our development processes using Lean and Agile principles. • Managing and scaling data products, ensuring they are meeting the evolving needs of the business.
Position Overview V4C.ai is seeking a motivated Data Engineer to join our remote team in the United States. In this role, you will support the design, development, and maintenance of data solutions using Databricks, helping clients and internal teams process, transform, and analyze data effectively. You'll work on building reliable data pipelines and workflows in a collaborative environment, gaining hands-on experience with modern data engineering tools and cloud technologies. Key Responsibilities - Collaborate with team members and stakeholders to understand data requirements and contribute to building scalable data pipelines and workflows in Databricks. - Develop and implement ETL/ELT processes using Databricks, Python, SQL, and related tools to ingest, transform, and prepare data. - Assist in optimizing data workflows for better performance, reliability, and cost-efficiency within Databricks environments. - Support the creation and maintenance of data models, tables, and integrations in cloud platforms (Azure, AWS, or similar). - Work closely with cross-functional teams (data analysts, scientists, and engineers) to deliver clean, accessible data for analytics and reporting. - Monitor data pipelines, troubleshoot basic issues, and contribute to documentation and best practices. - Stay curious about new Databricks features and data engineering trends to support ongoing improvements. Requirements - Bachelor's degree in Computer Science, Data Science, Engineering, Information Systems, or a related field (or equivalent practical experience). - 1-2 years of professional experience in data engineering, data processing, analytics engineering, or a closely related role (internships, co-ops, or academic projects with relevant tools count toward this). - Hands-on experience and comfort building basic data pipelines or transformations. - Proficiency in Python and SQL; experience with Scala is a plus but not required. - Basic understanding of cloud platforms such as Azure, AWS, or GCP (ex: working with storage, compute, or data services). - Solid analytical and problem-solving skills with attention to detail and a focus on writing clean, maintainable code. - Strong communication skills and ability to work collaboratively in a remote team environment. - Eagerness to learn, take ownership of tasks, and grow within data engineering.
Field Engineer responsibilities may vary depending on the project and assignment. This description is meant to provide an overall picture of the types of work and responsibilities you may encounter. Position Summary The Field Engineer plays a critical role in supporting TEiC projects across their full lifecycle, serving as a key member of the project management team. This position provides engineering, technical, and project execution support both on-site and from the home office. The Field Engineer typically spends a significant portion of the year at active project sites (ranging from approximately 25%–75% depending on project needs), with remaining time supporting estimating, planning, and preparation of future projects. In this role, the Field Engineer contributes to proposal development, project planning and scheduling, execution oversight, tooling and rigging coordination, safety and quality management, subcontractor oversight, and corporate and customer reporting. The position requires strong technical acumen, collaboration skills, and the ability to balance field execution responsibilities with office-based project support. Essential Roles and Responsibilities Project Estimation & Proposal Development - Participate in scope walk-downs and assist in developing estimates and proposals for customer submittal, in collaboration with Area Managers and project leadership. - Prepare Requests for Quotation (RFQs) for subcontractors and obtain vendor and material pricing. - Support proposal risk identification and contractual risk mitigation during the estimating phase. - Assist operations with proposal development, project schedules, forecasting, and execution planning. Project Planning & Execution - Assist in creating, implementing, and maintaining project execution plans and schedules (Primavera P6 or other scheduling tools). - Monitor project activities to ensure alignment with approved plans, schedules, and contract requirements. - Develop rigging plans and coordinate with third-party engineers to obtain required PE stamps. - Track project progress and earned value, updating systems such as InEight and internal reporting tools. - Support procurement activities, including issuing purchase orders and coordinating subcontractor and material delivery. - Assist with turnover and closeout activities, ensuring proper documentation is provided to construction and startup/commissioning teams. Safety, Quality, and Compliance - Incorporate health, safety, and environmental considerations into all project documentation and field activities. - Act as a role model for safety excellence, participating in job hazard analyses and reinforcing a strong safety culture. - Conduct work package walk-downs to monitor progress, quality, and compliance with specifications. - Ensure accurate tracking and reporting of production quantities and quality metrics. Technical & Engineering Support - Review engineering drawings, specifications, and RFIs to support field execution and resolve technical issues. - Manage the RFI process, ensuring thorough review and timely resolution. - Prepare construction and installation work packages for assigned disciplines, ensuring accuracy and completeness. - Provide technical input and engineering insight during project team meetings and execution planning. Customer & Stakeholder Engagement - Communicate effectively with project management teams, engineering groups, customers, subcontractors, and internal stakeholders. - Serve as a point of interface between field execution, engineering, and customer representatives. - Report project progress, changes, and risks to customers and TEiC leadership. - Develop change order estimates and support client negotiations related to scope, schedule, and cost impacts. Collaboration & Leadership - Collaborate closely with project managers, superintendents, craft employees, and engineering teams to support successful execution. - Participate in corporate meetings, customer visits, and project-related conference calls. - Build strong working relationships with field supervision by providing timely, clear technical support. - Effectively manage time and priorities while balancing on-site project demands and home-office responsibilities.



