Helping Visionaries Change the World
Middle Data Engineer – Azure Databricks
Location
Poland
Posted
122 days ago
Salary
0
Seniority
Senior
Job Description
Middle Data Engineer – Azure Databricks
Miratech
• Design, develop, and maintain data pipelines using Azure Databricks • Build and optimize data transformations using PySpark and SQL in Databricks • Implement and maintain Lakehouse architectures using Delta Lake • Develop ETL/ELT pipelines orchestrated through Azure Data Factory • Integrate data from multiple sources into the data platform and analytical layers • Design and maintain data models and data warehouse structures for analytics • Ensure data quality, scalability, and performance of large-scale data processing pipelines • Collaborate with BI teams to support Power BI and reporting platforms • Support and evolve existing SQL Server data platforms and ETL solutions (SSIS) when required • Contribute to the design of modern cloud-based data architectures
Job Requirements
- 3+ years of experience in Data Engineering or Data Warehouse development
- Experience with Azure Databricks
- Experience developing data pipelines using PySpark and Spark SQL
- Solid understanding of distributed data processing and big data concepts
- Experience working with Delta Lake and Lakehouse architectures
- Strong SQL skills and experience with SQL Server relational databases
- Experience building data pipelines using Azure Data Factory
- Experience handling large datasets and performance optimization
- Nice to have
- Experience with Spark optimization techniques (partitioning, caching, cluster tuning)
- Experience with structured streaming in Databricks
- Knowledge of CI/CD pipelines for data platforms (Azure Devops)
- Familiarity with Power BI
- Experience in migrating from traditional ETL process to cloud architectures
Benefits
- Culture of Relentless Performance: join an unstoppable technology development team with a 99% project success rate and more than 30% year-over-year revenue growth.
- Competitive Pay and Benefits: enjoy a comprehensive compensation and benefits package, including health insurance, and a relocation program.
- Work From Anywhere Culture: make the most of the flexibility that comes with remote work.
- Growth Mindset : reap the benefits of a range of professional development opportunities, including certification programs, mentorship and talent investment programs, internal mobility and internship opportunities.
- Global Impact: collaborate on impactful projects for top global clients and shape the future of industries.
- Welcoming Multicultural Environment: be a part of a dynamic, global team and thrive in an inclusive and supportive work environment with open communication and regular team-building company social events.
- Social Sustainability Values: join our sustainable business practices focused on five pillars, including IT education, community empowerment, fair operating practices, environmental sustainability, and gender equality.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
• Tackle fraud daily by designing and deploying innovative security scenarios • Build and maintain robust data pipelines to support regulatory reporting for financial institutions • Collaborate with teams across Fraud, Compliance, Security, and Tech • Write clean, reusable, and well-documented code, conduct thorough testing • Promote best practices in software development
Role Description We’re looking for someone with experience contributing to Wikidata and an understanding of how structured, open data is used across platforms like search engines and knowledge panels. You’ll help ensure that information related to BorrowMyDoggy is accurately represented in publicly available datasets, in line with community guidelines and best practices. This is a research-led, detail-oriented role, focused on data accuracy, sourcing, and structuring information in a neutral and compliant way. We’re a fun go-getter team who are incredibly supportive and always take initiatives to come up with ways to improve BorrowMyDoggy. Responsibilities - Review existing Wikidata entries related to BorrowMyDoggy and associated entities - Add or improve structured data (e.g. company information, key people, attributes) - Ensure all contributions follow Wikidata and Wikimedia guidelines - Source and reference reliable, third-party information - Identify gaps or inconsistencies in publicly available data - Advise on best practices for maintaining accurate open data presence Qualifications - Experience contributing to Wikidata - Strong understanding of reliable sources and citation standards - Attention to detail and structured thinking - Ability to work within neutral, non-promotional guidelines Requirements - Familiarity with Wikipedia policies (especially conflict of interest) - Experience with knowledge graphs / SEO / structured data Benefits - Work with a fun and friendly dog-loving team - Help shape the voice of a mission-driven brand - Create content for a large and engaged dog-loving community
Lead Data Engineer, Snowflake – Data Platform
mcpk.🇺🇦 Connecting the best Ukrainian software engineers with DACH businesses.
• Lead the data engineering efforts and drive architectural decisions for the Data Platform • Design, build, and optimise scalable Data Warehouses and data workflows using Snowflake • Deploy, monitor, and manage reliable data pipelines in a production environment • Bridge the gap between Data Engineering and DevOps by configuring and maintaining AWS infrastructure • Automate infrastructure and application deployments using Terraform, Docker, and CI/CD tools • Work autonomously while fostering collaboration, mentoring peers, and ensuring best practices
Principal Data Engineer Team Lead - OP02057
Dev.ProSoftware Development Partner. Result-driven. Quality-obsessed.
🟢 We’re expanding our team and opening new remote opportunities! Review the role expectations, share your resume in English, and our team will follow up shortly. We invite a Principal Data Engineer / Team Lead to join our team and drive the development of our modern data platform. In this role, you’ll leverage your deep hands-on engineering expertise and technical leadership to design scalable data pipelines, manage databases and cloud infrastructure, and mentor engineers in delivering robust, high-quality data systems. You’ll focus on performance, scalability, and security, ensuring our data platform efficiently supports business growth and operates reliably in production. 🟩 What's in it for you: - Join a dynamic global tech company delivering digital merchandising solutions across 50+ markets - Build and scale with a modern data stack (Snowflake, dbt, Airflow/Dagster, AWS) - Combine hands-on data engineering work with technical leadership, guiding teams and promoting best practices ✅ Is that you? - 7+ years of experience in Data Engineering - Experience designing and operating production-grade data platforms - Proven experience designing scalable ELT pipelines in AWS - Deep expertise in Snowflake architecture, performance tuning, and data modeling - Strong hands-on experience with dbt for modular data modeling, transformations, testing, and documentation - Expertise in data orchestration tools (Airflow, Dagster, Prefect, or similar) - Advanced SQL skills for data transformation and analysis - Strong leadership and mentorship abilities to guide engineers, establish standards, and drive engineering excellence - Excellent communication skills across technical and non-technical audiences - Innovative mindset to implement improvements in data architecture, tooling, and performance - High attention to detail, adaptability, and effective time management skills - Upper-Intermediate+ English level Desirable: - Bachelor’s degree in Computer Science or equivalent certifications - Full-stack web development experience (TypeScript, React.js, JavaScript, Node.js, Express.js) - Experience with CMS development or digital signage solutions - Advanced knowledge of cloud security best practices 🧩Key responsibilities and your contribution In this role, you'll lead the design and evolution of our data ecosystem, combining hands-on engineering with mentoring the team and driving best practices. - Architect our data ecosystem, ensuring the platform powers frontend applications efficiently - Lead and mentor the team, driving technical excellence through code reviews and best practices in data modeling - Build and maintain automated DAGs and ELT workflows for reliable, 24/7 data availability - Design and optimize Snowflake datasets to support analytics and customer-facing features - Partner with DevOps to configure and manage AWS services for smooth data ingestion and transformation - Proactively monitor workflows, troubleshoot failures, and ensure reliability via dbt testing - Collaborate with developers to align Node.js backends and React frontends with the data architecture - Establish data standards and document pipelines, DAGs, and data models for onboarding and knowledge sharing 🎾 What's working at Dev.Pro like? Dev.Pro is a global company that's been building great software since 2011. Our team values fairness, high standards, openness, and inclusivity for everyone — no matter your background 🌐 We are 99.9% remote — you can work from anywhere in the world 🌴 Get 30 paid days off per year to use however you like — vacations, holidays, or personal time ✔️ 5 paid sick days, up to 60 days of medical leave, and up to 6 paid days off per year for major family events like weddings, funerals, or the birth of a child ⚡️ Partially covered health insurance after the probation, plus a wellness bonus for gym memberships, sports nutrition, and similar needs after 6 months 💵 We pay in U.S. dollars and cover all approved overtime 📓 Join English lessons and Dev.Pro University programs, and take part in fun online activities and team-building events Our next steps: ✅ Submit a CV in English — ✅ Intro call with a Recruiter — ✅ Internal interview — ✅ Client interview — ✅ Offer Interested? Find out more: 📋How we work 💻 LinkedIn Page 📈 Our website 💻IG Page



