Software House focused on results since 1999
Senior Data Engineer, Python
Location
Poland
Posted
2 days ago
Salary
0
Seniority
Senior
Job Description
Senior Data Engineer, Python
Software Mind
• As a Senior Python Software Engineer, you will play a key role in designing, building, and improving data capabilities that strengthen the company’s competitive advantage in cyber data. • You’ll work closely with engineering, infrastructure, and analytics stakeholders to develop scalable data services and platform features across Azure and AWS environments. • Design and implement new data capabilities, including large-scale data ingestion, transformation pipelines, robust high-performance APIs, and consumers for high-frequency event streams. • Contribute to the development of the proprietary data platform and help evolve it towards a data mesh architecture for the enterprise. • Build solutions using the standard technology stack: Python, Linux via WSL, PostgreSQL, SQL Server, Databricks, and cloud infrastructure spanning Azure and AWS. • Develop advanced mechanisms for data ingestion, transformation, and mass-parallel orchestration of network IO. • Model data for operational and analytical purposes in collaboration with your team, other engineering teams, and analytical data customers. • Work with infrastructure teams to maintain Infrastructure as Code and deliver valuable features for the engineering platform. • Improve data quality across the estate by defining and acting on indicators such as completeness, accuracy, reliability, and usability. • Evaluate potential new data sources for specific applications, assessing their completeness, accuracy, and business value. • Contribute to quality automation in CI/CD processes, optimising for a bug-free release cadence and a positive developer experience. • Support test automation through platform enhancements and additional automated tests. • Maintain clear technical documentation, starting with well-documented code and extending to materials for technical and non-technical audiences. • Participate in a pairing-first development team by sharing expertise, learning from colleagues, and contributing to an open engineering culture. • Mentor and coach less experienced engineers through design discussions, code reviews, and practical knowledge sharing. • Assess application security and API quality to ensure solutions comply with relevant application security and API standards.
Job Requirements
- Senior-level commercial experience as a Software Engineer, with strong hands-on Python development skills.
- Practical experience building data platforms, data services, or backend systems that process, expose, or analyse large datasets.
- Strong understanding of data ingestion, transformation, event-driven or stream-oriented processing, and high-performance API development.
- Experience with relational databases and data modelling, especially PostgreSQL and/or SQL Server, for both operational and analytical use cases.
- Working knowledge of cloud infrastructure, preferably across Azure and AWS, and the ability to collaborate effectively with infrastructure or platform teams.
- Experience with Databricks or comparable data engineering platforms would be valuable for working with large-scale data workflows.
- Comfortable working in Linux-based development environments, including Linux via WSL.
- Experience maintaining or contributing to Infrastructure as Code and understanding how platform engineering supports product delivery.
- Strong quality mindset, including CI/CD, automated testing, test automation, debugging, code reviews, and continuous improvement of release cadence.
- Ability to evaluate data source quality using criteria such as completeness, accuracy, consistency, and suitability for specific applications.
- Good understanding of secure engineering practices, application security expectations, and API standards.
- Strong documentation habits and ability to communicate technical decisions clearly to technical and non-technical audiences.
- Collaborative, pairing-friendly approach with the ability to mentor others, challenge decisions constructively, and take ownership of outcomes.
- Fluent communication in English.
Benefits
- Flexible employment and remote work
- International projects with leading global clients
- International business trips
- Non-corporate atmosphere
- Language classes
- Internal & external training
- Private healthcare and insurance
- Multisport card
- Well-being initiatives
Related Guides
Related Job Pages
More Backend Engineer Jobs
Laravel Developer
Sur GlobalWe don’t just partner with you, we accelerate your progress and fuel your growth.
• Build, test, and maintain features within a Laravel application using the TALL stack. • Develop user interfaces using Livewire, Alpine.js, Tailwind CSS, and FilamentPHP. • Investigate and resolve bugs across the existing web application. • Write clean, secure, scalable, and maintainable code. • Review feature requests, clarify requirements, and propose practical technical solutions. • Collaborate directly with the Engineering Lead and company leadership throughout the development process. • Respond to application questions and support requests when technical assistance is required. • Manage development tasks and feature tickets using Jira. • Participate in Scrum-based planning, prioritization, and regular team check-ins. • Contribute to the improvement of development processes, application performance, and overall product quality.
Lead Backend Engineer
Insense | TikTok & Meta PartnerOne-stop shop to collaborate with creators for UGC, organic posting, and whitelisted ads.
• Design, develop, and maintain our backend systems and services. • Lead technical discussions and help define the architecture and technical direction of the backend. • Remain actively involved in coding, code reviews, and solving complex technical challenges. • Oversee the development and maintenance of our GraphQL API, ensuring scalability, performance, and reliability. • Support and mentor engineers through technical guidance, knowledge sharing, and feedback. • Help prioritize work, identify blockers, and drive projects through to delivery. • Manage deployments and contribute to infrastructure improvements in our Kubernetes environment on GKE. • Work closely with Product, Design, QA, and Engineering teams to deliver high-quality features and a great user experience. • Proactively identify opportunities for product and technical improvements based on business and user needs. • Help establish and maintain engineering best practices, code quality standards, and development processes. • Foster a collaborative and inclusive team environment while working with colleagues across different cultures and time zones.
Lead Backend Engineer
Insense | TikTok & Meta PartnerOne-stop shop to collaborate with creators for UGC, organic posting, and whitelisted ads.
• Design, develop, and maintain our backend systems and services. • Lead technical discussions and help define the architecture and technical direction of the backend. • Remain actively involved in coding, code reviews, and solving complex technical challenges. • Oversee the development and maintenance of our GraphQL API, ensuring scalability, performance, and reliability. • Support and mentor engineers through technical guidance, knowledge sharing, and feedback. • Help prioritize work, identify blockers, and drive projects through to delivery. • Manage deployments and contribute to infrastructure improvements in our Kubernetes environment on GKE. • Work closely with Product, Design, QA, and Engineering teams to deliver high-quality features and a great user experience. • Proactively identify opportunities for product and technical improvements based on business and user needs. • Help establish and maintain engineering best practices, code quality standards, and development processes. • Foster a collaborative and inclusive team environment while working with colleagues across different cultures and time zones.
Lead Backend Engineer
Insense | TikTok & Meta PartnerOne-stop shop to collaborate with creators for UGC, organic posting, and whitelisted ads.
• Design, develop, and maintain our backend systems and services. • Lead technical discussions and help define the architecture and technical direction of the backend. • Remain actively involved in coding, code reviews, and solving complex technical challenges. • Oversee the development and maintenance of our GraphQL API, ensuring scalability, performance, and reliability. • Support and mentor engineers through technical guidance, knowledge sharing, and feedback. • Help prioritize work, identify blockers, and drive projects through to delivery. • Manage deployments and contribute to infrastructure improvements in our Kubernetes environment on GKE. • Work closely with Product, Design, QA, and Engineering teams to deliver high-quality features and a great user experience. • Proactively identify opportunities for product and technical improvements based on business and user needs. • Help establish and maintain engineering best practices, code quality standards, and development processes. • Foster a collaborative and inclusive team environment while working with colleagues across different cultures and time zones.
