IT Staff Augmentation
Middle/Senior Data Engineer
Location
Poland
Posted
3 days ago
Salary
0
Seniority
Senior
Job Description
Middle/Senior Data Engineer
Bonapolia
• Develop, deploy, and maintain data pipelines and data governance systems on Databricks (Unity Catalog, Delta Lake, Workflows) • Conduct in-depth data analysis, profiling, and processing to classify data by domain and detect personal data (PII) • Contribute to the design of data access systems, focusing on data contracts, catalog access, and grant/rollback automation managed as Infrastructure-as-Code with Terraform • Review access architectures and contracts to ensure flexibility and reusability • Ensure that data products and access controls are deployed according to contracts and operate without unintended side effects • Maintain documentation for data contracts, access models, and governance processes • Monitor and support deployed pipelines and quality checks to ensure they meet data quality and performance expectations • Actively seek out information and internal solutions to ensure reusability and adoption of common data platform technologies
Job Requirements
- 3+ years of experience in Data Engineering
- Strong proficiency in Python
- Experience with Spark/PySpark for streaming, batch, and asynchronous data processing
- Data modeling
- Distributed data processing
- SQL
- Data warehouse/lakehouse architecture
- Hands-on experience with Databricks, GCP, or AWS
- Terraform
- Designing data access and governance solutions
- Understanding of data products and governance controls
Benefits
- Health insurance
- Flexible work arrangements
- Opportunities for professional development
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Data Access Engineer
Civitas LearningHelping colleges and universities build data-activated student impact strategies to advance student success every day
Role Description Civitas Learning is looking for a highly professional and confident individual to join our Deployment team. As a Senior Data Access Engineer, you’ll play a pivotal role in configuring, optimizing, and maintaining critical infrastructure that facilitates secure and efficient data access for millions of users across multi-tenant/multi-region environments. You’ll lead complex data integration solutions, ensure the highest levels of security, and collaborate strategically with internal and external teams to enhance Civitas Learning's application delivery and customer support capabilities. - Lead the configuration, automation, and maintenance of infrastructure serving millions of users accessing applications in multi-tenant/multi-region environments, acting as a Subject Matter Expert (SME). - Design and implement optimizations for existing infrastructure components, with a paramount focus on setting up, maintaining, and troubleshooting VPN connections ensuring top security. - Lead the implementation and management of Single Sign-On (SSO) across multiple products and oversee the setup of data extracts/ingests using internal ETL tool sets. - Work extensively with organizations within and outside the company (including AWS Product Teams) to define, scope, implement, test, deploy, and monitor existing and new products and internal tooling related to data access. - Uphold security as the number one priority, integrating and enforcing robust security measures across all data access infrastructure and processes. - Provide high-level troubleshooting and resolution for complex data access and integration issues. - Actively contribute to the optimization and elaboration of existing infrastructure components and continuously seek opportunities to improve efficiency and reliability in data access. Qualifications - 5-8+ years of progressive experience in Data Access Engineering, DevOps, Cloud Engineering, or a related infrastructure role, with a strong focus on data integration and access. - Proven experience in configuring and maintaining infrastructure serving high user volumes in multi-tenant/multi-region environments. - Expertise in setting up, maintaining, and troubleshooting VPN connections and implementing/managing SSO. - Bachelor’s degree in Computer Science, Engineering, or a related field. Requirements - Operating Systems: Ubuntu, OS X, Amazon Linux. - AWS Core Services: VPC, EC2, Route53, EKS, Elastic Map Reduce, Redshift, AWS RDS. - Networking & Protocols: VPN (Ipsec, PPTP, L2TP, SSL, HTTP), application transport and network infrastructure protocols, DNS concepts. - Directory Services/Auth: SAML, AWS Simple AD, LTI. - Public Key Infrastructure: SSH, PGP, TLS. - RDBMS: Postgres, SQL Server, MySQL, Oracle. - Languages: Python, Bash. - Version Control: Git, GitHub Web/GitHub Enterprise. - Metrics (DataDog, Statsd, ELK, Splunk), Continuous Integration (Jenkins), Virtualization (Vagrant), Containerization (Docker, podman, containerd, argocd) (Desirable) Benefits - Hourly value: $25 — $35 USD Company Description At Civitas Learning, we seek to help colleges and universities apply their vast student data to maximize institutional impact and improve the student outcomes that matter most. Civitas Learning’s flexible, all-in-one Student Impact Platform creates actionable insights that surface in a connected workflow, enabling higher education institutions to pinpoint students at risk of missing important milestones, explain why, take action, and evaluate which policies and programs are making a difference. With adaptable analytics based on models built for each institution and higher education expertise, we empower leaders and teams to turn insights into action to support students in reaching their full potential. Civitas Learning is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity or expression, national origin, age, disability, genetic information, protected veteran status, or any other status protected by applicable law.
Data Operations Engineer
TableCheckA fully integrated Restaurant Booking & Table Management System built to help restaurants enhance their guest experience
• Implementing source management through data generation and schema management • Define data ingestion pipelines that normalize and transform clients data to fit our standard data schema • Ensure data meet quality standards and routinely work with our customers, handling their requests and configuring the platform to their needs • The drive to collaborate, gather feedback, solve problems, and tackle challenges through test and learn is highly valuable in this position
Senior Data Engineer – Contractor
myPOSBy combining the latest payment technologies with imagination and expertise, we create a new world of payments.
• Build and maintain data pipelines for ingestion, transformation, and export across multiple sources and destinations • Develop and evolve scalable data architecture to meet business and performance requirements • Partner with analysts and data scientists to deliver curated, analysis-ready datasets and enable self-service analytics • Implement best practices for data quality, testing, monitoring, lineage, and reliability • Optimize workflows for performance, cost, and scalability (e.g., tuning Spark jobs, query optimization, partitioning strategies) • Ensure secure data handling and compliance with relevant data protection standards and internal policies • Contribute to documentation, standards, and continuous improvement of the data platform and engineering processes • Ensure secure, compliant handling of data and models, including access controls, auditability, and governance practices • Build and maintain MLOps automation: CI/CD for ML, environment management, artifact handling, versioning of data/models/code
Senior Data Engineer – Contractor
myPOSBy combining the latest payment technologies with imagination and expertise, we create a new world of payments.
• Build and maintain data pipelines for ingestion, transformation, and export across multiple sources and destinations • Develop and evolve scalable data architecture to meet business and performance requirements • Partner with analysts and data scientists to deliver curated, analysis-ready datasets and enable self-service analytics • Implement best practices for data quality, testing, monitoring, lineage, and reliability • Optimize workflows for performance, cost, and scalability (e.g., tuning Spark jobs, query optimization, partitioning strategies) • Ensure secure data handling and compliance with relevant data protection standards and internal policies • Contribute to documentation, standards, and continuous improvement of the data platform and engineering processes • Ensure secure, compliant handling of data and models, including access controls, auditability, and governance practices • Build and maintain MLOps automation: CI/CD for ML, environment management, artifact handling, versioning of data/models/code



