Job Closed
This listing is no longer active.
The all-in-one retail cannabis software solution
Data Engineer
Location
United States
Posted
65 days ago
Salary
0
Seniority
Senior
Job Description
Data Engineer
Sweed POS
• Design, build, and maintain data pipelines using Airflow, and Trino to ingest and process data from multiple systems (databases, APIs, event streams, 3rd-party integrations). • Improve data quality and reliability – implement monitoring, validation, and alerting for pipelines to ensure accuracy and consistency. • Develop and maintain the platform – deploy, monitor and maintain services in our aws cloud • Collaborate with cross-functional teams – work closely with Product Analytics, Data Architecture, and Engineering teams to define data requirements and deliver them effectively. • Optimize performance and cost – fine-tune queries, pipelines, and storage for speed and efficiency. • Document data assets – maintain clear documentation for data sources, pipelines, and models.
Job Requirements
- 3+ years of experience in data engineering or a related field.
- Strong proficiency in SQL and Python.
- Hands-on experience with: Airflow for workflow management
- OLAP databases, distributed query engines and data processing frameworks (clickhouse, trino, spark etc) for analytical workloads
- Solid understanding of data modeling and data engineering best practices
- Familiarity with event-based data architectures and streaming (spark, flink)
- Bonus points for: IaC: terraform, terragrunt for cloud infrastructure deployments
- IaC: helm, kustomize, argocd for k8s deployments
- Experience with building and owning cloud infrastructure
Benefits
- 100% remote – We’re a remote-first company, no offices needed!
- Flexible working hours – Core team time: 09:00-15:00 GMT (flexible per team)
- 20 paid vacation days per year
- 12 holidays per year
- 3 sick leave days
- Medical insurance after probation
- Equipment reimbursement (laptops, monitors, etc.)
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Über uns Die DIVINT Technology GmbH ist Microsoft Solutions Partner und ist ein innovatives IT-Beratungsunternehmen mit Fokus auf skalierbare Datenlösungen und moderne Cloud-Technologien. Wir unterstützen Unternehmen dabei, ihre Datenstrategien zu optimieren und datengesteuerte Entscheidungen zu treffen. Deine Aufgaben - Entwicklung und Implementierung von End-to-End-Datenlösungen unter Verwendung von Microsoft Fabric, einschließlich Lakehouse-Architekturen und OneLake - Aufbau und Optimierung von ETL/ELT-Prozessen mit Azure Data Factory und Synapse Pipelines - Erstellung und Verwaltung von Dataflows Gen2 und Notebooks zur Datenintegration und -transformation - Sicherstellung der Datenqualität, -sicherheit und -governance in Zusammenarbeit mit Microsoft Purview - Entwicklung interaktiver Dashboards und Berichte mit Power BI zur Unterstützung von Geschäftsentscheidungen - Zusammenarbeit mit Data Scientists zur Integration von Machine-Learning-Modellen in bestehende Datenpipelines Was wir bieten - Ein dynamisches und unterstützendes Arbeitsumfeld mit flachen Hierarchien - Möglichkeiten zur Weiterbildung und Zertifizierung in Microsoft-Technologien - Flexible Arbeitszeiten und die Option auf Remote-Arbeit - Attraktives Gehaltspaket und Zusatzleistungen - Zugang zu spannenden Projekten mit namhaften Kunden Dein Profil - Abgeschlossenes Studium in Informatik, Datenwissenschaft oder einem verwandten Bereich - Fundierte Kenntnisse in der Verwaltung von Microsoft Azure-Plattformen - Mindestens 3 Jahre Erfahrung in der Datenintegration und -verarbeitung mit Microsoft Azure - Fundierte Kenntnisse in Microsoft Fabric-Komponenten wie Data Factory, Synapse Analytics, Lakehouse und OneLake - Erfahrung in der Datenmodellierung und -visualisierung mit Power BI - Kenntnisse in Programmiersprachen wie SQL und Python - Vertrautheit mit Daten-Governance-Tools wie Microsoft Purview - Ausgezeichnete Kommunikationsfähigkeiten und Teamgeist
• Collaborate with cross-functional teams on data platform compliance initiatives • Monitor and manage cloud environments and compliance requirements • Implement best practices for data governance and API security • Develop CI/CD pipelines for data platform services
Azure Data Architect
AvengaA global IT engineering and consulting company specializing in custom software development.
• We are looking for a Data architect Azure, with a good overall understanding of available services in the Azure Analytics stack. • We need this person to be able to work according to Agile/SAFe methodology. • Strong communication skills and an analytical mindset is needed. • Our landscape is complex and international, our teams and stakeholders are located in multiple locations.
About The Company GROPYUS is a technology-based construction company focused on building multi-story residential buildings. Thanks to its prefabricated building system with various design options, industrial offsite construction, and fully digitalized processes, the company manufactures aspirational, sustainable, and affordable homes using timber construction methods. GROPYUS is using scalable construction and manufacturing solutions to tap into a future market, boost Europe's strength in innovation, while also playing a substantial role in improving sustainability. About The Role: We are growing our Data Platform Team within the Gropyus Tech department. Our Platform team is responsible for our internal platform, the Gropyus Data Fabric. Our team interacts with experts from various domains such as Digital Building Planning and Automation, Product Operations, Sustainability, AI, IoT, construction engineers, building architects, logistics experts, software engineering; solving complex challenges pertaining to end-to-end process for planning, building, and operating a building. What You Will Be Doing: As part of the Data Platform organization, you will: - Design, build, and maintain core data platform components, including ingestion frameworks, transformation pipelines, and data storage layers - Own and improve data reliability through monitoring, alerting, SLAs, and data quality checks - Collaborate with domain experts and software engineers to understand data needs and deliver high-quality datasets. - Lead strategic initiatives to modernize or scale our data ecosystem (including query optimization, schema design, analytics, etc) - Mentor and guide team members to elevate engineering rigor and technical capability What You Bring: - Experience working with a tech stack similar to: - Programming languages like Python or Kotlin. - Databases like Postgres, BigQuery, Spark, Graph DB - Tools like: Kubernetes, Docker, Terraform, Dagster, DBT - Cloud Storage Platforms - You have strong problem-solving and analytical skills and the ability to break down complex tasks for operations including working with stakeholders, adapting to dynamic input, and leading implementation projects - You have experience identifying and resolving issues related to data discrepancies and inconsistencies and creating validation and testing for prevention and handling - You have experience in building, operating, and scaling data intensive reactive processing pipelines from end to end including ingestion, storage, orchestration, transformation, enrichment, and analytics Optional Experience: - Some knowledge about semantic web technologies like RDF and OWL - Experience with ontology engineering, and knowledge engineering topics, including using ontology engineering tools such as Protege - Experience working with construction industry data and / or complex and large datasets - Data Science, Machine Learning and AI agents What we offer: - Be part of something big: You’re here to make a change? Come on board. At GROPYUS, we are on a mission to re-think an entire industry. Join us in reinventing construction and sustainable, affordable living. - It’s on you: We offer a tremendous amount of ownership and room to make a mark - at all our organization levels. Find your solutions, drive and test them. - Focus on results: You choose if you work from home, a park, or the office. Whether you start your day early, after your run, or pick up on work when your kids are in bed. What counts is your contribution and delivery. - Bring your uniqueness to the team: Innovation requires diversity of thought. Diversity in background, experience and thinking is crucial to create the best product for everyone. We actively seek diversity and strive to unlock each other’s full potential. We are very proud that people from all industries and all walks of life are joining our company – in addition to core areas such as construction, engineering, and start-ups, from stock-listed companies from across automotive e-Commerce, digital, sporting goods, and more. You will work in international teams with passionate colleagues. Inspire and be inspired. - Be an owner: Participate in the success of GROPYUS through stock options. Join us on our mission to design buildings as continuously evolving products to create the most exciting and affordable experience for all. We build for people and conserve the resources of our planet. We can't wait to get to know you. For more information, visit our website, and if you have any questions, please reach out to us via email.



