Job Closed
This listing is no longer active.
Senior Data Engineer
Location
United States
Posted
69 days ago
Salary
0
Seniority
Senior
Job Description
Senior Data Engineer
Palmetto State Armory L
Role Description The Senior Data Engineer is responsible for managing the development and maintenance of the company’s data infrastructure and analytics pipelines. This role focuses on creating simple, scalable, and high-performing data solutions to support business intelligence and AI initiatives. - Architect and oversee data warehouse technical designs in Snowflake to ensure scalability, stability, and security. - Develop and maintain automated data integration pipelines using ETL platforms and Snowflake to ingest data from various business systems. - Build and optimize transformation layers and data models to support reporting and visualization in Power BI. - Contribute directly to the design, development, and deployment of AI tools and machine learning datasets. - Enforce code quality standards and peer review processes to ensure the stability of the data environment. - Maintain technical documentation for all data models, integrations, and transformation logic. - Troubleshoot data discrepancies and pipeline failures, developing long-term fixes rather than temporary workarounds. - Collaborate extensively with the Chief Analytics Officer and project teams to translate business requirements into technical data solutions. - Research and provide feedback on new AI/ML technologies and data tools being considered for implementation. - All other duties as assigned. Qualifications - Strong knowledge of the software development lifecycle (SDLC) and data engineering best practices. - 3-4 years of experience with advanced Database administration and development. - Extensive knowledge of SQL for complex data transformation and optimization. - 3-4 years of experience writing Python code for data automation and scripting. - Experience with enterprise integration platforms and BI tools. - Demonstrated ability to research and resolve complex data problems using a variety of resources. - Strong planning and organizational skills to manage multiple data work efforts simultaneously. Working Conditions - On-call availability for rotation during the week and weekends. - Remote work. Physical Requirements - Employee may experience the following physical demands for extended periods of time: Sitting for extended periods of time; use of hands and fingers to operate a computer keyboard, mouse, sorter, power tools, and to handle other computer components; occasional climbing or bending to inspect cables in floors and ceilings; lifting and transporting of moderately heavy objects, such as computers and peripherals. Direct Reports - N/A Equal Opportunity Employer We are an equal opportunity employer. Export Control Compliance Notice This position may involve access to technology or software source code subject to U.S. export control laws (ITAR/EAR). Employment is contingent on verifying U.S. Person status or obtaining any necessary export license/confirming the availability of a license exception. Applicants must provide information for export control screening, which will be reviewed for compliance. Palmetto State Armory may elect not to pursue a license or exception and may decline to proceed with an applicant on that basis.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
• Design, build, and maintain data pipelines using Airflow, and Trino to ingest and process data from multiple systems (databases, APIs, event streams, 3rd-party integrations). • Improve data quality and reliability – implement monitoring, validation, and alerting for pipelines to ensure accuracy and consistency. • Develop and maintain the platform – deploy, monitor and maintain services in our aws cloud • Collaborate with cross-functional teams – work closely with Product Analytics, Data Architecture, and Engineering teams to define data requirements and deliver them effectively. • Optimize performance and cost – fine-tune queries, pipelines, and storage for speed and efficiency. • Document data assets – maintain clear documentation for data sources, pipelines, and models.
Über uns Die DIVINT Technology GmbH ist Microsoft Solutions Partner und ist ein innovatives IT-Beratungsunternehmen mit Fokus auf skalierbare Datenlösungen und moderne Cloud-Technologien. Wir unterstützen Unternehmen dabei, ihre Datenstrategien zu optimieren und datengesteuerte Entscheidungen zu treffen. Deine Aufgaben - Entwicklung und Implementierung von End-to-End-Datenlösungen unter Verwendung von Microsoft Fabric, einschließlich Lakehouse-Architekturen und OneLake - Aufbau und Optimierung von ETL/ELT-Prozessen mit Azure Data Factory und Synapse Pipelines - Erstellung und Verwaltung von Dataflows Gen2 und Notebooks zur Datenintegration und -transformation - Sicherstellung der Datenqualität, -sicherheit und -governance in Zusammenarbeit mit Microsoft Purview - Entwicklung interaktiver Dashboards und Berichte mit Power BI zur Unterstützung von Geschäftsentscheidungen - Zusammenarbeit mit Data Scientists zur Integration von Machine-Learning-Modellen in bestehende Datenpipelines Was wir bieten - Ein dynamisches und unterstützendes Arbeitsumfeld mit flachen Hierarchien - Möglichkeiten zur Weiterbildung und Zertifizierung in Microsoft-Technologien - Flexible Arbeitszeiten und die Option auf Remote-Arbeit - Attraktives Gehaltspaket und Zusatzleistungen - Zugang zu spannenden Projekten mit namhaften Kunden Dein Profil - Abgeschlossenes Studium in Informatik, Datenwissenschaft oder einem verwandten Bereich - Fundierte Kenntnisse in der Verwaltung von Microsoft Azure-Plattformen - Mindestens 3 Jahre Erfahrung in der Datenintegration und -verarbeitung mit Microsoft Azure - Fundierte Kenntnisse in Microsoft Fabric-Komponenten wie Data Factory, Synapse Analytics, Lakehouse und OneLake - Erfahrung in der Datenmodellierung und -visualisierung mit Power BI - Kenntnisse in Programmiersprachen wie SQL und Python - Vertrautheit mit Daten-Governance-Tools wie Microsoft Purview - Ausgezeichnete Kommunikationsfähigkeiten und Teamgeist
• Collaborate with cross-functional teams on data platform compliance initiatives • Monitor and manage cloud environments and compliance requirements • Implement best practices for data governance and API security • Develop CI/CD pipelines for data platform services
Azure Data Architect
AvengaA global IT engineering and consulting company specializing in custom software development.
• We are looking for a Data architect Azure, with a good overall understanding of available services in the Azure Analytics stack. • We need this person to be able to work according to Agile/SAFe methodology. • Strong communication skills and an analytical mindset is needed. • Our landscape is complex and international, our teams and stakeholders are located in multiple locations.
