• Design, develop, optimize and maintain scalable data pipelines and transformations using Databricks, Apache Spark and SQL. • Implement data ingestion, transformation, and orchestration workflows to support back and where applicable real-time processing. • Perform data quality assurance activities, including identifying and resolving any inconsistencies in data flow, data outside legitimate ranges, and illogical data responses by developing data quality reports and investigation and resolution of data anomalies or errors by using a combination of software packages including SAS, Excel, and other software as warranted. • Use technical expertise, initiative, creativity, critical thinking, and strong communication and interpersonal skills daily to solve data quality problems in support of technical development efforts. • Implement data quality controls to ensure accuracy, completeness, and reliability of datasets. • Document data pipelines, transforms, business rules and data dependencies using appropriate technical documentation methods (e.g., data flow diagrams, data dictionaries, etc.). • Serve as liaison and coordinate with a multi-disciplinary team. • Collaborate with the program team to identify opportunities for process improvements, making strategic adjustments, and exploit opportunities focused on maximizing programmatic impact. • Communicate data issues, risks, and remediation approaches clearly to technical and non-technical team members.

• Lead the technical design, construction, and evolution of the data architecture, ensuring it is scalable, resilient, and efficient • Design and implement complex data pipelines (ETL/ELT) to integrate diverse sources into our ecosystem • Establish technical governance by defining modeling standards, taxonomy, and ensuring data quality and consistency across the data lifecycle • Serve as a high-level technical bridge between Software Engineering, Product, BI, and AI • Ensure performance with large data volumes by optimizing queries and storage in Data Warehouse/Data Lake • Implement engineering best practices (CI/CD, data testing, version control) across the data stack • Define security and compliance guidelines (LGPD) for processing and storage layers • Act as a technical mentor, raising the team's knowledge bar and fostering a culture of engineering excellence

Requisition Number: 103511 Principal Software Engineer - Data Location: You will have the flexibility to work fully remote from anywhere across the US. Insight at a Glance - 14,000+ engaged teammates globally - Received 35+ industry and partner awards in the past year Now is the time to bring your expertise to Insight. We are not just a tech company; we are a people-first company. We believe that by unlocking the power of people and technology, we can accelerate transformation and achieve extraordinary results. As a Fortune 500 Solutions Integrator with deep expertise in cloud, data, AI, cybersecurity, and intelligent edge, we guide organizations through complex digital decisions. About the role We are seeking a Principal Data Engineer to serve as a senior technical leader within our Data & AI Business Unit. This role represents the highest level of individual contributor for data engineering and is a natural progression toward Solutions or Data Architecture roles. As a Principal Data Engineer, you will lead the design and implementation of complex data pipelines and platforms, influence architectural decisions, establish engineering standards, and mentor other engineers—while remaining deeply hands on. Responsibilities - Design, build, and optimize scalable, reliable data pipelines and platforms - Lead technical implementation across ingestion, transformation, and data serving layers - Translate architectural direction into production ready engineering solutions - Influence and contribute to data platform and solution architecture decisions - Establish and enforce engineering standards, patterns, and best practices - Serve as a technical mentor and escalation point for senior and mid level engineers - Partner closely with architects, analytics, BI, and AI teams to deliver end to end solutions - Own performance tuning, reliability, and operational excellence of data systems - Review designs and code to ensure quality, scalability, and maintainability - Stay current on modern data engineering tools, frameworks, and architectural trends Travel & Work Environment - Hybrid or remote work environment (US based) - Occasional travel to support planning, delivery, or team collaboration - Fast paced, collaborative engineering culture focused on quality and scale What we’re looking for - 8+ years of experience in data engineering or data platform development - Experience operating as a Senior or Principal level engineer on complex data initiatives - Strong expertise in data pipeline development (batch and/or streaming) - Deep hands-on experience with cloud data platforms (Azure, AWS, or GCP) - Advanced SQL skills and solid experience with data modeling practices - Strong programming experience in Python, SQL, and/or Spark - Proven ability to influence technical direction without direct authority - Experience working in collaborative, cross functional environments - Ability to clearly communicate tradeoffs, risks, and implementation details Certifications - Cloud or data platform certifications preferred (Azure, AWS, GCP, Databricks, Snowflake, Fabric, etc.) What you can expect We’re legendary for taking care of you, your family and to help you engage with your local community. We want you to enjoy a full, meaningful life and own your career at Insight. Some of our benefits include: - Freedom to work from another location, even an international destination, for up to 30 consecutive calendar days per year. - Comprehensive benefits package including medical, dental, vision, and company 401k match. But what really sets us apart are our core values of Hunger, Heart, and Harmony, which guide everything we do, from building relationships with teammates, partners, and clients to making a positive impact in our communities. Join us today, your ambITious journey starts here. When you apply, please tell us the pronouns you use and any reasonable adjustments you may need during the interview process. At Insight, we celebrate diversity of skills and experience so even if you don’t feel like your skills are a perfect match - we still want to hear from you! Compensation Range - Base Salary: $130,000 – $145,000, based on experience The position described above provides a summary of some the job duties required and what it would be like to work at Insight. For a comprehensive list of physical demands and work environment for this position, click here. Insight is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veteran status, sexual orientation or any other characteristic protected by law. Posting Notes: Chandler, AZ || Arizona (US-AZ) || United States (US) || IT Infrastructure & Support || None || US - Chandler,AZ ||

This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more. Role Description CommIT Enterprises, Inc. is seeking a highly skilled Lead Data Engineer to join a team in Charleston, SC, but this role can be REMOTE, to design, develop, and maintain advanced data ingestion pipelines and models that support the United States Marine Corps (USMC) logistics situational awareness and decision-making. This role requires expertise in ETL/ELT processes, CI/CD pipeline development, and data modeling to ensure reliable, scalable, and secure data solutions. This role directly supports the USMC by enabling data-driven situational awareness, ensuring leaders have timely, accurate, and actionable insights to inform operational decisions. Responsibilities - Lead the design, development, and maintenance of CI/CD pipelines that enable ingestion teams to seamlessly move ETL/ELT processes through Development, Testing, and Production environments. - Build and optimize ETL/ELT workflows to ingest, validate, and transform data from diverse sources. - Apply data modeling techniques to create Silver and Gold Tier data assets that enhance situational awareness and support decision-making. - Collaborate with cross-functional teams to ensure data pipelines and models align with operational requirements and reporting needs. - Drive best practices in data engineering, automation, and pipeline reliability to support mission-critical analytics. Qualifications - Master’s degree with 6 years of experience (or Bachelors with 8 years of experience) in Computer Science, Software Engineering, Computer Engineering, Mathematics or relevant field. Degree may be substituted with additional relevant industry experience and/or industry accepted training and certification. - 5+ years of experience in data engineering with a focus on ETL/ELT and CI/CD. - Hands-on experience with Databricks, Delta Lake, and GitLab Enterprise. - Strong proficiency in Python and SQL. - Experience supporting logistics, defense, or mission-critical environments is a plus. - Proven experience with ETL and ELT processes for ingesting structured, semi-structured, and unstructured data sources. - Deep understanding of CI/CD practices, with the ability to design and implement pipelines using Databricks and GitLab Enterprise for Data Ingestion teams. - Strong background in data modeling, with the ability to build Silver and Gold Tier Tables and Views to support operational dashboards and reporting. Requirements - ETL and ELT methods - Databricks and Delta Tables - Python and SQL programming - CI/CD pipeline development and automation - GitLab Enterprise for version control and deployment Security Requirements - Secret Clearance - Security+ Certification Equal Opportunity Employer CommIT Enterprises, Inc. is an Equal Opportunity Employer. Employment decisions are made without regard to race, color, religion, national origin, gender, sexual orientation, gender identity, age, physical or mental disability, genetic factors, military/veteran status or other characteristics protected by law.