An education technology company based in Portland, Oregon, Clarity Innovations offers consulting, marketing strategy, and other services designed to match "prom
Principal Data Engineer
Location
Maryland
Posted
63 days ago
Salary
0
Seniority
Senior
Job Description
Principal Data Engineer
Clarity Innovations
Title: Principal Data Engineer Location: Columbia, MD Job Description: Clarity Innovations is a trusted national security partner, dedicated to safeguarding our nation’s interests and delivering innovative solutions that empower the Intelligence Community (IC) and Department of Defense (DoD) to transform data into actionable intelligence, ensuring mission success in an evolving world. Our mission-first software and data engineering platform modernizes data operations, utilizing advanced workflows, CI/CD, and secure DevSecOps practices. We focus on challenges in Information Warfare, Cyber Operations, Operational Security, and Data Structuring, enabling end-to-end solutions that drive operational impact. We are committed to delivering cutting-edge tools and capabilities that address the most complex national security challenges, empowering our partners to stay ahead of emerging threats and ensuring the success of their critical missions. At Clarity, we are people-focused and set on being a destination employer for top talent, offering an environment where innovation thrives, careers grow, and individuals are valued. Join us as we continue to lead innovation and tackle the most pressing challenges in national security. Position Overview The Data Transport Engineer II is responsible for the design, implementation, and validation of secure data movement within the Unified Data Model (UDM) team. This role focuses on integration between UDM, Apache NiFi, and external stakeholder systems in constrained and classified environments where data flow correctness, schema integrity, and transport reliability are mission-critical. The position is delivery and compliance-oriented rather than availability or on-call focused. Position Details Clearance Required: Active TS/SCI with CI poly Employment Type: Full-Time Location: Hybrid - Maryland/DC Key Responsibilities - Design, implement, and validate secure data movement between Apache NiFi and external stakeholder components. - Support ingestion pipelines, data transfer reliability, and format validation in constrained and classified environments. - Troubleshoot data flow issues, schema alignment failures, and transport-layer integration problems across system boundaries. - Partner with platform and infrastructure teams to ensure data movement architecture aligns with enterprise standards and security controls. - Develop and maintain documentation for data transport patterns, pipeline configurations, and integration test results. - Contribute to delivery timelines by meeting enterprise compliance requirements and integration milestones. - Participate in peer reviews of pipeline configurations, data schemas, and transport layer designs. - Support sprint-based delivery within an Agile/Scrum environment, reporting progress to program leadership. Required Qualifications Clearance & Compliance - Active TS/SCI w/ CI Poly security clearance (required prior to start). - Ability to operate in classified environments and comply with all applicable government and program security protocols. Technical Skills - Hands-on experience with Apache NiFi for data flow design, pipeline configuration, and processor development. - Working knowledge of data format conversion and schema validation (JSON, XML, Avro, Protobuf, or similar). - Familiarity with data modeling concepts and structured data interchange patterns. - Experience with REST APIs and integration patterns for data transport between distributed systems. - Proficiency in at least one scripting or programming language (Python, Groovy, Java) for pipeline customization. - Understanding of data transport security requirements including encryption in transit and access control. Experience - 5-10 years of experience in data engineering, integration engineering, or a directly related role. - Experience working in government, defense, or other regulated/classified environments preferred. - Demonstrated ability to troubleshoot integration failures and resolve data consistency issues in production pipelines. Preferred Qualifications - Experience with Kubernetes-based deployment environments and containerized data pipelines. - Familiarity with document/data ingestion workflows. - Experience with CI/CD pipelines and DevSecOps practices in a government contracting context. - Familiarity with Agile/Scrum delivery and working in cross-functional product teams. We are an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or veteran status.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Lead Data Engineer - Oracle - Python
Raymond JamesRaymond James is a diversified financial services holding company that was founded in 1962. The company provides financial services to corporations, municipalit
Title: Lead Data Engineer (Oracle/Python) Location: FL - Saint Petersburg - 880 Carillon Pkwy Tower 1 Job Description: time type Full time job requisition id R-0010448 Job Description Summary We are seeking a highly skilled and experienced Lead Developer to join our dynamic team. The ideal candidate will have a strong background in Python, Oracle database development, CI/CD processes, Jenkins, Kubernetes, database optimization, and data manipulation. As a Lead Developer, you will be responsible for leading a team of developers, designing and implementing robust solutions, and ensuring the seamless integration and optimization of our systems. Job Description This position will follow our hybrid work model, we expect the selected candidate to be in the office 8-10 days per month at the St. Petersburg, FL Corporate Office location. Please note: This role is not eligible for Work Visa sponsorship, either currently or in the future. Responsibilities: - Lead Development Projects: Oversee the development lifecycle, from requirements gathering to deployment, ensuring high-quality deliverables. - Python Development: Design, develop, and maintain Python applications and scripts. - Oracle Database Development: Create and optimize complex queries, stored procedures, and database schemas. - CI/CD Implementation: Develop and maintain CI/CD pipelines using Jenkins and other tools to automate the build, test, and deployment processes. - Kubernetes Management: Deploy, manage, and scale applications using Kubernetes. - Database Optimization: Analyze and optimize database performance, ensuring efficient data retrieval and storage. - Data Manipulation: Utilize Pandas for data analysis, transformation, and manipulation. - Team Leadership: Mentor and guide junior developers, fostering a collaborative and innovative team environment. - Technical Documentation: Create and maintain comprehensive technical documentation for all projects. Technical Skills: - Proficiency in Python, Oracle database development, CI/CD, Jenkins, Kubernetes, and Pandas. - Database Optimization: Strong understanding of database optimization techniques and best practices. - Leadership: Proven experience in leading development teams and managing projects. - Problem-Solving: Excellent analytical and problem-solving skills. - Communication: Strong verbal and written communication skills. Preferred Skills: - Agile Methodologies: Experience working in Agile/Scrum environments. - Cloud Platforms: Familiarity with cloud platforms such as AWS, Azure, or Google Cloud. - Relevant certifications in Python, Oracle, Kubernetes, or CI/CD tools. Education Bachelor’s: Business Administration, Bachelor’s: Computer and Information Science (Required), Bachelor’s: Computer Engineering Work Experience General Experience - 6 to 10 years Certifications Travel Less than 25% Workstyle Hybrid The total compensation for this position includes base salary or wages, and may include components such as additional compensation (cash or equity), discretionary bonuses, or commissions. This position is eligible for a benefits package that may include medical, dental, and vision; life insurance; critical illness insurance and accident insurance; disability benefits; retirement savings; paid time off (including vacation, holidays, and sick leave); and parental leave. Eligibility for benefits and specific offerings may vary based on position and employment status. To view more details of the benefits offered, visit Myrjbenefits.com. At Raymond James our associates use five guiding behaviors (Develop, Collaborate, Decide, Deliver, Improve) to deliver on the firm's core values of client-first, integrity, independence and a conservative, long-term view. We expect our associates at all levels to: • Grow professionally and inspire others to do the same • Work with and through others to achieve desired outcomes • Make prompt, pragmatic choices and act with the client in mind • Take ownership and hold themselves and others accountable for delivering results that matter • Contribute to the continuous evolution of the firm At Raymond James – as part of our people-first culture, we honor, value, and respect the uniqueness, experiences, and backgrounds of all of our Associates. When associates bring their best authentic selves, our organization, clients, and communities thrive. The Company is an equal opportunity employer and makes all employment decisions on the basis of merit and business needs. #LI-SA1
Data Product Owner
Poland and Eastern EuropeXebia is a global tech company with a journey in CEE that started with two Polish companies – PGS Software and GetInData. We are a team of 1,000+ experts delivering top-notch work across cloud, data, and software. We work on impactful projects across various sectors including fintech, e-commerce, aviation, logistics, media, and fashion, helping clients build scalable platforms and cutting-edge applications. Our clients include notable names like McLaren, Aviva, Deloitte, Spotify, Disney, ING, UPS, Tesco, Truecaller, AllSaints, Volotea, Schmitz Cargobull, Allegro, and InPost.
Hello, let’s meet! We are Xebia - a place where experts grow. For nearly two decades now, we've been developing digital solutions for clients from many industries and places across the globe. Among the brands we’ve worked with are UPS, McLaren, Aviva, Deloitte, and many, many more. We're passionate about Cloud-based solutions. So much so, that we have a partnership with three of the largest Cloud providers in the business – Amazon Web Services (AWS), Microsoft Azure & Google Cloud Platform (GCP). We even became the first AWS Premier Consulting Partner in Poland. Formerly we were known as PGS Software. In 2021, we joined Xebia Group – a family of interlinked companies driven by the desire to make a difference in the world of technology. Xebia stands for innovation, talented team members, and technological excellence. Xebia means worldwide recognition, and thought leadership. This regularly provides us with the opportunity to work on global, innovative projects. Our mission can be captured in one word: Authority. We want to be recognized as the authority in our field of expertise. What makes us stand out? It's the little details, like our attitude, dedication to knowledge, and the belief in people's potential - emphasizing every team members development. Obviously, these things are not easy to present on paper – so make sure to visit us to see it with your own eyes! Now, we've talked a lot about ourselves – but we'd love to hear more about you. Send us your resume to start the conversation and join the #Xebia. You will be: - collaborating with stakeholders to identify and understand requirements impacting our data products by creating clear and actionable user stories, - conducting regular stakeholder engagement & serve as the primary point of contact, - responsible for a healthy backlog management on Jira, defining and prioritizing features based on based on value & business urgency for delivery in a Scaled Agile environment, - participating in sprint planning meetings, defining sprint goals, and working closely with the development team to ensure that user stories are well-understood, estimated accurately, and delivered within the scheduled iterations, - defining the product & solution vision and roadmap while aligning with overall business objectives and compliance needs, - working closely with data engineering teams to ensure the successful delivery of data products, - proactively identifying gaps in the current product offering and leading the effort to develop solutions that drive business value, - staying updated on EMEA changes and industry trends to proactively adapt data and analytics strategy for reporting. Your profile: - proven experience as a Product Owner or similar role, preferably in data & analytics teams, - strong understanding of EMEA regulatory landscape, including GDPR, MiFID II, PSD2, AML, FINRA, FCA, BaFin and exposure to EU regulatory bodies such as ECB, EBA & CBI, - english proficiency at B2 level or higher, - analytical mindset with experience in data analysis and reporting, - familiarity with agile methodologies and product management frameworks, - knowledge of data governance and data management principles, - technical know-how of data lake, data warehouse & data visualization, - proficient in working on SQL databases with working knowledge of data analysis. Work from the European Union region and a work permit are required. Nice to have: - Certification in Product Management (e.g., Certified Scrum Product Owner) Recruitment Process: CV review – HR call – Interview – Client Interview – Decision
Senior Data Engineer (Snowflake)
Poland and Eastern EuropeXebia is a global tech company with a journey in CEE that started with two Polish companies – PGS Software and GetInData. We are a team of 1,000+ experts delivering top-notch work across cloud, data, and software. We work on impactful projects across various sectors including fintech, e-commerce, aviation, logistics, media, and fashion, helping clients build scalable platforms and cutting-edge applications. Our clients include notable names like McLaren, Aviva, Deloitte, Spotify, Disney, ING, UPS, Tesco, Truecaller, AllSaints, Volotea, Schmitz Cargobull, Allegro, and InPost.
Hello, let’s meet! Who We Are While Xebia is a global tech company, our journey in CEE started with two Polish companies – PGS Software, known for world-class cloud and software solutions, and GetInData, a pioneer in Big Data. Today, we’re a team of 1,000+ experts delivering top-notch work across cloud, data, and software. And we’re just getting started. What We Do We work on projects that matter – and that make a difference. From fintech and e-commerce to aviation, logistics, media, and fashion, we help our clients build scalable platforms, data and AI solutions, and cutting-edge applications to shape the future of tech. Our clients include McLaren, Aviva, Deloitte, Spotify, Disney, ING, UPS, Tesco, Truecaller, AllSaints, Volotea, Schmitz Cargobull, Allegro, InPost, and many, many more. We value smart tech, real ownership, and continuous growth. We use modern, open-source stacks, and we’re proud to be trusted partners of Databricks, dbt, Snowflake, Azure, GCP, and AWS. Fun fact: we were the first AWS Premier Partner in Poland! Beyond Projects What makes Xebia special? Our community. We support tech communities, organize meetups (Software Talks, Data Tech Talks), and have a culture that actively support your growth via Guilds, Labs, and personal development budgets — for both tech and soft skills. It’s not just a job. It’s a place to grow. What sets us apart? Our mindset. Our vibe. Our people. And while that’s hard to capture in text – come visit us and see for yourself. You will be: - Designing and building scalable, efficient, and fault-tolerant data products using predominantly Azure and Snowflake technology, - working closely with the Product Owner and Tech Lead to identify, refine and build solutions to deliver the prioritised use-cases, - engaging with stakeholders to understand requirements, - ensuring the platform remains secure, well-monitored and performant. Your profile: - ready to join within 2 weeks, - experience in data engineering in a fast-paced, large-scale production environment. - demonstrable expert skills in SQL, including a knowledge of efficient and performant query design, - experience building production systems utilising cloud services, - uses coding best practices and understands data architecture patterns - deep understanding/experience of data warehousing, and ETL/ELT processes, - experience of Snowflake cloud data warehouse including SnowSQL, - familiarity with utilizing CI/CD processes (e.g. Azure DevOps) and Git-based code repositories, - experience of programming/scripting languages (e.g. Python), - experience of data-ingestion and transformation tooling such as FiveTran, dbt, Azure Data Factory or Matillion, - experience of data visualisation tooling such as PowerBI, Tableau or ThoughtSpot, - experience of data modelling, - excellent communication, collaboration, and problem-solving skills, - practical experience using AI-powered assistants (e.g. Claude Code, GitHub Copilot, Cursor) to improve productivity, quality, or decision-making in software delivery. Work from the European Union region and a work permit are required. Nice to have: - Snowflake and Azure cloud certification is a huge plus Recruitment Process: CV review – HR call – Interview – Client Interview – Decision
Data Engineer with Airflow
Poland and Eastern EuropeXebia is a global tech company with a journey in CEE that started with two Polish companies – PGS Software and GetInData. We are a team of 1,000+ experts delivering top-notch work across cloud, data, and software. We work on impactful projects across various sectors including fintech, e-commerce, aviation, logistics, media, and fashion, helping clients build scalable platforms and cutting-edge applications. Our clients include notable names like McLaren, Aviva, Deloitte, Spotify, Disney, ING, UPS, Tesco, Truecaller, AllSaints, Volotea, Schmitz Cargobull, Allegro, and InPost.
Hello, let’s meet! Who We Are While Xebia is a global tech company, our journey in CEE started with two Polish companies – PGS Software, known for world-class cloud and software solutions, and GetInData, a pioneer in Big Data. Today, we’re a team of 1,000+ experts delivering top-notch work across cloud, data, and software. And we’re just getting started. What We Do We work on projects that matter – and that make a difference. From fintech and e-commerce to aviation, logistics, media, and fashion, we help our clients build scalable platforms, data and AI solutions, and cutting-edge applications to shape the future of tech. Our clients include McLaren, Aviva, Deloitte, Spotify, Disney, ING, UPS, Tesco, Truecaller, AllSaints, Volotea, Schmitz Cargobull, Allegro, InPost, and many, many more. We value smart tech, real ownership, and continuous growth. We use modern, open-source stacks, and we’re proud to be trusted partners of Databricks, dbt, Snowflake, Azure, GCP, and AWS. Fun fact: we were the first AWS Premier Partner in Poland! Beyond Projects What makes Xebia special? Our community. We support tech communities, organize meetups (Software Talks, Data Tech Talks), and have a culture that actively support your growth via Guilds, Labs, and personal development budgets — for both tech and soft skills. It’s not just a job. It’s a place to grow. What sets us apart? Our mindset. Our vibe. Our people. And while that’s hard to capture in text – come visit us and see for yourself. You will be: - providing hands-on assistance with Airflow configuration, DAG design, scheduling, and troubleshooting, - acting as a technical advisor for customer data engineering teams using diverse technology stacks, - helping customers integrate Airflow with their existing data ecosystem (e.g. cloud data warehouses, transformation tools, infrastructure as code), - supporting customers during initial platform adoption and production onboarding, - toubleshooting complex Airflow-related issues and guiding customers toward stable, reliable solutions, - collaborating with an internal project owner responsible for scope management, status tracking, and meeting facilitation. Your profile: - strong hands-on knowledge of Apache Airflow, including DAG development, scheduling, and operational concepts, - professional experience with Python, - experience supporting or working with data engineering platforms in a customer-facing or advisory role, - ability to troubleshoot distributed systems and production issues, - strong communication skills and customer empathy, especially in technical training and support scenarios, - ability to work independently in a remote, distributed environment, - practical understanding of Kubernetes and containerized environments, - experience working with managed cloud services, - familiarity with at least one modern data stack (e.g. Snowflake, dbt, Terraform), - experience delivering technical workshops, training sessions, or enablement activities. - ability to quickly learn new platforms and internal tooling, - practical experience using AI-powered assistants (e.g. Claude Code, GitHub Copilot, Cursor) to improve productivity, quality, or decision-making in software delivery. Work from the European Union region and a work permit are required. Nice to have: - experience with Airflow administration in production environments, - exposure to infrastructure as code (Terraform or similar), - familiarity with SQL and analytical data workflows, - previous experience in customer support, reliability engineering, or platform engineering roles, - experience working with enterprise customers during onboarding or adoption phases, - interest in and familiarity with emerging AI-driven practices (e.g. agent-based workflows, automation patterns, AI-augmented development), with a willingness to explore and experiment beyond standard approaches. Recruitment Process: CV review – HR call – Interview – Client Interview – Decision
