Job Closed

This listing is no longer active.

Leidos logo
Leidos

Leidos is an innovation company rapidly addressing the world’s most vexing challenges in national security and health.

Senior Data Engineering Specialist

Data EngineerData EngineerFull TimeRemoteSeniorTeam 10,001+Since 1969H1B SponsorCompany SiteLinkedIn

Location

Illinois

Posted

46 days ago

Salary

$107.9K - $195.1K / year

Seniority

Senior

Job Description

Senior Data Engineering Specialist

Leidos

• Provide strategic technical leadership in data engineering, serving as the primary customer-facing expert on DISN network topology data to enable advanced data correlation and enrichment. • Represent the team in high-level technical discussions and decision-making with internal and external stakeholders, influencing solution design and architecture. • Architect, design, develop, document, test, and deploy complex software solutions using Python, JavaScript, Java, and SQL, ensuring scalability and maintainability. • Lead the creation of advanced Kibana visualizations and dashboards, leveraging machine learning capabilities and React to deliver actionable insights. • Oversee the design and implementation of robust data enrichment pipelines, integrating diverse data sources into Confluent (Kafka) and Elastic platforms. • Direct the development and management of multi-site Kafka and Elastic clusters, including deployment, configuration, testing, troubleshooting, and maintenance to support mission-critical operations. • Lead Kafka system integrations between Elasticsearch/Logstash and other enterprise systems. • Guide Agile collaboration, leading scrum teams, mentoring junior engineers, and fostering a culture of continuous improvement and innovation. • Communicate and collaborate effectively with geographically distributed teams to ensure alignment and successful completion of project objectives. • Troubleshoot and resolve complex installation, infrastructure, and system issues; proactively report, monitor, and mitigate technical risks. • Author, review, and maintain comprehensive technical documentation, including DoD requirements, interface documents, and security compliance artifacts. • Ensure all solutions adhere to DoD security standards and guidelines, and provide oversight for platform sustainment and reliability, proactively addressing operational challenges.

Job Requirements

  • Bachelor’s degree from an accredited college in a related discipline, or equivalent experience/combined education, with 8-12 years of professional experience; or 6-10 years of professional experience with a related master’s degree.
  • 8+ years of experience in software engineering, data engineering, or business/data analysis, with demonstrated leadership in Agile/Scrum teams.
  • Extensive hands-on software development experience with Python, Java, SQL, and working knowledge of JavaScript and HTML.
  • Advanced experience with distributed version control systems such as Git and Bitbucket.
  • Deep expertise in data analytics and visualization tools, including Kibana, Power BI, Tableau, and the ELK stack (Elasticsearch, Logstash, Kibana).
  • Proven experience designing, developing, and optimizing ETL processes and complex data pipelines, including integration with event streaming platforms such as Kafka.
  • Strong background in data modeling, unification, and analytics to support data-driven projects and advanced enrichment.
  • Demonstrated ability to architect and implement application and system integrations, including Kafka and Elastic platform integrations.
  • Solid understanding of networking and internet protocols, with experience supporting network-centric and data-driven environments.
  • Experience developing and deploying software on UNIX/Linux command line platforms.
  • Strong facilitation, stakeholder engagement, and communication skills, with the ability to bridge business and technical perspectives and collaborate with customer representatives, domain experts, systems engineers and architects.
  • Experience with Agile project management and collaboration tools such as JIRA and Confluence.
  • Demonstrated leadership in mentoring junior team members and fostering a culture of continuous improvement.
  • Active Secret DoD Security clearance prior to start date.
  • Active Security+ Certification (or other applicable DoD 8570 IAT II certification) prior to start date.

Benefits

  • competitive compensation
  • Health and Wellness programs
  • Income Protection
  • Paid Leave
  • Retirement

Related Categories

Related Job Pages

More Data Engineer Jobs

AAA logo

Sr. Data Engineer

AAA

Proud to serve our 62+ million members, help travelers see the world and drive real change to improve road safety.

Data Engineer46 days ago
Full TimeRemoteTeam 5,001-10,000Since 1902H1B Sponsor

Sr. Data Engineer As our Sr Data Engineer, you will function as a consultant between our technology unit and other business units to understand their challenges. You’ll ask questions and present ideas that enable them to solve those data problems with code. To thrive in this role, you must be an expert to query and process large data sets of 200,000 rows or more, ideally in SQL. You must also have functional knowledge of programming languages like Python, Spark and good understanding of cloud technologies. Be prepared to share an example of how you design and develop a solution to a business problem (real or hypothetical for more junior candidates). What You’ll Do - Every day you will independently work on design and develop solutions to issues across the business. Our team’s success isn’t just implementing the code but seeing that those insights are implemented by the business, and they have the necessary tools to accomplish the goal. More senior Data Scientists will write these technical specifications while junior applicants are doing the work to translate specs into functional code. - Ask questions and do quality testing to understand if the solution meets the objectives of the business or the goal we set for the business. You will work side-by-side with the business to make sure it works as expected, not just as designed. - Mentor other data engineers on the team, and review solutions to check for quality and completeness of the solution for the business problem. Clearly communicate solutions to business owners. What You’ll Need - To thrive in this role, you must have a passion for problem-solving using data. Your experience in querying the high volumes of data and doing the data analysis must inform how you design solutions that align with the business objectives. - Being proficient with SQL and programming languages such as Python and Spark is a must. - Experience with data integration from different sources into Big Data systems is preferable. - Experience with design, coding, and quality testing. These solutions will deploy across products that are important to our customers and the business. They must be high-quality and functional. - A willingness to collaborate. Our best work is done when we work together - either with non-technical or technical leads. You should be interested in learning from others regardless of their role in the organization. - You have worked previously with an Agile team or understand these concepts. You expect to participate in daily standup meetings, you’ll complete your projects or stories during our sprints, and you’ll be ready to meet frequent deployment deadlines. #LI-LD1 Remarkable benefits: • Health coverage for medical, dental, vision • 401(K) saving plans with company match AND Pension • Tuition assistance • Floating holidays and PTO for community volunteer programs • Paid parental leave • Wellness programs • Employee discounts (membership, insurance, travel, entertainment, services and more!) Auto Club Enterprises is the largest club within the national AAA federation. We have nearly 17,000 employees in 24 states helping more than 18 million members. The strength of our organization is our employees. Bringing together and supporting different cultures, backgrounds, personalities, and strengths creates a team capable of delivering legendary, lifetime service to our members. When we embrace our diversity – we win. All of Us! With our national brand recognition, long-standing reputation since 1900, and constantly growing membership, we are seeking career-minded, service-driven professionals to join our team. "Through dedicated employees we proudly deliver legendary service and beneficial products that provide members peace of mind and value.” AAA is an Equal Opportunity Employer Our organization participates in E-Verify

United States
Full TimeRemoteTeam 5,001-10,000

At Mukuru, data isn’t just something we store, it’s how we drive smarter decisions, power innovation, and scale impact across Africa. As a Senior Data Engineer, you’ll be at the centre of transforming how we build, process, and use data. Why this role matters You won’t just maintain data systems, you’ll redefine them. This role is key to modernising our data platform, enabling faster insights, better decisions, and scalable solutions that support a growing fintech ecosystem. What you’ll do Build the future of data - Design and implement scalable, cloud-based data platforms - Lead the shift from traditional ETL to modern ELT architectures - Drive innovation using frameworks like Medallion Architecture and ODS Own data pipelines end-to-end - Optimise and manage data ingestion, transformation, and storage - Ensure high-quality, reliable, and accessible data - Implement best practices in CI/CD and version control (Git) Lead and influence - Guide technical decisions and mentor team members - Drive proof-of-concept initiatives for new technologies - Collaborate with cross-functional teams to solve complex data challenges Enable smarter decisions - Partner with stakeholders to deliver data solutions that drive business value - Ensure data supports analytics, reporting, and strategic initiatives Protect what matters - Maintain high standards of data security, governance, and compliance - Align with financial industry regulations and best practices What you bring - 5+ years’ experience in Data Engineering - Experience in a senior or leadership role - Strong expertise in cloud data platforms (Snowflake, AWS, Azure, BigQuery, Databricks) - Advanced skills in SQL, Python or Java - Strong understanding of ELT/ETL, data modelling, and data pipelines What sets you apart - You think beyond solutions, you think scalable architecture - You enjoy solving complex data problems - You’re proactive, innovative, and always improving - You can influence both technical teams and business stakeholders I am sure you are reading this job description and meet majority of the criteria BUT you may also still not be 100% comfortable in applying. We believe that there is a place for everyone under the Mukuru sun and we want YOU to contribute to our diverse tapestry of talent. So come on, take a leap of faith, and send your application if you meet majority of our requirements. Remember to include a snippet of how you will bring value and help us build a future of success that will help us determine where and how you may best be suited” Maybe you are just the future Mukurian we need!! Should you be appointed in a remote/work from home role at Mukuru, it is your responsibility to ensure that you have uninterrupted internet connectivity and a ‘work-like’ environment at your home location, in order to deliver your best in terms of performance, productivity and service to our customers. If you do not receive any response after two weeks, please consider your application unsuccessful. NB: ALL STAFF APPOINTMENTS WILL BE MADE WITH DUE CONSIDERATION OF THE COMPANY’S DIVERSITY AND INCLUSION PLANS

South Africa
United Biosource Corporation logo

Director, Data Engineering

United Biosource Corporation

UBC is proud to be an equal opportunity employer and does not discriminate because of race, color, sex, age, national origin, religion, sexual orientation, gender identity and/or expression, status as a veteran, and basis of disability or any other federal, state, or local protected class. We are committed to a diverse, equitable and inclusive culture that fosters respect for each other, our clients, and our patients.

Data Engineer46 days ago

Role Description The Director - Data Engineering is responsible for the Enterprise Data Warehouse (EDW) and all data processes, integrations, and backend data delivery. This role leads a team of experienced Senior Data Warehouse Engineers, ensuring that projects are delivered on time, with high quality. The role involves building partnerships with cross-functional teams, managing and communicating effectively with stakeholders, and strict adherence to UBC Agile DevOps best practices. This role requires a hands-on, engaged approach with a strong, communicative, and supportive leadership style. - Work with Senior Leadership and stakeholders to define and execute the long-term vision and strategic roadmap for the enterprise data warehouse. - Lead and manage end-to-end delivery of backend data projects, ensuring timely, quality delivery. - Lead technical data discussions with enterprise teams and stakeholders. - Develop and maintain detailed project plans, including management of resource allocation, budgets, and timelines. - Coordinate with product owners, engineers, Quality Assurance (QA), and stakeholders to ensure alignment and successful execution of project objectives. - Serve as the primary point of contact for external clients and internal business partners, providing proactive verbal and written updates, managing expectations, and addressing any issues or concerns. - Ensure high quality of data project deliverables through comprehensive testing and adherence to Agile DevOps workflow processes. - Build and optimize an agile, collaborative, high-performing Data Engineering team, encouraging continuous improvement and innovation. - Identify and resolve technical and project-related barriers. - Implement data engineering best practices, staying updated on latest industry trends and technologies. - Mentor and develop Data Engineers, providing guidance and support to promote professional growth and team culture. - Provide technical expertise and coaching to Data Engineers during design, code review, and troubleshooting working sessions. - Oversee the design, development, and implementation of data pipelines for data ingestion, transformation and delivery. Qualifications - Bachelor’s or Master’s Degree in a Data-Related Focus, Computer Science, Information Technology, Business or a related field. - 10+ years experience leading a data engineering team. - Significant experience in technical data project management with a proven track record of successful delivery. - Expertise in data integration techniques, including ETL/ELT processes and data pipelines. - Understanding of data modelling techniques, e.g., hierarchical, relational, entity-relationship (ER). - Significant experience with Snowflake as a relational database system (RDBMS). - Proficient with SQL. - Extensive knowledge of data governance principles, data quality management, and data privacy regulations. - Strong understanding of software development lifecycle (SDLC) and Agile methodologies. - Strong experience working in projects with Agile/Scrum methodologies. - Excellent leadership and team management skills with the ability to motivate and guide a team of Data Engineers. - Exceptional communication and interpersonal skills, with the ability to engage effectively with technical and non-technical stakeholders. - Analytical and problem-solving abilities with strong attention to detail. - Experience managing resource allocation. - Strong data architecture experience. - Experience working with APIs and a multitude of data source formats including JSON and XML. - Experience with data tokenization. - Significant experience with healthcare data. Preferred Qualifications - Experience with EDC, CTMS, and eTMF data. - Experience with pharmacovigilance or REMS data. - Experience with reimbursement, medical/pharmacy claims, or pharmacy datasets. - Proficient in project management tools and software. - Experience with Azure Data Factory. - Experience with AI tools to enhance data engineering services. - Experience working with healthcare data exchanges using FHIR and HL7 standards. - Well-versed in HIPAA and GDPR compliance standards. - Background working with Real World Data (RWD). Supervisory Responsibilities - 4-6 Data Warehouse Engineers

United States
Lean Solutions Group logo

Senior Data Engineer

Lean Solutions Group

Lean Tech is a rapidly expanding organization situated in Medellín, Colombia. We pride ourselves on possessing one of the most influential networks within software development and IT services for the entertainment, financial, and logistics sectors. Our corporate projections offer many opportunities for professionals to elevate their careers and experience substantial growth. Joining our team means engaging with expansive engineering teams across Latin America and the United States, contributing to cutting-edge developments in multiple industries.

Data Engineer46 days ago
Full TimeRemoteTeam 501-1,000

Company Overview: Global Technology Services is a rapidly expanding organization situated in Medellín, Colombia. We pride ourselves on possessing one of the most influential networks within software development and IT services for the entertainment, financial, and logistics sectors. Our corporate projections offer a multitude of opportunities for professionals to elevate their careers and experience substantial growth. Joining our team means engaging with expansive engineering teams across Latin America, Philippines and the United States, contributing to cutting-edge developments in multiple industries. Position Title: Senior Data Engineer Location: LATAM What you will be doing: We are seeking a skilled Senior Migration Engineer to support the migration of enterprise data warehouse workloads to the Databricks Data Intelligence Platform. This role is highly hands-on and focuses on executing migration activities, including assessment, SQL code conversion, data movement, validation, and production cutover support. You will collaborate closely with client data teams and internal stakeholders, leveraging modern data engineering tools and migration frameworks to ensure high-quality, scalable, and reliable data platform transformations. Required Skills & Experience To excel in this role, you should possess: - 5+ years of experience with Microsoft SQL Server as developer. - T-SQL, stored procedures, SQL Server Integration Services (SSIS), SQL Server Agent - 1+ year of experience with Databricks or Apache Spark - Databricks SQL, Delta Lake, Unity Catalog fundamentals - Strong understanding of data type mapping between SQL Server and Databricks - Hands-on experience with ETL/ELT patterns (incremental loads, MERGE operations, data validation) - Experience with SQL transpilation/migration tools (e.g., Lakebridge/BladeBridge, Morpheus, or similar) - Familiarity with command-line tools and connectivity frameworks - Familiar with Databricks CLI, Azure/AWS CLI, JDBC, pyodbc - Ability to debug, troubleshoot, and optimize converted SQL and ETL processes Nice to Have Skills: - Python / PySpark for ETL transformations and stored procedure rewrites - Experience with data reconciliation frameworks and validation strategies - Familiarity with Infrastructure as Code (Terraform, DABs) - Previous experience in large-scale data warehouse migrations - Databricks Data Engineer Associate certification Soft Skills: - Strong analytical and problem-solving skills with attention to detail - Effective communication skills for collaborating with technical and non-technical stakeholders - Ability to work independently in a fast-paced, client-facing environment - Adaptability to evolving project requirements and technologies - Strong documentation and knowledge-sharing practices Why you will love Lean Tech: - Join a powerful tech workforce and help us change the world through technology - Professional development opportunities with international customers - Collaborative work environment - Career path and mentorship programs that will lead to new levels. Join Lean Tech and contribute to shaping the data landscape within a dynamic and growing organization. Your skills will be honed, and your contributions will play a vital role in our continued success. Lean Tech is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.

Brazil