Job Closed
This listing is no longer active.
At Capital One, we think and work like a tech company, using our digital fluency to transform everything about the customer experience. We’re bending data to our will, and turning a stodgy industry on its head. That’s reflected in our ranking as the number one business technology innovator in the U.S. in the 2016 InformationWeek Elite 100.
Senior Data Engineer – Enterprise Data Storage and Consumption Platforms
Location
Virginia
Posted
88 days ago
Salary
$286.2K - $326.7K / year
Seniority
Senior
Job Description
Senior Data Engineer – Enterprise Data Storage and Consumption Platforms
Capital One
• Build awareness, increase knowledge and drive adoption of modern technologies, sharing consumer and engineering benefits to gain buy-in • Identify, benchmark and contribute towards opportunities to improve system availability, security, reliability, cost optimization and performance • Strike the right balance between lending expertise and providing an inclusive environment where others’ ideas can be heard and championed; leverage expertise to grow skills in the broader Capital One team • Promote a culture of engineering excellence, using opportunities to reuse and innersource solutions where possible • Effectively communicate with and influence key stakeholders across the enterprise, at all levels of the organization • Operate as a trusted advisor for a specific technology, platform or capability domain, helping to shape use cases and implementation in a unified manner • Lead the way in creating next-generation talent for Tech, mentoring internal talent and actively recruiting external talent to bolster Capital One’s Tech talent
Job Requirements
- Bachelor’s Degree
- At least 7 years of experience in software engineering or data engineering
- At least 5 years of people management experience
- At least 3 years of experience with Big Data and data streaming
- At least 3 years of experience with cloud-based data platforms (Amazon Web Services, Microsoft Azure, Google Cloud Platform)
- At least 9 years of experience in data engineering writing production quality code with a focus on distributed systems
- Masters’ Degree (Preferred)
- 10+ years of experience in data engineering (Preferred)
- 3+ years of experience implementing big data frameworks and processing solutions (Preferred)
- 3+ years of data modeling experience (Preferred)
- 2+ years of experience with ontology standards for defining a domain (Preferred)
- 2+ years of experience using Python, SQL or Scala (Preferred)
- 1+ year of experience deploying machine learning models (Preferred)
- 5+ years of experience with Agile engineering practices (Preferred)
- 8+ years in-depth experience with the Hadoop stack (MapReduce, Pig, Hive, Hbase) (Preferred)
- 8+ years experience with NoSQL implementation (Mongo, Cassandra) (Preferred)
- 8+ years experience developing Java based software solutions (Preferred)
- 8+ years experience in at least one scripting language (Preferred)
- 8+ years experience developing software solutions to solve complex business problems (Preferred)
- 8+ years experience with Relational Database Systems and SQL (Preferred)
- 8+ years experience designing, developing, and implementing ETL (Preferred)
- 8+ years experience with UNIX/Linux including basic commands and shell scripting (Preferred)
- 8+ years of experience providing technical leadership (Preferred)
- 8+ years of experience leading the full life-cycle of IT development and platform support (Preferred)
Benefits
- Comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Senior Data/ETL Developer Antech Systems is seeking an experienced database specialist and solutions architect to join our performance solutions team. In this ETL oriented position you will be responsible for evolving and sustaining a large legacy database cluster in several ways: - Developing data interactions through dynamic, stored procedure, and automated applications of SQL - Evolving existing data architecture into a more modern and optimized design, most likely some version of a data lake. - Working with developers and solutions architects to fulfill user stories on functional needs of both traditional web application deployment and Government Cloud application. - Addressing emergent issues and resolving data and/or database issues - Assisting or leading the developer of data related components across the ETL spectrum including in future states with active engage of securely controlled AI elements - Performance, Resilience, and Extendibility optimization. While many elements of this work can be approached from a strong foundation in traditional DBA skills the work emphasizes Data Developer and ETL skillsets or those aligned with large scale data infrastructure transformation such as migration and successful user shift to a data lake model. For many of these efforts you will support other senior architects, developers and specialists to optimize database use across a range of projects which vary from highly transactional to primarily analytical in data collection and use under NAWCAD WOLF ASI, associated DoD/Federal programs, and NAS Pax River Hosted infrastructure. Projects and interdisciplinary teamwork will support both Fleet/external user facing and in-house products fusing highly structured, user generated and unstructured data sources. This position is open to those with the right skillsets in all US locations with a preference for technically qualified candidates located within 100 driving miles of Webster Field in St. Inigoes MD or Lexington Park, MD and able to support up to 4 daytrips per month to these locations as required. Applicants must have a senior level combination of education and experience demonstrated with one of the following combinations: A Bachelor’s degree in computer science, math, data science, informatics, engineering, science, media development, or information/data discipline with at least 10 years’ experience. OR an Associates in a relevant field as described earlier with at least 13 years’ experience. OR a high school diploma/GED with at least 17 years’ experience. A Security+, SecurityX, or CISSP/CISA will be required within 60 days of starting this position so those possessing one or more of these will receive a positive scoring factor in consideration. A relevant professional certification (Microsoft Certified: Azure Database Administrator Associate certification, Microsoft Certified: Fabric Analytics Engineer Associate, Microsoft Certified: Azure Solutions Architecture Expert, Certified Data Management Professional, CompTIA Data+, Microsoft Azure Data Engineer Associate, certification in Microsoft SQL Server, etc.) may be substituted for 1-3 years of experience based on the seniority of the certification held. More targeted certification in other database technologies, containerization, and software engineering will be assessed as a benefit but will not substitute for required experience/education. Significant experience with complex data environments mixing multiple types of database engines is a strong plus. Applicants must be a U.S. citizen and able to qualify for a Security Clearance. Active Security Clearance is a plus. Position may require travel up to 5% of the time, outside of the monthly day trips to St Mary’s Maryland for those within range to do so, mostly within less than 100 miles of NAS Pax River. Monthly travel to St Mary’s Maryland or to NSWC Indian Head will not be consider local travel for the purposes of any travel consideration and/or reimbursements unless explicitly otherwise designed as extended duration and approved for travel costs by Antech leadership. Key Job areas will include: - DB Management (SQL & NoSQL): Practical understanding of SQL (especially MS SQL Server) and NoSQL at the administrative and traditional ‘ilities’ level (usability, supportability, extendibility, sustainability, resilience and optimizability) as well as data modeling, query optimization, and migration: - Data Management & Governance: Comprehensive knowledge of data management principles, ontology, data governance frameworks (e.g., DAMA-DMBOK), and best practices for non-Cloud and Cloud supporting databases Experience implementing or supporting data governance programs, including defining data policies, standards, models, interfaces and procedures - Understanding of the key DoD and Industry data standards, policies, and practices - Data Quality Enhancement: Continuously refine data related storage, query, and interfacing elements to prompt data hygiene, overall data quality, and identify/mitigation data conflicts within the larger data ecosystem - Expert knowledge of relational database concepts and highly proficient in SQL, with extensive experience optimizing queries, stored procedure and data API development - Data Solution Development & Architecture: Designing and implementing complex, scalable, and secure solutions tailored to customer needs. This includes continued evolution and new development within the broader framework of well-integrated data components: - Thought and creation of solution components for scalable data use including transaction optimization, load balance, precompute, data warehousing, data lake solutions, and cloud migration strategies - Leading or contributing to the design and implementation of data architectures including zero trust interfaces to external data repositories - Develop and implement a comprehensive data architecture that aligns with the organization's goals and supports business intelligence and analytics initiatives - Develop architecture strategy based on modern data architectures like Data Products, Data Mesh, Data Fabric and Domain Driven Design - Design data models (canonical, conceptual and logical data models and data flow. charts) for operational and analytical systems, ensuring consistency and scalability - Ability to advise senior management and technical teams benefits, risks, and impacts of various data architecture and changes. Including but not limited to changes to data center infrastructure/policy, changes to overall data architecture, and data access interfaces. - Data Integration/ELT: Demonstrated capability and proven ability to apply concepts and principles of building and scaling Extract, Load, Transform (ELT) pipelines. Experience overseeing or managing projects involving data pipeline orchestration, data quality management, and performance optimization. - Data Science/AI & Data Standards: Understanding of how data standards impact data science, information availability, data hygiene and AI/ML initiatives: - Experience contributing to or managing projects that apply data standards in data preparation, feature engineering, model training, validation, and AI/ML workflows is a plus Required Skills: In addition to an overall IT experience level of at least 10 years, at least 8 years of experience in three of the technical areas relevant to the above key job areas having been performed as core aspects of work activities OR 10+ in two of the defined areas . Additional desired experience includes: - User Story decomposition into technical solution components - Agile Test-Driven Development - DoD Data management and integration - Non-disruptive transformation of complex legacy database collections - Experience working with multi-disciplinary solutions teams - Database/Data Entity containerization - Evolutionary ETL - Legacy Systems migration - Coordination with and optimization for hosted database infrastructure The successful candidate will bring an established record of success in full stack development and or life-cycle database management blended with expert artisan capabilities in creating and implementing efficient, mission effective, resilient solutions that can evolve as available HW/SW infrastructure and broader organizational policy modernizes. This includes developing components, modules, libraries, or microservices, automation of workflows and business process, data transformation, and/or authenticated/zero trust cross platform interfacing. If you possess a combination of several of the above experience and highlighted capabilities below Antech offers a role on a growing team with great benefits, professional opportunities to excel, diverse creative peers, and a flexible work environment we want to talk to you! Salary Range: $120,000 - $143,200 - Antech applies several factors to determine each individual’s appropriate salary component in their compensation package, including but not limited to location, the individual’s particular combination of education, knowledge, skills, competencies, and experience, as well as contract-specific elements and broader organizational requirements. The range displayed represents the overall expected salary range for this position and is just one component of Antech’s total compensation package for employees. We offer a variety of benefits to our employees, including: - Health, dental, and vision insurance - 401(k) retirement plan with company match - Life insurance - Long-term/Short-term disability insurance (LTD/STD) - Employee Stock Ownership Plan (ESOP) - Vacation, Sick and Holiday leave - Parental leave Antech Systems, Inc. (ASI) is an Equal Opportunity Employer and endorses the intent of all federal and state laws created to prohibit discrimination. ASI provides, upon request, reasonable accommodation including auxiliary aids and services necessary to afford individuals with disabilities an equal opportunity.
About Us Heartland Security Insurance Group (HSIG) is a diversified holding company specializing in insurance, risk management, and financial services. Through our family of subsidiary companies—including Hibbs-Hallmark & Company, Claims Administrative Services (CAS), and Contract Claims Services (CCS)—we provide comprehensive solutions that protect businesses, employees, and communities across the country. At HSIG, our culture is built on honesty, integrity, and teamwork. We’re a family business that values hard work — but never at the expense of our families. We believe in supporting one another, focusing on results (not politics), and creating an environment where every associate can thrive personally and professionally. Our team is entrepreneurial and forward-thinking, always looking for opportunities while remaining disciplined and committed to protecting the company’s long-term financial strength. We take pride in offering a comfortable, professional, and fun workplace — one that fosters collaboration, growth, and lasting success. At Heartland, we want every team member to feel valued, inspired, and confident in building a rewarding career and a prosperous future. Join Heartland Security Insurance Group and be part of a company that does business the right way — with integrity, balance, and heart. To learn more about Heartland Security Insurance Group please visit: https://www.heartlandsig.com/ **Remote Role in Texas** SQL Developer Primary Responsibility The SQL Developer will primarily be responsible for MS SSIS, SSRS and SSAS development. In addition, this position will be responsible for stored procedure, view and index development, as well as SQL Server instance management and performance tuning. Essential Functions & Responsibilities - The SQL Developer will be primarily responsible for MS SQL Analysis Services, Integration Services, Reporting Services, Stored Procedures, Views, Indexes and relational database architecture. - This position will work with end users in developing analytic and reporting tools, and with the application development group in database schema, stored procedure and view development. - Duties will also include MS SQL server maintenance and tuning to achieve maximum performance. - Create, monitor and troubleshoot SQL jobs, and integration service packages. - Writing and creating data load scripts and stored procedures; ensuring that data is loaded in a timely manner and to vendor and/or client specifications. - Ability to work with various departments and associated vendors and/or clients with data issues. - Performance Tuning: review monitoring tools and query execution plans to maintain or increase query efficiency. Also perform root cause analysis on query performance issues to improve application response time for our clients - Other duties as assigned. Required Qualifications - Qualified candidates must possess a bachelor's degree in Computer Science or related discipline - At least 3 years’ experience in Microsoft SQL Server development and management. Preferred Qualifications - Prefer experience in the areas of Insurance, Claims or Finance. - Experience with Power BI Server, Power BI Desktop, Power Query (M language), and Data Analysis Expressions (DAX) is preferred. Knowledge, Skills & Abilities - Must be proficient in Microsoft SQL Server 2012,2016 and 2022, Analysis Services with in-depth knowledge of authoring SRSS reporting and SSIS development for SQL Agent jobs. - Other requirements include a strong work ethic, team player, attention to detail, the ability to multi-task and meet timed deadlines. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.
This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more. Role Description We are seeking a highly skilled Power BI Data Engineer who combines deep technical expertise in data engineering with exceptional data visualization abilities. This hands-on role requires someone who can architect robust data solutions while creating compelling, insight-driven dashboards that transform complex data into clear, actionable intelligence. This role is expected to interact directly with end users regarding requirements, testing, and implementation. This position is remote with preference to align to one of Legence’s office locations. Key Responsibilities - Power BI Development & Visualization - Create sophisticated, visually stunning Power BI dashboards and reports that drive business decisions. - Develop advanced DAX calculations, measures, and calculated columns to support complex analytical requirements. - Design intuitive, user-friendly interfaces with custom visuals, drill-through capabilities, and interactive features. - Implement dynamic report features including bookmarks, parameters, field parameters, and dynamic formatting. - Build composite models and leverage advanced features like aggregations, incremental refresh, and query folding. - Data Engineering & Architecture - Design, build, and maintain scalable data pipelines and ETL/ELT processes using Power Query, Dataflows, and Azure Data Factory. - Develop and optimize data models using star schema, snowflake schema, and other dimensional modeling techniques. - Implement and manage data warehouses and data lakes using Azure Synapse Analytics, SQL Server, or similar platforms. - Write and optimize complex SQL queries, stored procedures, and database functions for performance and efficiency. - Establish data governance frameworks, including data quality checks, validation rules, and documentation standards. - Technical Implementation - Configure and manage Power BI/Fabric workspaces, deployment pipelines, and version control. - Implement row-level security (RLS) and object-level security (OLS) for data protection. - Optimize report performance through query optimization, data model refinement, and DAX tuning. - Integrate Power BI with various data sources including SQL databases, APIs, SharePoint, Excel, and cloud platforms. - Automate data refresh schedules and monitor gateway configurations. Qualifications - 3+ years of hands-on experience with Power BI development (Desktop, Service, and Report Server). - Expert-level proficiency in DAX (Data Analysis Expressions) and Power Query (M language). - Strong SQL skills with experience in database design, query optimization, and performance tuning. - Solid understanding of data warehousing concepts, dimensional modeling, and ETL principles. - Experience with data visualization best practices and UI/UX design principles. - Proficiency in Azure data services (Azure SQL Database, Synapse Analytics, Data Factory, or Fabric). - Deep understanding of data modeling techniques and relationships (one-to-many, many-to-many, bi-directional). - Strong grasp of statistical concepts and analytical methodologies. - Ability to translate complex business requirements into technical data solutions. - Experience with data quality assessment and data profiling. - Proven ability to create visually compelling, executive-level dashboards and reports. - Strong problem-solving skills with a hands-on, solution-oriented approach. - Excellent communication skills to explain technical concepts to non-technical stakeholders. - Detail-oriented with commitment to code quality and documentation. - Demonstrated ability to use AI and automation in software engineering. Preferred Qualifications - CS or CIS bachelor’s degree. - Microsoft certifications: PL-300 (Power BI Data Analyst), DP-203 (Data Engineer), or DP-500 (Enterprise Data Analyst). - Experience with Python or R for advanced analytics integration. - Familiarity with Git/Azure DevOps for version control and CI/CD pipelines. - Knowledge of DAX Studio, and other Power BI development tools. - Experience with Power BI Embedded or custom API development. - Understanding of data science concepts and predictive analytics. Technical Environment - Power BI Desktop, Power BI Service, Power BI Premium/Fabric. - SQL Server, Azure SQL Database, Azure Synapse Analytics. - Azure Data Factory, Azure Data Lake Storage. - DAX Studio, Tabular Editor, Power Query. - Git/Azure DevOps for version control. Benefits - 401(k) Plan with Company Match: Currently match contributions dollar-for-dollar up to 4% of eligible pay; immediate vesting. - Health & Welfare Benefits: Employer provided medical, dental, vision, prescription drug, Employee Assistance Program and accident & illness coverage. - Life and Disability Insurance: Employer provided basic life insurance and AD&D valued at 50K coverage amount with the option for voluntary buy up for additional coverage. - Time Off: Flexible non-accrual vacation; company holidays per policy. - Expenses: Business travel and related expenses reimbursed per company policy.
This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more. Role Description 3 Key Consulting is hiring an Associate Engineer, Drug Product Manufacturing Data Analysis for a consulting engagement with our direct client, a leading global biopharmaceutical company. - Remote but preferably someone who is located near Thousand Oaks or Cambridge sites for occasional onsite. - Dayshift 8AM - 5PM. - Implementation/enhancement of digital systems and automated analysis/visualization tools (Spotfire) that are utilized for streamlining data management and data monitoring. - Data extraction, verification, analysis, and technical reports for process monitoring. - Supporting investigations of adverse signals identified through process data monitoring. - Integration of new products and processes to data monitoring business process and quality management system. - Support for other ad hoc studies and projects as applicable (e.g. technology transfers of processes to new sites). Qualifications - Some industry experience through internship or research projects with a bachelor's degree. - Educational background in engineering, data sciences, biology, chemistry, or related discipline. - Drug product experience in Fill finish or inspection. - Experience with Excel, statistical process control, Spotfire, or Tableau. - Manufacturing experience; strongly preferable for this experience to be in drug product/pharmaceutical field. - Manufacturing experience in other fields may also be considered, depending on relevance of skills involved and transferability/applicability to this position. - Experience with data entry, verification, analysis, and/or data management IS systems. Requirements - Bachelor degree OR Associate degree and 4 years of experience OR High school diploma / GED and 6 years of experience. Red Flags - Lack of consistency, focus, or direction (in terms of career trajectory and interests). - Lack of clear interest in or motivation for taking on this specific role. Interview Process - Preliminary phone interview. - Team video interview. Benefits - Pay Rate: $32 - $35/hour W2. - Duration: 1+ year (with likely extensions and/or conversion to permanent).
