Job Closed
This listing is no longer active.
Sr. Principal Data Engineer / Data Architect
Location
United States
Posted
97 days ago
Salary
0
No structured requirement data.
Job Description
Sr. Principal Data Engineer / Data Architect
Compulse
This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more. Role Description As the Sr. Principal Data Engineer, you will be the primary architect of Digital Remedy’s next-generation data platform. You won't just move data; you will design the blueprints for how we handle massive-scale AdTech telemetry. You will bridge the gap between business priorities and technical execution, ensuring our "Partner" integrations are scalable, cost-efficient, and resilient. - Architectural Leadership: Design and oversee the migration/optimization of our data lakehouse architecture using Databricks. - Production Excellence: Serve as the escalation point for the platform, leveraging a proven record of handling production issues to ensure 24/7 reliability of mission-critical pipelines. - Strategic Capacity Planning: Work directly with the SVP of Tech to translate product roadmaps into technical requirements, multitasking across various high-priority workstreams without losing sight of architectural integrity. - Infrastructure as Code: Drive the adoption of Databricks Asset Bundles (DABs) to standardize deployments across dev, staging, and production. - Mentorship & Governance: Provide high-level guidance to engineering squads in India and the US, defining schemas and governance models for BigQuery and Databricks. Qualifications - Minimum 4+ years of hands-on experience specifically within the Databricks ecosystem (Delta Lake, Unity Catalog, Photon). - Deep proficiency in Spark (PySpark/Scala), Python, and SQL. Experience with GCP (BigQuery) is a major plus. - Proven experience managing petabyte-scale datasets and high-concurrency pipelines (AdTech experience preferred). - Must be a self-starter capable of taking a high-level concept from the SVP and driving it to completion with minimal supervision. - 10+ years in Data Engineering, with at least 3 years in a Principal or Architect capacity. Requirements - A history of successfully diagnosing and resolving complex, large-scale production bottlenecks and data outages. - A demonstrated ability to multi-task, balancing long-term architectural R&D with immediate business requests and partner integrations. - Strong understanding of optimizing Databricks/BigQuery costs and the ability to communicate technical trade-offs to non-technical stakeholders. Benefits - Base salary compensation range for this role is $131,250 to $175,000. - Final compensation will be determined by various factors such as a candidate’s relevant work experience, skills, certifications, and geographic location. - Full time positions are eligible for benefits that include participation in a retirement plan, quarterly and annual incentive plan bonuses, life and disability insurance, health, dental and vision plans, flexible spending accounts, 15 paid vacation days, 2 paid personal days, 9 paid holidays, 40 hours of paid sick leave, parental leave, and employee stock purchase plan.
Job Requirements
- Minimum 4+ years of hands-on experience specifically within the Databricks ecosystem (Delta Lake, Unity Catalog, Photon).
- Deep proficiency in Spark (PySpark/Scala), Python, and SQL. Experience with GCP (BigQuery) is a major plus.
- Proven experience managing petabyte-scale datasets and high-concurrency pipelines (AdTech experience preferred).
- Must be a self-starter capable of taking a high-level concept from the SVP and driving it to completion with minimal supervision.
- 10+ years in Data Engineering, with at least 3 years in a Principal or Architect capacity.
- A history of successfully diagnosing and resolving complex, large-scale production bottlenecks and data outages.
- A demonstrated ability to multi-task, balancing long-term architectural R&D with immediate business requests and partner integrations.
- Strong understanding of optimizing Databricks/BigQuery costs and the ability to communicate technical trade-offs to non-technical stakeholders.
Benefits
- Base salary compensation range for this role is $131,250 to $175,000.
- Final compensation will be determined by various factors such as a candidate’s relevant work experience, skills, certifications, and geographic location.
- Full time positions are eligible for benefits that include participation in a retirement plan, quarterly and annual incentive plan bonuses, life and disability insurance, health, dental and vision plans, flexible spending accounts, 15 paid vacation days, 2 paid personal days, 9 paid holidays, 40 hours of paid sick leave, parental leave, and employee stock purchase plan.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Enterprise Data Architect III
Healthcare Management AdministratorsProving What's Possible in Healthcare®
HMA is the premier third-party health plan administrator across the PNW and beyond. We relentlessly deliver on our promise to provide medium to large-size employers with customized health plans. We offer various high-quality, affordable healthcare plan options supported with best-in-class customer service. We are proud to say that for three years, HMA has been chosen as a ‘Washington’s Best Workplaces’ by our Staff and PSBJ™. Our vision, ‘Proving What’s Possible in Healthcare™,’ and our values, People First!, Be Extraordinary, Work Courageously, Own It, and Win Together, shape our culture, influence our decisions, and drive our results. What we are looking for: We are always searching for unique people to add to our team. We only hire people that care deeply about others, thrive in evolving environments, gain satisfaction from being part of a team, are motivated by tackling complex challenges, are courageous enough to share ideas, action-oriented, resilient, and results-driven. What you can expect: You can expect an inclusive, flexible, and fun culture, comprehensive salary, pay transparency, benefits, and time off package with plenty of personal development and growth opportunities. If you are looking for meaningful work, a clear purpose, high standards, work/life balance, and the ability to contribute to something important, find out more about us at: https://www.accesshma.com/ How YOU will make a Difference: As the Enterprise Data Architect, you will be a central figure in our modernization program. You will be the visionary and technical leader responsible for designing the blueprint for our future-state data ecosystem. Moving from legacy systems to a cloud-native environment, you will architect and build a scalable, secure, and compliant data platform that will serve as the foundation for all analytics, reporting, and data-driven decision-making across the enterprise. This role requires a unique blend of deep technical expertise, strategic thinking, and a thorough understanding of the complexities of healthcare data. What YOU will do: - Strategy & Road mapping: - Develop and own the enterprise data architecture roadmap, aligning it with the company's strategic modernization goals. - Lead the evaluation, selection, and implementation of modern data technologies, including cloud data warehouses, data lakes, data integration tools, and governance platforms. - Design a target-state architecture that supports everything from operational reporting to advanced analytics and machine learning workloads. - Design & Implementation: - Create detailed architectural blueprints for data ingestion, transformation, storage, and consumption patterns across the organization. - Lead the design and oversee the development of robust, scalable, and real-time ETL/ELT data pipelines to migrate and integrate data from legacy on-premise systems to our new cloud platform (Azure). - Establish standards and best practices for data modeling (e.g., dimensional modeling, 3NF), data quality, and metadata management. - Governance & Security: - Architect solutions that ensure strict adherence to healthcare regulations, including HIPAA and HITECH, for all data at rest and in transit. - Design and implement a comprehensive Master Data Management (MDM) strategy for core entities such as Members, Providers, Claims, and Products. - Partner with security and compliance teams to define data classification, access control, and data masking/anonymization policies within the new architecture. - Collaboration & Leadership: - Serve as the lead technical subject matter expert on data architecture, providing guidance and mentorship to data engineers, BI developers, and data scientists. - Collaborate closely with business stakeholders, application developers, and infrastructure teams to ensure architectural alignment and successful solution delivery. - Effectively communicate complex technical concepts and architectural designs to both technical and non-technical audiences, from engineers to executive leadership.
Job Description: Onset Technologies is seeking a Data Architect to design, develop, and maintain data architecture supporting enterprise reporting, analytics, and business intelligence for the Railroad Commission of Texas. The role ensures that data structures, reporting models, and integration patterns are scalable, reliable, and aligned with business requirements. The architect will collaborate with enterprise architects, data engineers, report developers, and business stakeholders to deliver high-quality reporting solutions that enable informed decision-making. Responsibilities: - Lead the design of scalable data solutions to support modernization initiatives and future growth. - Design and maintain reporting data models, including star/snowflake schemas, semantic layers, and reporting datasets. - Translate business requirements into technical data structures, ETL/ELT pipelines, and data flows. - Ensure consistency, accuracy, and integrity across reporting environments. - Support creation of reusable data assets for BI tools such as Power BI or similar platforms. - Collaborate with business units and mainframe teams to define KPIs, metrics, and analytical goals. - Establish and enforce data governance standards, including metadata management, naming conventions, and documentation. - Ensure compliance with security, privacy, and regulatory requirements. - Mentor report developers and analysts on data modeling best practices. - Troubleshoot complex data issues and provide architectural guidance for resolution. Required Skills & Experience: - 8+ years in data modeling (star schema, snowflake schema, semantic modeling). - 6+ years hands-on experience with enterprise reporting platforms (Power BI, Tableau, SSRS). - 8+ years translating business requirements into technical data structures. - 8+ years proficiency with Microsoft Office tools (Word, Excel, PowerPoint, Visio, SharePoint). - 6+ years experience with KPI design, business metrics, and analytical methodologies. - 8+ years ability to interpret data models, data dictionaries, and technical documentation. - 4+ years knowledge of data governance frameworks and metadata management. - 4+ years experience delivering in fast-paced, deadline-driven environments. - 2+ years strong interpersonal skills for cross-functional collaboration. Preferred Skills & Experience: - 3+ years familiarity with mainframe systems (IMS, COBOL files, JCL, batch processes). - 2+ years knowledge of PII, state, and federal data governance regulations. - 5+ years experience on projects migrating from legacy to modern data systems. Eligibility: - Must be eligible to work in the U.S. without sponsorship. PLEASE SUBMIT YOUR RESUME IN WORD FORMAT
Senior Cloud Data Engineer (Snowflake)
General DynamicsGeneral Dynamics is a global aerospace and defense company offering products designed to provide safety and security to people around the world. In the past, Ge
Type of Requisition: Regular Clearance Level Must Currently Possess: None Clearance Level Must Be Able to Obtain: None Public Trust/Other Required: BI Full 6C (T4) Job Family: Software Engineering Job Qualifications: Skills: AWS Cloud Computing, ETL, Snowflake (Platform)Certifications: NoneExperience: 5 + years of related experienceUS Citizenship Required: No Job Description: Job Description Own the opportunity as a Senior Cloud Data Engineer and help ensure the mission is never interrupted. At GDIT, we deliver clarity with our cloud solutions and provide meaningful work. Your work will be an important part of transforming our clients for the modern age and help them face any obstacle. At GDIT, people are our differentiator. As a Senior Cloud Data Engineer, you will help ensure today is safe and tomorrow is smarter. Our work depends on a Senior Cloud Data Engineer joining our dynamic team to work in a fast-paced environment with engineering, migration, and operations. We’re looking for a self-starter, to work both as part of the team and on individual assignments, in an environment of customer mission delivery, integrity, and communications. We’re looking to fill this role with someone who currently has the cloud experience, certifications, and skills to execute in large environments, is flexible and enjoys tackling challenges, and desires to join a large team that is building and sustaining a large, multi-tenant cloud platform/enterprise and migrating/expanding/automating the enterprise. If this sounds like you and you'd love to learn and grow with a team while delivering program milestones, then we’d love to hear from you! HOW A SENIOR CLOUD DATA ENGINEER WILL MAKE AN IMPACT: - Designs, architects, deploys and maintains cloud data solutions - Works hands-on with Snowflake implementing logical and physical data models - Maintains the integrity and security of systems - Maintains all documentation - Supports and develops automation - Has exposure to Bash, PowerShell, Python - Maintains/enhances knowledge of related AWS cloud services - Work across teams, and external customer groups to develop strategy, design solutions, and advise implementation teams during infrastructure buildouts - Deal with escalations. Make assessments, recommendations or provide solutions to resolve issues - Compose and maintain standard operating procedures and work instructions, knowledge articles, etc. WHAT YOU’LL NEED TO SUCCEED: Required Education: Technical Training, Certification(s) or Degree Required Experience: - Experience with Cloud Computing - AWS - 5+ years experience required Required Technical Skills: - Hands-on experience with Snowflake - Ability to implement logical and physical data models in Snowflake - Experience developing in cloud-based data platforms - Proficiency with ETL/ELT frameworks - Linux / Windows Server Required Skills and Abilities: Excellent communication skills with demonstrated experience delivering presentations to diverse audiences at various levels of an organization Preferred Skills and Experience: - 7+ years experience strongly preferred, with 3+ years of experience at the Senior level - Demonstrable experience leveraging AI/ML as a force multiplier and/or have implemented AI/ML solutions will be strongly preferred - Strong proficiency with SQL and data transformation techniques - Familiarity with Agile / Scrum delivery environments Preferred Certification: Snowflake SnowPro Core Security Clearance Level: None Location: Remote GDIT IS YOUR PLACE: - 401K with company match - Comprehensive health and wellness packages - Internal mobility team dedicated to helping you own your career - Professional growth opportunities including paid education and certifications - Cutting-edge technology you can learn from - Rest and recharge with paid vacation and holidays The likely salary range for this position is $128,039 - $173,229. This is not, however, a guarantee of compensation or salary. Rather, salary will be set based on experience, geographic location and possibly contractual requirements and could fall outside of this range. Scheduled Weekly Hours: 40 Travel Required: Less than 10% Telecommuting Options: Remote Work Location: Any Location / Remote Additional Work Locations: Total Rewards at GDIT: Our benefits package for all US-based employees includes a variety of medical plan options, some with Health Savings Accounts, dental plan options, a vision plan, and a 401(k) plan offering the ability to contribute both pre and post-tax dollars up to the IRS annual limits and receive a company match. To encourage work/life balance, GDIT offers employees full flex work weeks where possible and a variety of paid time off plans, including vacation, sick and personal time, holidays, paid parental, military, bereavement and jury duty leave. GDIT typically provides new employees with 15 days of paid leave per calendar year to be used for vacations, personal business, and illness and an additional 10 paid holidays per year. Paid leave and paid holidays are prorated based on the employee’s date of hire. The GDIT Paid Family Leave program provides a total of up to 160 hours of paid leave in a rolling 12 month period for eligible employees. To ensure our employees are able to protect their income, other offerings such as short and long-term disability benefits, life, accidental death and dismemberment, personal accident, critical illness and business travel and accident insurance are provided or available. We regularly review our Total Rewards package to ensure our offerings are competitive and reflect what our employees have told us they value most. We are GDIT. A global technology and professional services company that delivers consulting, technology and mission services to every major agency across the U.S. government, defense and intelligence community. Our 30,000 experts extract the power of technology to create immediate value and deliver solutions at the edge of innovation. We operate across 50 countries worldwide, offering leading capabilities in digital modernization, AI/ML, Cloud, Cyber and application development. Together with our clients, we strive to create a safer, smarter world by harnessing the power of deep expertise and advanced technology. Join our Talent Community to stay up to date on our career opportunities and events atgdit.com/tc. Equal Opportunity Employer / Individuals with Disabilities / Protected Veterans
Director, Data Center Cost Control Team Lead
OracleOracle, headquartered in Austin, Texas, is a global leader in computing solutions. The company specializes in database management systems, cloud-engineered systems, and enterprise
This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more. Role Description The AI Gigascale Construction Cost Manager Lead (OCI) provides end-to-end cost leadership for Oracle Cloud Infrastructure (OCI) gigascale construction programs, including hyperscale data center campuses and associated enabling infrastructure. This role blends rigorous cost management and project controls with scaled, time-to-market–focused delivery execution to improve forecast accuracy, accelerate executive decision-making, strengthen early risk detection, and deliver clear, auditable cost transparency across the full project lifecycle. - Build and lead a cost controls function and team - Establish standardized processes, systems, and reporting that scale across multiple sites and workstreams - Own the development and maintenance of estimates, budgets, forecasts, cash flow, contingency, and change control - Partner closely with Design & Construction, Procurement/Supply Chain, Finance, Scheduling/Project Controls, and Delivery leadership - Drive predictable outcomes and disciplined cost governance - Champion the responsible use of AI and advanced analytics within Oracle construction and engineering productivity suite - Create repeatable models, dashboards, and insights that improve performance (e.g., variance detection, cost risk indicators, productivity signals, invoice/bid anomalies) - Ensure outputs are explainable, traceable, and aligned with enterprise data governance and compliance expectations NOTE: Work from home/remote with no less than 50% travel. Benefits - Flexible medical, life insurance, and retirement options - Opportunities for community involvement through volunteer programs Company Description Only Oracle brings together the data, infrastructure, applications, and expertise to power everything from industry innovations to life-saving care. And with AI embedded across our products and services, we help customers turn that promise into a better future for all. Discover your potential at a company leading the way in AI and cloud solutions that impact billions of lives. True innovation starts when everyone is empowered to contribute. That’s why we’re committed to growing a workforce that promotes opportunities for all. We’re committed to including people with disabilities at all stages of the employment process. If you require accessibility assistance or accommodation for a disability at any point, let us know by emailing accommodation-request_mb@oracle.com or by calling 1-888-404-2494 in the United States. Oracle is an Equal Employment Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability and protected veterans’ status, or any other characteristic protected by law. Oracle will consider for employment qualified applicants with arrest and conviction records pursuant to applicable law.


