Job Closed
This listing is no longer active.
Delivering practical solutions to solve complex challenges with an eye on maximizing customers' current IT investments
Lead Microsoft Data Engineer
Location
United States
Posted
89 days ago
Salary
$135K - $160K / year
Seniority
Lead
Job Description
Lead Microsoft Data Engineer
Procentrix, LLC
Role Description The Lead Azure Data Engineer is responsible for migration, governance, and data integration for the implementation of new Microsoft Cloud based document routing and task management system. They will ensure alignment with the technical, security, and document management requirements such as: - Leading data discovery and mapping - Validating metadata standards - Managing data migration into Dataverse and SharePoint Online - Ensuring proper implementation of retention, auditability, and role-based access controls within the Microsoft SaaS architecture Qualifications - A minimum of 6 years IT experience with focus on data integration and data migration using Azure Data Services - Must have strong experience designing data models, configuring Dataverse tables, managing relationships, enforcing row- and field-level security, and supporting workflow-driven data structures - Knowledge of SharePoint Online document libraries, metadata schemas, retention labels, records management, and large-volume document storage design - Proficiency in data mapping, transformation, validation, and migration using APIs, Azure services, Power Automate, and REST-based integrations - Experience with Azure data services (e.g., Azure Data Factory, Azure SQL, Azure AI Search, Azure storage components) in FedRAMP-aligned environments - Understanding of producing audit logging, identity integration (Entra ID), and support for records retention and legal hold requirements - Ability to structure data for Power BI dashboards, performance reporting, and AI-enabled search and discovery - Establishing metadata standards, validation rules, lifecycle controls, and ensuring data accuracy and consistency across enterprise workflows - Bachelors degree or equivalent - Must be a US Citizen Requirements - Microsoft Azure data services certifications - Active Federal Government Public Trust clearance Benefits The projected compensation range for this position is $135K - $160K annualized (USD). The final salary offered will generally fall within this range and is determined by various factors, including but not limited to the individual's particular combination of education, knowledge, skills, competencies, and experience, as well as internal pay equity, location, contract-specific affordability and other organizational requirements.
Job Requirements
- A minimum of 6 years IT experience with focus on data integration and data migration using Azure Data Services
- Must have strong experience designing data models, configuring Dataverse tables, managing relationships, enforcing row- and field-level security, and supporting workflow-driven data structures
- Knowledge of SharePoint Online document libraries, metadata schemas, retention labels, records management, and large-volume document storage design
- Proficiency in data mapping, transformation, validation, and migration using APIs, Azure services, Power Automate, and REST-based integrations
- Experience with Azure data services (e.g., Azure Data Factory, Azure SQL, Azure AI Search, Azure storage components) in FedRAMP-aligned environments
- Understanding of producing audit logging, identity integration (Entra ID), and support for records retention and legal hold requirements
- Ability to structure data for Power BI dashboards, performance reporting, and AI-enabled search and discovery
- Establishing metadata standards, validation rules, lifecycle controls, and ensuring data accuracy and consistency across enterprise workflows
- Bachelors degree or equivalent
- Must be a US Citizen
- Microsoft Azure data services certifications
- Active Federal Government Public Trust clearance
Benefits
- The projected compensation range for this position is $135K - $160K annualized (USD). The final salary offered will generally fall within this range and is determined by various factors, including but not limited to the individual's particular combination of education, knowledge, skills, competencies, and experience, as well as internal pay equity, location, contract-specific affordability and other organizational requirements.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
• Support enterprise data platform initiatives • Manage and implement changes across enterprise data environments including Azure Synapse and Databricks • Support ETL processes, data pipelines, and API connectivity • Ensure data consistency, quality, and accessibility • Develop and maintain scalable data pipelines and integration services • Collaborate with data architects, analysts, and business stakeholders to support data integration and master data initiatives.
• Support the design, discovery, and implementation of enterprise data platforms that enable advanced analytics and operational workflows. • Lead the development of a centralized data storefront and enterprise analytics ecosystem. • Integrate enterprise data into operational workflows. • Develop and maintain scalable data architectures, pipelines, and data integration frameworks. • Integrate multiple structured and unstructured data sources from enterprise systems, operational databases, and external platforms. • Ensure data architectures support data governance, lineage, quality monitoring, and enterprise data management standards. • Lead technical discovery sessions with mission and business stakeholders to identify data sources, use cases, and operational requirements. • Develop analytics dashboards, operational insights, and data products supporting leadership decision-making. • Provide technical leadership in data architecture design and integration strategies.
• Design, build, and maintain scalable batch and streaming data pipelines supporting enterprise analytics, reporting, and downstream consumption • Develop and optimize data ingestion, transformation, and orchestration workflows across structured and semi‑structured data sources • Engineer and maintain curated, analytics‑ready data models (e.g., dimensional, canonical, or domain‑oriented datasets) • Ensure data solutions meet performance, reliability, availability, and recoverability expectations • Implement data solutions aligned to Penn Mutual’s cloud data platform strategy, including cloud storage, compute, and analytics services • Apply data architecture patterns that support data lakes, lake houses, and analytical warehouses • Partner with Enterprise Architecture to ensure data solutions conform to technology standards, integration patterns, and security requirements • Contribute to platform evolution decisions, including tooling selection, architectural patterns, and modernization initiatives • Embed data quality checks, validation rules, and observability into pipelines to ensure trusted data • Support data governance and stewardship practices, including metadata management, lineage, and controlled data access • Ensure data solutions comply with security, privacy, and regulatory requirements relevant to financial services and insurance • Collaborate with analytics, reporting, and data science teams to enable self‑service analytics and advanced insights • Translate business requirements into well‑designed data structures and datasets that are easy to consume and reuse • Support downstream use cases including dashboards, regulatory reporting, operational analytics, and advanced modeling • Serve as a technical leader and subject‑matter expert for data engineering practices across the organization • Mentor junior and mid‑level data engineers through design reviews, code reviews, and knowledge sharing • Promote engineering best practices including version control, automated testing, CI/CD, and documentation • Drive continuous improvement through evaluation of emerging data technologies and industry trends.
Senior Data Engineer
CareforthFounded in Boston, Careforth's caregiver programs and services improve health outcomes, keeping care at home longer. Additionally, our programs provide financial benefit to caregivers and cost savings to state agencies and health plans. At Careforth, we understand the challenges of caregiving and are committed to supporting family caregivers at every turn. Caregivers play a critical role in the future of healthcare—and so can you.
About Us A pioneer in the caregiving space, Careforth supports family caregivers across the United States to confidently care for their loved ones at home. Through a combination of in-person home visits, remote coaching and our proprietary digital collaboration app, we provide caregivers with support, guidance, confidence, and connection to resources they need. The Caregivers and families we support stay with Careforth for many years, building lasting relationships along the way. Join us today and live our values: lead with heart, cultivate trust, go beyond. Position Summary This individual will contribute to the evolution of the enterprise DataHub/Delta Lake architecture, driving best practices in cloud-native, Spark-based data engineering. The ideal candidate has hands-on expertise with Databricks, AWS Cloud services, and Apache Spark (Python/Scala), and can serve as both a technical leader and mentor for junior engineers. What You Will Do - Architect and build robust, scalable, and secure data pipelines leveraging Databricks, Apache Spark, and AWS Cloud (EMR, Redshift, S3, Glue, Lambda). - Participate and represent the data team in critical design discussions with technical leads across various product lines. - Collaborate closely with application developers, product managers, and business analysts to translate requirements into data models, ETL/ELT workflows, and analytics-ready datasets. - Conduct pull request reviews and enforce engineering excellence in code quality, testing, and performance optimization. - Troubleshoot and optimize production data workflows while ensuring observability, resilience, and cost-efficiency at scale. - Research, evaluate, and apply emerging tools and technologies to continuously modernize the data engineering ecosystem. - Act as a mentor to junior engineers, fostering a culture of collaboration, innovation, and continuous learning. What You Will Bring - Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field. - 7–10 years of professional data engineering experience, including at least 3+ years with modern cloud-based data lake architectures. - Deep expertise in Apache Spark (PySpark, Scala, or Java) for large-scale distributed data processing. - Strong experience with Databricks for collaborative data engineering and advanced analytics. - Hands-on experience with AWS services including EMR, Redshift, S3, Glue, Lambda, IAM, and related cloud-native data tools. - Proficiency in Python (preferred) as well as Java or Scala. - Strong understanding of data modeling, data pipelines, and workflow orchestration (Airflow, Step Functions, or similar). - NOGO experience - Solid foundation in algorithms, data structures, and software engineering best practices. - Excellent communication skills and a proven ability to work cross-functionally with product and engineering teams. - *******Please note the interview process may entail an onsite finalist interview in Boston, MA. You'll Benefit From At Careforth your well-being matters. With flexible schedules, a remote-first culture, and a nationally recognized wellness program, our benefits are designed to help you thrive, both professionally and personally. Discover how we invest in you: https://careforth.com/careers/#benefits The pay range for this position is $125K - $185K. The actual wage offered may be lower or higher depending on budget and candidate experience, knowledge, skills, qualifications, and geographic location. #LI-Remote (exceptions NYC, CA, and CO) Join Our Award Winning Team Founded in Boston, Careforth's caregiver programs and services improve health outcomes, keeping care at home longer. Additionally, our programs provide financial benefit to caregivers and cost savings to state agencies and health plans. At Careforth, we understand the challenges of caregiving and are committed to supporting family caregivers at every turn. Caregivers play a critical role in the future of healthcare—and so can you. Apply now! For more information, please visit www.Careforth.com. Careforth is an Equal Opportunity Employer* DISCLAIMER: Please note this job description is not designed to cover or contain a comprehensive listing of activities, duties or responsibilities that are required of the employee for this job. *Careforth supports families with diverse backgrounds and as an equal opportunity employer, we seek employees who reflect the diverse population we serve. Careforth complies with all applicable laws concerning hiring and employment practices and is firmly committed to fostering and maintaining a workplace free from discrimination. We pledge to hire, train, and promote our employees without regard to race, religion, gender, gender identity, genetic information, age, national origin, sexual orientation, disability, veteran status, or any other category protected by applicable law. Careforth strives to create experiences that are accessible and welcoming to everyone, including making www.careforth.com and the careers site accessible to any and all users. If you would like to contact us regarding the company’s diversity, equity and inclusion initiatives, inquire about a specific accessibility need or the accessibility of our website, or if you need assistance completing an application process, please contact People & Culture at 866-797-2333.



