Job Closed
This listing is no longer active.
Allstate du Canada, compagnie d’assurance, est une cheffe de file dans le domaine des assurances automobile et habitation; elle offre à ses clients des produits et services de prévention et de protection qui conviennent à toutes les étapes de la vie. Au service des Canadiens depuis 1953, l’entreprise met tout en œuvre pour que non seulement ses clients, mais aussi ses employés soient en bonnes mains, comme en fait foi sa présence au palmarès des Employeurs de choix au Canada pendant neuf années de suite. Allstate du Canada tient à contribuer au mieux-être des communautés dans lesquelles elle exerce ses activités au moyen de partenariats avec des organismes caritatifs et de programmes misant sur la générosité de ses employés.
Senior Data Engineer
Location
Illinois
Posted
5 days ago
Salary
$90.7K - $153.9K / year
Seniority
Senior
Job Description
Senior Data Engineer
Allstate
• Design, build, and maintain scalable batch and streaming data pipelines using Apache Spark and cloud‑native data technologies. • Develop and optimize ETL/ELT workflows to ingest, transform, and curate data from diverse source systems into analytics‑ready datasets. • Implement data modeling and transformation logic to support reporting, dashboards, and downstream analytical and machine learning workloads. • Build and manage data processing workloads within modern lakehouse platforms, including Microsoft Fabric / OneLake (preferred). • Ensure data quality, reliability, and consistency by implementing validation checks, monitoring, and reconciliation processes. • Optimize Spark jobs for performance, cost efficiency, and scalability across large and complex datasets. • Manage and evolve data schemas while handling schema drift and upstream source changes. • Develop reusable frameworks, libraries, and standardized patterns to improve data engineering productivity and consistency. • Implement CI/CD pipelines for data workloads to enable automated testing, deployment, and rollback. • Monitor data pipelines and jobs, troubleshoot failures, and resolve performance or data quality issues. • Partner with analytics engineers, BI developers, and data scientists to understand data requirements and deliver curated datasets. • Collaborate with platform, security, and governance teams to ensure data security, compliance, and proper access controls. • Contribute to Agile delivery processes, including sprint planning, design reviews, and continuous improvement initiatives.
Job Requirements
- Strong experience as a Data Engineer building and operating production data pipelines
- Hands-on experience with Apache Spark for large-scale data processing
- Proficiency in Python, SQL, and data transformation best practices
- Experience with cloud-based data platforms and storage (e.g., Data Lakes, Lakehouse architectures)
- Familiarity with Microsoft Fabric, OneLake, or similar analytics platforms (strong plus)
- Experience designing and optimizing data models for analytical workloads
- Understanding of distributed data processing concepts, performance tuning, and fault tolerance
- Experience with CI/CD, version control, and infrastructure-as-code concepts
- Strong problem-solving skills and ability to troubleshoot complex data issues
- Excellent communication skills and ability to collaborate across technical and non-technical teams
- 4+ years of experience in data engineering or equivalent role (preferred).
Benefits
- comprehensive technology setup, including a laptop, monitors, headset, keyboard, and mouse
- monthly connectivity reimbursement to help offset internet costs
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
• Build and maintain data pipelines across Salesforce, SharePoint, Excel, and operational systems into our StarRocks data warehouse using dbt and Python. • Develop and ship AI agents and copilots using the Claude API (and other LLM tooling) for use cases like lead scoring, account research, call analysis, and internal Q&A over company data. • Design and automate cross-system workflows using Power Automate, Teams Adaptive Cards, and lightweight Python/FastAPI services to replace manual, spreadsheet-driven processes. • Model business data in dbt and Omni — building reusable semantic models, metrics, and dashboards that GTM, RevOps, and leadership rely on. • Enrich and clean prospect and account data using sources like ZoomInfo, LinkedIn Sales Navigator, and public government datasets (e.g., USASpending, SAM.gov, FCC, EIA, FERC, SEC EDGAR). • Prototype and ship internal tools end-to-end — backend (Python/FastAPI), frontend (Vite/React), and storage (PostgreSQL, StarRocks) — for AI-prioritized daily workflows. • Write clear documentation for data models, pipelines, agents, and workflows so the team can extend and maintain them. • Collaborate with GTM, RevOps, Finance, and product teams to translate business questions into data and automation solutions. • Stay current on advances in agentic AI, retrieval, evals, and the modern data stack — and bring useful ideas back to the team.
Senior Staff Specialist, Quality Systems
BD - Becton, Dickinson and CompanyBD - Becton, Dickinson and Company was founded in 1897 with a vision to improve patient outcomes in healthcare. The global medical technology company has grown
Title: Sr. Staff Specialist, Quality Systems Location: San Diego United States Job Description: We are the people who give possibilities purpose BD is one of the largest global medical technology companies in the world. Advancing the world of health is our Purpose, and it's no small feat. It takes the imagination and passion of all of us-from design and engineering to the manufacturing and marketing of our billions of MedTech products per year-to look at the impossible and find transformative solutions that turn dreams into possibilities. Job Description We are the makers of possible BD is one of the largest global medical technology companies in the world. Advancing the world of health is our Purpose, and it's no small feat. It takes the imagination and passion of all of us-from design and engineering to the manufacturing and marketing of our billions of MedTech products per year-to look at the impossible and find transformative solutions that turn dreams into possibilities. We believe that the human element, across our global teams, is what allows us to continually evolve. Join us and discover an environment in which you'll be supported to learn, grow and become your best self. Become a maker of possible with us. Responsibilities: This role must develop strategic quality programs to oversee and foster the following areas and represent QMS expert-level leadership and guidance for teams. - QMS architecture: QMS certificate change notifications; change in scope of activities performed at sites; and site transfers - QMS compliance: front room host for external audits and inspections; QMS expert to prep SMEs for front room; Management Review host; identifying QMS gaps in organizational structure, competency, or technical areas; implementing solutions to close QMS gaps, including but not limited to CAPAs, projects, workshops, and training; authoring CAPA investigations - QMS harmonization activities: MMS lead for Inspire Quality program to harmonize processes with Global expectations and between MMS platforms (including Class I/II medical devices and non-medical devices) - QMS integration activities: QMS impact assessments for integrating acquisitions, platforms, products, sites, etc.; due diligence activities for potential acquisitions Required Qualifications: - A BS degree in a technical field (Engineering, Science, Math/Stat) - Minimum 8 years experience in Quality, Regulatory, or Operations of a Medical Device, IVD, Pharmaceutical or Biotech firm. - Demonstrated expert-level knowledge of QMS. - Ability to travel domestically and internationally, up to 25% - Strong leadership skills with demonstrated ability to deliver excellent results - Strong project management, team skills, and influential management - Experience leading or supporting FDA and/or Notified Body inspections - Excellent communication skills (up, down, and outward) Preferred Qualifications: - Experience in Regulatory Affairs preferred. - Experience in metrics, data analytics, and/or statistical analysis preferred. - ASQ certifications CQE, CSQE, CRE, CMQ/OE, CSSGB and/or CSSBB highly desired. At BD, we prioritize on-site collaboration because we believe it fosters creativity, innovation, and effective problem-solving, which are essential in the fast-paced healthcare industry. For most roles, we require a minimum of 4 days of in-office presence per week to maintain our culture of excellence and ensure smooth operations, while also recognizing the importance of flexibility and work-life balance. Remote or field-based positions will have different workplace arrangements which will be indicated in the job posting. For certain roles at BD, employment is contingent upon the Company's receipt of sufficient proof that you are fully vaccinated against COVID-19. In some locations, testing for COVID-19 may be available and/or required. Consistent with BD's Workplace Accommodations Policy, requests for accommodation will be considered pursuant to applicable law. Why Join Us? A career at BD means being part of a team that values your opinions and contributions and that encourages you to bring your authentic self to work. It's also a place where we help each other be great, we do what's right, we hold each other accountable, and learn and improve every day. To find purpose in the possibilities, we need people who can see the bigger picture, who understand the human story that underpins everything we do. We welcome people with the imagination and drive to help us reinvent the future of health. At BD, you'll discover a culture in which you can learn, grow, and thrive. And find satisfaction in doing your part to make the world a better place. To learn more about BD visit https://bd.com/careers Becton, Dickinson, and Company is an Equal Opportunity Employer. We evaluate applicants without regard to race, color, religion, age, sex, creed, national origin, ancestry, citizenship status, marital or domestic or civil union status, familial status, affectional or sexual orientation, gender identity or expression, genetics, disability, military eligibility or veteran status, and other legally-protected characteristics. Why Join Us? To find purpose in the possibilities, we need people who can see the bigger picture, who understand the human story that underpins everything we do. We welcome people with the imagination and drive to help us reinvent the future of healthcare. At BD, you'll discover a culture in which you can learn, grow and thrive. We believe that when people connect in person, we learn faster, collaborate more deeply, and build a stronger culture. Join us and enjoy a culture where face-to-face collaboration supports your learning, your progress, and your success. To learn more about BD visit https://bd.com/careers. Becton, Dickinson, and Company is an Equal Opportunity Employer. We evaluate applicants without regard to race, color, religion, age, sex, creed, national origin, ancestry, citizenship status, marital or domestic or civil union status, familial status, affectional or sexual orientation, gender identity or expression, genetics, disability, military eligibility or veteran status, and other legally protected characteristics. Required Skills Optional Skills . Primary Work Location USA CA - San Diego TC Bldg C&D Additional Locations Work Shift At BD, we reward, support and develop our associates through our comprehensive Total Rewards program. We are committed to attracting and retaining high quality talent by providing reward and recognition opportunities that promote a performance-based culture, as well as a competitive package of compensation and benefits programs. You can learn more on our career site under "Our Commitment to You." Our salary or hourly rate ranges reward associates fairly and competitively. We regularly review these ranges and factors, such as location, contribute to the range displayed. Our pay is based on the role and the necessary skills and education to perform it successfully. The salary or hourly rate offered is determined by the role's specific requirements, including any applicable step rate pay system at the work location. Salary or hourly pay ranges are influenced by labor laws and Collective Bargaining Agreement (CBA) requirements applicable to the work location which may also affect the workplace arrangement of the role. Salary Range Information $155,900.00 - $257,300.00 USD Annual
- Design, build, and optimize scalable data pipelines to power our AI operational initiatives. - Implement and manage data flows tailored for **agentic workflows** and **LLM interactions**. - Maintain and evolve our data infrastructure, ensuring high data quality and availability. - Partner with the AI team to deploy smart, efficient, and automated solutions.
Senior Manager – Data Engineering
Magna Legal ServicesMagna LS is a litigation consulting and support company providing services from Discovery to Trial.
• Serve as the internal authority on Snowflake architecture, performance tuning, cost governance, and security (RBAC, data masking, network policies). • Design and maintain a scalable, well-documented warehouse structure including database, schema, and object hierarchy standards. • Drive Snowflake feature adoption — dynamic tables, Snowpark, data sharing, and emerging capabilities. • Own the dbt project end-to-end: modeling conventions, testing strategy, documentation standards, and CI/CD integration. • Establish and enforce a layered modeling approach (staging → intermediate → marts) that downstream teams can trust and self-serve. • Lead the design and operation of data pipelines on Azure, including Azure Data Factory • Ensure reliable, monitored data movement from source systems into Snowflake with clear SLAs and alerting. • Manage, mentor, and grow a team of data engineers — running regular 1:1s, setting performance goals, and building a culture of engineering excellence. • Own hiring, onboarding, and career development for the data engineering function. • Translate business requirements from stakeholders into well-scoped, prioritized engineering work. • Define and enforce organization-wide ETL/ELT best practices, naming conventions, and code review standards. • Champion data quality, observability (e.g., dbt tests), and lineage across the platform. • Proactively identify opportunities for data process improvements and lead initiatives to implement these changes.




