Job Closed

This listing is no longer active.

Senior Data Engineer

Data EngineerData EngineerOtherRemoteSeniorTeam 10,001+Since 1931H1B SponsorCompany SiteLinkedIn

Location

Illinois

Posted

84 days ago

Salary

$98.1K - $167.9K / year

Seniority

Senior

Bachelor Degree3 yrs expExperience acceptedEnglishDockerJavaApache KafkaKubernetesNoSQLPythonScalaApache SparkSQL

Job Description

Senior Data Engineer

Allstate

• Design, build, and support high-quality data solutions and pipelines using modern engineering practices and tools. • Partner closely with product managers, software engineers, and data analysts to deliver scalable, reliable data capabilities that power digital products and business insights. • Accountable for the end-to-end lifecycle of data products, from design and implementation through production support, data quality, and performance against key metrics. • Integrate data from diverse sources including APIs, databases, event streams, and third-party systems. • Apply modern engineering practices, including version control, testing, CI/CD, and automated deployments. • Ensure data quality, integrity, and reliability through validation, monitoring, and observability tools. • Optimize data workflows for performance, cost efficiency, and operational resilience. • Document data flows, lineage, and technical components in support of transparency and maintainability.

Job Requirements

  • Strong proficiency with data pipeline development in Python, Java, or Scala.
  • Experience with modern data frameworks (Spark, Kafka, Flink, dbt, or equivalent).
  • Solid understanding of SQL and NoSQL databases and data modeling principles.
  • Ability to optimize SQL, pipelines, and storage for performance and cost.
  • Experience building batch and/or streaming data solutions.
  • Experience using Microsoft Fabric Notebooks to develop, debug, and operationalize data engineering workflows.
  • Experience with containerization and orchestration tools (Docker, Kubernetes).
  • Experience with observability and monitoring tools (Datadog preferred).
  • Ability to work in collaborative, iterative, product-centric team environments.
  • Strong communication and problem-solving skills.
  • 4 year Bachelor's Degree.
  • 3 or more years of experience (Preferred)

Benefits

  • Health insurance
  • 401(k) matching
  • Flexible work arrangements
  • Professional development programs

Related Categories

Related Job Pages

More Data Engineer Jobs

SmartAsset logo

Data Engineer

SmartAsset

An award-winning financial technology company that helps millions of people make smart financial decisions.

Data Engineer84 days ago
Full TimeRemoteTeam 201-500Since 2013H1B No Sponsor

• Architect, design, implement, and operate end-to-end data engineering solutions using Agile methodology. • Develop and manage robust data integrations with external vendors and organizations (including complex API integrations). • Collaborate closely with Data Analysts, Data Scientists, DBAs, and cross-functional teams to understand requirements and deliver high-impact data solutions. • Lead and take ownership of assigned technical projects in a fast-paced environment. • Drive continuous improvement in the quality, security, efficiency, and scalability of our data pipelines and infrastructure.

New York
$135.5K - $200K / year
Job Closed
TEKenable Ltd logo

Senior Data Engineer Consultant – ADF, Microsoft Fabric

TEKenable Ltd

Experts in AI & Data utilising cloud solutions to drive business transformation.

Data Engineer84 days ago
Full TimeRemoteTeam 201-500Since 2002H1B No Sponsor

• We’re hiring a **Senior Data Engineer** to help shape the future of data-driven transformation for our clients. • Collaborate directly with clients to solve complex data challenges, delivering scalable solutions that drive real business value. • Design, develop, and maintain scalable data pipelines while collaborating with data analysts to understand their requirements. • Implement data integration solutions to support various business needs, ensuring data quality and integrity through rigorous testing and validation. • Optimise data systems for both performance and scalability.

Ireland
Brandeis University logo

Temporary Online Course Developer – RITM 145 Data Engineering, Pipelines, and Distributed Information Systems

Brandeis University

Brandeis University is an equal opportunity employer which does not discriminate against any applicant or employee on the basis of race, color, ancestry, religious creed, gender identity and expression, national or ethnic origin, sex, sexual orientation, pregnancy, age, genetic information, disability, caste, military or veteran status or any other category protected by law (also known as membership in a "protected class").

Data Engineer84 days ago
OtherRemoteTeam 501-1,000

Temporary Online Course Developer – RITM 145 Data Engineering, Pipelines, and Distributed Information Systems Location: Remote (U.S.-based only) Division: Rabb School of Continuing Studies, Brandeis University Compensation: $3,000 (Approx. 65 hours over 12 weeks) Brandeis University’s Rabb School of Continuing Studies is seeking a skilled online course developer to design and build a new three credit asynchronous online course titled: RITM 145 Data Engineering, Pipelines, and Distributed Information Systems. This role is for an experienced academic and curriculum strategist to serve as an Online Course Developer within Brandeis Online’s graduate program. The developer will design and build asynchronous, instructor-facilitated online courses aligned with institutional learning outcomes, accreditation standards, and workforce relevance. This course will cover end-to-end data engineering: ingestion, transformation, pipeline orchestration, distributed storage, and scalable analytics foundations. Responsibilities: The development of an online asynchronous course entails the creation and/or selection of elements as outlined in the Brandeis Online Course Standards. Required components include a Brandeis-compliant syllabus, instructor-created materials informed by current industry knowledge, learning objects, and applied assignments and assessments aligned to course and program outcomes. The Developer is responsible for the substantive content and pedagogical strategies of the course and agrees to uphold Brandeis’s academic standards and online course development guidelines. Throughout the design process, the Developer will collaborate with Brandeis Online staff, adhere to technical requirements for LMS integration, and meet project milestones. Course drafts will be submitted at designated intervals for feedback, and final approval will be contingent upon a comprehensive design review by a Learning Designer, and Brandeis Online. Qualifications: - Master’s degree in Data Engineering, Computer Science, Information Systems, Data Science, or a closely related field. - Minimum 3+ years of professional experience in data engineering, data architecture, distributed data systems, or large-scale data processing environments. - Demonstrated expertise in data pipeline development, ETL/ELT workflows, distributed storage systems, and scalable data processing frameworks. - Experience with programming languages and tools commonly used in data engineering (e.g., Python, SQL, Spark, Kafka, Airflow, or similar technologies). - At least 1 year of teaching or training experience (preferably online/asynchronous). - Minimum 1 year experience developing asynchronous online courses for adult learners in higher education. - Proficiency with LMS platforms and digital authoring tools. - Familiarity with analytical tools, collaborative platforms, and interdisciplinary teamwork. - Strong communication, organization, and independent work skills. - Familiarity with curriculum design, accreditation standards, and graduate-level rigor. - Ability to translate interdisciplinary content into engaging, accessible learning pathways. - Strong writing and editing skills to produce cohesive, learner-centered experiences. Preferred Experience: - Doctorate (PhD or DBA) in Data Engineering, Computer Science, Information Systems, Data Science, or related field. - 5+ years of experience in enterprise data architecture, large-scale data platform engineering, or analytics infrastructure leadership. - Professional experience as a Data Architect, Data Engineering Lead, Analytics Platform Engineer, or Distributed Systems Architect. - Industry certifications such as Google Professional Data Engineer, AWS Data Analytics Specialty, Azure Data Engineer Associate, or equivalent. - Experience teaching or developing graduate-level online courses. - Knowledge of global learner personas and culturally responsive pedagogy. - Familiarity with Moodle LMS and digital authoring tools (e.e., H5P). - Familiarity with experiential learning models and employer-aligned curriculum. Additional Details: - Fully remote (U.S.-based applicants only; no visa sponsorship). - 12-week development timeline (~65 total hours). - Compensation: $3000.00. Pay Range Disclosure The University's pay ranges represent a good faith estimate of what Brandeis reasonably expects to pay for a position at the time of posting. The pay offered to a selected candidate during hiring will be based on factors such as (but not limited to) the scope and responsibilities of the position, the candidate's work experience and education/training, internal peer equity, and applicable legal requirements. Equal Opportunity Statement Brandeis University is an equal opportunity employer which does not discriminate against any applicant or employee on the basis of race, color, ancestry, religious creed, gender identity and expression, national or ethnic origin, sex, sexual orientation, pregnancy, age, genetic information, disability, caste, military or veteran status or any other category protected by law (also known as membership in a "protected class").

United States

Analytics Architect

Accenture

Accenture Federal Services, a division of Accenture, provides technology and consulting services to U.S. federal agencies, delivering solutions that enhance per

Data Engineer84 days ago

At Accenture Federal Services, nothing matters more than helping the US federal government make the nation stronger and safer and life better for people. Our 13,000+ people are united in a shared purpose to pursue the limitless potential of technology and ingenuity for clients across defense, national security, public safety, civilian, and military health organizations. Join Accenture Federal Services, a technology company within global Accenture. Recognized as a Glassdoor Top 100 Best Place to Work, we offer a collaborative and caring community where you feel like you belong and are empowered to grow, learn and thrive through hands-on experience, certifications, industry training and more. Join us to drive positive, lasting change that moves missions and the government forward! The work: - Key Responsibilities: - Architect and design databases, applications, and backend services - Develop and secure internal APIs, ETL processes, and integrations with external APIs - Lead DevOps processes, including build and release pipelines - Ensure robust data security across authentication, authorization, and access control layers - Apply data science expertise to guide model selection, implementation tradeoffs, and AI integration - Produce clear and comprehensive technical documentation - Communicate architectural decisions and rationale to client stakeholders and IT leadership - Deliver end‑to‑end solutions from design through deployment - Here is what you need: - Experience with Dataverse and/or Power Platform - Experience with API/ETL development using Power Automate, Python, and /or Azure Data Factory - Security experience with roles, API authentication, and/or Entra ID - Experience with Analytics and AI tools (AI Builder, Azure OpenAI, and/or Azure AI Search) - CI/CD expertise in Azure DevOps - Understanding of data science fundamentals - Secret clearance required - US Citizenship Preferred experience: - Background in delivering full solutions within consulting or client‑facing environments - Familiarity with broader Power Platform solution design and lifecycle management ***This role is fully remote within Contiguous US*** As required by local law, Accenture Federal Services provides reasonable ranges of compensation for hired roles based on labor costs in the states of California, Colorado, Hawaii, Illinois, Maryland, Massachusetts, Minnesota, New Jersey, New York, Washington, Vermont, the District of Columbia, and the city of Cleveland. The base pay range for this position in these locations is shown below. Compensation for roles at Accenture Federal Services varies depending on a wide array of factors, including but not limited to office location, role, skill set, and level of experience. Accenture Federal Services offers a wide variety of benefits. You can find more information on benefits here. We accept applications on an on-going basis and there is no fixed deadline to apply. The pay range for the states of California, Colorado, Hawaii, Illinois, Maryland, Massachusetts, Minnesota, New Jersey, New York, Washington, Vermont, the District of Columbia, and the city of Cleveland is: $100,200—$203,400 USD What We Believe As a company wholly dedicated to serving the US federal government, we bring together the best talent to help reinvent how federal agencies operate and deliver greater value for their mission and the American people. We have an unwavering commitment to creating a culture in which all our people are respected, feel a sense of belonging, and have equal opportunity. As a business imperative, every person at Accenture Federal Services has the responsibility to create and sustain a culture where everyone feels welcomed and included. This is grounded in our core values and our experience that hiring and developing great people who reflect different perspectives, experiences, and backgrounds is key to driving innovation and delivering the results that our clients and the country count on. Equal Employment Opportunity Statement We believe that no one should be discriminated against because of their differences. All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by federal, state, or local law. Our rich diversity makes us more innovative, more competitive, and more creative, which helps us better serve our clients and our communities. For details, view a copy of the Accenture Federal Services Equal Opportunity Policy Statement. Accenture Federal Services is an Equal Employment Opportunity employer. Additionally, as an Affirmative Action Employer for Veterans and Individuals with Disabilities, Accenture Federal Services is committed to providing veteran employment opportunities to our service men and women. Requesting An Accommodation Accenture Federal Services is committed to providing equal employment opportunities for persons with disabilities or religious observances, including reasonable accommodation when needed. If you are hired by Accenture Federal Services and require accommodation to perform the essential functions of your role, you will be asked to participate in our reasonable accommodation process. Accommodations made to facilitate the recruiting process are not a guarantee of future or continued accommodations once hired. If you are being considered for employment opportunities with Accenture Federal Services and need an accommodation for a disability or religious observance during the interview process or for the job you are interviewing for, please speak with your recruiter. Other Employment Statements Applicants for employment in the US must have work authorization that does not now or in the future require sponsorship of a visa for employment authorization in the United States. Candidates who are currently employed by a client of Accenture Federal Services or an affiliated Accenture business may not be eligible for consideration. Job candidates will not be obligated to disclose sealed or expunged records of conviction or arrest as part of the hiring process. The Company will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. Additionally, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with the Company's legal duty to furnish information. California requires additional notifications for applicants and employees. If you are a California resident, live in or plan to work from Los Angeles County upon being hired for this position, please click here for additional important information.

United States
$100K - $203K / year
Job Closed