Experian

We're unlocking the power of data to help create a better tomorrow.

Senior Data Engineer

Data EngineerData EngineerFull TimeRemoteSeniorTeam 10,001+Since 1996H1B SponsorCompany SiteLinkedIn

Location

Brazil

Posted

161 days ago

Salary

0

Seniority

Senior

Job Description

Senior Data Engineer

Experian

• Will work in a squad, actively participating in ceremonies, discussions, supporting decision-making and resolving conflicts • Responsible for ensuring the quality and security of delivered software • Communicate designs in a way that team members can understand • Integrate the system with new or modified software components

Job Requirements

  • Experience with Scala and Python programming languages
  • Experience with data pipeline and big data architectures (Kappa and Lambda)
  • Experience with the AWS data stack (e.g., Amazon Athena, EMR, Glue, S3, EC2 and AWS Lake Formation)
  • Experience with relational databases (e.g., Aurora, RDS, Redshift) and non-relational databases (e.g., ElastiCache, DocumentDB, Keyspaces)
  • Experience with version control using Git
  • Experience with messaging/queueing systems (Kafka and SQS)
  • Experience with automated testing
  • Experience with CI/CD (Jenkins)
  • Familiarity with containerization (Docker, Kubernetes)
  • Familiarity with monitoring tools (Grafana, Kibana, Graylog)
  • Experience with agile methodologies such as Scrum and Kanban
  • Familiarity with Clean Code and S.O.L.I.D. development principles
  • Good written and verbal communication skills.

Benefits

  • Health plan
  • Opportunities for professional development
  • Inclusive culture

Related Categories

Related Job Pages

More Data Engineer Jobs

OtherRemoteTeam 5,001-10,000Since 1902H1B No Sponsor

• Engineering and designing secure, scalable solutions that span sensors to cloud • Collaborating with clients and sales teams to enable IT/OT Convergence Solutions • Proposing secure solutions including Digital Infrastructure and Cybersecurity • Delivering operational impact through proof-of-concepts • Facilitating quality handovers to internal execution teams • Identifying process improvements and emerging technology trends

United States
$120K - $150K / year
Job Closed
Software Mind logo

Senior Data Engineer, Azure

Software Mind

Software House focused on results since 1999

Data Engineer161 days ago
Full TimeRemoteTeam 1,001-5,000Since 1999H1B No Sponsor

• Develop reusable, metadata-driven data pipelines • Automate and optimize any data platform related processes • Build integrations with data sources and data consumers • Add data transformation methods to shared ETL libraries • Write unit tests • Develop solutions for the Databricks data platform monitoring • Proactively resolve any performance or quality issues in ETL processes • Cooperate with infrastructure engineering team to set up cloud resources • Contribute to data platform wiki / documentation • Perform code reviews and ensures code quality • Initiate and implements improvements to the data platform architecture

Poland
Job Closed
Leidos logo

Data Architecture, Governance Intern

Leidos

Leidos is an innovation company rapidly addressing the world’s most vexing challenges in national security and health.

Data Engineer161 days ago
OtherRemoteTeam 10,001+Since 1969H1B Sponsor

• Supporting data modeling and data product teams with documentation, metadata enrichment, and asset organization • Assisting with data governance activities, including business glossary management, data domain alignment, and stewardship workflows • Building Collibra content and business community views • Helping synchronize the Collibra DEV environment to make it closer to production (views, glossary terms, and data assets) to support testing and development • Creating and updating standard operating procedures (SOPs) and training materials, including short how-to guides and videos • Writing and validating Snowflake SQL queries to support data quality checks, analysis, and governance use cases • Assisting with data quality initiatives, including profiling, rule definition, and issue tracking • Collaborating with engineers and data scientists to build one or two simple APIs or data integrations • Participating in team meetings, design discussions, and governance forums to gain exposure to enterprise data decision-making

United States
$40.3K - $72.9K / year
Job Closed

Data Architect

Independence Pet Holdings - IPH

Independence Pet Holdings (IPH) is a company focused on providing exceptional pet care products and services. The company fosters a culture of innovation and co

Data Engineer161 days ago

Established in 2021, Independence Pet Holdings is a corporate holding company that manages a diverse and broad portfolio of modern pet health brands and services, including insurance, pet education, lost recovery services, and more throughout North America. We believe pet insurance is more than a financial product and build solutions to simplify the pet parenting journey and help improve the well-being of pets. As a leading authority in the pet category, we operate with a full stack of resources, capital, and services to support pet parents. Our multi-brand and omni-channel approach include our own insurance carrier, insurance brands and partner brands. Clarus is a pioneering pet health technology company on a mission to transform the future of pet healthcare. We are dynamic entrepreneurs improving pet health by providing trusted and transparent information across the entire pet health landscape. Join us in shaping a smarter, healthier future for pets everywhere. As we expand, we are looking for a seasoned Data Architect , in the data team, who can hit the ground running by building data models across the operational and analytics data store. This role will be reporting to the Senior Director of Data and Analytics. Role Overview This is a hands-on role for an experienced Data Architect with a proven track record of implementing a scalable data lake/medallion architecture and building robust data models in partnership with our product and engineering teams. The role is focused on designing and implementing scalable data solutions using Azure Databricks, acting as a subject matter expert in the platform to create efficient data pipelines, manage data lakes, and ensure data quality while leveraging the full capabilities of the Azure cloud ecosystem. Key Responsibilities: Design and implement data architecture solutions using Databricks, Spark, and Azure data services. Develop and optimize data models for both operational and analytical systems. Ensure data integrity, security, and accessibility across various platforms. Integrate data pipelines with event-based and microservice architectures leveraging Service Bus, Event Hub, and Functions. Create and maintain data standards, guidelines, and best practices. Conduct data quality assessments and implement data governance policies. Provide guidance on data storage solutions and ELT/ETL processes. Collaborate with developers, analysts, and data scientists to deliver trusted datasets for reporting, analytics, and machine learning use cases. Participate in architecture discussions, backlog refinement, estimation, and sprint planning. Contribute to defining and maintaining best practices, coding standards, and quality guidelines for data engineering. Perform code reviews, provide technical mentorship, and foster knowledge sharing within the team. Continuously evaluate and enhance data engineering tools, frameworks, and processes in the Azure environment. Qualifications: Company paid short-term and long-term disability 12 weeks of 100% paid Parental Leave Health Savings Account (HSA) Flexible Spending Accounts (FSA) Retirement savings plan Personal Paid Time Off Paid holidays and company-wide Wellness Day off Paid time off to volunteer at nonprofit organizations Pet friendly office environment Commuter Benefits Group Pet Insurance On the job training and skills development Employee Assistance Program (EAP)

Massachusetts
Job Closed