Job Closed

This listing is no longer active.

MediaRadar, Inc. logo
MediaRadar, Inc.

Sales enablement platforms customized for media, and ad tech companies that help you close more deals.

Data Engineer

Data EngineerData EngineerOtherRemoteSeniorTeam 201-500Since 2007H1B No SponsorCompany SiteLinkedIn

Location

United States

Posted

103 days ago

Salary

0

Seniority

Senior

Job Description

Data Engineer

MediaRadar, Inc.

• Involve in Design, development, and maintenance of scalable ETL/ELT pipelines on Azure Databricks using Apache Spark (PySpark/Spark SQL). • Design and implement both batch and real-time data ingestion and transformation processes. • Build and manage Delta Lake tables, schemas, and data models to support efficient querying and analytics. • Consolidate and process large-scale datasets from various structured and semi-structured sources (e.g., JSON, Parquet, Avro). • Write optimized SQL queries for large datasets using Spark SQL and PostgreSQL. • Develop, schedule, and monitor workflows using Databricks Workflows, Airflow or similar orchestration tools. • Design, build, and deploy cloud-native, containerized applications on Azure Kubernetes Service (AKS) and integrate with Azure services. • Ensure data quality, governance, and compliance through validation, documentation, and secure practices. • Collaborate with data analysts, data architects, and business stakeholders to translate requirements into technical solutions. • Contribute to and enforce best practices in data engineering, including version control (Git), CI/CD pipelines, and coding standards. • Continuously enhance data systems for improved performance, reliability, and scalability. • Mentor junior engineers and help evolve team practices and documentation. • Stay up to date on emerging trends, technologies, and best practices in the data engineering space. • Work effectively within an agile, cross-functional project team.

Job Requirements

  • A Bachelor’s degree (or equivalent) in computer science, information technology, engineering, or related discipline.
  • Minimum 5+ years of experience working as a Data Engineering.
  • Minimum 3-5 years of experience in Azure Databricks.
  • Proven experience as a Data Engineer, with a strong focus on Azure Databricks and Apache Spark.
  • Proficiency in Python, PySpark, Spark SQL, and working with large-scale datasets in different data formats.
  • Strong experience designing and building ETL/ELT workflows in both batch and streaming environments.
  • Solid understanding of data lakehouse architectures and Delta Lake.
  • Experience in Azure Kubernetes Service (AKS) is desired.
  • Proficient in SQL and experience with PostgreSQL or similar relational databases.
  • Experience with workflow orchestration tools (e.g., Databricks Workflows, Airflow, Azure Data Factory).
  • Familiarity with data governance, quality control, and security best practices.
  • Strong problem-solving skills and attention to detail.
  • Excellent communication and collaboration skills, with a track record of working cross-functionally.
  • Comfortable working in agile development environments and using tools like Git, CI/CD, and issue trackers (e.g., Jira).

Benefits

  • Medical, Dental & Vision Insurance
  • 401k with Company Match
  • Flexible PTO
  • Commuter Benefits
  • Gym Discounts
  • Summer Fridays

Related Categories

Related Job Pages

More Data Engineer Jobs

Alignment Health logo

Manager, Data Engineering

Alignment Health

Alignment Health is breaking the mold in conventional health care, committed to serving seniors and those who need it most: the chronically ill and frail. It takes an entire team of passionate and caring people, united in our mission to put the senior first. We have built a team of talented and experienced people who are passionate about transforming the lives of the seniors we serve. In this fast-growing company, you will find ample room for growth and innovation alongside the Alignment Health community. Working at Alignment Health provides an opportunity to do work that really matters, not only changing lives but saving them. Together.

Data Engineer103 days ago
OtherRemoteTeam 501-1,000Since 2013H1B No Sponsor

• Translates business requirements into specifications that will be used to implement the required data load (ETL), reports and dashboards. • Gathers business requirements, development and delivery of business intelligence & reporting services and lead end to end BI delivery. • Develops and implements business intelligence, analytics, and dashboards using out-of-box features customizations and visualizations to support organizational initiatives. • Designs, models, develops & optimizes stored procedures to meet data management and data load and reporting objectives. • Designs and models data flows and ETL procedures ensuring data quality and integrity. • Ensures data sets feeding the analytics platforms are tuned for optimal performance. • Works with power users of the analytics/reporting tools to advise on best practices for Business Intelligence reporting. • Troubleshoots and resolves issues with the processes used and the content produced by the BI platform. • Works with business stakeholders to define and improve standardized and ad-hoc analytics/reporting capabilities. • Works as part of the BI team to maintain and develop all components of the BI platform. • Provides ongoing maintenance support through troubleshooting, report modifications and optimization. • Provides input into the technical architecture and the data warehouse technology stack. • Creates functional and technical design documents and maintains documentation for all reports and dashboards created or modified. • Responsibilities include orienting and training employees; assigning workload; planning, monitoring, and appraising job results; and coaching, counseling, and disciplining employees.

California
$130.3K - $195.5K / year
Job Closed
CSCI Consulting logo

SAP Data Migration Architect

CSCI Consulting

Our clients come first. Every single time.

Data Engineer103 days ago
OtherRemoteTeam 201-500H1B Sponsor

• Lead planning and execution of data migration activities from four SAP ECC environments into SAP S/4HANA • Utilize tools such as SNP CrystalBridge (or similar) to perform data extraction, transformation, loading, and reconciliation • Define and implement required data transformation rules to ensure data integrity and alignment with the new ERP design • Collaborate with Functional Process Teams to support readiness activities, validate business requirements, and ensure successful migration outcomes • Participate in multiple integrated test cycles, including mock conversions and validation testing, to confirm migration accuracy • Identify defects, gaps, and inconsistencies between SAP and legacy systems; coordinate resolution with project teams • Support functional data design discussions and technical load processes as required • Provide expert guidance on migration strategy, tools, and best practices • Escalate risks, issues, and decision points to leadership in a timely manner • Provide deployment and post-go-live support to ensure a stable transition to S/4HANA

United States
Job Closed
Five Forty logo

Data Engineer

Five Forty

540 is a forward-thinking company that the government turns to in order to #getshitdone. We don’t just talk about innovation – we deliver it. We break down barriers, build impactful technology, and solve mission-critical problems.

Data Engineer103 days ago

This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more. Role Description 540 is seeking a Data Engineer to join the Advana team supporting the MHS Caduceus program. In this role, you’ll help build and maintain the Financial Management Data Analytics stream supporting the Defense Health Program portfolio. You’ll work hands-on with complex DoD and DHA data to develop scalable data products that provide actionable financial insight. This role focuses on delivering production-ready data capabilities that support mission-critical healthcare and financial decision-making. Location: Remote, with preference for candidates located near Arlington, VA for occasional in-person client meetings Citizenship & Clearance Requirement: per client requirements, candidates must be U.S. Citizens with an active DoD Secret clearance Education Requirement: Bachelor’s Degree 540 Internal Thrive Level: Data Engineer II or III Qualifications - 3+ years of data engineering or related experience - Strong Python experience - Experience engaging with clients and/or stakeholders - Experience building and maintaining data pipelines and ETL processes - Experience working with Databricks or similar modern data platforms - Experience consuming data via APIs - Familiarity with Git-based development workflows - Comfortable working in terminal / command-line environments - Experience with data visualization tools (Tableau or similar) Requirements - AWS cloud experience - Experience working with very large datasets (billions of records) - Experience with Palantir Foundry - Experience building, deploying and managing Tableau dashboards - Experience working with Advana data environments - GitLab experience - Experience working with DoD systems - Experience working with financial systems Benefits - Flexible PTO + all Federal holidays off - Health, dental and vision insurance plans - Flexible Spending Account (FSA) - 401k with employer match - Company-sponsored life insurance, short- and long-term disability - Professional development (training, certifications, conferences) - Paid cloud developer accounts - Referral bonuses - HQ office perks (parking / metro reimbursement, nitro coffee & lunches) - Annual social events (540 Week, hackathon, charity golf tournament, etc.) - Access to 540’s Washington Capitals & Nationals tickets

United States
Job Closed
Fanatics, Inc. logo

Staff Data Engineer

Fanatics, Inc.

We amplify pride and create connections for all fans around the world.

Data Engineer103 days ago
OtherRemoteTeam 1,001-5,000Since 2011H1B No Sponsor

• Design, build, and operate core platform systems, including schema management, streaming frameworks, and event mesh systems. • Define technical standards and patterns for the Streaming Data Platform team. • Lead cross-team design reviews for systems that interact with or depend on the streaming platform. • Drive platform reliability, performance, and cost strategy across streaming services. • Design and implement shared libraries, frameworks, and tooling for stream consumers. • Partner with product and engineering teams to translate requirements into platform capabilities. • Produce technical proposals and documentation that communicate design, trade-offs, and long-term implications. • Serve as an escalation point for complex streaming issues and high-impact incidents. • Sponsor and grow senior engineers through technical mentorship and challenging assignments.

New York
$180.5K - $237.5K / year