Job Closed
This listing is no longer active.
Scratch Financial is the world's simplest patient financing solution.
Senior Staff Data Engineer
Location
New York
Posted
42 days ago
Salary
$150K - $185K / year
Seniority
Senior
Job Description
Senior Staff Data Engineer
Scratch Financial
Company Description NBCUniversal is one of the world's leading media and entertainment companies. We create world-class content, which we distribute across our portfolio of film, television, and streaming, and bring to life through our global theme park destinations, consumer products, and experiences. We own and operate leading entertainment and news brands, including NBC, NBC News, NBC Sports, Telemundo, NBC Local Stations, Bravo, and Peacock, our premium ad-supported streaming service. We produce and distribute premier filmed entertainment and programming through our powerhouse film and television studios, including Universal Pictures, DreamWorks Animation, and Focus Features, and the four global television studios under the Universal Studio Group banner, and operate industry-leading theme parks and experiences around the world through Universal Destinations & Experiences, including Universal Orlando Resort, home to Universal Epic Universe, and Universal Studios Hollywood. NBCUniversal is a subsidiary of Comcast Corporation. Visit www.nbcuniversal.com for more information. Our impact is rooted in improving the communities where our employees, customers, and audiences live and work. We have a rich tradition of giving back and ensuring our employees have the opportunity to serve their communities. We champion an inclusive culture and strive to attract and develop a talented workforce to create and deliver a wide range of content reflecting our world. Job Description The Data Management and BI Team is seeking a Sr. Staff Data Engineer to join our team. We build data pipelines to land, profile, and store multiple internal & external datasets. We also build applications that surface this data to support our business partners' strategic decision-making. We're an AWS shop that uses open-source technologies including Scala, Python, Pandas, Spark, Hive, and Postgres as well as BI tools, such as Tableau and MicroStrategy. We work in a very agile environment, where product specifications are flexible and often change rapidly over time. We're seeking people who are comfortable with ambiguity, can drive towards clarity, and define execution plans. While the key focus for this role is on backend engineering, engineers who have full-stack expertise will be especially considered. Responsibilities: - Designs, builds, and oversees the deployment and operation of technology architecture, solutions and software to capture, manage, store, and utilize structured and unstructured data from internal and external sources - Contributor to the overall Data Product roadmap by working closely with our business partners to understand their challenges and develop analytical tools to help drive business decisions - Develops technical tools and programming that leverage artificial intelligence, machine learning, and big-data techniques to cleanse, organize and transform data and to maintain, defend and update data structures and integrity on an automated basis - Leverage prototyping methodologies to propose and design creative business solutions that exploit our broad toolset of technologies (Big Data, MicroStrategy, Tableau, Python, Spark etc). - Creates and establishes design standards and assurance processes for software, systems, and applications development to ensure compatibility and operability of data connections, flow,s and storage requirements. - Reviews internal and external business and product requirements for data operations and activity and suggests changes and upgrades to systems and storage to accommodate ongoing needs. - Design, develop, and maintain CI/CD pipelines using GitHub Actions to automate deployment, testing, and monitoring of applications. - Implement and manage serverless solutions (e.g., AWS Lambda, EMR Serverless, Kafka, SNS, SQS, Athena etc.) as part of the application architecture. - Implement infrastructure as code (IaC) practices using tools like Terraform, AWS CloudFormation, or similar to manage cloud infrastructure. - Work with development teams to set up automated testing frameworks, ensuring high test coverage and code quality. - Must understand the basics of relational data modeling and be able to clearly articulate the reasons for using to non-relational systems in our architecture. Experience in desired but relevant experience in any of the following is acceptable: Singlestore, MySQL, Redshift, Athena, MSSQL Server, Oracle. - Decent understanding for the digital media ad sales business and ad serving technologies with experience working with ad serving transactional data logs or Nielsen demographic data. - Educate and inform business partners on architecture, capabilities, best practices and solutions to build out future enhancements - Assist in analyzing business requirements, source systems, understand underlying data sources, transformation requirements, data mapping, data model and metadata for reporting solutions - Writing easily understood documentation and architecture diagrams and keeping them up to date as code and frameworks change over time. Qualifications - Strong Computer Science/Engineering/Information Systems background - 10+ Years of Experience in Data Modeling, Data architecture, Data Quality, Metadata, ETL, and Data Warehouse methodologies and technologies. - 5+ years experience with AWS technologies. - Strong experience using Python and Pandas in an AWS Lambda framework is highly desired. Experience using EMR and/or DataBricks or the ability to read EMR code and translate it into Lambdas. - Proven experience (3+ years) in designing and managing CI/CD pipelines, specifically using GitHub Actions. - Demonstrated experience with Python, APIs, Spark, and Scala. - Experience with with advanced SQL, Linux, MicroStrategy, Tableau, and Pandas. - Strong problem-solving skills. - Strong oral and written communication and influencing skills, with the ability to communicate new concepts and drive change in processes and behaviors and to communicate complex technical topics to management and non-technical audiences. - Bachelor's degree in Engineering, Computer Science, Information Systems or related field with 10+ years of relevant experience. Desired Characteristics: - 1+ years in Digital Media Publisher Industry with a solid understanding of Digital Research - Experience with various digital platforms such as Omniture (Site Catalyst), Rentrak, comScore, Operative One, Google DoubleClick, Freewheel, Ad-Juster, MOAT, Nielsen, Facebook, Twitter, etc - Understanding of how to manage code in the Enterprise Git repository with appropriate branching and documentation skills - Ability to design optimized, performant, and visually appealing reports, user interfaces, mockups, and documentation - Ability to read external API documentation and write pipelines to extract data from our partners' systems - Ability to write and stand up internal API endpoints to share data with other internal teams. - Strong analytical focus, results-oriented, and execution driven. - Ability and desire to work within a cross-functional team environment with people from multiple business units, vendors, countries, and cultures. - Self-driven/self-initiator and resourceful to achieve goals independently as well as in teams and promotes an open flow of information so that all stakeholders are well informed. - Flexibility to adjust to changing requirements, schedules, and priorities. - Ability to work independently under minimum supervision and be proactive in solving issues - Energetic, committed, and solution-focused with the ability to perform under pressure and meet targets Additional Requirements: - Fully Remote: This position has been designated as fully remote, meaning that the position is expected to contribute from a non-NBCUniversal worksite, most commonly an employee's residence. This position is eligible for company sponsored benefits, including medical, dental and vision insurance, 401(k), paid leave, tuition reimbursement, and a variety of other discounts and perks. Learn more about the benefits offered by NBCUniversal by visiting the Benefits page of the Careers website. Salary range: $150,000 - $185,000 (bonus eligible) We are accepting applications for this position on an ongoing basis. Additional Information As part of our selection process, external candidates may be required to attend an in-person interview with an NBCUniversal employee at one of our locations prior to a hiring decision. NBCUniversal's policy is to provide equal employment opportunities to all applicants and employees without regard to race, color, religion, creed, gender, gender identity or expression, age, national origin or ancestry, citizenship, disability, sexual orientation, marital status, pregnancy, veteran status, membership in the uniformed services, genetic information, or any other basis protected by applicable law. If you are a qualified individual with a disability or a disabled veteran, you have the right to request a reasonable accommodation if you are unable or limited in your ability to use or access nbcunicareers.com as a result of your disability. You can request reasonable accommodations by emailing AccessibilitySupport@nbcuni.com. For LA County and City Residents Only: NBCUniversal will consider for employment qualified applicants with criminal histories, or arrest or conviction records, in a manner consistent with relevant legal requirements, including the City of Los Angeles' Fair Chance Initiative For Hiring Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act, where applicable.
Benefits
- 401(K), 401(K) matching, Adoption Assistance, Childcare benefits, Commuter benefits, Company equity, Company-sponsored outings, Company sponsored family events, Continuing education stipend, Customized development tracks, Dental insurance, Disability insurance, Volunteer in local community, Employee stock purchase plan, Family medical leave, Fitness stipend, Flexible Spending Account (FSA), Generous parental leave, Generous PTO, Health insurance, Job training & conferences, Open door policy, Life insurance, Charitable contribution matching, Mentorship program, Paid volunteer time, Online course subscriptions available, Onsite gym, Open office floor plan, Paid holidays, Paid industry certifications, Pair programming, Paid sick days, Onsite office parking, Partners with nonprofits, Performance bonus, Pet insurance, Promote from within, Recreational clubs, Lunch and learns, Relocation assistance, Return-to-work program post parental leave, Team based strategic planning, OKR operational model, Team workouts, Continuing education available during work hours, Tuition reimbursement, Vision insurance, Wellness programs, Mental health benefits, Fertility benefits, Personal development training
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Senior Lead Trading Strategist
DraftKings Inc.Defining what it means to build and deliver the most extraordinary sports & entertainment experiences.The Crown is Yours
At DraftKings, AI is becoming an integral part of both our present and future, powering how work gets done today, guiding smarter decisions, and sparking bold ideas. It's transforming how we enhance customer experiences, streamline operations, and unlock new possibilities. Our teams are energized by innovation and readily embrace emerging technology. We're not waiting for the future to arrive. We're shaping it, one bold step at a time. To those who see AI as a driver of progress, come build the future together. The Crown Is Yours As a Senior Lead Trading Strategist, you'll define and evolve the systems that power real-time market-making and automated trading at scale. You'll operate at the intersection of quantitative research and production engineering, translating complex market behavior into high-performance trading strategies. Working across teams, you'll lead the design and development of low-latency systems that price markets, manage risk, and react to high-frequency events. Your work will shape how markets behave, driving innovation and unlocking new opportunities through data-driven strategy and technical leadership. What you'll do as a Senior Lead Trading Strategist - Lead the design, implementation, and continuous refinement of market-making and trading strategies informed by market microstructure, participant behavior, and risk constraints. - Translate quantitative research and hypotheses into scalable, production-grade trading systems in close partnership with Engineers, Data Scientists, and fellow Strategists. - Architect and evolve backtesting frameworks that accurately model execution, liquidity dynamics, and behavioral responses. - Develop and oversee real-time decision engines that price markets, optimize inventory, and react to high-frequency event streams. - Set technical direction for trading systems, ensuring scalability, performance, and reliability in production environments. - Contribute on monitoring, alerting, and observability standards for live systems, enabling rapid diagnosis and resolution of anomalies. - Communicate strategy vision, system behavior, and business impact clearly to technical and non-technical stakeholders, influencing decision-making across teams. What you'll bring - At least 7 years of experience in machine learning, quantitative modeling, or algorithmic strategy development. - Strong proficiency in Python (including NumPy, Pandas, and PyTorch) and experience with C++, C#, Java, or Rust for performance-critical systems. - Deep expertise in market making, market microstructure, liquidity modeling, and risk-aware optimization. - Strong foundation in statistical and probabilistic modeling, including time-series analysis and signal evaluation. - Experience working with automated trading systems, prediction markets, sports betting, or crypto and decentralized finance environments. - Strong leadership and communication skills, with a demonstrated ability to lead complex technical initiatives and influence cross-functional teams. Join Our Team We're a publicly traded (NASDAQ: DKNG) technology company headquartered in Boston. As a regulated gaming company, you may be required to obtain a gaming license issued by the appropriate state agency as a condition of employment. Don't worry, we'll guide you through the process if this is relevant to your role. The US base salary range for this full-time position is 184,000.00 USD - 230,000.00 USD, plus bonus, equity, and benefits as applicable. Our ranges are determined by role, level, and location. The compensation information displayed on each job posting reflects the range for new hire pay rates for the position across all US locations. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific pay range and how that was determined during the hiring process. It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.
Data Engineer
BJAKBjak is a technology company focused on making financial services easy, fun and more rewarding for everyone
About BJAK BJAK is building the next-generation insurance and financial services platform - designed to be intuitive, intelligent and personalised. Presently we are the largest insurance platform in Southeast Asia, and expanding globally with a strong focus on technology and product superiority. We are looking for talented, ownership-minded individuals. In return, expect growth, trust, autonomy, rewards, and impact. About the Role As a Data Engineer, you will build and operate the data infrastructure that powers BJAK’s analytics, product insights, and downstream systems. You will work closely with analytics, product, and engineering teams to ensure data is reliable, accessible, and production-ready at scale. What You Will Be Doing - Design, build, and maintain scalable, fault-tolerant data pipelines (batch and/or streaming) for core business and product data. - Ingest data from diverse sources including APIs, databases, event streams, and third-party services, ensuring high data quality and reliability. - Design and manage data models and storage layers (data warehouses, data lakes) that support analytics and downstream use cases. - Partner with analytics, product, and engineering teams to deliver clean, well-documented datasets that enable self-service analytics and experimentation. - Implement monitoring, logging, and alerting to ensure pipeline reliability, performance, and cost efficiency. - Enforce data governance best practices, including access control, privacy, documentation, and data lineage. What You Will Need - 3+ years of experience as a Data Engineer, data-heavy Backend Engineer, or similar role. - Strong programming skills in Python and/or TypeScript, with solid SQL proficiency. - Good understanding of data modeling, ETL/ELT concepts, and analytics workflows. - Hands-on experience with data warehouses (e.g. BigQuery, Snowflake). - Experience building and operating production data pipelines. Nice-to-Have - Experience with cloud platforms (especially GCP). - Exposure to streaming systems (Kafka, Pub/Sub). - Familiarity with dbt and analytics engineering practices. - Experience with data lake technologies. - Exposure to ML data pipelines or feature stores. Why Join BJAK - Build and own data systems that operate at real scale - Work on high-impact, business-critical data use cases - High-ownership role with autonomy and trust - Flat structure - execution and results matter more than titles - Competitive compensation and strong growth opportunities
Data Engineer (GCP) ID56375
AgileEngineAgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.
AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards. WHY JOIN US If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you! ABOUT THE ROLE WHAT YOU WILL DO - Build and maintain scalable, distributed, fault-tolerant data pipelines on GCP; - Develop and manage lakehouse layers and Delta Lake workflows using BigQuery and Dataproc; - Collaborate with stakeholders across data engineering, compliance, and business teams; - Design and implement pipelines to acquire, normalise, transform, and release large volumes of financial data; - Design and implement bitemporal data models on BigQuery for regulatory-grade time-series datasets; - Build and maintain testing frameworks for data pipelines and transformation logic; - Own end-to-end solutions including ingestion pipelines, QA workflows, correction management, and audit trails; - Contribute to shared platform services in a collaborative environment; - Support implementation of AI solutions including data ingestion, anomaly detection, and semantic search using Vertex AI. MUST HAVES - 6–8 years of experience in data engineering; - Proficiency in Python for data pipelines, transformation logic, and automation; - Proficiency in SQL with hands-on experience in BigQuery including partitioning, clustering, and time-series queries; - Experience with Cloud Composer (Apache Airflow) for pipeline orchestration; - Working knowledge of Dataproc (Apache Spark) for batch ingestion and incremental processing; - Experience with AI-assisted development tools such as GitHub Copilot or similar; - Experience with Git version control and collaboration workflows; - Familiarity with REST APIs for integrations; - Familiarity with GCP technologies (Cloud Storage, Pub/Sub, Datastream, Cloud Monitoring, IAM, VPC Service Controls); - Understanding of financial data concepts related to equities and& other asset classes; - Upper-intermediate English level. NICE TO HAVES - Knowledge of data libraries such as pandas or PySpark; - Experience with columnar storage and time-series analytics tools such as ClickHouse; - Familiarity with Dataplex for data governance and lineage; - Understanding of Change Data Capture (CDC) using Datastream; - Understanding of bitemporal data modeling concepts; - Knowledge of financial reference data such as equities, fixed income, or corporate actions; - Experience with BigQuery cost management techniques; - Experience with CI/CD pipelines and Terraform for infrastructure as code; - Exposure to LLMs and& Agentic AI using Vertex AI for data-related use cases. PERKS AND BENEFITS - Remote work & Local connection: Work where you feel most productive and connect with your team in periodic meet-ups to strengthen your network and connect with other top experts. - Legal presence in India: We ensure full local compliance with a structured, secure work environment tailored to Indian regulations. - Competitive Compensation in INR: Fair compensation in INR with dedicated budgets for your personal growth, education, and wellness. - Innovative Projects: Leverage the latest tech and create cutting-edge solutions for world-recognized clients and the hottest startups.
Data Engineer II
Centene CorporationTransforming the health of the communities we serve, one person at a time.
You could be the one who changes everything for our 28 million members by using technology to improve health outcomes around the world. As a diversified, national organization, Centene's technology professionals have access to competitive benefits including a fresh perspective on workplace flexibility. Position Purpose: Develops and operationalizes data pipelines to make data available for consumption (reports and advanced analytics), including data ingestion, data transformation, data validation / quality, data pipeline optimization, and orchestration. Engages with the DevSecOps Engineer during continuous integration and continuous deployment. - Designs and implements standardized data management procedures around data staging, data ingestion, data preparation, data provisioning, and data destruction (scripts, programs, automation, assisted by automation, etc.) - Designs, develops, implements, tests, documents, and operates large-scale, high-volume, high-performance data structures for business intelligence analytics - Designs, develops, and maintains real-time processing applications and real-time data pipelines - Ensure quality of technical solutions as data moves across Centene’s environments - Provides insight into the changing data environment, data processing, data storage, and utilization requirements for the company and offers suggestions for solutions - Develops, constructs, tests, and maintains architectures using programming language and tools - Identifies ways to improve data reliability, efficiency, and quality; use data to discover tasks that can be automated - Performs other duties as assigned - Complies with all policies and standards Education/Experience: A Bachelor's degree in a quantitative or business field (e.g., statistics, mathematics, engineering, computer science) and requires 2 – 4 years of related experience. Or equivalent experience acquired through accomplishments of applicable knowledge, duties, scope and skill reflective of the level of this position. Technical Skills: - One or more of the following skills are desired. - - SQL Server - SSIS - Healthcare experience Pay Range: $63,600.00 - $114,600.00 per year Centene offers a comprehensive benefits package including: competitive pay, health insurance, 401K and stock purchase plans, tuition reimbursement, paid time off plus holidays, and a flexible approach to work with remote, hybrid, field or office work schedules. Actual pay will be adjusted based on an individual's skills, experience, education, and other job-related factors permitted by law, including full-time or part-time status. Total compensation may also include additional forms of incentives. Benefits may be subject to program eligibility. Centene is an equal opportunity employer that is committed to diversity, and values the ways in which we are different. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or other characteristic protected by applicable law. Qualified applicants with arrest or conviction records will be considered in accordance with the LA County Ordinance and the California Fair Chance Act



