Job Closed
This listing is no longer active.
Passionate music fans. Innovative tech pros. Perfect harmony. Join our band.
Data Engineer – Wrapped – Fixed Term
Location
New York
Posted
57 days ago
Salary
0
Seniority
Senior
Job Description
Data Engineer – Wrapped – Fixed Term
Spotify
• Design, build, and maintain distributed data pipelines that power Spotify Wrapped data stories and personalized experiences for more than 300M users globally • Partner with Data Scientists to evaluate and operationalize new Wrapped story concepts, balancing personalization, scalability, and eligibility requirements • Build scalable systems that process large-scale listening data and generate insights celebrating users’ unique listening journeys • Develop and optimize pipelines supporting AI-powered personalized playlist experiences and recommendation technologies • Collaborate with partner teams to integrate social and shared listening experiences into Wrapped and adjacent user experiences • Contribute to technical excellence by improving reliability, observability, performance, and development velocity across the squad’s data systems • Support experimentation and iteration on new storytelling concepts beginning early in the product development cycle • Work cross-functionally with engineering, product, design, and music domain experts to bring large-scale personalized experiences to life
Job Requirements
- Experience of working in a product-driven engineering environment
- Experience working with high-volume datasets using distributed systems and big data technologies such as Python, Scala, Scio, Ray, Apache Spark, or similar frameworks
- Proficient in designing and building distributed data pipelines in Python, Scala, or Java, including experience with frameworks such as Scio and platforms like Dataflow
- Understanding of data modeling, data access, and storage techniques across both batch and analytical processing systems
- Experience working with large-scale analytical systems such as BigQuery or similar technologies
- Valuing iterative software development, data-driven decision making, reliability, responsible experimentation, and cost-efficient engineering practices
- Thriving in collaborative environments and enjoy working closely with cross-functional teams
- A creative problem solver who enjoys building products creating meaningful experiences for millions of users
- Excitement for turning research ideas and experimental concepts into reliable, scalable production systems
Benefits
- Flexibility to work where you work best
- In-person meetings with flexibility to work from home
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Role Description We are looking for a Middle Data Engineer specialized in Azure Databricks to join our data platform team. The candidate will design and develop modern data pipelines and Lakehouse architectures, leveraging Azure Databricks, Spark, and Azure Data Factory, while integrating with existing SQL Server-based data warehouse environments, also evolving our data platform towards scalable, cloud-based data architectures, enabling advanced analytics and business intelligence. - Design, develop, and maintain data pipelines using Azure Databricks - Build and optimize data transformations using PySpark and SQL in Databricks - Implement and maintain Lakehouse architectures using Delta Lake - Develop ETL/ELT pipelines orchestrated through Azure Data Factory - Integrate data from multiple sources into the data platform and analytical layers - Design and maintain data models and data warehouse structures for analytics - Ensure data quality, scalability, and performance of large-scale data processing pipelines - Collaborate with BI teams to support Power BI and reporting platforms - Support and evolve existing SQL Server data platforms and ETL solutions (SSIS) when required - Contribute to the design of modern cloud-based data architectures Qualifications - 3+ years of experience in Data Engineering or Data Warehouse development - Experience with Azure Databricks - Experience developing data pipelines using PySpark and Spark SQL - Solid understanding of distributed data processing and big data concepts - Experience working with Delta Lake and Lakehouse architectures - Strong SQL skills and experience with SQL Server relational databases - Experience building data pipelines using Azure Data Factory - Experience handling large datasets and performance optimization Requirements - Nice to have: Experience with Spark optimization techniques (partitioning, caching, cluster tuning) - Experience with structured streaming in Databricks - Knowledge of CI/CD pipelines for data platforms (Azure Devops) - Familiarity with Power BI - Experience in migrating from traditional ETL process to cloud architectures Soft Skills - Strong analytical and problem-solving skills - Ability to work in collaborative environments and to adapt - Committed to continuous learning and professional development, with a keen focus on advancing cloud computing expertise - Team player - Good communication skills with technical and non-technical roles - Proactive, actively identifying improvements and proposing solutions - Comfortable working in dynamic environments where priorities and technologies evolve Benefits - Culture of Relentless Performance: join an unstoppable technology development team with a 99% project success rate and more than 30% year-over-year revenue growth - Competitive Pay and Benefits: enjoy a comprehensive compensation and benefits package, including health insurance, and a relocation program - Work From Anywhere Culture: make the most of the flexibility that comes with remote work - Growth Mindset: reap the benefits of a range of professional development opportunities, including certification programs, mentorship and talent investment programs, internal mobility and internship opportunities - Global Impact: collaborate on impactful projects for top global clients and shape the future of industries - Welcoming Multicultural Environment: be a part of a dynamic, global team and thrive in an inclusive and supportive work environment with open communication and regular team-building company social events - Social Sustainability Values: join our sustainable business practices focused on five pillars, including IT education, community empowerment, fair operating practices, environmental sustainability, and gender equality
Enrollment Clerk / Data Entry Specialist
Goldbelt, Inc.Goldbelt, Inc. is a facilities services company that is “building a brighter future” for its Alaska Native shareholders. The company, as an employer, strive
Role Description We are seeking a detail-oriented and organized Enrollment Clerk/Data Entry Specialist to support a Bureau of Indian Affairs (BIA) contract focused on records management and digitization. Remote work may be authorized based on security, workload, or operational need. Responsibilities - Front-line intake and application processing - Data entry and records maintenance - Customer and applicant support - Mail processing and front desk operations - Receive, log, and track all incoming CDIB applications and supporting documents - Review applications for completeness and accuracy based on BIA standards - Conduct genealogical research and documentation verification as needed - Prevent fraudulent submissions by validating authenticity of supporting evidence - Enter all applicant data into the Enrollment database, ensuring accuracy - Maintain both physical and electronic records - Prepare applicant correspondence including status updates, deficiency notices, and determinations - Staff analyze family tree history, verify lineage, check for fraud, and ensure eligibility Qualifications - Ability to collaborate with tribal representatives and federal staff - Proficiency in Microsoft Office Suite (Word, Excel, Outlook) - Strong attention to detail and organizational skills - Excellent communication and collaboration skills - High school diploma or equivalent; associate degree preferred - Minimum 2+ years of experience in data entry, records management, or administrative support - Experience in policy development and technical writing - Knowledge of Alaska Native communities, tribal enrollment, and genealogical research (preferred) Requirements - Limited in-state travel may be needed for training, outreach, or tribal coordination Benefits - Salary range: $40,083.00 to $48,020.00 annually - Competitive base salary commensurate with qualifications and experience - Comprehensive benefits package including medical, dental, and vision insurance - 401(k) plan with company matching - Tax-deferred savings options - Supplementary benefits - Paid time off - Professional development opportunities
Role Description A-TEK is seeking a Senior Data Engineer to support enterprise data modernization, cloud-native data engineering, analytics enablement, and data governance initiatives for Federal customers. This role focuses on designing and implementing scalable data platforms, automated ETL/ELT pipelines, and modern cloud-based data solutions supporting scientific, operational, and mission-critical environments. The ideal candidate combines strong hands-on engineering expertise with the ability to collaborate across technical and non-technical teams to modernize data ecosystems and improve enterprise data accessibility, quality, governance, and analytics capabilities. NOAA experience is preferred. This position is remote and requires the ability to obtain and retain a public-trust clearance. Responsibilities - Design, develop, and optimize enterprise data warehouses and large-scale ETL/ELT pipelines - Engineer cloud-native data processing solutions supporting structured, semi-structured, and unstructured data - Develop scalable ingestion and transformation frameworks for high-volume and real-time data processing - Support modernization of legacy data environments into cloud-based architectures - Design and implement data models, schemas, and database structures optimized for analytics and reporting - Develop metadata-driven automation, data quality validation, lineage tracking, and governance capabilities - Build and maintain reporting, analytics, and dashboarding solutions supporting operational and executive decision-making - Collaborate with architects, engineers, analysts, and business stakeholders to define technical requirements and implementation strategies - Support AI/ML and advanced analytics initiatives through scalable data engineering and MLOps-ready infrastructure - Implement Infrastructure-as-Code (IaC), CI/CD pipelines, and automated deployment processes - Perform database tuning, query optimization, and performance engineering activities - Support secure data management and compliance with Federal security and data governance requirements - Provide technical leadership, mentoring, and engineering best practices across project teams Qualifications - Bachelor’s degree in Computer Science, Information Systems, Engineering, or related field - 7+ years of experience in data engineering, data warehousing, database engineering, or related disciplines - Strong experience designing and implementing ETL/ELT pipelines and enterprise data warehouse solutions - Experience with distributed processing frameworks and cloud-native data ecosystems - Strong experience with data modeling, database design, and dimensional modeling techniques - Experience implementing data governance, metadata management, data quality, and data integrity controls - Proficiency with SQL and Python-based data engineering and automation - Experience with cloud data platforms and services in AWS, Azure, or Google Cloud - Experience supporting large-scale, modern data modernization initiatives - Strong verbal and written communication skills with the ability to explain complex technical concepts to both technical and non-technical stakeholders - Experience collaborating across cross-functional teams in Agile or DevSecOps environments Preferred Qualifications - NOAA or broader Federal civilian agency experience - Experience supporting scientific, environmental, geospatial, or research data environments - Experience with GIS or geospatial data platforms - Experience with AI/ML data engineering or MLOps support - Experience with Infrastructure-as-Code and CI/CD automation - Familiarity with metadata management, data catalogs, and enterprise governance frameworks - Experience with real-time streaming or event-driven data architectures - AWS or Azure certifications Preferred Technical Skills - SQL Server, PostgreSQL, Oracle, or cloud-native databases - Azure Data Factory, SSIS, Informatica, dbt, Airflow, or similar ETL frameworks - Azure Synapse, Databricks, Spark, Hadoop, Kafka, or distributed analytics platforms - Python, Pandas, NumPy, PySpark - Power BI, Tableau, SSRS, or enterprise analytics platforms - Docker, Kubernetes, Git, Azure DevOps, Jenkins, Terraform, or similar DevOps technologies - REST APIs and data integration services Compensation Salary Range: $160,000 – $170,000 annually (commensurate with experience, professional certifications and location) Benefits - Health, dental, and vision insurance - 401(k) with employer match - Paid time off - Professional development opportunities
Business Informatics Support Data Engineer
Trillium Health ResourcesTransforming Lives. Building Community Well-Being.
• Collaborate with business units to understand data needs and translate them into effective reporting solutions by gathering requirements and delivering high-quality data solutions that support operational and strategic goals • Develop, maintain, and optimize SSRS reports and Power BI dashboards to provide actionable insights • Write and troubleshoot SQL queries to extract, transform, and analyze data from various sources • Ensure data accuracy, consistency, and integrity across all reporting platforms



