Job Closed
This listing is no longer active.
With a strong Data Engineering backbone, we deliver Databricks projects from concept to production.
Data Engineer
Location
United States
Posted
102 days ago
Salary
0
Seniority
Senior
Job Description
Data Engineer
SunnyData
• You will be part of a team responsible for supporting new and existing customers in their data engineering needs. • You will guide customers to make the best technical decisions to achieve their goals • You will actively work across multiple customer accounts, which you will need to track and report on their progress. • You will build and operationalize complex data solutions, correct problems, apply transformations, and recommend data cleansing/quality solutions. • You will design data solutions. • You will analyze sources to determine value and recommend data to include in analytical processes. • You will incorporate core data management competencies, including data governance, data security, and data quality. • You will collaborate within and across teams to support delivery and educate end users on data products / analytic environments. • You will perform data and system analysis, assessment, and resolution of defects and incidents of moderate complexity, correcting as appropriate. • You will test data movement, transformation code, and data components.
Job Requirements
- 3+ years of related experience in data engineering and data product development.
- Experience in one or more of the following:
- Data Engineering technologies (e.g., Spark, Hadoop, Kafka)
- Databricks platform - data engineering and/or ML ops experience would be a huge bonus
- Data Science and Machine Learning technologies (e.g., pandas, scikit-learn, HPO)
- Data Warehousing (e.g., SQL, OLTP/OLAP/DSS)
- Solid understanding of the end to end data analytics workflow
- Demonstrated track record of domain expertise, including the ability to understand technical concepts and possess in-depth knowledge of the immediate systems worked on
- Proven problem-solving skills, including debugging skills
- Strong verbal and written communication skills
- Ability to work autonomously and self-motivation in identifying personal growth opportunities
- Excellent time management and prioritization skills.
- Knowledge of public cloud platforms AWS, Azure, or GCP would be a plus
- Nice to have: Databricks Certification
Benefits
- Health Insurance : Employees and their eligible family members including spouses, domestic partners, and children are eligible for coverage from the first day of employment.
- Paid Time Off : Start your career at SunnyData with a minimum of 15 days Paid Time Off annually, plus nine paid company Holidays.
- An opportunity to grow your technical and people skills, lead teams on complex customer projects that are highly innovative and cutting edge. Great opportunity to grow in your career with the right level of focus, innovation and customer centricity with a high growth consulting company dedicated to Databricks.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more. Role Description At arrivia, we believe travel has the power to transform lives. To deliver world-class travel experiences to our millions of members, we need a world-class data foundation. We are looking for a Data Lake Architect II to be the visionary behind our next-generation cloud data platform. You won't just be managing data; you’ll be architecting the engine that powers our enterprise-scale AI, machine learning, and real-time analytics. If you are passionate about turning raw data into "travel magic" using the latest Azure and Lakehouse technologies, we want to talk to you. What You’ll Do - Architect the Vision: Design end-to-end data lake solutions (batch and streaming) that handle structured and unstructured data at scale. - Build for Intelligence: Implement optimized storage layers and feature stores specifically designed to supercharge our Data Science team’s ML workloads. - Engineer Flow: Construct high-performance ingestion pipelines using Spark, Databricks, Kafka, and Flink. - Drive Innovation: Lead the transition toward Lakehouse architectures (Delta Lake/Iceberg) and explore cutting-edge tech like Vector Databases for RAG. - Master the Cloud: Act as the primary authority for Azure architecture decisions, ensuring our compute strategy is serverless, scalable, and cost-efficient. - Govern with Excellence: Define the frameworks for metadata, lineage, and data quality that ensure our data is trusted and secure. Qualifications - 3+ years of dedicated Azure architecture experience (6+ years in IT overall). - Deep expertise in Azure Data Lake, Synapse, Databricks, and Big Data frameworks (Spark, Trino, or Flink). - Experience operationalizing models via MLflow, Vertex AI, or SageMaker. - Proven success with Infrastructure as Code (Terraform), CI/CD (Azure DevOps), and distributed systems. - The ability to translate complex technical "hows" into clear business "whys." - Ideally, you hold an Azure Solutions Architect Expert or Azure Data Engineer Associate certification. Benefits - Stay Curious: We give you the space to learn, grow, and experiment with generative AI and new data patterns. - Win Together: We thrive on a culture of connection and inclusion. - Travel Perks: We’re in the travel business—we want you to experience the world! - Work Your Way: Enjoy a flexible environment (Remote/WFH) with a team that trusts your expertise. Company Description We’re a global powerhouse born from the merger of ICE, SOR Technology, and WMPH Vacations. We combine 55 years of stability with the agility of a tech innovator.
Senior Data Engineer, Reporting
CreatorIQThe most trusted software to unify and power advanced influencer marketing for the world’s most innovative enterprises
• Design and implement ETL pipelines migrating from transactional databases to analytical data warehouses • Create real-time data ingestion systems processing campaign data, user metrics, and business intelligence • Build multi-tenant data models with proper partitioning strategies for enterprise-scale clients • Develop data quality frameworks with comprehensive validation, monitoring, and alerting • Implement Row-Level Security (RLS) and Role-Based Access Control (RBAC) in analytical databases • Design dynamic permission models supporting organization-level and division-level data access • Build session-based context management for secure multi-tenant queries • Create comprehensive audit trails and access logging for compliance requirements • Design database schemas with advanced partitioning and indexing strategies • Build materialized views and aggregated tables for real-time analytics • Implement query optimization, data skipping, and compression techniques • Handle high-concurrency embedded dashboard usage with sub-second query performance • Build dashboard data sources with optimized SQL transformations • Handle complex data structures and parsing requirements • Create flat, denormalized tables optimized for embedded analytics consumption • Implement custom field handling for tenant-specific metadata requirements
Senior Platform & Data Architect – Germany
Transparent HiringTech recruiting and relocation services for German companies seeking to acquire and relocate IT talents from abroad.
• Own the architecture and delivery of a scalable internal platform (end-to-end, not just concepts) • Translate business needs into clear technical designs and working systems • Build and improve data pipelines, integrations, and automation • Establish clean foundations for data reliability, reporting, and operational tooling • Collaborate closely with stakeholders across Germany and the US
Azure Data Architect
ExavaluDigital Transformation Consulting Leader with expertise in business/ technology advisory and digital platform solutions
• Data Pipeline Engineering: Architect, build, and maintain complex, real-time, and batch data pipelines using Azure Data Factory, Python/PySpark, and Databricks. • Architecture & Modelling: Design and implement modern data warehouse solutions, data models, and data lakes, optimizing for performance and scalability. • Data Ingestion & Integration: Ingest, cleanse, and transform data from diverse sources into usable data structures for analytics. • Security & Governance: Implement security features, including role-based access control (RBAC), data encryption, and governance via Azure Purview.
