One-stop-shop for entrepreneurs to start & grow their business in Australia, Hong Kong, Singapore and the UK.
Data Engineer
Location
Worldwide
Posted
1 day ago
Salary
0
Seniority
Mid Level
Job Description
Data Engineer
Sleek
Role Description We are looking for a skilled and passionate Data Engineer to join our growing Data Platform team. Mission: - Design, build, and maintain robust data pipelines on Databricks and AWS infrastructure that power analytics and reporting capabilities across the organization. Key responsibilities: - Design and implement scalable ETL/ELT pipelines using both batch and streaming patterns. - Build and maintain ingestion workflows from diverse sources (databases, APIs, event streams). - Implement Change Data Capture (CDC), full-load, and incremental ingestion strategies. - Develop and manage data workflows using Apache Airflow for orchestration. - Configure and manage data ingestion connectors using Airbyte. - Work with Databricks to build and optimize data engineering workloads on the Lakehouse platform. - Write and optimize complex SQL queries. - Solid hands-on experience on dbt with Databricks, build modular, testable dbt models for data transformation. - Develop and maintain data models in staging, intermediate, and mart layers following data warehousing best practices. - Working knowledge of AWS services like S3, Lambda, EC2, IAM, etc. - Containerize data services and applications using Docker & EKS. - Ensure data quality, observability, and reliability across the data platform. - Document pipelines, models, and data dictionaries to maintain platform knowledge. Qualifications - 3+ years of professional experience in data engineering. - Strong understanding of data platform architecture: Lakehouse, Data Warehouse, Data Lake patterns. - Hands-on experience with ETL/ELT design patterns including batch processing and stream processing. - Familiarity with ingestion patterns: full load, incremental, CDC, event-driven. - 5+ years of hands-on experience as a Database Administrator in production environments. - Strong understanding of database internals — storage engines, transactions, isolation levels, locking, MVCC, query planners. - Proven experience supporting mission-critical OLTP workloads with high availability requirements. - Solid scripting skills in Bash and/or Python for automation. Requirements - Experience building data pipelines on Databricks (Delta Live Tables, Jobs, Notebooks). - Proficiency with PySpark or Spark SQL for large-scale data processing. - Familiarity with Delta Lake concepts: ACID transactions, time travel, schema evolution. - Proficiency with Apache Airflow — authoring, scheduling, and monitoring DAGs. - Experience with Airbyte for managing source-to-destination data connectors. - Hands-on experience administering MongoDB (self-managed and/or Atlas). - Replica set configuration, sharding, indexing strategies, and aggregation pipeline tuning. - Backup, restore, and disaster recovery using mongodump/mongorestore or Ops Manager. - Strong SQL skills — query optimization, window functions, CTEs, and complex joins. - Experience with dbt (data build tool) for transformation, testing, and documentation. - Practical experience with AWS services (S3, Lambda, IAM, CloudWatch, etc). Benefits - Humility and kindness: A culture of not taking ourselves too seriously and being able to laugh. - Flexibility: Work from home and the option to work fully remote from anywhere in the world for 1 month each year. - Financial benefits: Competitive market salaries, generous paid time off, and access to a flexi benefits scheme. - Personal growth: Responsibility and autonomy with a range of internal and external training programs. Company Description Sleek launched in 2017 and now has around 15,000 customers across our offices in Singapore, Hong Kong, Australia, and the UK. We have around 500 staff with an intact startup mindset. We have recently raised Series B financing off the back of >70% compound annual growth in Revenue over the last 5 years. Sleek has been recognised by The Financial Times, The Straits Times, Forbes, and LinkedIn as one of the fastest-growing companies in Asia. Backed by world-class investors, we are on track to be one of the few cash flow positive, tech-enabled unicorns based out of Asia Pacific.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Lead Data Engineer
Blue Cross and Blue Shield of Kansas CityBlue Cross and Blue Shield of Kansas City is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, status as a protected veteran, or disability.
Role Description The Lead Data Engineer analyzes, develops, and maintains complex logical data designs in support of corporate and customer information system requirements. Through proper data design and governance, this role maintains and monitors the use of standards and procedures and the integration of systems. This individual contributes to the enterprise architecture as a representative of data design and governance. Our ideal candidate uses expert specialist skills and knowledge to define and deliver data solutions and to contribute to the development and implementation of IT plans in line with the overall strategy of IT and the business. - Provides vision, leadership, and strategic direction on data management and enterprise information management and leads & coaches junior Data Engineers. - Defines, develops, and delivers consistent information and data standards, methodologies, guidelines, best practices, and approved modeling techniques on data/information management, data quality, and data governance. - Designs enterprise data architecture, including conceptual architectures for solution strategies, for data stores supporting transactional processing, data warehouses, operational data stores, data marts, and analytics. - Provides assistance and guidance to the development team regarding data model, SQL, and Stored procedures, including code review of complex SQL and Stored procedures and performance tuning as needed by development teams. - Develops data models as required by project teams. - Collects, maintains, and publishes corporate metadata related to the modeling in an enterprise asset repository. - Simplifies the existing data architecture and data architecture SDLC process, delivering reusable services and cost-saving opportunities in line with the policies and standards of the group. - Utilizes skills with the appropriate tools and business requirements to model entity relationships, multi-dimensionality, subject areas, state transitions, data flows and integrations, and reference data. - Leads the design, development, implementation, and maintenance of complex data systems and solutions ensuring technology solutions are in alignment with data architecture principles and target state. - Creates and maintains accurate, complete, and consistent governed conceptual, logical, and physical data models with lineage and implementation traceability metadata. - Responsible for source to target mapping where business rules are clearly documented and defined. Qualifications - Bachelor’s degree in Computer Science, Information Systems, Engineering, or a related field. - 7 years’ experience with data warehousing, including 5 years’ experience with relational modeling. - 7+ years of SQL development. - Experience with DLM and Enterprise Platforms for managing data movement. - Thorough understanding of the insurance industry (including claims processes, how attribution works, and the core business concepts of insurance). - Understanding of Scrum and Agile development practices. - Proven data governance and information management experience. - Strong interpersonal communication and follow-through skills and demonstrated initiative in autonomous environments. - Experience with database technologies (e.g., SQL, NoSQL, Snowflake, and Data Lake design). - Experience with ETL and other business intelligence tools. - Experience analyzing, organizing, and preparing data for use through the development of proprietary systems. - Experience designing multi-dimensional data models using Kimball Methodology. - Very effective interpersonal skills. Requirements - Master’s degree in Business Administration, Computer Science, Information Systems, or a related field of study. - 3 years’ experience in the healthcare industry. - 7+ years in IT. - Ability to lead, guide, motivate, and direct the work of others. - Experience with source to target mapping where business rules are clearly documented and defined. - Highly technical with hands-on experience using Python, or JVM language (Java, Scala, Clojure, or Kotlin). - Experience implementing, managing, and developing in Apache Airflow or other orchestration tools. - Experience implementing data solutions in a major cloud provider (Azure, AWS, or GCP). - Experience with semi-structured formats (Avro, Parquet, ORC, YAML, JSON, or XML). - Experience with MDM Implementation. - Experience with MDM Tools (Informatica, Profisee, or similar). - Experience implementing Kafka, Schema Registry, and Kafka Streaming and/or Spark Streaming. - Experience with Microsoft Azure. - Experience with Apache Airflow and Celery. - Experience with Docker, Kubernetes, and Terraform. - Experience with Snowflake or Synapse. - Experience with Informatica IDQ, EDC, IICS, and Axon. - Experience with Scala, Python, and Java. - Experience with NodeJS and React. - Experience with Azure Data Lake Storage Gen2. - Experience with cloud platforms such as Azure, AWS. Benefits - Highly competitive total rewards package, including comprehensive medical, dental, and vision benefits as well as a 401(k) plan that both the employee and employer contribute. - Annual incentive bonus plan based on company achievement of goals. - Time away from work including paid holidays, paid time off, and volunteer time off. - Professional development courses, mentorship opportunities, and tuition reimbursement program. - Paid parental leave and adoption leave with adoption financial assistance. - Employee discount program. Company Description Blue Cross and Blue Shield of Kansas City is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to, among other things, race, color, religion, sex, sexual orientation, gender identity, national origin, age, status as a protected veteran, or disability.
Forward Deployed Data Engineer
DatafoldDatafold is the data engineering automation platform. A major part of our business is delivering large-scale data engineering projects such as data platform migrations with AI, at fixed price and guaranteed timeline. We are not a typical services provider or SI – we are a venture-backed software company that reimagined automation from the ground up and has been delivering projects up to 6x faster than alternatives. We partner heavily with leading data platforms, including Databricks and Snowflake, to deliver large-scale complex migrations.
Role Description Datafold is hiring a Forward Deployed Data Engineer to own the delivery of our AI-automated data platform migration projects. This is a high-ownership, customer-facing role at the intersection of data engineering, AI, and project leadership. As a Forward Deployed Data Engineer leveraging Datafold's AI technology, you will own migration projects end-to-end, gain deep understanding of the customer's data platform, manage execution of the project, and remove any blockers on the way for a timely migration delivery. Using our proprietary AI tooling to plan and deliver the migration projects, you will be doing the work equivalent to a full team of consultants. What You'll Do - Own 1–4 concurrent migration projects end-to-end: scoping, planning, execution, and customer handoff - Be the primary customer contact: run weekly check-ins, manage stakeholder expectations, and escalate risks early before they compound - Configure Datafold's Migration Agent and oversee the migration execution - Partner with Datafold's engineering team to execute migrations - Help refine and scale our product and delivery playbook as the team grows Qualifications - 3–6 years in data consulting, professional services, or a customer-facing data engineering role - Excellent communication skills — equally comfortable in an exec check-in and a technical design session - Strong grasp of the modern data stack: dbt, Snowflake, Databricks, orchestration tools, and major patterns (stored procedures, streaming, incremental processing) - Extreme ownership mentality — you identify, surface, and fix problems and rally the team to help without being told - AI power user — using AI every day and always learning and improving on how to use it more effectively - Exposure to legacy data stack and patterns (ETL, stored procedures, etc.) and data platform migration projects is a strong plus Benefits - Competitive salary + equity Company Description Datafold is the data engineering automation platform. A major part of our business is delivering large-scale data engineering projects such as data platform migrations with AI, at fixed price and guaranteed timeline. We are not a typical services provider or SI – we are a venture-backed software company that reimagined automation from the ground up and has been delivering projects up to 6x faster than alternatives. We partner heavily with leading data platforms, including Databricks and Snowflake, to deliver large-scale complex migrations.
Role Description The Data Entry Specialist is responsible for accurately inputting patient information into Sharecare’s internal systems and client Electronic Medical Record (EMR) platforms. This role requires keen attention to detail, efficient data management, and strict adherence to HIPAA compliance standards, supporting the Release of Information (ROI) process. The ideal candidate thrives in a fast-paced, collaborative environment, demonstrating a strong commitment to accuracy, productivity, and the protection of sensitive patient data. - Accurately enter and update patient data in internal and client-facing systems - Access and navigate multiple EMR platforms to retrieve, validate, and process patient health information (PHI) - Ensure data accuracy and consistency while meeting productivity benchmarks - Maintain strict confidentiality and comply with HIPAA and company privacy policies - Collaborate with team members to support process improvements and service quality - Provide courteous, timely, and professional communication with internal and external stakeholders as needed Qualifications - Proficiency in Microsoft Office applications - Strong organizational and multitasking skills essential - Demonstrated ability to manage time effectively and meet task deadlines - Willingness to learn programs and processes quickly - Strong documentation, communication, and customer service skills - Self-motivated, dependable, and able to work independently or as part of a team - Proven ability to maintain productivity, utilization, and quality performance standards Requirements - Ability to sit or stand for extended periods of time - Physical capacity to lift and carry 25 lbs. - Manual dexterity sufficient for long periods of typing, writing, and handling documents - Visual acuity to read documents and use a computer monitor - Clear speaking and hearing ability for communication - Adequate hand-eye coordination and sensory abilities for job-related tasks HIPAA/Compliance - Maintain the confidentiality of patient and client information - Comply with HIPAA standards and all relevant corporate integrity and security obligations - Report unethical, fraudulent, or illegal behavior - Maintain current HIPAA certification annually Company Description Sharecare is a digital healthcare company that delivers software and tech-enabled services to stakeholders across the healthcare ecosystem to help improve care quality, drive better outcomes, and lower costs. Through its data-driven AI insights, evidence-based resources, and comprehensive platform – including benefits navigation, care management, home care resources, health information management, and more – Sharecare helps people easily and efficiently manage their healthcare and improve their well-being.
Role Description At Thermo Fisher Scientific team, you’ll discover impactful work, innovative thinking and a culture dedicated to working the right way, for the right reasons - with the customer always top of mind. The work we do matters, like helping customers find cures for cancer, protecting the environment, and supporting our customers’ medical related inquiries. As the world leader in serving science, with the largest investment in R&D in the industry, our colleagues are empowered to realize their full potential as part of a fast-growing, global organization that values passion and unique contributions. Our commitment to our colleagues across the globe is to provide the resources and opportunities they need to make a difference in our world while building a fulfilling career with us. Join our collaborative team at Thermo Fisher Scientific as a Sr Staff IT Architect and help drive innovation in technology solutions that enable our mission of making the world healthier, cleaner, and safer. You'll play a key role in designing and implementing enterprise-wide solutions across multiple domains including: - Cloud infrastructure - Cybersecurity - AI/ML - Data architecture - Automation As a technical leader, you'll: - Design scalable solutions - Establish best practices - Provide strategic direction for critical technology initiatives - Work with cross-functional teams to translate business requirements into robust architectural designs - Ensure alignment with enterprise standards - Shape our technology roadmap and guide digital transformation across the organization This role offers the opportunity to work with advanced technologies and lead complex projects that have meaningful impact. You'll support technical teams, engage key stakeholders, and help build innovative solutions that enable business growth and operational excellence. Qualifications - Masters degree with 6+ years of experience, or Bachelor’s Degree with 8+ years of experience in data/platform architecture or related field - In some cases, an equivalency, consisting of a combination of appropriate education, training and/or directly related experience, will be considered sufficient for an individual to meet the requirements of the role. Requirements - Experience in enterprise data architecture, data modeling, and data mapping is required. - Experience with Snowflake is required. - Experience with SQL/PLSQL and data transformation frameworks is required. - Data modeling tools (e.g., Erwin or similar) is required. - Experience defining and enforcing data governance and platform standards is required. - Experience with Agile methodologies and project delivery frameworks is required. - Experience with Databricks and DBT is preferred. Knowledge, Skills and Abilities - Demon strated ability to design and implement enterprise-scale data solutions and integrations - Strong understanding of data architecture patterns, data pipelines, and data lifecycle management - Experience working in complex, multi-program enterprise environments - Strong stakeholder management and communication skills, including engagement with senior leaders - Ability to operate independently and drive outcomes across multiple initiatives - Advanced SQL proficiency, including complex joins, CTEs, window functions, aggregation logic, and query performance tuning. - Strong expertise in data modeling methodologies, including dimensional modeling (Kimball), normalization techniques, and OLTP vs OLAP design principles. - Demon strated ability to guide and influence through collaboration - Experience supporting technical teams and implementing architectural standards - Strong analytical and problem-solving capabilities with attention to detail - Excellent written and verbal communication skills - Ability to translate complex technical concepts for non-technical audiences Location - Fully remote in the US - Relocation assistance is NOT provided. - Must be legally authorized to work in the US without sponsorship. - Must be able to pass a comprehensive background check, which includes a drug screening. Company Description Our Mission is to enable our customers to make the world healthier, cleaner and safer. Watch as our colleagues explain 5 reasons to work with us. As one team of 100,000+ colleagues, we share a common set of values - Integrity, Intensity, Innovation and Involvement - working together to accelerate research, solve complex scientific challenges, drive technological innovation and support patients in need. #StartYourStory at Thermo Fisher Scientific, where diverse experiences, backgrounds and perspectives are valued. Apply today! http://jobs.thermofisher.com


