Agence d’expérience numérique
Data Engineer
Location
California + 1 moreAll locations: California | Montana
Posted
1 day ago
Salary
$70K - $85K / year
Seniority
Senior
Job Description
Data Engineer
Verndale
• Design, build, and maintain robust ETL/ELT pipelines that move data from diverse source systems into analytics, AI, and machine learning platforms. • Develop and optimize data architectures that support real-time and batch analytics, ML workflows, and personalization. • Partner with data architects, analysts, and client stakeholders to translate business requirements into technical designs. • Ensure data quality, lineage, observability, and security through validation, monitoring, and governance best practices. • Optimize performance and cost-efficiency of pipelines and storage. • Support cloud-first architectures across AWS, Azure, and GCP.
Job Requirements
- 3–4+ years of experience in building production-grade data pipelines and data systems.
- Strong proficiency in SQL, Python, or Java/Scala.
- Experience with modern data platforms (Snowflake, BigQuery, Redshift, Databricks, Synapse).
- Hands-on skills with streaming technologies (Kafka, Kinesis, Pub/Sub).
- Knowledge of data modeling principles and schema design for analytics and operational systems.
- Familiarity with DevOps and CI/CD practices for data, including version control (GitHub/GitLab), testing, and deployment automation.
- Exposure to data governance, security, compliance, and observability frameworks.
- Ability to collaborate in a consulting/client-facing environment, balancing technical depth with pragmatic delivery.
Benefits
- Generous paid company holidays, vacation, and paid sick time to every employee starting on day one.
- Top-of-the-line Health Insurance, plus monthly perks customized to meet individual employees’ needs.
- Support a healthy work/life balance.
- Remote work options available for certain roles.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Assistant Vice President – Technology, Data Warehouse
MashreqWe are Mashreq - Inspiring you to Rise Every Day
• The Enterprise Data Platform stream delivers outcomes to help different parts of the bank gain meaningful insights from their Data Assets. • Our core function spans multiple Data Warehouses, Hadoop, Business Intelligence and Analytics Cluster within Information Management. • The work involves providing delivery and support of platforms spanning over Hadoop, DWH, ETL, Reporting & Analytics application landscape. • You will be handling critical applications that influence bank’s management decision making process, regulatory reporting (which can influence financial/non-financial penalties) and operational reporting.
Senior Data Integration Engineer
Vori HealthA better approach to back, neck, and orthopedic care – all in one convenient place.
Role Description We are looking for a Senior Data Integration Engineer to design, build, and operate API-driven data services that connect operational systems, synchronize data reliably across boundaries, and land curated datasets in Snowflake while working closely with Hasura as the operational database and API layer. You will collaborate closely with Data Engineers and Implementation teams to ensure a seamless end-to-end data flow. Qualifications - Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field. - 5+ years of experience in data operations, with a strong background in building and optimizing data delivery pipelines and data management UI. - Knowledge of Python, Typescript, Bash, GraphQL, SQL. - Expertise working with AWS-based solutions. - Expertise working with modern data platforms (e.g., Redshift, Snowflake, etc.) and tools (e.g., AWS S3, lambdas, etc.). - Experience with SCM and CI/CD tools such as GitHub/Github Actions. - Experience with React applications. - Exceptional problem-solving skills and the ability to work collaboratively in a fast-paced, dynamic startup environment. - Excellent communication and project management skills, with a proven track record of delivering projects that provide significant business value. - Solid understanding of networking, authentication, and encryption concepts (SSH, SSL/TLS, key management). - Understanding of data pipelines and orchestration (Airflow, dbt Cloud jobs, or similar). - Familiarity with observability tools (Datadog or equivalent). Requirements - Prior experience with clinical or healthcare data, with a strong understanding of relevant data structures, such as Encounters, Claims, Financial Data, etc. - Stay updated with emerging data technologies and assess their applicability to the organization. - Drive initiatives for continuous improvement in data management processes and tools. - Leverage AI first mentality for optimizing and innovating on data architecture. - Authorized or able to provide required documents to work in United States or Canada. Benefits - Competitive Salary & Equity: We offer competitive pay based on experience and the value you bring to the team. - Equity Options: As part of our commitment to long-term success, we offer equity options, giving you the opportunity to share in the growth of the company. - Health & Wellness: Our health benefits include medical, dental, and vision coverage to keep you and your family healthy. We also offer wellness programs and mental health resources to help you thrive both personally and professionally. - Retirement Plans: We provide a 401(k) plan and Roth options to help you plan for the future and enjoy peace of mind. - Paid Time Off (PTO): Enjoy generous paid time off, including vacation days, holidays, and sick leave, to recharge and maintain a healthy work-life balance. - Fully Remote Work: Work from your home or private office location! We offer a flexible, fully remote work environment that allows you to manage your workspace in a way that best suits your lifestyle. - Professional Development: We encourage continuous learning and growth with access to training, workshops, and Professional Development stipend for further education. - Parental Leave: We offer paid parental leave to support team members through important life moments, whether you're welcoming a child or expanding your family. - Employee Assistance Program (EAP): Access confidential counseling and support for personal or work-related challenges to maintain your well-being along with additional employee assistance programs. Company Description Vori Health is an award-winning, nationwide, virtual-first, musculoskeletal medical practice focused on evidence-based care that treats the whole person. We are on a mission to empower humanity to lead a healthier life.
Data Engineer
payabl.We're powering the growth of merchants by helping them take payments easily, securely and globally.
Role Description The role is about: - Data Team, where you play a vital role in collecting, analyzing, and interpreting data to support decision-making across the organization. - Your tasks include data collection, ensuring quality, and developing databases. - You're skilled in SQL, Python for data manipulation and visualization tools. - Collaborative and communicative, you work with various teams to understand their needs and provide actionable insights. - Passionate about staying updated with new technologies, you drive innovation and contribute to a culture of continuous improvement. Location: remote Poland, Portugal or on-site Cyprus Reporting to: Head of Engineering What you will do: - Lakehouse Architecture and Data Platform Design - Design, build, and maintain scalable data lakehouse solutions on AWS using S3, Apache Iceberg, and AWS Glue Catalog as core platform components. - Contribute to the evolution of the medallion architecture, ensuring that bronze, silver, and gold layers are reliable, performant, and aligned with business needs. - CDC and Streaming Data Ingestion - Build and support real-time and near-real-time ingestion pipelines that stream operational data from on-premise databases into AWS using Debezium, Kafka, Kafka Connect, and Iceberg sinks. - Monitor and troubleshoot streaming pipelines, including connector issues, schema changes, data consistency, and ingestion reliability. - Data Modelling and Business-Ready Layers - Design and implement silver and gold layer datasets that transform raw operational data into trusted, business-ready data products. - Work closely with analysts, analytics engineers, and business stakeholders to understand requirements and create reusable, well-structured data models. - Batch and Distributed Processing - Develop and maintain batch and distributed processing jobs using PySpark on AWS EMR and AWS Glue. - Optimize data transformation jobs for performance, scalability, reliability, and cost efficiency. - Data Integration and Orchestration - Build and maintain data workflows using Apache Airflow for API ingestion, batch processing, and orchestration across the medallion architecture. - Support integrations from external and third-party systems using tools such as Airbyte. - Data Quality, Governance, and Reliability - Implement data quality checks, validation processes, and reconciliation logic to ensure trusted and consistent datasets across the platform. - Contribute to data governance practices around documentation, ownership, lineage, access, and compliance. - Infrastructure and DevOps Collaboration - Collaborate on AWS infrastructure and deployment practices, working with services such as S3, Glue, EMR, IAM, EKS, and related platform components. - Support infrastructure-as-code workflows using Terraform and Terragrunt in collaboration with engineering and infrastructure teams. Qualifications - Minimum 3+ years of experience in data engineering or related roles. - Strong experience with SQL and data modeling for analytics and reporting use cases. - Strong programming experience with Python, ideally including PySpark. - Experience designing and maintaining ETL/ELT pipelines in production environments. - Experience with real-time or near-real-time data ingestion. - Experience working with Kafka or similar streaming technologies. - Experience with CDC concepts and tools such as Debezium. - Experience with data lake or lakehouse architectures on cloud platforms. - Hands-on experience with AWS data services such as: S3, Glue Catalog, Glue Jobs, EMR, IAM, Related AWS services. - Experience with Apache Iceberg, Delta Lake, or similar open table formats. - Experience designing curated analytics layers, such as silver and gold layers in a medallion architecture. - Experience with orchestration tools such as Apache Airflow or Dagster. - Experience working with relational databases such as MySQL, MariaDB, or PostgreSQL. - Working knowledge of Unix/Linux environments and shell scripting. - Understanding of data quality, governance, lineage, and production monitoring concepts. Good to Have - Experience with Apache Druid, ClickHouse, Snowflake, Databricks, or other analytical databases and warehouse platforms. - Experience with Airbyte or similar data integration tools. - Experience with dbt or collaboration with analytics engineering teams. - Experience with Terraform and Terragrunt. - Experience with Docker and Kubernetes. - Experience optimizing Spark jobs on EMR or AWS Glue. - Experience with data visualization tools such as: Tableau, Power BI, Superset, AWS QuickSight. - Experience with data observability, alerting, and monitoring tools. Benefits - Future-Proof Your Finances: Once you’ve passed probation, we’ll kickstart your Provident Fund to secure your future. - Grow with Us: Annual Learning Budget for professional development (eligible after probation)—because your growth is our growth. - Wolt Your Way Through Lunch: €150 monthly Wolt allowance to keep you fueled and happy. - Stay Active Your Way: Enjoy a SportsBenefits membership giving you access to a wide variety of gyms and sports facilities to support your active lifestyle. - Drive in Style: After one year with us, you may be eligible for a company car—performance and availability permitting. - Park with Ease: Complimentary parking space just steps from the office, so your commute is as smooth as your workday. - Max Out Your Downtime: 25 days of vacation + public holidays, plus an additional 10 sick days. - Shop & Save: Exclusive local discount card + tickets for exciting events like Beonix, basketball games, and more. - Speak Like a Local: Join free Greek language classes, twice a week, open to all team members. - Celebrate Together: We bring colleagues from all offices together for unforgettable company celebrations. - Global Collaboration & Events: Opportunities to participate in international company events and initiatives, connecting with colleagues from all regions and contributing to a truly global community. Hiring Process - Step 1 – Thinking in Action (45 minutes): Your first conversation will be with our Talent Acquisition team. We'll explore your background, career journey, motivations, and overall fit for the role. As part of this discussion, you'll also complete a short technical screening that will be reviewed by our engineering team. - Step 2 – Build in Production (60–90 minutes): Meet with the Hiring manager and technical experts for a practical assessment. Depending on the role, this may involve a live coding exercise or a real-world scenario designed to evaluate your technical skills, problem-solving approach, and ability to work through challenges similar to those faced by our teams. - Step 3 – Final Interview (45 minutes): The final stage is a group interview with senior members of our Technology squad, which may include the CTO and Head of Engineering. Together, we'll discuss team fit, collaboration style, expectations from both sides, and any remaining questions about the role, team, or technology domain. Let's embark on a journey to redefine the landscape of payments together. We're not just offering a role; we're inviting you to be a part of something bigger. Join our team, and let's innovate, disrupt, and lead the future of payments. Together, we can make an impact that resonates. Welcome to the team! Please review our Privacy Policy to understand how we process your personal data during the recruitment process: https://payabl.com/privacy-policy
Role Description As our Senior Data Engineer, you will focus on the acquisition of data, the flow of data through our data lakehouse to our data consumers. You will deliver data products to internal company employees as well as build data products for our external customers. You will help design and implement these systems and will interact with teams on both ends of the data flow. - Define and implement data pipelines using AWS, Fivetran, Snowflake, dbt, and Looker. - Serve as a key technical authority and team influencer, driving the vision, delivery, and continuous improvement of data products. - Translate business strategy into practical data engineering execution. - Lead the team in adopting and utilizing tools such as Fivetran, dbt, Iceberg, Dataiku, and feature flag frameworks. - Capture all important business data from our transactional systems into our data lakehouse. - Act as a crucial link between data engineering, general engineering, data science, and product teams during planning and delivery. - Emphasize clear communication, comprehensive documentation, and empower the team to deliver effectively. - Architect and lead the adoption of data technologies, integrating tools like Fivetran and dbt. - Support IAC strategy for infrastructure and pipeline deployment, ensuring compliance, rollback safety, and peer-reviewed workflows. - Identify best practices for feature flag toggling strategies in critical data pipelines. - Drive internal knowledge sharing and technical writing culture, including mentoring junior staff on documentation standards. - Thrive in collaborative team environments and mentor junior team members by providing guidance, support, and best practices. - Adept at designing scalable architectural solutions while effectively communicating complex concepts to both technical and non-technical audiences. Qualifications - At least 6 years experience in data engineering. - Strong understanding of ETL and data pipeline tools and techniques. - Proficiency in at least one SQL variant (we use MySQL and SnowSQL), and writing performant queries. - Highly collaborative team player with team leadership skills. - Experience with dbt or similar tools for moving, storing, and transforming data. - Strong programming experience, preferably in Python, or other object-oriented language. - Build highly reliable systems. - Strong diagnostic skills. - Strong organizational and communication skills. Requirements - The annual base salary range for this role is $150,000 — $185,000 USD. - Actual compensation may vary based on factors including the candidate's experience, qualifications, skills, and work location. - This position will remain posted until filled. Benefits - Competitive salary and benefits with growth-company options grant. - Fast-paced and professional work culture. - Stock options with standard startup vesting - 1 year cliff; 4 years total. - $50 monthly communication expense stipend to go towards your phone/internet bill. - $250 stipend to enhance your WFH setup. - Reimbursement for peripheral equipment: monitor (up to $400), keyboard and mouse (up to $200). - Premium medical benefits including vision and dental (100% coverage for employees). - Company-sponsored life and disability insurance. - Paid parental bonding leave. - Paid sick leave, jury duty, bereavement. - 401k plan. - Flexible Time Off (our team members typically take off ~3-4 weeks per year). - Volunteer Time Off. - 13 scheduled holidays.



