Senior Software Engineer, Data Platform
Location
Canada
Posted
88 days ago
Salary
CA$170K - CA$280K / year
Seniority
Senior
Job Description
Senior Software Engineer, Data Platform
Lithic
• Design, build, and maintain backend services and REST APIs that serve data from various SQL subsystems and other data sources • Develop well-tested, production-grade Python services with clean API contracts, proper authentication, versioning, and error handling • Work closely with the Analytics Engineering team to expose modeled data (billing, settlement, finance) through APIs that downstream consumers can rely on • Build internal tooling and services that enable the broader organization to self-serve their data needs without writing SQL • Participate in code reviews, system design discussions, and engineering best practices across the Infrastructure org • Contribute to service observability: logging, metrics, alerting, and on-call practices for the services you own • Maintain and improve existing data pipelines that move data from source systems into Snowflake (Airflow, Airbyte) • Contribute to the dbt project alongside the Analytics Engineering team — model improvements, test coverage, and data quality • Support data governance practices including access controls, lineage documentation, and data quality standards
Job Requirements
- Strong Python proficiency with experience building backend services and REST APIs
- Experience with web frameworks such as FastAPI, Flask, Django, or similar
- Solid SQL skills and hands-on experience with modern cloud data warehouses (Snowflake strongly preferred)
- Experience designing and building production APIs with proper authentication, versioning, and error handling
- Familiarity with CI/CD, automated testing, and operational reliability practices
- A track record of shipping reliable, well-tested services in production environments
- Comfort navigating ambiguity and driving projects forward with minimal oversight
- Experience with data pipeline development using tools like Airflow, Airbyte, Dagster, or similar (preferred)
- Familiarity with dbt or similar transformation frameworks (preferred)
- Experience in fintech, payments, or other financial services environments (preferred)
- Familiarity with AWS services (Lambda, S3, RDS, API Gateway, ECS/Fargate) (preferred)
- Kafka or event streaming experience (preferred)
- Infrastructure-as-code experience (Terraform, Pulumi) (preferred)
Benefits
- Unlimited PTO
- 12-weeks fully paid parental leave
- 4-Week Fully Paid Sabbatical (earned at your 5-year anniversary)
- Work From Anywhere: work from anywhere in the world 4-weeks each year
- 3% cashback on card purchases with your complimentary Privacy.com employee account
- Health, vision, and dental insurance; HSA Contribution Match
- 401(k) match
- Voluntary Life Insurance and STD/LTD
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Senior Data Engineer – Full Stack
EXLWe make sense of data to drive your business forward. #MakeSenseofData #DriveYourBusinessForward #PartnerYourWay
• Platform Strategy & Leadership • Technical Direction: Define and champion the architectural roadmap and best practices for our end-to-end data pipelines, ensuring scalability, reliability, and security across the platform. • Team Mentorship & Project Velocity: Act as a primary technical mentor, guiding a team of engineers, conducting code reviews, and aggressively driving the project timeline to ensure rapid delivery of data products. • Stakeholder Collaboration: Partner with Data Scientists, Analysts, and business stakeholders to translate complex requirements into robust, production-ready data solutions. • Collaboration with Data Scientists and ML Engineers: Data Accessibility, Support for Model Development, Data Quality Assurance • Data Pipeline Development & Management • Ingestion & Transformation: Design, build, and optimize high-volume data ingestion and transformation jobs using tools like dbt Core, AWS Glue, or Flexter, ensuring data quality and integrity. • Workflow Orchestration: Develop and maintain sophisticated data pipelines using orchestrators such as Dagster or Talend, focusing on modularity and reusability. • Streaming & Real-time Integration: Implement and manage real-time data flows utilizing Confluent platforms or native AWS streaming services (e.g., Kinesis) for immediate data availability. • Data Security and Privacy: Data Anonymization, Compliance with Regulations • Be well versed with DataOps and DevOps fundamentals - Assist and drive the Data Ecosystem Management & Monitoring - Open Table Formats & Management: Implement and maintain the Iceberg open table format, utilizing tools like Upsolver (Talend Open Lakehouse) for efficient schema evolution and data management. - Compute Engine Optimization: Optimize query performance and cost efficiency across our primary compute engines: Snowflake, Amazon Redshift, and AWS Athena. Observability & Monitoring: Integrate comprehensive monitoring and observability into all pipelines using Splunk to ensure high availability, rapidly identify bottlenecks, and troubleshoot production issues
• Make data originating from global (external) sources available in an analytical data store for business areas, ensuring governance and access in accordance with policies and governance established by Rumo. • Build data pipelines with DevOps practices, using Terraform and Jenkins/GitHub to automate AWS infrastructure provisioning and solution deployments. • Assist data analysts in classifying personal and sensitive data and configuring it in AWS Lake Formation (column- and row-level access permissions). • Process large volumes of data using Spark via EMR Studio and AWS Glue Jobs and Workflows. • Assist data analysts in designing dimensional models for data analysis (facts and dimensions).
Data Integration Specialist (Contractor)
Alloy.aiAlloy.ai is purpose-built to help consumer goods brands sell more products, save time and solve complex supply chain challenges. With daily SKU-store level insights in Alloy.ai, brands can quickly sense problems, respond in seconds instead of days, and predict issues their competitors won’t see coming. Alloy.ai is built on a cloud data platform powered by 850+ pre-built connectors that integrate point-of-sale and inventory data with supply chain data — giving brands complete and instant visibility into demand and inventory across their network. Alloy.ai is trusted by companies ranging from the Fortune 500 to digital-natives, including Crayola, Bic, Valvoline, Bosch, Simplisafe, and Melissa & Doug. Customers routinely achieve a 35%+ reduction in out-of-stocks, a 5%+ bottom line impact, and millions of dollars in incremental orders with their retail partners.
About Alloy.ai At Alloy.ai, we work with consumer goods companies that make the products we eat, wear, and use every day, as well as the ones we occasionally splurge on. We’re tackling a real and complex problem for them—managing supply and demand in the face of constantly changing customer behavior, highly complex supply chain networks, 40-year-old data standards and labor-intensive manual processes. Alloy.ai is a fast-growing, well-funded startup with an expanding presence across the world. Our team hails from successful startups, leading tech companies and Fortune 100 enterprises. We believe deeply in fostering individual ownership, iterating to excellence, focusing on what matters, communicating openly & respectfully, and supporting one another. We encourage people of all backgrounds to apply. Alloy.ai is committed to creating an inclusive culture, and we celebrate diversity of all kinds. About The Role Our network-based data platform is one of Alloy.ai’s core strategic assets. When we work with manufacturers, we are able to quickly integrate disparate information shared by their trading partners, including retailers, material suppliers, distributors and logistics providers, and we can do that up to an order of magnitude faster than other solutions. Most of our integration infrastructure with more than 400 active integrations is fully reusable, and connections to common trading partners are maintained across multiple Alloy customers. Our implementation team is in charge of building,and deploying data for customers, ensuring integration best practices are adhered to. This contractor role extends our implementation team and will interface with integration specialists, project managers and our engineering team. About You In this role, you will help a project team deliver retailer data integrations to our customers. Your task is to devise data mapping procedures for new retailer data feeds based on existing best practices for feed design and implementations and to deliver them to our customers. You will write data transformations for our data pipeline which processes our customers’ data at any time of day. You will get to know the data back office of retailers you may know from your daily shopping and learn more about some of your favourite brands’ businesses. To succeed in this position, you should possess curiosity, creativity, good problem solving skills and be an effective communicator all while being able to work successfully in a team and independently. What You Will Do - Design and build new integrations for retailer data sources based on customer requirements to unlock powerful cross-retailer analyses combining data from various, disparate data sources. - Critically QA and test your work. - Analyze data for issues and report back possible solution paths to team members if you cannot solve them. - Facilitate quality checks and provide User Acceptance Testing dashboards for integrations prior to customer sign off. - Work together with a project team of project managers, integrations specialists, and data engineers to deliver a stellar customer experience throughout the implementation journey. - Deliver against a project plan with deadlines and timelines while providing progress as necessary to internal stakeholders. What We Are Looking For - You are adept at data analysis and data wrangling through programming (e.g. pandas, dplyr), database querying (SQL), or spreadsheets (Excel). - You can successfully work independently on projects and deliver to deadlines. - Ability to communicate regularly to stakeholders and identify delays or roadblocks early to ensure key deadlines and milestones are met. - You are intellectually curious, especially about data, and are constantly eager to find out how things work and how to fix them. - You are a self-starter, and actively seek advice from other team members to maximize the quality of your work. - You are an effective communicator both verbally and written with a knack for translating technical details to non-technical audiences. - You are organized, can effectively keep track of a long to-do list in order to prioritize and deliver tasks on time. You leave no loose ends! - Preferably, you have some experience working with versioning tools and code review. $30 - $30 an hour Role Specifics - Contract role is hourly with an expected initial scope of 20 hours a week with daily, set hours overlapping with 9am - 5pm EST. There is potential for additional hours up to 40 hours a week, with flexibility to set your own schedule over time if deliverables are being met. - This is a 6 month contract position to start with a potential opportunity for extension. - Role is preferred to be in person in Vancouver or Toronto but Remote will be considered for the right candidate. - Work needs to be completed from the United States or Canada unless discussed ahead of time with the VP of Operations and hiring manager. - Contractor needs to have a computer that meets the below requirements (if not possible please let us know ahead of time for potential alternatives) and comply with all of Alloy’s security requirements including a basic background check. - Must be able to enable full hard disk encryption - Pay will be semi-monthly. This is not a full time position and does not offer benefits. Alloy reserves the right to request a schedule change even after schedule is set as business needs arise but contractor can as well as long as it fits with other contractors. Any days off (including statutory holidays) should be agreed upon in advance to ensure coverage. This is a month to month contract position with an initial commitment of 6 months. Contractor will need to meet Alloy’s security requirements including: basic background check upon offer as Contractor will be dealing with sensitive data, accepting and complying with all Alloy security policies, and have a computer with full hard disk encryption (if not possible please let us know ahead of time for potential alternatives).
Data Science Investigations Department: Investigations Employment Type: Full Time Location: Remote Description Who are we? Hi! 👋 We are Ravelin! We're a fraud detection company using advanced machine learning and network analysis technology to solve big problems. Our goal is to make online transactions safer and help our clients feel confident serving their customers. And we have fun in the meantime! We are a friendly bunch and pride ourselves in having a strong culture and adhering to our values of empathy, ambition, unity and integrity. We really value work/life balance and we embrace a flat hierarchy structure company-wide. Join us and you’ll learn fast about cutting-edge tech and work with some of the brightest and nicest people around - check out our Glassdoor reviews. If this sounds like your cup of tea, we would love to hear from you! For more information check out our blog to see if you would like to help us prevent crime and protect the world's biggest online businesses. The Role We are currently looking for a Junior level Data Scientist to join a fantastic team of client-facing data scientists and client support analysts. You will be working to discover patterns and trends concerning fraud in our clients' data. In this key role, you'll be applying exploratory analysis to form realistic and useful narratives from data, asking “why” as well as “what” and “how". You will interact directly and indirectly with clients to help them understand what is happening with their fraud, and help us to target our efforts ever more precisely. Key Responsibilities Responsibilities - Work directly with clients to provide fraud analytics and ML model insights - Analyse datasets with millions of rows to identify fraud patterns, trends and emerging threats to improve client performance - Discuss specific fraud problems with clients, in order to deeply understand how they manifest and to propose effective and elegant solutions - Prepare reports and present findings of analysis to clients when required - Identify new model features and improve model performance - Optimise the performance of our graph networks using network analysis - Get hands on experience with our cloud infrastructure and make the most of the available tools for enhancing our clients’ data and performance - Build internal tools in Python for optimising and improving our analytical capabilities Skills, Knowledge and Expertise Requirements - 1 years' experience or training as a data analyst, intelligence analyst or data scientist - Strong critical thinking skills, intuitively curious and able to diagnose data issues - Strong communication and presentation skills - Diligence, attention to detail, ability to prioritise and follow through on tasks - Experience with SQL - ability to run complex queries to answer your own questions - Experience with Python for data analysis - Knowledge of supervised and unsupervised ML techniques - Desirable: some knowledge, understanding or experience of network analysis - Desirable: hands-on experience with DBT Benefits Benefits - Flexible Working Hours & Remote-First Environment — Work when and where you’re most productive, with flexibility and support. - Comprehensive BUPA Health Insurance — Stay covered with top-tier medical care for your peace of mind. - £1,000 Annual Wellness and Learning Budget — Prioritise your health, well-being and learning needs with funds for fitness, mental health, and more. - Monthly Wellbeing and Learning Day — Take every last Friday of the month off to recharge or learn something new, up to you. - 25 Days Holiday + Bank Holidays + 1 Extra Cultural Day — Enjoy generous time off to rest, travel, or celebrate what matters to you. - Mental Health Support via Spill — Access professional mental health services when you need them. - Aviva Pension Scheme — Plan for the future with our pension program. - Ravelin Gives Back — Join monthly charitable donations and volunteer opportunities to make a positive impact. - Fortnightly Randomised Team Lunches — Connect with teammates from across the company over in person or remote lunches every other week on us! - Cycle-to-Work Scheme — Save on commuting costs while staying active. - BorrowMyDoggy Access — Love dogs? Spend time with a furry friend through this unique perk. - Weekly Board Game Nights & Social Budget — Unwind with weekly board games or plan your own socials, supported by a company budget. *Job offers may be withdrawn if candidates do not meet our pre-employment checks: unspent criminal convictions, employment verification, and right to work.*



