The communications protocol for web3 📲
Senior Data Engineer
Location
United Kingdom
Posted
78 days ago
Salary
0
Seniority
Senior
Job Description
Senior Data Engineer
WalletConnect, Inc.
• Design, build, and operate scalable data pipelines for WalletConnect payments and platform data — event-driven, near real-time processing across high-volume transaction flows. • Maintain and evolve the real-time data platform, moving it from MVP pipeline to scalable production architecture. • Model and process transactional and ledger-style data — financial reconciliation, merchant reporting, wallet fee breakdowns, and settlement tracking. • Contribute to improving the overall data platform architecture as requirements grow. • Ensure data accuracy, freshness, and observability across critical workflows — payments flow correctness, wallet connection success rates, and transaction health. • Build monitoring and alerting that meets the reliability bar required for financial data systems. • Own data quality across the pipeline — from ingestion through transformation to downstream consumption. • Develop backend services that expose data to internal platforms, APIs, and downstream systems so teams across the company can consume it. • Support downstream use cases including financial reconciliation, merchant reporting, operational monitoring, and product analytics. • Collaborate with product, engineering, and infrastructure teams to onboard new data use cases and ensure clean integration points. • Own and operate the systems you build, including deployment, monitoring, and reliability. • Collaborate closely with the Data Engineering Lead on architecture decisions and platform evolution. • Contribute to engineering standards, documentation, and operational playbooks for the data platform.
Job Requirements
- 5+ years of experience in data engineering or data infrastructure — you’ve built, shipped, and operated production data systems.
- Strong experience building data pipelines and production data platforms — ingestion, transformation, modelling, and serving.
- Comfortable using AI-assisted development tools/agents, with strong discipline in reviewing, validating, and productionizing generated code.
- Expertise in SQL and large-scale data processing.
- Experience with modern data stack tools: Airflow, dbt, ClickHouse, BigQuery, Snowflake, Athena, or similar.
- Experience working with event-driven architectures and real-time or near real-time data processing.
- Strong programming skills in Python or similar backend languages.
- Experience designing systems with data quality, monitoring, and reliability in mind — you treat data correctness as a first-class concern.
- Ability to operate independently and own production systems end-to-end in a remote, async team.
- Nice-to-Haves: Experience in fintech, payments, or financial infrastructure — reconciliation, settlement, ledger reporting, or merchant data.
- Experience working with high-volume event data at scale.
- Familiarity with ledger-style or transactional data models.
- Exposure to Web3, blockchain, or crypto ecosystems — on-chain data, wallet analytics, or token transaction flows.
- Rust experience or willingness to learn.
- Experience building data platforms in fast-growing startups where you’ve shaped the architecture from early stages.
Benefits
- Fully remote position with a budget for your home office or work environment.
- Regular team offsites to incredible locations around the world.
- Opportunities to travel to conferences and community events.
- Generous PTO and parental leave.
- Meaningful Learning & Development budget.
- Competitive compensation package including salary, equity, and potentially tokens.
- Healthcare coverage for US-based team members.
- The chance to build at the forefront of onchain payments with one of the most recognised companies in Web3.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Military Advisor- Big Data & Systems Engineer (Part Time/ Remote) (Mission Assurance 4)- 27692
HII's Mission Technologies divisionHII works within our nation’s intelligence and cyber operations communities to defend our interests in cyberspace and anticipate emerging threats. Our capabilities in cybersecurity, network architecture, reverse engineering, software and hardware development uniquely enable us to support sensitive missions for the U.S. military and federal agency partners.
Requisition Number: 27692 Required Travel: 51 - 75% Employment Type: Part Time/Hourly/Non-Exempt Anticipated Salary Range: $106,124.00 - $150,000.00 Security Clearance: Ability to Obtain Level of Experience: Senior HI This opportunity resides with All-Domain Operations (ADO), a business group within HII’s Mission Technologies division. All-Domain Operations comprises multi-domain operations, platforms and logistics, and intelligence operations. HII designs, develops, integrates and manages the sensors, systems and other assets necessary to support integrated ISR operations and accelerated decision-making. With data fusion and mission management capabilities for the Department of Defense, the combatant commands and the intelligence community, HII advances the mission around the globe. Meet HII’s Mission Technologies Division Our team of more than 7,000 professionals worldwide delivers all-domain expertise and advanced technologies in service of mission partners across the globe. Mission Technologies is leading the next evolution of national defense – the data evolution - by accelerating a breadth of national security solutions for government and commercial customers. Our capabilities range from C5ISR, AI and Big Data, cyber operations and synthetic training environments to fleet sustainment, environmental remediation and the largest family of unmanned underwater vehicles in every class. Find the role that’s right for you. Apply today. We look forward to meeting you. To learn more about Mission Technologies, click here for a short video: https://vimeo.com/732533072 Summary HII-Mission Technologies is seeking an experienced and skilled Military Advisor- Big Data Analytics & Systems Engineer to provide expert guidance and support to our military clients! As a Military Advisor, you will be responsible for providing technical expertise, developing and delivering training programs, and conducting operational assessments. In this role, you will support large-scale data collection, processing, and analysis efforts focused on understanding population sentiment, digital trends, and information environments. The selected candidate will design and implement systems that capture, process, and analyze high-volume data from scraping, collection, and digital monitoring efforts. These insights will support programs designed to build situational awareness of the digital environment, identify emerging trends, and inform strategic messaging, engagement, and influence activities. This role combines data engineering, analytics, and digital environment analysis, requiring both technical expertise and the ability to translate large datasets into actionable insights. Come join our growing team today! *Position: Remote and part time. *Travel: This position requires episodic travel to OCONUS locations, often to remote and challenging environments. Expect deployments lasting several weeks to months at a time. Travel may include locations with limited infrastructure and security concerns. What you will do - Develop and maintain systems to capture and process large-scale datasets from scraping, automated collection, and external data feeds - Design data pipelines that ingest structured and unstructured data at scale - Manage ETL processes to clean, normalize, and integrate multiple data sources - Analyze large datasets to identify population sentiment, behavioral patterns, and digital engagement trends - Apply statistical analysis, machine learning, and natural language processing techniques to extract insights from text and social media data - Monitor shifts in online discourse and emerging narratives - Design and implement scalable big data architectures to support large analytical programs - Integrate data systems into platforms used for digital awareness and influence analysis programs - Ensure systems support high-volume processing and rapid analytical outputs - Translate complex datasets into actionable insights for program planners and decision makers - Develop dashboards, visualizations, and analytical reports - Support program efforts aimed at understanding information flows, messaging effectiveness, and audience behavior - Additional duties as assigned or required What we are looking for - 9 years relevant experience with Bachelors in related field; 7 years relevant experience with Masters in related field; 4 years relevant experience with PhD or Juris Doctorate in related field; or High School Diploma or equivalent and 13 years relevant experience - Experience with large-scale data analytics and distributed data systems - Strong proficiency in Python and SQL - Experience working with large datasets from scraping, APIs, or automated collection systems - Experience designing data pipelines and big data processing workflows - Strong communication skills to translate analytics into operational insights - Excellent presentation and interpersonal skills - Ability to work effectively in a fast-paced, dynamic environment - Willingness to deploy up to 50% of the time as required by mission needs - Clearance: Must be able to obtain and maintain a Secret clearance Bonus points for... - Instructor experience, with a proven ability to develop and deliver effective training programs - Ability to identify patterns and insights in large, noisy datasets - Understanding of digital ecosystems and online behavioral trends - Experience building analytical tools for monitoring and assessing information environments - Experience with social media analytics or sentiment analysis - Experience applying natural language processing (NLP) to large text datasets - Experience with machine learning techniques for trend detection or classification - Experience with web scraping frameworks and large-scale data collection systems - Experience with distributed data environments such as Spark, Hadoop, or Kafka - Clearance: Possess and maintain a Secret clearance Physical Requirements May require working in an office, industrial, shipboard, or laboratory environment. Capable of climbing ladders and tolerating confined spaces and extreme temperature variances. HII is more than a job - it’s an opportunity to build a new future. We offer competitive benefits such as best-in-class medical, dental and vision plan choices; wellness resources; employee assistance programs; Savings Plan Options (401(k)); financial planning tools, life insurance; employee discounts; paid holidays and paid time off; tuition reimbursement; as well as early childhood and post-secondary education scholarships. Bonus/other non-recurrent compensation is occasionally offered for qualified positions, and if applicable to this role will be addressed by the recruiter at the screening phase of application. Why HII We build the world’s most powerful, survivable naval ships and defense technology solutions that safeguard our seas, sky, land, space and cyber. Our workforce includes skilled tradespeople; artificial intelligence, machine learning (AI/ML) experts; engineers; technologists; scientists; logistics experts; and business administration professionals. Recognized as one of America’s top large company employers, we are a values and ethics driven organization that puts people’s safety and well-being first. Regardless of your role or where you serve, at HII, you’ll find a supportive and welcoming environment, competitive benefits, and valuable educational and training programs for continual career growth at every stage of your career. Together we are working to ensure a future where everyone can be free and thrive. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, physical or mental disability, age, or veteran status or any other basis protected by federal, state, or local law. Do You Need Assistance? If you need a reasonable accommodation for any part of the employment process, please send an e-mail to buildyourcareer@hii-co.com and let us know the nature of your request and your contact information. Reasonable accommodations are considered on a case-by-case basis. Please note that only those inquiries concerning a request for reasonable accommodation will be responded to from this email address. Additionally, you may also call 1-844-849-8463 for assistance. Press #3 for HII Mission Technologies.
Afresh is the leading AI company in fresh food—partnering with grocers like Albertsons, Wakefern, Meijer, and Stater Bros to order billions of dollars of fresh food in over 12,000 grocery departments nationwide. Following record-breaking 70% growth in 2025, we’ve expanded our platform to cover all fresh departments, launched our full store suite, and debuted DC Fresh Buying. We’re on a mission to eliminate food waste and make fresh food accessible to all. In 2025 alone our software helped save 200M lbs of food waste. If you're looking for a role where your work directly translates into massive scale and social good, and you want to be part of the team that defines the future of fresh, there is no better time to join us. About the Role We’re looking for a Data Engineer who’s excited to work at the intersection of food waste, large-scale data processing, and applied AI. In this role, you’ll help shape how customer data flows through our platform, improving how we ingest, transform, and operationalize real-world datasets to drive down food waste for grocery chains. You’ll work closely with other data engineers, product engineers, and AI/ML engineers to design and implement reliable, efficient ETL pipelines and streamline how we integrate with new customers. You’ll contribute to the development of new features that support our expanding product lines. Your work will have a direct and visible impact on our ability to onboard customers more easily/quickly and power our machine learning grocery solution. What You’ll Do - Build and maintain robust data pipelines that ingest, transform, and validate complex customer data using PySpark, Python, and dbt to process billions of records from customer datasets, ensuring data is accurate, reliable, and ready for downstream use. - Help improve integrations with new customers, making the process faster and more repeatable through thoughtful tooling. - Contribute to the adoption of cutting-edge AI tooling (e.g., LLM-assisted data cleaning, semantic validation, and anomaly detection). - Collaborate with product, engineering, and go-to-market teams to design and deliver data solutions for new products and features. - Identify and implement optimizations to improve ETL runtime and data processing scalability, reducing the time and effort required for integrations. - Solve real-world data quality challenges by working directly with messy, incomplete, or inconsistent customer data to extract the signal we need. - Learn and grow by pairing with other engineers, participating in design reviews, and taking on bigger and bigger projects. Skills and Experience - 2+ years of experience building ETLs or data workflows with Python, PySpark, SQL, or similar tools. - Comfortable working with messy, incomplete, or inconsistent datasets—and turning them into something structured and usable. - Experience in identifying areas where tooling or automation can simplify workflows and reduce manual effort. - Experience or strong interest in platforms like Databricks, Snowflake, and dbt. - Strong problem-solving skills and the ability to work with ambiguous or incomplete requirements to deliver concrete, impactful solutions. - Attention to detail and pride in delivering robust, maintainable solutions. - Collaborative and communicative — you work well across teams and aren't afraid to ask questions. - Learning mindset — hungry to grow your skills and move fast. We encourage all highly-qualified candidates to apply, even if they don’t meet every listed qualification. We encourage you to apply even if you don’t meet every requirement. This position is not eligible for employer sponsorship Salary Band in Canada: $114,00 - 154,000 Salary Band in U.S.: $130,000 - $176,000 About Afresh Founded in 2017, Afresh is working on the #1 solution to curb climate change: reducing food waste. By combining human insight and transformative technology, we're helping grocers provide fresher food to customers at more affordable prices. Afresh sits at an incredible intersection of positive social impact, rocket ship financial growth, and cutting-edge technology. Our best-in-class AI research has been published in top journals including ICML, and we've raised over $148 million in funding from investors including former co-CEO of Whole Foods Market Walter Robb and Eric Schmidt's Innovation Endeavors. Fresh is the past, present, and future of our food system – the waste we create today will impact our planet for years to come. Join us as we continue to build a vibrant, diverse, and inclusive team that embodies our company’s values of proactivity, kindness, candor, and humility. Afresh provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, genetics, sexual orientation, gender identity/expression, marital status, pregnancy or related condition, or any other basis protected by law. Here at Afresh, many of our employees work remotely provided that they reside in one of the following states: AL, AR, CA, CO, FL, GA, IL, KY, MA, MI, MT, MO, NV, NJ, NY, NC, OR, PA, TX, WA, UT, VA, WI.
Afresh is the leading AI company in fresh food—partnering with grocers like Albertsons, Wakefern, Meijer, and Stater Bros to order billions of dollars of fresh food in over 12,000 grocery departments nationwide. Following record-breaking 70% growth in 2025, we’ve expanded our platform to cover all fresh departments, launched our full store suite, and debuted DC Fresh Buying. We’re on a mission to eliminate food waste and make fresh food accessible to all. In 2025 alone our software helped save 200M lbs of food waste. If you're looking for a role where your work directly translates into massive scale and social good, and you want to be part of the team that defines the future of fresh, there is no better time to join us. About the Role As a Senior Data Engineer, you’ll play a key role in scaling and improving how we integrate and process customer data. You will design and implement ETLs that reliably process large volumes of customer-provided data and build tools/improve the platform to make customer integrations faster, more accurate, and more scalable. You’ll also contribute to the development of new features that support our expanding product lines. Your work will have a direct and visible impact on our ability to onboard customers more easily and quickly and power our machine learning grocery solution. What You’ll Do - Build tools and frameworks that streamline customer integrations, enabling faster onboarding and better handling of customer data. - Create robust ETLs in PySpark and DBT to process billions of records from customer datasets, ensuring data is accurate, reliable, and ready for downstream use. - Investigate and implement new technologies into the data platform, focusing on practical solutions that address current pain points and anticipate future needs. - Collaborate with product, engineering, and go-to-market teams to design and deliver data solutions for new products and features. - Identify and implement optimizations to improve ETL runtime and data processing scalability, reducing the time and effort required for integrations. - Solve real-world data quality challenges by working directly with messy, incomplete, or inconsistent customer data to extract the signal we need. - Support team members by mentoring engineers, leading technical discussions, and providing clear, actionable feedback. What Makes You a Great Fit We encourage all highly-qualified candidates to apply, even if they don’t meet every listed qualification. - Significant experience designing and maintaining ETLs that process large-scale datasets. - Proficiency with Python, PySpark, SQL, and experience working on platforms/tools like Databricks, Snowflake, or DBT. - Strong problem-solving skills and the ability to work with ambiguous or incomplete requirements to deliver concrete, impactful solutions. - A focus on practical outcomes—you're skilled at balancing technical rigor with the need to get things done. - Experience working directly with complex, unclean datasets and finding innovative ways to process and analyze them. - A knack for identifying areas where tooling or automation can simplify workflows and reduce manual effort. - Excellent communication skills—you’re able to explain your ideas clearly to both technical and non-technical audiences. - Proven leadership in technical projects, with a willingness to mentor and help others grow. Why Work Here - Join a mission-driven company reducing millions of pounds of food waste in grocery stores per year. - Work on challenging, real-world problems that have a direct impact on our customers. - Be part of a collaborative, supportive team where your ideas are valued and acted on. - Use cutting-edge tools and platforms to solve meaningful data challenges. We’re looking for someone who thrives on tackling complex data problems and takes pride in building systems that work seamlessly at scale. If that sounds like you, we’d love to hear from you! This position is not eligible for immigration sponsorship Salary Range in U.S.: $156,000 - $211,000 Salary Range in Canada (CAD): $137,000 - $185,000 About Afresh Founded in 2017, Afresh is working on the #1 solution to curb climate change: reducing food waste. By combining human insight and transformative technology, we're helping grocers provide fresher food to customers at more affordable prices. Afresh sits at an incredible intersection of positive social impact, rocket ship financial growth, and cutting-edge technology. Our best-in-class AI research has been published in top journals including ICML, and we've raised over $148 million in funding from investors including former co-CEO of Whole Foods Market Walter Robb and Eric Schmidt's Innovation Endeavors. Fresh is the past, present, and future of our food system – the waste we create today will impact our planet for years to come. Join us as we continue to build a vibrant, diverse, and inclusive team that embodies our company’s values of proactivity, kindness, candor, and humility. Afresh provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, genetics, sexual orientation, gender identity/expression, marital status, pregnancy or related condition, or any other basis protected by law. Here at Afresh, many of our employees work remotely provided that they reside in one of the following states: AL, AR, CA, CO, FL, GA, IL, KY, MA, MI, MT, MO, NV, NJ, NY, NC, OR, PA, TX, WA, UT, VA, WI.
Data Engineering Summer Intern
Judi HealthJudi Health values a diverse workplace and celebrates the diversity that each employee brings to the table. We are proud to provide equal employment opportunities to all employees and applicants for employment and prohibit discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, medical condition, genetic information, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.
Role Description We are seeking a highly motivated and talented Data Engineering Intern to join our team and play a critical role in shaping the future of healthcare data management. This individual will be involved in supporting building robust, scalable, and accurate data systems that empower operational and analytics teams to make informed decisions and drive positive outcomes. Position Responsibilities: - Partner closely with operational and analytics teams to translate business needs into effective data solutions - Architect and implement ETL workflows leveraging CapitalRx platforms and technologies such as Python, dbt, SQLAlchemy, Terraform, Airflow, Snowflake, and Redshift - Conduct testing to ensure the flawless execution of data pipelines before production deployment - Proactively identify and resolve data-related issues, ensuring system reliability and data integrity - Provide ongoing maintenance and support for data infrastructure - Responsible for adherence to the Capital Rx Code of Conduct including reporting of noncompliance. Qualifications - Pursuing a Masters degree in Computer Science, Information Technology, or a related field - Knowledge of Python (or Java), SQL, JSON, and XML - Knowledge of data warehousing architecture techniques and familiarity with Kimball methodology - A strong interest in data engineering, displaying the ability to design, implement, and maintain complex data pipelines - Capacity to analyze the company's broader data landscape and architect scalable data solutions that support growth - Excellent communication skills to collaborate effectively with both technical and non-technical stakeholders - A self-motivated and detail-oriented individual with the ability to tackle and solve intricate technical challenges Requirements - Experience as a Data Engineer, ideally in the healthcare or PBM sector - Knowledge of Airflow, dbt, Snowflake, and SQL development and Python experience Benefits - Salary Range: $35 - $40 USD

