TRM Labs

TRM Labs specializes in blockchain investigations and risk management, empowering organizations to detect, investigate, and prevent crypto-related fraud and financial crime. Founde

Senior Software Engineer, Data Platform

Location

Canada

Posted

1 day ago

Salary

0

Seniority

Senior

Job Description

Senior Software Engineer, Data Platform

TRM Labs

Role Description As a Senior Software Engineer on the Data Platform team, you will be responsible for executing mission-critical systems and data services that analyze blockchain transaction activity at petabyte scale, and ultimately work to build a safer financial system for billions of people. - Build highly reliable data services to integrate with dozens of blockchains. - Develop complex ETL pipelines that transform and process petabytes of structured and unstructured data in real-time. - Design and architect intricate data models for optimal storage and retrieval to support sub-second latency for querying blockchain data. - Oversee the deployment and monitoring of large database clusters with an unwavering focus on performance and high availability. - Collaborate across departments, partnering with data scientists, backend engineers, and product managers to design and implement novel data models that enhance TRM’s products. Qualifications - A Bachelor's degree (or equivalent) in Computer Science or a related field. - A proven track record, with 5+ years of hands-on experience in architecting distributed system architecture, guiding projects from initial ideation through to successful production deployment. - Exceptional programming skills in Python, as well as adeptness in SQL or SparkSQL. - Versatility that spans the entire spectrum of data engineering in one or more of the following areas: - In-depth experience with data stores such as Iceberg, Trino, BigQuery, and StarRocks, and Citus. - Proficiency in data pipeline and workflow orchestration tools like Airflow, DBT, etc. - Expertise in data processing technologies and streaming workflows including Spark, Kafka, and Flink. - Competence in deploying and monitoring infrastructure within public cloud platforms, utilizing tools such as Docker, Terraform, Kubernetes, and Datadog. - Proven ability in loading, querying, and transforming extensive datasets. Requirements - Build scalable engines to optimize routine scaling and maintenance tasks. - Enable tasks to be faster next time and reduce dependency on a single person. - Identify ways to compress timelines using the 80/20 principle. - Identify first version, a.k.a., "skateboards" for projects. Benefits - Remote-first and async friendly environment. - High level of personal ownership and accountability. - Close collaboration across teams and functions. - Creative problem solving and out-of-the-box thinking. - A pace that rewards urgency, adaptability, and outcomes. Company Description TRM Labs provides AI-powered intelligence solutions that help public and private sector agencies investigate and disrupt crime. TRM's platforms enable investigators to trace illicit activity, build cases, and construct operating pictures of threat networks. TRM is a Series C company with $220M in total funding, backed by Blockchain Capital, Goldman Sachs, Bessemer, Y Combinator, Thoma Bravo, and others. Headquartered in San Francisco, TRM operates as a distributed-first company with hubs in Los Angeles, San Francisco, New York, Washington D.C., London, and Singapore.

Related Categories

Related Job Pages

More Data Engineer Jobs

Peraton Corporation logo

Senior Technical Lead for Data

Peraton Corporation

Peraton Corporation, a national security company headquartered in Herndon, Virginia, supplies solutions for mission-critical programs and systems. Founded in 2017, Peraton's missio

Data Engineer1 day ago

Role Description We are looking for a highly experienced Senior Technical Lead for Data to lead engineering and architectural efforts supporting the design, development, and maintenance of large-scale enterprise data systems. The ideal candidate will have deep expertise in data systems architecture, cloud environments, and enterprise database products, with proven leadership managing high-availability mission-critical systems in federal environments. You will oversee engineering teams, manage risk, develop technical performance metrics, and ensure the stable, secure, and efficient operation of data systems integrated with Identity and Access Management (IAM) and cloud platforms. As the Senior Technical Lead for Data, you will serve as the authoritative technical voice for all data-related workstreams, translating complex business and mission requirements into scalable, secure, and compliant data architectures while directly mentoring and guiding a team of data engineers. Sitting at the intersection of data engineering, cloud architecture, data governance, and technical leadership, you will collaborate closely with IAM engineers, platform architects, data scientists, security teams, and program leadership to ensure the data platform is modern, resilient, and aligned with federal data governance mandates and Zero Trust principles. - Lead the design, development, evaluation, testing, and integration of organizational data systems infrastructure, including both hardware and software components. - Ensure all systems meet stability, integrity, and efficient operation requirements in accordance with approved specifications; verify systems are properly maintained and optimized once operational. - Provide technical support for acquisition documentation, milestone reviews, and key operational and test events throughout the program lifecycle. - Oversee the systems engineering team and all engineering activities supporting organizational data and information systems, including networked software and associated operating systems. - Execute and manage risk assessments, develop mitigation strategies, and plan cost, schedule, and execution plans for assigned projects. - Develop and review technical performance metrics to track and communicate system health, delivery progress, and operational readiness. - Plan, manage, and coordinate multiple concurrent tasks, each with strict deadlines across a large-scale, highly available system integrated with business-critical platforms. - Drive continuous improvements and optimizations to database systems, data encryption, storage, and retention strategies. - Collaborate with IAM engineers, platform architects, data scientists, security teams, and program leadership to ensure data solutions align with organizational goals, AWS GovCloud architecture, and IAM frameworks. - Support agile development teams by assessing how enhancements, defects, and other requests impact the architecture and performance of the application. - Demonstrate expert knowledge of recent technological advances in computer science and engineering to inform architectural decisions and modernization efforts. - Provide excellent written and verbal communication to stakeholders at all levels, including executive briefings, technical documentation, and team guidance. Qualifications - Minimum of 12 years with BS/BA or 16 years with a HS diploma/equivalent. - Minimum 10 years of experience in Information Technology supporting complex data systems. - 7+ years of experience working with IBM, Oracle, and cloud-based database products. - Training and certification (mandatory) in target ICAM database products preferred, especially Oracle and DB2. - Strong understanding of software development, enhancement, and maintenance lifecycles. - Demonstrated experience with the planning, management, leadership, and coordination of multiple concurrent tasks with strict deadlines for large-scale, highly available systems integrated with business-critical platforms. - Demonstrated expertise in data encryption, data storage, and retention policies in secure federal environments. - Proven ability to perform complex technical tasks in a highly secure environment. - Strong technical knowledge of IT systems, IAM, and AWS GovCloud services. - Experience with agile/scrum methodologies. - Expert knowledge of recent advances in computer science and engineering. - Must be able to obtain and maintain the required agency clearance. - Must be a US Citizen. Preferred Skills - Experience with federal IT programs, regulatory compliance, and federal acquisition documentation. - Familiarity with enterprise data governance and security frameworks (NIST, FISMA, FedRAMP). - Knowledge of cloud-native database and data warehousing technologies on AWS GovCloud. - Experience supporting ATO processes, System Security Plans (SSPs), and continuous monitoring activities. - Familiarity with Zero Trust Architecture principles and federal mandates (OMB M-22-09, EO 14028). Company Description Peraton is a next-generation national security company that drives missions of consequence spanning the globe and extending to the farthest reaches of the galaxy. As the world’s leading mission capability integrator and transformative enterprise IT provider, we deliver trusted, highly differentiated solutions and technologies to protect our nation and allies. Peraton operates at the critical nexus between traditional and nontraditional threats across all domains: land, sea, space, air, and cyberspace. The company serves as a valued partner to essential government agencies and supports every branch of the U.S. armed forces. Each day, our employees do the can’t be done by solving the most daunting challenges facing our customers. Target Salary Range $135,000 - $216,000. This represents the typical salary range for this position. Salary is determined by various factors, including but not limited to, the scope and responsibilities of the position, the individual’s experience, education, knowledge, skills, and competencies, as well as geographic location and business and contract considerations. Depending on the position, employees may be eligible for overtime, shift differential, and a discretionary bonus in addition to base pay. EEO EEO: Equal opportunity employer, including disability and protected veterans, or other characteristics protected by law.

United States
$135K - $216K / year

Role Description We are looking for a motivated and technically solid L1 Data Engineer to join our growing Data & Analytics team. In this role, you will be responsible for designing, building, and maintaining the data architecture and infrastructure that supports our organization's data strategy. You will work hands-on to develop, test, and deploy reliable data solutions — ensuring pipelines are scalable, efficient, and aligned with business requirements. This is an ideal opportunity for a data professional who is eager to deepen their expertise in cloud-native data platforms, particularly within the Microsoft Azure and Databricks ecosystem, and who thrives in a collaborative, fast-paced environment. - Design, develop, and maintain scalable data pipelines and ETL/ELT workflows to support business intelligence and analytics use cases. - Build and optimize data ingestion processes using Azure Data Factory and Databricks, ensuring data quality and consistency across all layers of the data platform. - Transform and process large datasets using PySpark and Python, applying best practices for performance and maintainability. - Write and optimize complex SQL queries to support analytical reporting and data validation requirements. - Collaborate with data architects and senior engineers to implement and maintain data models aligned with organizational standards. - Monitor, troubleshoot, and resolve pipeline failures and data quality issues, applying root-cause analysis to prevent recurrence. - Contribute to documentation of data pipelines, data dictionaries, and engineering standards. - Support the team in exploring and evaluating new tools and approaches to continuously improve the data infrastructure. Qualifications - 2+ years of professional experience in a Data Engineering or closely related role. - Strong proficiency in Python for data processing, transformation, and automation tasks. - Hands-on experience with Pandas for data manipulation and PySpark for distributed data processing. - Practical experience with Databricks, including notebook development, clusters, and job orchestration. - Experience building and managing data pipelines with Azure Data Factory. - Working knowledge of Azure Synapse Analytics, particularly Spark pool integration. - Solid SQL skills, including query writing, optimization, and performance tuning. - Familiarity with data engineering principles including incremental loading, data lake architecture, and Delta Lake. - Understanding of data governance and security concepts within a cloud data platform. Requirements - Experience with SQL Server migration projects, including schema conversion and data movement. - Exposure to Terraform for Azure infrastructure provisioning and management. - Familiarity with CI/CD practices applied to data engineering workflows. - Experience with Delta Sharing or Lakehouse Federation concepts. Certification Requirement Candidates are expected to hold or be actively working toward the Databricks Certified Data Engineer Associate certification. This certification validates foundational knowledge across the following domains: - Databricks Lakehouse Platform architecture and capabilities - ETL and ELT workflows using Spark SQL and PySpark - Incremental data processing and structured streaming - Production pipeline development and orchestration - Data governance and security within the Databricks environment

United Arab Emirates
DeepSource GmbH logo

Data Engineer, L2

DeepSource GmbH

Build Artificial Intelligence Talented Teams

Data Engineer1 day ago
Full TimeRemoteTeam 1-10H1B No Sponsor

• Responsible for designing, building, and maintaining the data architecture and infrastructure required for our organization's data needs • Develop, test, and deploy data solutions, ensuring they meet our organization's needs

Egypt

Role Description As a Data Engineer, He/She will be responsible for designing, building, and maintaining the data architecture and infrastructure required for our organization's data needs. They will also be responsible for developing, testing, and deploying data solutions, ensuring that they meet our organization's needs. Qualifications - Experience working with Python for data analysis and processing. - Proficient in using the Pandas library for data manipulation and analysis. - Experience working with Pyspark for distributed data processing. - Familiar with Databricks for managing big data workloads. - Experience with Azure Synapse Spark for building and managing data pipelines. - Experience with Azure Data Factory for creating and managing data integration workflows. - Proficient in SQL and experienced in optimizing SQL queries for performance. - Experience migrating data from SQL Server to other platforms. - Bonus: Experience with Terraform for Azure. - Knowledge assessed in the Databricks certification: Databricks Certified Data Engineering Associate. - Knowledge assessed in the Databricks certification: Databricks Certified Data Engineering Professional. Company Description

Worldwide