Job Closed

This listing is no longer active.

Sysdig logo
Sysdig

Confidently secure containers, Kubernetes and cloud services with #SecureDevOps.

Senior Software Engineer, Data Platform Team

Data EngineerData EngineerFull TimeRemoteSeniorTeam 201-500Since 2013H1B SponsorCompany SiteLinkedIn

Location

Italy

Posted

65 days ago

Salary

0

Seniority

Senior

5 yrs expEnglish

Job Description

Senior Software Engineer, Data Platform Team

Sysdig

• Own the design and development of features and components for the data platform, focusing on high-throughput data ingestion, transformation, and storage. You will report to the Director, Engineering. • Architect and implement robust, distributed, and scalable data processing pipelines in Go to ensure data quality and reliability. • Contribute to the technical strategy and roadmap for the data platform, anticipating future data needs for product features and internal analytics. • Mentor junior and mid-level engineers on the team, and conduct thorough code reviews to ensure quality and best practices. • Participate in an on-call rotation to address urgent operational issues impacting data services.

Job Requirements

  • 5+ years in a software engineer role, with experience in a technical leadership capacity
  • Extensive experience designing, building, and operating large-scale, distributed data processing systems and data pipelines.
  • Deep knowledge of data architecture, storage, and access patterns
  • Strong computer science fundamentals in design, data structures, and algorithms
  • Clean coding and automation practices

Benefits

  • Extra days off to prioritize your well-being
  • Mental health support for you and your family through the Modern Health app
  • Great compensation package

Related Categories

Related Job Pages

More Data Engineer Jobs

Full TimeRemoteTeam 10,001+H1B Sponsor

Sr. Distinguished, Data Engineer - Enterprise Data Storage and Consumption Platforms Data Engineer - Remote-Eligible Distinguished Data Engineers are individual contributors who strive to be diverse in thought so we visualize the problem space. At Capital One, we believe diversity of thought strengthens our ability to influence, collaborate and provide the most innovative solutions across organizational boundaries. Distinguished Engineers will significantly impact our trajectory and devise clear roadmaps to deliver next generation technology solutions. About the Team: You will join the Data Storage & Consumption Platform team within Enterprise Data, serving as a Senior Director-level Individual Contributor (IC). This role demands a visionary and hands-on leader to drive the technical strategy for consumption platforms leveraged by all lines of business. Your focus is on maturing platform scalability, Operational Excellence, Performance, and Resiliency. We require deep expertise in AWS infrastructure ,Lakehouse architecture, Snowflake, Databricks platform and BI tools to mature these enterprise-scale systems and execute technical strategy. Our Sr. Distinguished Engineers Are: - Deep technical experts and thought leaders that help accelerate adoption of the very best engineering practices, while maintaining knowledge on industry innovations, trends and practices - Visionaries, collaborating on Capital One's toughest issues, to deliver on business needs that directly impact the lives of our customers and associates - Role models and mentors, helping to coach and strengthen the technical expertise and know-how of our engineering and product community - Evangelists, both internally and externally, helping to elevate the Distinguished Engineering community and establish themselves as a go-to resource on given technologies and technology-enabled capabilities Responsibilities: - Build awareness, increase knowledge and drive adoption of modern technologies, sharing consumer and engineering benefits to gain buy-in - Identify, benchmark and contribute towards opportunities to improve system availability, security, reliability, cost optimization and performance - Strike the right balance between lending expertise and providing an inclusive environment where others' ideas can be heard and championed; leverage expertise to grow skills in the broader Capital One team - Promote a culture of engineering excellence, using opportunities to reuse and innersource solutions where possible - Effectively communicate with and influence key stakeholders across the enterprise, at all levels of the organization - Operate as a trusted advisor for a specific technology, platform or capability domain, helping to shape use cases and implementation in an unified manner - Lead the way in creating next-generation talent for Tech, mentoring internal talent and actively recruiting external talent to bolster Capital One's Tech talent Basic Qualifications: - Bachelor's Degree - At least 7 years of experience in software engineering or data engineering - At least 5 years of people management experience - At least 3 years of experience with Big Data and data streaming - At least 3 years of experience with cloud-based data platforms (Amazon Web Services, Microsoft Azure, Google Cloud Platform) - At least 9 years of experience in data engineering writing production quality code with a focus on distributed systems Preferred Qualifications: - Masters' Degree - 10+ years of experience in data engineering - 3+ years of experience implementing big data frameworks and processing solutions - 3+ years of data modeling experience - 2+ years of experience with ontology standards for defining a domain - 2+ years of experience using Python, SQL or Scala - 1+ year of experience deploying machine learning models - 5+ years of experience with Agile engineering practices - 8+ years in-depth experience with the Hadoop stack (MapReduce, Pig, Hive, Hbase ) - 8+ years experience with NoSQL implementation (Mongo, Cassandra) - 8+ years experience developing Java based software solutions - 8+ years experience in at least one scripting language - 8+ years experience developing software solutions to solve complex business problems - 8+ years experience with Relational Database Systems and SQL - 8+ years experience designing, developing, and implementing ETL - 8+ years experience with UNIX/Linux including basic commands and shell scripting - 8+ years of experience providing technical leadership - 8+ years of experience leading the full life-cycle of IT development and platform support Capital One is open to hiring a Remote Employee for this opportunity. At this time, Capital One will not sponsor a new applicant for employment authorization, or offer any immigration related support for this position (i.e. H1B, F-1 OPT, F-1 STEM OPT, F-1 CPT, J-1, TN, E-2, E-3, L-1 and O-1, or any EADs or other forms of work authorization that require immigration support from an employer). The minimum and maximum full-time annual salaries for this role are listed below, by location. Please note that this salary information is solely for candidates hired to perform work within one of these locations, and refers to the amount Capital One is willing to pay at the time of this posting. Salaries for part-time roles will be prorated based upon the agreed upon number of hours to be regularly worked. Remote (Regardless of Location): $286,200 - $326,700 for Sr. Dir, Data Engineering Richmond, VA: $286,200 - $326,700 for Sr. Dir, Data Engineering Candidates hired to work in other locations will be subject to the pay range associated with that location, and the actual annualized salary amount offered to any candidate at the time of hire will be reflected solely in the candidate's offer letter. This role is also eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI). Incentives could be discretionary or non discretionary depending on the plan. Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the Capital One Careers website . Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level. This role is expected to accept applications for a minimum of 5 business days. No agencies please. Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination in compliance with applicable federal, state, and local laws. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York City's Fair Chance Act; Philadelphia's Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1-800-304-9102 or via email at RecruitingAccommodation@capitalone.com . All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations. For technical support or questions about Capital One's recruiting process, please send an email to Careers@capitalone.com Capital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site. Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).

Virginia
$286.2K - $326.7K / year
Job Closed
Canoe Intelligence logo

Data Engineer

Canoe Intelligence

Guiding the investment industry forward with smarter alts management

Data Engineer65 days ago
Full TimeRemoteTeam 51-200Since 2017H1B No Sponsor

• Contribute to the design and development of our Data platform. • Work closely with AI / ML Engineers to build intelligence and automation into all Canoe systems. • Design and implement data models, data pipelines, and data architectures in support of new Canoe product offerings. • Participate in cross-functional teams as Data Engineering’s representative. • Build observable systems and be an organization leader in operational excellence.

New York
$110K - $140K / year
SupplyHouse.com logo

Sr. Data Architect

SupplyHouse.com

Plumbing, Heating & HVAC Supplies. Real People. Real Service.

Data Engineer65 days ago
Full TimeRemoteTeam 501-1,000Since 2004H1B Sponsor

Real people. Real service. At SupplyHouse.com, we value every individual team member and cultivate a community where people come first. Led by our core values of Generosity, Respect, Innovation, Teamwork, and GRIT, we’re dedicated to maintaining a supportive work environment that celebrates diversity and empowers everyone to reach their full potential. As an industry-leading e-commerce company specializing in HVAC, plumbing, heating, and electrical supplies since 2004, we strive to foster growth while providing the best possible experience for our customers. We are looking for a Sr. Data Architect to join our IT Team. This individual will report into our Vice President of IT, and will be responsible for defining and driving our enterprise data architecture strategy while remaining hands-on in delivering scalable, reliable data products. This role operates at a company-wide scope, shaping long-term data platform direction, governance standards, and scalable architecture patterns that enable analytics, AI/ML, operational systems, and business intelligence. As a strategic individual contributor, the Sr. Data Architect will partner with executive leadership, Engineering, Analytics, Security, and Product teams to ensure data is reliable, secure, governed, and positioned as a competitive advantage. This remote position is open to individuals who live in, or are open to relocating to, the following states: Arizona, Delaware, Florida, Georgia, Kentucky, Nevada, New Jersey, New York, North Carolina, Ohio, Rhode Island, South Carolina, Tennessee, Texas, Virginia, and Washington. This position requires travel to our headquarters in Melville, NY 3 times per year for internal meetings and team building activities. Additional travel may be required based on department and company needs. We reimburse reasonable and necessary travel expenses, and you’re also welcome to work on-site anytime beyond these visits – our doors are always open. Role Type: Full-Time, Exempt Location: Remote Schedule: Monday through Friday, 8:00 a.m. to 5:00 p.m. EST Base Salary: $145,000 – $180,000 per year Responsibilities: - Design, build, and maintain scalable ELT/ETL pipelines into BigQuery for core domains (orders, customers, products, inventory, fulfillment, procurement, marketing) - Build orchestration patterns with strong operational rigor (retries, idempotency, backfills, SLAs/SLOs, incident response) to enable reliable delivery - Implement data quality and testing frameworks (freshness checks, anomaly detection, unit/integration tests) and standardize monitoring/observability - Standardize CI/CD and infrastructure-as-code patterns for data systems and guide teams on best practices for ingestion, transformation, and orchestration - Lead modernization initiatives such as legacy warehouse to cloud lakehouse migrations and platform upgrades - Create and own curated, analytics-ready datasets and models (dimensional/conformed, semantic-ready layers) that make reporting fast, consistent, and self-serve - Establish and enforce standards for conceptual, logical, and physical data modeling - Oversee domain-driven modeling and data product design through reusable patterns and reference implementations - Establish data architecture standards including modeling conventions, schema evolution/versioning, incremental loading strategies, and warehouse performance patterns - Define and evolve the enterprise data architecture vision aligned to business strategy, including canonical data models, domain boundaries, and integration patterns - Lead architecture decisions for data warehousing, lakehouse, streaming, MDM, and operational data platforms - Evaluate and select strategic data technologies and vendors - Partner with Security and Legal to design privacy and compliance architectures (GDPR/CCPA/SOC2-aligned approaches) and establish enterprise governance frameworks - Build governance fundamentals including documentation, lineage/metadata, access controls, and PII handling - Act as the escalation point for data architecture decisions and mentor senior engineers/architects through reviews, templates, and best practices - Partner with application engineering and analytics stakeholders to define data contracts and ensure reliable upstream/downstream integrations - Translate business capabilities into scalable data platform solutions - Optimize cost and performance across BigQuery workloads (query optimization, partition pruning, clustering strategies, and workload management where applicable) - Drive adoption of emerging capabilities (real-time analytics, AI enablement, semantic layers, data mesh) and develop multi-year data roadmap and maturity models - Operate at enterprise scope across multiple business domains - Influence strategy beyond the immediate team and set technical direction that others follow Requirements: - Bachelor's degree in CS, Engineering, Information Systems, or a related field - ​A minimum of 10 years of experience in Data Engineering, Architecture, or Platform Engineering - A minimum of 5 years of experience designing enterprise-scale cloud data architectures (AWS, Azure, or GCP) - Expertise in data warehousing, Lakehouse architecture, distributed processing, streaming, and enterprise data modeling (Kimball, Inmon, Data Vault, and/or domain-driven design) - Strong understanding of data governance, metadata management, and security architecture - Experience leading cross-functional architecture initiatives - Proven ability to influence senior stakeholders and executives Preferred Qualifications: - A minimum of 7 years of experience in Data Engineering, Analytics Engineering, or Data Platform roles with significant production ownership - Deep experience with GCP services relevant to data engineering (e.g., Cloud Storage, Pub/Sub, Dataflow, Cloud Composer, Cloud Functions/Run, Secret Manager, IAM) - Experience with BigQuery best practices (partitioning/clustering, incremental strategies, performance tuning, cost controls) - Strong understanding of BI consumption needs (star schema design, incremental refresh considerations, semantic consistency/metrics definitions) - Experience implementing data mesh or domain-oriented ownership models, AI/ML feature platform exposure, regulated environment experience, and strong cloud cost management acumen - Industry certifications (AWS Solutions Architect, Azure Architect, GCP Professional Architect) Why work with us: - We have awesome benefits – We offer a wide variety of benefits to help support you and your loved ones. These include: - Comprehensive and affordable medical, dental, vision, and voluntary life insurance options - 401(k) with up to 4% company match - Paid vacation, sick time, and holidays - Company-paid basic life insurance and long-term disability - Discounted auto, home, and pet insurance programs - Flexible Spending Account (FSA) - Confidential mental health, financial planning, and legal support through our Employee Assistance Program (EAP) - Company-provided equipment and one-time $250 work from home stipend - $750 annual professional development budget - $25 monthly Grubhub credit - Company rewards and recognition program - And more! - We empower ownership – We all contribute to our success and we all share in it. Our Ownership for All program ensures each SupplyHouse team member will benefit financially from the company’s growth and accomplishments. - We promote work-life balance – We value your time and encourage a healthy separation between your professional and personal life to feel refreshed and recharged. Look out for our wellness initiatives and ask about our Flex-Time Policy! - We support growth – We encourage you to embrace continuous learning and take on new challenges. In an exciting and evolving industry, we provide opportunities for career growth through our annual merit and bonus opportunities, hands-on training, diversity and inclusion initiatives, internal mobility options, and professional development budget. - We give back – We live and breathe our core value, Generosity, by giving back to the trades and organizations around the world. We make a difference through donation drives, employee-nominated contributions, support for non-profit organizations, Volunteer Paid Time Off, and more. - We listen – We value hearing from our employees. Everyone has a voice, and we encourage you to use it! We actively elicit feedback through our monthly town halls, regular 1:1 check-ins, employee listening initiatives, and company-wide ideas form to incorporate suggestions and ensure our team enjoys coming to work every day. Check us out and learn more at: https://www.supplyhouse.com/our-company! Additional Details: - Remote employees are expected to work in a distraction-free environment. Personal devices, background noise, and other distractions should be kept to a minimum to avoid disrupting virtual meetings or business operations. - Applicants must be currently authorized to work in the U.S. on a full-time basis. SupplyHouse.com will not sponsor applicants for work visas. - SupplyHouse.com is an Equal Opportunity Employer. We welcome and encourage individuals of all backgrounds, experiences, and perspectives to apply. Employment decisions are based on qualifications, merit, and business needs. - To ensure fairness and trust in our hiring process, we ask that all application materials, assessments, and interview responses reflect your own thinking and perspective. You may use AI tools to assist in preparing your responses, as long as this use is clearly disclosed and you can speak authentically to your ideas and work. Our focus is on honesty, judgment, and how you approach problem-solving. We appreciate your transparency and look forward to learning more about your skills. - We are committed to providing a safe and secure work environment and conduct thorough background checks on all potential employees in accordance with applicable laws and regulations. - All emails from the SupplyHouse team will only be sent from an @supplyhouse.com email address. Please exercise caution if you receive an email from an alternate domain.

United States
$145K - $180K / year
Full TimeRemoteTeam 51-200

Role Description For our client, a leading Swiss insurance company, we are looking for an experienced DWH Architect / Senior Data Engineer. If you are ready to tackle complex challenges and actively shape modern data platforms, we look forward to hearing from you. - Design and implement modern data warehouse architectures - Lead data migration and modernization of existing DWH systems - Analysis and translation of business and technical requirements into scalable, architecture-compliant solutions - Collaborate closely with internal stakeholders and cross-functional teams - Ensure data governance, security, and compliance with Swiss regulatory requirements - Continuously develop and optimize data platforms and reporting solutions - Development and enforcement of naming conventions, self-service approaches and boundaries, tool recommendations, and guidelines Qualifications - Experienced DWH Architect with strong expertise in modern data architectures (Medallion Architecture, Star Schema, Gold Layer) - Hands-on experience with Databricks (PySpark, Delta Lake, Unity Catalog), Azure Data Platform, and Power BI - Knowledge of traditional DWH environments - Proven experience in data warehouse migration and modernization projects - Strong knowledge of Databricks, Azure, and Power BI, with an understanding of legacy DWH architectures - Ability to understand both technical and business requirements and translate them into DARTS-compliant solutions - Fluent English required; German is a plus - Experience working in international, remote-enabled project teams Requirements - Start: Immediately available or by arrangement (long-term project) - Workload: Fulltime 100% - Location: Remote (Nearshore)

North Macedonia
Job Closed