DoiT International logo
DoiT International

DoiT International is a computer software company that is on a mission to help clients “focus on building the best products for their own customers.” As an

Principal Data Engineer

Location

Portugal

Posted

12 days ago

Salary

0

Seniority

Lead

Job Description

Principal Data Engineer

DoiT International

• Design, build, and deploy large-scale distributed systems and high-throughput data pipelines using Go and cloud-native technologies • Lead system-wide architectural decisions, focusing on data flow, performance, and resilience • Actively contribute to the codebase with high quality code • Lead major technical initiatives, reduce technical debt and ensure the platform meets the reliability and scalability SLAs • Collaborate with product and engineering teams and R&D management to define the technical roadmap, review architecture and mentor junior engineers

Job Requirements

  • 8+ years of backend engineering experience
  • 3+ years architecting high-load systems or data pipelines in a production environment
  • Deep expertise in distributed systems using modern languages (Go, Java, Rust, or Python)
  • Strong, hands-on experience with relational and analytical databases (Postgres, ClickHouse is preferred)
  • Proven experience with microservices, containers, and modern DevOps practices (Docker, Kubernetes, GitOps, CI/CD)
  • Demonstrated ability to combine hands-on coding with architectural leadership, including strong debugging, benchmarking, and performance optimization skills

Benefits

  • Health insurance
  • Professional development opportunities
  • Flexible working hours

Related Categories

Related Job Pages

More Data Engineer Jobs

Pinterest logo

Staff Software Engineer, Big Data Storage

Pinterest

An internet company and social media platform, Pinterest helps people dream about, plan, and prepare for a life they love by “pinning” inspirational, user-g

Data Engineer12 days ago

Title: Staff Software Engineer, Big Data Storage Location: Palo Alto, CA, US; Remote, US Job Description: About Pinterest: Millions of people around the world come to our platform to find creative ideas, dream about new possibilities and plan for memories that will last a lifetime. At Pinterest, we’re on a mission to bring everyone the inspiration to create a life they love, and that starts with the people behind the product. Discover a career where you ignite innovation for millions, transform passion into growth opportunities, celebrate each other’s unique experiences and embrace the flexibility to do your best work. Creating a career you love? It’s Possible. At Pinterest, AI isn't just a feature, it's a powerful partner that augments our creativity and amplifies our impact, and we’re looking for candidates who are excited to be a part of that. To get a complete picture of your experience and abilities, we’ll explore your foundational skills and how you collaborate with AI. Through our interview process, what matters most is that you can always explain your approach, showing us not just what you know, but how you think. You can read more about our AI interview philosophy and how we use AI in our recruiting process here. We’re looking for a Staff Software Engineer to help build the next generation of Pinterest’s big data storage platform. You’ll work on some of the most exciting big data open source technologies — especially Apache Iceberg — at exabyte scale to power the data infrastructure that helps Pinners discover and do what they love. As a Staff Software Engineer, you’ll serve as a technical leader and hands-on contributor, designing and building highly scalable storage systems for Pinterest’s data lake. You’ll partner closely with teams across data, ML/AI, analytics, and infrastructure to evolve our storage and metadata management capabilities, enabling efficient, reliable, and governed access to data at massive scale. What you’ll do: - Design, implement, and optimize Pinterest’s exabyte-scale data lake storage platform. - Lead complex technical projects and initiatives for data lake storage and metadata management, driving them from architecture through execution. - Collaborate with stakeholders and partner teams across the organization to design storage and metadata layer technologies that unlock big data and ML/AI innovations. - Build storage capabilities that efficiently support large-scale ML/AI workloads, including high-throughput data access, schema evolution, and large-scale column backfills. - Shape the long-term technical direction for scalable, reliable, and efficient big data storage systems. - Engage with and contribute to open source communities such as Apache Iceberg, Spark, and Flink to help address Pinterest’s scaling challenges. What we’re looking for: - 8+ years of relevant industry experience designing and building large-scale production distributed systems. - Strong experience designing and maintaining scalable storage, metadata, or data lake infrastructure. - Experience building storage capabilities for large-scale ML/AI or analytics workloads, including high-throughput data access, schema evolution, and large-scale column backfills. - Deep knowledge with building distributed systems, data storage systems, and production infrastructure. - Experience with big data technologies such as Apache Iceberg, Spark, Flink, Presto/Trino, Hive, or similar systems. - Proficiency in programming languages like Java, Scala, or Python. - Proven ability to lead complex technical initiatives and influence architecture across teams. - Strong collaboration, communication, and problem-solving skills, with a drive for technical excellence and innovation. - Bachelor’s degree in a relevant field such as Computer Science, or equivalent experience In-Office Requirement Statement: - We let the type of work you do guide the collaboration style. That means we're not always working in an office, but we continue to gather for key moments of collaboration and connection. - This role will need to be in the office for in-person collaboration 1-2 times/quarter and therefore can be situated anywhere in the country. Relocation Statement: - This position is not eligible for relocation assistance. #LI-HYBRID #LI-AH2 At Pinterest we believe the workplace should be equitable, inclusive, and inspiring for every employee. In an effort to provide greater transparency, we are sharing the base salary range for this position. The position is also eligible for equity. Final salary is based on a number of factors including location, travel, relevant prior experience, or particular skills and expertise. US based applicants only $177,185—$364,795 USD Our Commitment to Inclusion: Pinterest is an equal opportunity employer and makes employment decisions on the basis of merit. We want to have the best qualified people in every job. All qualified applicants will receive consideration for employment without regard to race, color, ancestry, national origin, religion or religious creed, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, age, marital status, status as a protected veteran, physical or mental disability, medical condition, genetic information or characteristics (or those of a family member) or any other consideration made unlawful by applicable federal, state or local laws. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. If you require a medical or religious accommodation during the job application process, please complete this form for support.

California
$177.2K - $364.8K / year
Incubeta logo

Freelance Data Engineer

Incubeta

We Are A Team Of Over 800 Creators, Thinkers, Makers & Doers, Ready To Help Brands Upgrade Their Growth.

Data Engineer12 days ago
ContractRemoteTeam 501-1,000H1B No Sponsor

• Designs, builds, and maintains complex data processing systems • Ensures data integrity and optimizes pipelines for efficiency and scalability • Troubleshoots complex data issues and conducts quality checks • Mentors junior team members and fosters collective growth • Maintains clear documentation for data solutions • Identifies optimization opportunities and plans implementation • Delivers new solutions or expands existing solutions based on received briefs • Takes responsibility for security in PII data, code management, and deployment • Proactively identifies improvements for dashboards across the business • Engages with projects, providing support in modeling feasibility and blockers • Conducts quality checks and ensures technical implementations meet standards • Independently owns small-scale projects and delivers them by meeting success criteria and deadlines.

South Africa
Zensar logo

AI / DATA ENGINEER

Zensar

At Zensar, we’re “experience-led everything”. We are committed to conceptualizing, designing, engineering, marketing, and managing digital solutions and experiences for over 130 leading enterprises. We are a company driven by a bold purpose: Together, we shape experiences for better futures. Whether for our clients, our people, or the world around us, this belief powers everything we do. At the heart of our culture is ONE with Client - a set of four core values that reflect who we are and how we work: One Zensar, Nurturing, Empowering, and Client Focus. Part of the $4.8 billion RPG Group, we’re a community of 10,000+ innovators across 30+ global locations, including Milpitas, Seattle, Princeton, Cape Town, London, Zurich, Singapore, and Mexico City. We believe the best work happens when individuality is celebrated, growth is encouraged, and well-being is prioritized. We are an equal employment opportunity (EEO) and affirmative action employer, committed to creating an inclusive workplace. All qualified applicants will be considered without regard to race, creed, color, ancestry, religion, sex, national origin, citizenship, age, sexual orientation, gender identity, disability, marital status, family medical leave status, or protected veteran status.

Data Engineer12 days ago
Full TimeRemoteTeam 10,001

Role Description The AI/Data Engineer will play a crucial role in designing and implementing data ingestion, processing, and indexing pipelines for our RAG Search application. This role is responsible for ensuring secure and efficient data management, from ingestion to retrieval, and for building advanced retrieval and RAG capabilities. The successful candidate will have strong hands-on experience in: - Data engineering - Search technologies - AI-powered search applications - Python - Enterprise search platforms Company Description At Zensar, we’re “experience-led everything”. We are committed to conceptualizing, designing, engineering, marketing, and managing digital solutions and experiences for over 130 leading enterprises. We are a company driven by a bold purpose: Together, we shape experiences for better futures. At the heart of our culture is ONE with Client - a set of four core values that reflect who we are and how we work: - One Zensar - Nurturing - Empowering - Client Focus Part of the $4.8 billion RPG Group, we’re a community of 10,000+ innovators across 30+ global locations, including Milpitas, Seattle, Princeton, Cape Town, London, Zurich, Singapore, and Mexico City. We believe the best work happens when individuality is celebrated, growth is encouraged, and well-being is prioritized. We are an equal employment opportunity (EEO) and affirmative action employer, committed to creating an inclusive workplace. All qualified applicants will be considered without regard to race, creed, color, ancestry, religion, sex, national origin, citizenship, age, sexual orientation, gender identity, disability, marital status, family medical leave status, or protected veteran status.

India
Comcast logo

Manager, Data Engineering

Comcast

Headquartered in Philadelphia, Pennsylvania, Comcast was established in 1963 as a single-system cable company. Over the years, Comcast experienced tremendous gr

Data Engineer12 days ago
Full TimeRemoteTeam 10,000Since 1963

Comcast Advertising is driving the TV advertising industry forward, from delivering ads to linear and digital audiences to pioneering the tech that makes it possible. We help brands connect with their audiences on every screen using advanced data, technology, and premium video content. Our media sales division helps local, regional, and national brands reach potential customers through multiscreen TV advertising. Our ad tech division FreeWheel provides comprehensive adtech that makes it easier to buy and sell premium video advertising across all screens, data types, and sales channels. Job Summary Comcast Advertising is driving the TV advertising industry forward, from delivering ads to linear and digital audiences to pioneering the tech that makes it possible. We help brands connect with their audiences on every screen using advanced data, technology, and premium video content. Our media sales division helps local, regional, and national brands reach potential customers through multiscreen TV advertising. Our ad tech division FreeWheel provides comprehensive adtech that makes it easier to buy and sell premium video advertising across all screens, data types, and sales channels. Comcast Advertising Media Solutions and Data team is hiring a Manager, Data Engineering who will lead a team of data engineers responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support our Audience and Measurement, Attribution & Reporting teams. This role is pivotal in enabling data-driven advertising solutions that power Comcast's ecosystem. Reporting to the Director of Data Engineering, you will collaborate with cross-functional teams to ensure high-quality, reliable data flows that fuel business growth. Job Description Core Responsibilities - Lead the team, providing mentorship, coaching, and regular feedback to enable hands-on career development. - Scaling the team and supporting them in their growth. Identify and provide team members with growth opportunities that align with their career goals. - Ensure all engineers keep current with technological developments within the industry. - Advocating for improvements to data quality, security, and performance. - Ensure on-time delivery of solutions without sacrificing sustainability, avoiding technical debt. - Iterate on regular process meetings that help maintain strong communication among the team. - Partner with stakeholders to help develop and continuously refine the short- and long-term roadmap. - Serves as the primary point of contact and liaison between teams. - Manage all the deliverables to ensure adherence to deadlines, specifications, and budgets. Monitor project progress and report findings to the leadership team. - Initiate, influence, and drive a diverse set of data-oriented problems, working with a wide range of teams and learning a great deal about ad-tech in the process. - Conduct work performance reviews, and ensure work performance is adhering to Company standards. - Consistent exercise of independent judgment and discretion in matters of significance. - Regular, consistent and punctual attendance. Must be able to work nights and weekends, variable schedule(s) and overtime as necessary. - Other duties and responsibilities as assigned. What We're Looking For: - Ideally 5+ years of data engineering experience. - Communication and leadership experience, with experience initiating and driving projects. - Passion for growing and developing engineers, helping them level up in their careers. - A track record of fostering collaboration among team members through an effective process. - Ability to make the tradeoffs required to ship without compromising quality or team health. - A self-starter, comfortable with ambiguity and enjoying working in a fast-paced dynamic environment. - Experience helping maintain a technical roadmap and balancing novel asks from engineering, product, and other stakeholders against improvements to the existing platform. - Expertise in at least one backend language, such as Java, Scala, C++, Python - we build our services with Python. - Familiarity with ETL and creating pipelines for large datasets. - Experience utilizing cloud infrastructure - We build and maintain high-quality data solutions on the state-of-the-art cloud-native data platform using AWS, Databricks and Snowflake. - Experience scaling and managing 3+ person teams Employees at all levels are expected to: - Understand our Operating Principles; make them the guidelines for how you do your job. - Own the customer experience - think and act in ways that put our customers first, give them seamless digital options at every touchpoint, and make them promoters of our products and services. - Know your stuff - be enthusiastic learners, users and advocates of our game-changing technology, products and services, especially our digital tools and experiences. - Win as a team - make big things happen by working together and being open to new ideas. - Be an active part of the Net Promoter System - a way of working that brings more employee and customer feedback into the company - by joining huddles, making call backs and helping us elevate opportunities to do better for our customers. - Drive results and growth. - Support a culture of inclusion in how you work and lead. - Do what's right for each other, our customers, investors and our communities. Disclaimer: This information has been designed to indicate the general nature and level of work performed by employees in this role. It is not designed to contain or be interpreted as a comprehensive inventory of all duties, responsibilities and qualifications. Comcast is an equal opportunity workplace. We will consider all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability, veteran status, genetic information, or any other basis protected by applicable law. Comcast will consider for employment applicants with arrest or conviction records in accordance with the requirements of applicable law, including the San Francisco Fair Chance Ordinance, the Los Angeles Fair Chance Initiative for Hiring Ordinance, the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Please note that federal state, or local laws and regulations may restrict or prohibit Comcast from hiring individuals convicted of certain crimes. Additionally, an applicant's criminal history may have a direct, adverse, and negative relationship on the job duties of this position, which may result in the withdrawal of a conditional offer of employment. Skills: Data Engineering; Artificial Intelligence (AI); Data Operations Salary: National Pay Range: $97,815.94 USD-$229,256.11 USD Illinois Pay Range: $103,929.44 USD - $201,745.38 USD Colorado Pay Range: $110,042.93 USD - $210,915.62 USD Hawaii Pay Range: $128,383.42 USD - $192,575.13 USD Washington DC Pay Range: $140,610.41 USD - $210,915.62 USD Maryland Pay Range: $116,156.43 USD - $210,915.62 USD Minnesota Pay Range: $110,042.93 USD - $192,575.13 USD New York Pay Range: $116,156.43 USD - $229,256.11 USD Washington Pay Range: $110,042.93 USD - $220,085.87 USD New Jersey Pay Range: $122,269.93 USD - $220,085.87 USD Vermont Pay Range: $116,156.43 USD - $183,404.89 USD Massachusetts Pay Range: $122,269.93 USD - $220,085.87 USD California Pay Range: $110,042.93 USD - $203,783.21 Comcast intends to offer the selected candidate base pay within this range, dependent on job-related, non-discriminatory factors such as experience. The application window is 30 days from the date job is posted, unless the number of applicants requires it to close sooner or later. The application window is 30 days from the date job is posted, unless the number of applicants requires it to close sooner or later. Base pay is one part of the Total Rewards that Comcast provides to compensate and recognize employees for their work. Most sales positions are eligible for a Commission under the terms of an applicable plan, while most non-sales positions are eligible for a Bonus. Additionally, Comcast provides best-in-class Benefits to eligible employees. We believe that benefits should connect you to the support you need when it matters most, and should help you care for those who matter most. That's why we provide an array of options, expert guidance and always-on tools, that are personalized to meet the needs of your reality - to help support you physically, financially and emotionally through the big milestones and in your everyday life. Please visit the compensation and benefits summary on our careers site for more details. Education Bachelor's Degree While possessing the stated degree is preferred, Comcast also may consider applicants who hold some combination of coursework and experience, or who have extensive related professional experience. Relevant Work Experience 5-7 Years

Pennsylvania
$97.8K - $229.3K / year
Job Closed