Staff Data Engineer

Data EngineerData EngineerFull TimeRemoteLeadTeam 1,001-5,000Since 1999H1B No SponsorCompany SiteLinkedIn

Location

Brazil

Posted

86 days ago

Salary

0

Seniority

Lead

Job Description

Staff Data Engineer

Blip

• Design, implement, and optimize high-throughput, low-latency data pipelines capable of processing billions of events per day. • Build scalable data ingestion and transformation frameworks leveraging Kafka, Flink, Spark, Airflow, Beam, and/or GCP-related data engineering technologies. • Ensure fault-tolerance, exactly-once semantics, and replayability in all event processing flows. • Establish reusable patterns and accelerators for pipeline development, deployment, and monitoring. • Design data models across streaming, analytical, and serving layers (Bronze/Silver/Gold, event sourcing, CDC, and dimensional schemas). • Partner with Data Architects to evolve domain-driven data models ensuring semantic alignment and traceability from source to consumption. • Implement optimal partitioning, clustering, and indexing strategies for performance and cost efficiency across Databricks, BigQuery and other storage & processing engines. • Embed observability, lineage, and data quality validations into every pipeline. • Define and enforce SLAs and SLOs for data delivery, freshness, and accuracy. • Collaborate with Platform Engineers to integrate metrics, alerts, and self-healing mechanisms for critical data flows. • Act as a technical leader within the Data Engineering team: leading design reviews, conducting architecture spikes, and mentoring engineers. • Work closely with AI, Platform, and Product teams to deliver event-driven capabilities that power intelligent products in real time. • Promote craftsmanship, performance, and simplicity as core engineering values.

Job Requirements

  • 6+ years in Data Engineering, Software Engineering, or Distributed Systems roles.
  • Proven experience building and operating data-intensive and streaming systems in production.
  • Hands-on experience with Apache Kafka, Flink, Spark Streaming, Databricks & GCP-related data engineering technologies.
  • Strong understanding of event-driven architectures, change data capture (CDC), and real-time data modeling patterns.
  • Proficiency in Python or PySpark, and solid command of SQL.
  • Experience with cloud-native data services (GCP, Azure, or AWS) and workflow orchestration (Airflow/Composer).
  • Deep understanding of data modeling and storage formats (Delta, Parquet, Avro).
  • Experience with CI/CD for data pipelines, testing frameworks, and infrastructure automation (Terraform).

Benefits

  • Flexible Hours: More autonomy to organize your schedule with balance and responsibility.
  • Flexible Work Models: Remote, hybrid, or on-site, depending on the role’s needs.
  • No Dress Code: Freedom to be yourself without formality.
  • Home Office Allowance and Blip Setup: Financial support to set up or improve your remote workspace.
  • Birthday Day Off: One day off during your birthday month to celebrate as you wish.
  • Blip Recharge: 5 paid days off per year for roles without time tracking, designed to help balance your workload.
  • Meal Allowance or Food Voucher: R$ 1,144.00 monthly, no deductions, credited also during vacation and leaves.
  • Beneflex: Monthly amount credited to a flexible balance, allowing full flexibility of use according to your needs.
  • Transportation Allowance: Available as needed for commuting.
  • Wellhub (Gympass): Access to gyms, wellness apps, and physical activities, also available for dependents.
  • SESC Partnership: Access to culture, leisure, sports, hotels, holiday resorts, and more.
  • Health Plan (SulAmérica): National coverage, private room for you and your dependents; only co-payment applies.
  • Dental Plan: National coverage for you and your dependents, with three plan options and full company coverage of the chosen plan cost.
  • Conexa Saúde: Online psychological counseling platform.
  • Life Insurance: Coverage equivalent to 24 times your monthly salary.
  • Extended Maternity Leave: 180 days to welcome this new phase with peace of mind.
  • Extended Paternity Leave: 30 days to be present and strengthen family bonds.
  • Childcare Assistance: Reimbursement of R$ 676.81 for children up to 2 years old and R$ 592.21 for children up to 5 years old.
  • Dependent Assistance for PCD (people with disabilities): Support of R$ 846.02 for children with disabilities or neurodiversity.
  • Educational Incentive: Partnerships with higher education institutions and language schools.
  • Short-Term Incentive (ICP): Financial recognition tied to Blip’s objectives.
  • Your Name Matters: Reimbursement of up to R$ 250.00 for expenses related to changing first name and/or gender marker, supporting inclusion and respect for identity.

Related Categories

Related Job Pages

More Data Engineer Jobs

Kyndryl logo

Managing Data Architect— Data & Cloud Architecture Lead

Kyndryl

We design, build, manage and modernize the mission-critical technology systems that the world depends on every day.

Data Engineer86 days ago
OtherRemoteTeam 10,001+Since 2021H1B Sponsor

Who We Are At Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward – always pushing ourselves to go further in our efforts to build a more equitable, inclusive world for our employees, our customers and our communities. The Role Are you ready to join a team that is passionate about solving complex business problems with cutting-edge technology? Kyndryl is seeking a talented Data Architect who will take charge of all things data and information, transforming them into remarkable solutions that drive our customers’ success. Get ready to unleash your creative prowess and shape the future of data management. As a Managing Data Architect— Data & Cloud Lead with Kyndryl, you will play a vital role in managing all aspects of data and information, from understanding business requirements to translating them into data models scheme design and data architectures. Your expertise will be critical in guiding the full IT data lifecycle governance , including acquisition, transformation, classification, storage, presentation, distribution, security, privacy, and archiving to ensure data is accurate, complete and secure. You will work closely with our customers to design solutions and data architectures that address their unique business problems, considering their needs and constraints while applying your industry knowledge and expertise. You will have the opportunity to work with diverse technologies, like databases (relational, hierarchical and object-oriented), file systems and storage management, document imaging, knowledge and content management, taxonomies and business intelligence. All relevant for designing business-driven IT solutions that meet data requirements and incorporate cloud solutions for different types of storage needs. As a Managing Data Architect— Data & Cloud Lead , you will have the chance to develop and design centralized or distributed systems that both address user requirements and perform efficiently and effectively. You will ensure the viability of proposed solutions by conducting solution assurance assessments and work closely with the project team and key stakeholders to ensure that the final solution meets all customer requirements and expectations. At Kyndryl, you'll be part of a dynamic, forward-thinking team where creativity knows no bounds. Together, we'll shape the future of data architecture and revolutionize the way businesses thrive. Apply now and take the first step towards an exciting and rewarding career with Kyndryl. Your Future at Kyndryl Every position at Kyndryl offers a way forward to grow your career, from a Junior Architect to Principal Architect – we have opportunities for that you won’t find anywhere else, including hands-on experience, learning opportunities, and the chance to certify in all four major platforms. Kyndryl currently does not require employees to be fully vaccinated against COVID-19, however, if you are hired to work at a client, customer, or partner location, you may be required to show proof of vaccination to align with their respective COVID-19 vaccination policies. Those who believe they are eligible may apply for a medical or religious accommodation prior to the start of employment. Who You Are You’re good at what you do and possess the required experience to prove it. However, equally as important – you have a growth mindset; keen to drive your own personal and professional development. You are customer-focused – someone who prioritizes customer success in their work. And finally, you’re open and borderless – naturally inclusive in how you work with others. Required Skills, Experience and Circumstances: • Minimum of 10+ years of experience working with cloud based data platforms, data integration and governance framework with one of the three cloud technologies (Azure, AWS, or GCP) • Strong knowledge in data modeling, database design and data management best practice • Ability to architect, design and implement infrastructure and platforms from a data and storage perspective • Experience with programming languages, such as Python, C, C++ and Java Preferred Skills and Experience: • Bachelor's or Master's degree in Computer Science, Information Systems, Security, or a related field Compensation: The compensation range for the position in the U.S. is $138,480 to $263,160 based on a full-time schedule. Your actual compensation may vary depending on your geography, job-related skills and experience. For part time roles, the compensation will be adjusted appropriately. The pay or salary range will not be below any applicable state, city or local minimum wage requirement. There is a different applicable compensation range for the following work locations: California (San Francisco Bay Area): $166,200 to $315,720 California (All Other): $152,400 to $289,440 Colorado: $138,480 to $263,160 Massachusetts: $138,480 to $289,440 New York City: $166,200 to $315,720 Washington: $152,400 to $289,440 Washington DC: $152,400 to $289,440 This position will be eligible for Kyndryl’s discretionary annual bonus program, based on performance and subject to the terms of Kyndryl’s applicable plans. You may also receive a comprehensive benefits package which includes medical and dental coverage, disability, retirement benefits, paid leave, and paid time off. Note: If this is a sales commission eligible role, you will be eligible to participate in a sales commission plan in lieu of the annual discretionary bonus program. Applications will be accepted on a rolling basis. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran. Being You Diversity is a whole lot more than what we look like or where we come from, it’s how we think and who we are. We welcome people of all cultures, backgrounds, and experiences. But we’re not doing it single-handily: Our Kyndryl Inclusion Networks are only one of many ways we create a workplace where all Kyndryls can find and provide support and advice. This dedication to welcoming everyone into our company means that Kyndryl gives you – and everyone next to you – the ability to bring your whole self to work, individually and collectively, and support the activation of our equitable culture. That’s the Kyndryl Way. What You Can Expect With state-of-the-art resources and Fortune 100 clients, every day is an opportunity to innovate, build new capabilities, new relationships, new processes, and new value. Kyndryl cares about your well-being and prides itself on offering benefits that give you choice, reflect the diversity of our employees and support you and your family through the moments that matter – wherever you are in your life journey. Our employee learning programs give you access to the best learning in the industry to receive certifications, including Microsoft, Google, Amazon, Skillsoft, and many more. Through our company-wide volunteering and giving platform, you can donate, start fundraisers, volunteer, and search over 2 million non-profit organizations. At Kyndryl, we invest heavily in you, we want you to succeed so that together, we will all succeed. Get Referred! If you know someone that works at Kyndryl, when asked ‘How Did You Hear About Us’ during the application process, select ‘Employee Referral’ and enter your contact's Kyndryl email address.

United States
$138K - $263K / year
Nordcloud, an IBM Company logo

Azure Data Engineer

Nordcloud, an IBM Company

We supercharge our customers, using the world's best technology platforms.

Data Engineer86 days ago
Full TimeRemoteTeam 501-1,000Since 2011H1B No Sponsor

• Designing, architecting, and implementing modern, secure, cloud-native data platforms on Azure • Building the underlying infrastructure that makes data accessible for a new wave of data-powered apps and GenAI services

Poland
Job Closed
Zscaler logo

Principal AI and Data Architect

Zscaler

Zscaler helps leading organizations in 180+ countries securely transform their networks and applications for a mobile and cloud-first world. Founded in 2008, th

Data Engineer86 days ago

About Zscaler Zscaler accelerates digital transformation to ensure our customers can be more agile, efficient, resilient, and secure. As an AI-forward enterprise, we are constantly pushing the envelope, leveraging the world’s largest security data lake to power our cloud-native Zero Trust Exchange platform. This innovation protects our customers from cyberattacks and data loss by securely connecting users, devices, and applications in any location. Here, impact in your role matters more than title and trust is built on results. We say, impact over activity. We seek innovators who actively use AI to amplify their impact and who thrive in an environment where we leverage intelligent systems to stay ahead of evolving threats. We believe in transparency and value constructive, honest debate—we’re focused on getting to the best ideas, faster. We build high-performing teams that can make an impact quickly and with high quality. To do this, we are building a culture of execution centered on customer obsession, collaboration, ownership, and accountability. We value high-impact, high-accountability with a sense of urgency where you’re enabled to do your best work and embrace your potential. If you’re driven by purpose, thrive on solving complex challenges, and want to be part of the team that’s helping to secure the AI age, we invite you to bring your talents to Zscaler and help shape the future of cybersecurity. Red Canary, a Zscaler company, monitors an enterprise’s environment to detect and respond to cybersecurity threats so they can focus on their mission. Our Managed Detection and Response (MDR) solution is a unique blend of human expertise and security, which protects organizations from modern adversaries as their teams work remotely, move to the cloud, and they adopt new cybersecurity and IT technologies. Role We are looking for a Principal AI and Data Architect to join our Red Canary team. This is a Remote role, reporting to the VP, Software Engineering. You will architect the large-scale data infrastructure and advanced AI/ML frameworks necessary to automate threat detection and enhance SOC efficiency. Ultimately, this leader will transform massive security telemetry into actionable intelligence using ML Models, LLMs, and AI agents to drastically reduce manual analyst workloads. What you’ll do (Role Expectations) - Lead the design and implementation of large-scale data architectures for cloud-based systems (AWS, Azure) to efficiently ingest, store, and process massive volumes of security telemetry and alerts - Spearhead advanced AI/ML initiatives, including Generative AI, to develop end-to-end AI solutions for SOC automation, threat detection, and threat hunting, leveraging frameworks like Scikit-learn, TensorFlow, and PyTorch - Drive the use of Large Language Models (LLMs) and AI Agents to enhance the enrichment of security data, enabling faster human decision-making, while exploring and evaluating various LLM architectures - Collaborate across teams to integrate ML-driven insights into the platform and apply automation and analytics to reduce analyst workload and enhance detection fidelity - Provide architectural guidance across engineering based on the fast-paced world of GenAI, Agents, and classic ML models, including those developed by our internal R&D teams Who You Are (Success Profile) - You thrive in ambiguity. You're comfortable building the path as you walk it. You thrive in a dynamic environment, seeing ambiguity not as a hindrance, but as the raw material to build something meaningful. - You act like an owner. Your passion for the mission fuels your bias for action. You operate with integrity because you genuinely care about the outcome. You adapt to what’s needed, navigating seamlessly between high-level strategy and hands-on execution. - You are a problem-solver. You seek out challenges because you are energized by finding solutions, knowing that solving the hard problems delivers the biggest impact. - You are a high-trust collaborator. You are ambitious for the team, not just yourself. You embrace our challenge culture by giving and receiving ongoing feedback—knowing that candor delivered with clarity and respect is the truest form of teamwork and the fastest way to earn trust. - You are a learner. You have a true growth mindset and never stop developing yourself, actively seeking feedback to become a better partner and a stronger teammate. You love what you do and you do it with purpose. What We’re Looking for (Minimum Qualifications) - 12+ years of experience inclusive of data architecture and AI/ML, with a track record of designing and implementing large-scale data systems and production-grade ML solutions - Proficiency in Python (for data processing and ML pipelines), cloud platforms (AWS and/or Azure including data storage, compute services, and security controls), and MLOps best practices - Bachelor's degree in Computer Science or a related field or equivalent What Will Make You Stand Out (Preferred Qualifications) - Security domain knowledge including SOC operations, threat detection methodologies, log formats, common attack techniques, and understanding of how ML can enhance detection and response - Familiarity with modern data pipelines, streaming technologies, and AI Agent frameworks - Proficiency with infrastructure-as-code, containerization, and CI/CD for data and model deployments #LI-KM9 #LI-Remote Zscaler’s salary ranges are benchmarked and are determined by role and level. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations and could be higher or lower based on a multitude of factors, including job-related skills, experience, and relevant education or training. The base salary range listed for this full-time position excludes commission/ bonus/ equity (if applicable) + benefits. Base Pay Range $133,000—$235,000 USD At Zscaler, we are committed to building a team that reflects the communities we serve and the customers we work with. We foster an inclusive environment that values all backgrounds and perspectives, emphasizing collaboration and belonging. Join us in our mission to make doing business seamless and secure. Our Benefits program is one of the most important ways we support our employees. Zscaler proudly offers comprehensive and inclusive benefits to meet the diverse needs of our employees and their families throughout their life stages, including: - Various health plans - Time off plans for vacation and sick time - Parental leave options - Retirement options - Education reimbursement - In-office perks, and more! Learn more about Zscaler’s Future of Work strategy, hybrid working model, and benefits here. By applying for this role, you adhere to applicable laws, regulations, and Zscaler policies, including those related to security and privacy standards and guidelines. Zscaler is committed to providing equal employment opportunities to all individuals. We strive to create a workplace where employees are treated with respect and have the chance to succeed. All qualified applicants will be considered for employment without regard to race, color, religion, sex (including pregnancy or related medical conditions), age, national origin, sexual orientation, gender identity or expression, genetic information, disability status, protected veteran status, or any other characteristic protected by federal, state, or local laws. See more information by clicking on the Know Your Rights: Workplace Discrimination is Illegal link. Pay Transparency Zscaler complies with all applicable federal, state, and local pay transparency rules. Zscaler is committed to providing reasonable support (called accommodations or adjustments) in our recruiting processes for candidates who are differently abled, have long term conditions, mental health conditions or sincerely held religious beliefs, or who are neurodivergent or require pregnancy-related support.

United States
$133K - $235K / year
Job Closed
Corporate Tools LLC logo

Senior Data Engineer

Corporate Tools LLC

Corporate Tools is proudly, stubbornly independent. No outside investors calling the shots. It’s just us choosing customers over profits, every time. We build the behind-the-scenes tools that keep businesses running: software, LLC filings, registered agent service, website and domain registration, address services… basically all the unglamorous stuff that makes companies actually work. We’ve grown into one of the largest B2B providers in the U.S. by sticking to a simple mission: solve the real, messy, confusing problems of starting and running a business, while keeping your privacy intact and making your life a whole lot easier.

Data Engineer86 days ago
OtherRemoteTeam 1,200Since 2014

Overview: Corporate Tools is hiring a Senior Data Engineer for up to $150,000/year. You will be a traditional company employee. This is a remote position, but if you're near one of our local offices, you're welcome to come hangout with us in-office as well. Our main offices are in Post Falls, ID, and Spokane, WA; we also have satellite offices in Austin, TX, and Salt Lake City, UT. You'll be working 40 hours a week and, of course, enjoy great company benefits. As a Senior Data Engineer at Corporate Tools, you will work closely with our Software and Analyst teams to manage everything that has to do with data. This role will help get large datasets into the hands of people that need it while also making sure it doesn't adversely impact other things we have going on in our software ecosystem. There will be a heavy focus on infrastructure, data pipelines and scalable database design - we want someone who can help us improve our current databases and infrastructure and maintain it in a cost-effective manner. This is more than just building and maintaining ETL pipelines. We need innovation, creativity, and solutions that will have a significant impact on how our data is handled and created. Wage: $150,000/year Benefits: - 100% employer-paid medical, dental and vision for employees - Annual review with raise option - 22 days Paid Time Off accrued annually, and 4 holidays - After 3 years, PTO increases to 29 days. Employees transition to flexible time off after 5 years with the company-not accrued, not capped, take time off when you want - The 4 holidays are: New Year's Day, Fourth of July, Thanksgiving, and Christmas Day - Paid Parental Leave - Up to 6% company matching 401(k) with no vesting period - Quarterly allowance - Use to make your remote work set up more comfortable, for continuing education classes, a plant for your desk, coffee for your coworker, a massage for yourself... really, whatever - Open concept office with friendly coworkers - Creative environment where you can make a difference - No dumb benefits like free dog walking on the weekends that snobby hipster places have to make you feel cool, but mathematically won't cost the company much money because you won't use it - Trail Mix Bar --- oh yeah Responsibilities: - Focus on data infrastructure. Lead and build out data services/platforms from scratch (using OpenSource tech). - Creating and maintaining transparent, bulletproof ETL (extract, transform, and load) pipelines that cleans, transforms, and aggregates unorganized and messy data into databases or data sources. - Consume data from roughly 40 different sources - Collaborate closely with our Data Analysts to get them the data they need. - Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. - Improve existing data models while implementing new business capabilities and integration points. - Creating proactive monitoring so we learn about data breakages or inconsistencies right away. - Maintaining internal documentation of how the data is housed and transformed. - Improve existing data models, and design new ones to meet the needs of data consumers across Corporate Tools. - Stay current with latest cloud technologies, patterns, and methodologies; share knowledge by clearly articulating results and ideas to fellow engineers, data analysts, and stakeholders. Requirements: - Bachelor's (BA or BS) in computer science, or related field. - 2+ years in a full stack development role - 4+ years of experience working in a data engineer role, or related position. - 2+ years of experience standing up and maintaining a Redshift warehouse - 4+ years of experience with Postgres, specifically with RDS. - 4+ years of AWS experience, specifically S3, Glue, IAM, EC2, DDB, and other related data solutions. - Experience working with Redshift, DBT, Snowflake, Apache Airflow, Azure Data Warehouse, or other industry standard big data or ETL related technologies. - Experience working with both analytical and transactional databases. - Advanced working SQL (Preferably PostgreSQL) knowledge and experience working with relational databases. - Experience with Grafana or other monitoring/charting systems. - Proven knowledge of data platforms and tangible examples of designing and developing complex data pipelines to support better decision making in the business. - Experience hosting and operating data platforms in cost efficient manner. - Ability to translate business requirements into non-technical, lay terms. - Proven expertise with data architecture design and deployment, data modeling, and database development.

Texas + 3 moreAll locations: Texas | Washington | Idaho | Utah
$150K / year