Job Closed
This listing is no longer active.
Halliburton is an Equal Opportunity Employer. Employment decisions are made without regard to race, color, religion, disability, genetic information, pregnancy, citizenship, marital status, sex/gender, sexual preference/orientation, gender identity, age, veteran status, national origin, or any other status protected by law or regulation.
Data Engineer
Location
Brazil
Posted
90 days ago
Salary
0
Seniority
Mid Level
Job Description
Data Engineer
Halliburton
Role Description We are implementing a strict Medallion Architecture to organize petabytes of industrial data. This role is for a Data Engineer who excels at transforming raw chaos into structured, queryable assets. You will build and maintain the ELT pipelines that move data from "Bronze" (Raw) to "Silver" (Cleaned) and "Gold" (Aggregated). You will work with Delta Lake (On-prem/Databricks), Polars, and Airflow to ensure data quality and availability for Data Scientists and the Knowledge Graph. What You’ll Do - Pipeline Development: Develop and maintain robust Airflow DAGs to orchestrate complex data transformations. - Data Transformation: Use Spark (when scale requires) and Polars to clean, enrich, and aggregate data according to business logic. - Architecture Implementation: Enforce the Medallion Architecture patterns, ensuring clear separation of concerns between data layers. - Performance Tuning: Optimize processing workflows (Polars/Spark) jobs and SQL queries to reduce costs and execution time; make intelligent decisions on when to use Polars vs. Spark. - Deployment & Operations: Manage code deployment to on-prem and cloud infrastructure, including containerization and environment configuration. - Data Quality: Implement comprehensive data validation checks and quality gates between medallion layers. - Data Cataloging: Maintain the metadata and catalog entries to ensure all data assets are discoverable and documented. The Technology Stack - Orchestration: Apache Airflow. - Data Processing: Polars (primary for ETL), PySpark/SQL (for massive scale). - Compute: Single-node workers (Polars), Databricks/Spark clusters (when scale requires). - Storage: Delta Lake, Parquet, S3/Blob Storage, MinIO. - Language: Python 3.12+ (w/ Polars), SQL. Qualifications - Complete Bachelor's degree in Computer Science, Engineering, or related. - 3+ years of experience in Data Engineering. - Strong proficiency in Apache Airflow and Databricks. - Experience implementing Medallion/Delta Lake architectures. - Strong SQL and Python skills. - Advanced English communication skills. Requirements - Experience with Unity Catalog or other governance tools. - Familiarity with dbt (data build tool). - Background in processing telemetry or sensor data. Benefits - Compensation is competitive and commensurate with experience. Company Description Halliburton is an Equal Opportunity Employer. Employment decisions are made without regard to race, color, religion, disability, genetic information, pregnancy, citizenship, marital status, sex/gender, sexual preference/orientation, gender identity, age, veteran status, national origin, or any other status protected by law or regulation.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Basic Data Entry Clerk Wanted - Work From Home 25 Words Per Minute Input - Typing
Jobconversion, LLCThank you for your interest!
Hello and thank you for your interest! We're looking for folks nationwide who are great at data entry and typing. We offer a flexible work from home remote position that allows you to stay home with the family! The pay range is flexible from $16/ph to $30/ph DOE and level of experience. You'll meet these requirements to work from home remotely • Stable Internet connection • Work can be done using the following: Phone device, laptap or computer • Must be able to type accurately with a minimum speed of 30 words per minute • Able to focus on tasks without being distracted • Must be resident of the US • Not afraid of emailing clients as needed We're looking for folks who we can depend on who can work from home remotely without distraction and are go-getters. Pay range from 16 to 30 hourly depending on the role, level of experience and proven ability to work from home at the same level as from an office. Data entry clerks come from all different backgrounds including, data entry, telemarketing, customer service, sales, clerical, secretary, administrative assistant, warehouse, inventory, receptionist, call center, part-time, retail fields & more • Must be 16 year of age or older • Must be proficient with basic PC skills • Must have an internet connection • Basic english written language • Basic english spoken language Thank you for your interest!
Lead Data Engineer
Encora DigitalEncora, a leader in digital engineering, drives innovation by crafting cutting-edge, cloud-first, data-first, and AI-first solutions that redefine industries. S
Lead and mentor a data engineering team, oversee data migration strategies, design scalable data pipelines, and collaborate with stakeholders to align data initiatives with business objectives, ensuring robust software solutions.
About Airwallex Airwallex is the only unified payments and financial platform for global businesses. Powered by our unique combination of proprietary infrastructure and software, we empower over 200,000 businesses worldwide - including Brex, Rippling, Navan, Qantas, SHEIN and many more - with fully integrated solutions to manage everything from business accounts, payments, spend management and treasury, to embedded finance at a global scale. Proudly founded in Melbourne, we have a team of over 2,000 of the brightest and most innovative people in tech across 26 offices around the globe. Valued at US$8 billion and backed by world-leading investors including T. Rowe Price, Visa, Mastercard, Robinhood Ventures, Sequoia, Salesforce Ventures, DST Global, and Lone Pine Capital, Airwallex is leading the charge in building the global payments and financial platform of the future. If you're ready to do the most ambitious work of your career, join us. Attributes We Value We hire successful builders with founder-like energy who want real impact, accelerated learning, and true ownership. You bring strong role-related expertise and sharp thinking, and you're motivated by our mission and operating principles. You move fast with good judgment, dig deep with curiosity, and make decisions from first principles, balancing speed and rigor. You're humble and collaborative; turn zero-to-one ideas into real products, and you "get stuff done" end-to-end. You use AI to work smarter and solve problems faster. Here, you'll tackle complex, high-visibility problems with exceptional teammates and grow your career as we build the future of global banking. If that sounds like you, let's build what's next. About Airwallex Airwallex is the only unified payments and financial platform for global businesses. Powered by our unique combination of proprietary infrastructure and software, we empower over 200,000 businesses worldwide - including Brex, Rippling, Navan, Qantas, SHEIN, and many more - with fully integrated solutions to manage everything from business accounts, payments, spend management, and treasury, to embedded finance at a global scale. Airwallex has established dual HQs in San Francisco, CA, and Singapore, and recently crossed the US$1B ARR threshold. The business was proudly founded in Melbourne, and now, in our 10th year, we have a team of over 2,000 of the brightest and most innovative people in technology across 26 offices worldwide. Valued at US$8 billion and backed by world-leading investors including T. Rowe Price, Activant, Lingotto, Robinhood Ventures, TIAA Ventures, Visa, Airtree, Blackbird, Sequoia, DST Global, Greenoaks, Salesforce Ventures, Lone Pine, and Square Peg, Airwallex is leading the charge in building the global payments and financial platform of the future. If you're ready to do the most ambitious work of your career, join us. Role Summary: We're hiring a Director, Data Platform Engineering (based in Singapore) to own the architecture, delivery, and adoption of a governed, reusable Data → Knowledge → Skills stack that powers analytics, AI agents, and real-time decisioning across the company. This is a product-facing platform leadership role. The successful leader will design and scale the semantic and operational layers on top of our Data Lakehouse (Databricks), enforce strong governance and lineage, and productize capabilities so both human analysts and machine agents reason and act consistently. The Role: Our platform is evolving beyond raw data storage into a structured, scalable system comprising three tightly integrated layers: Data - Governed, well-modeled, structured datasets including transactional records, event streams, dimensional models, and feature tables. This foundation must deliver high quality, strong lineage, and built-in regional compliance. It should be clean, trusted, and fully queryable. Knowledge - A semantic layer that makes data meaningful to both humans and machines. This includes standardized business metric definitions, entity relationships, contextual documentation, and company-specific domain knowledge. It enables analysts and AI agents alike to ask questions such as "What is our net revenue retention in SEA?" and receive consistent, trustworthy answers without having to reverse-engineer underlying schemas. Skills - Operationalized capabilities that act on data and knowledge. These include reusable analytical workflows, agent-callable tools, automated pipelines, API endpoints, and transformation primitives. Together, they form the building blocks that allow AI agents and internal teams not only to query information but to reason, automate, and execute reliably. We are looking for a leader who can architect and scale this governed stack across regions and use cases, while ensuring it remains accessible and intuitive for Data Science, AI engineering, and technical business stakeholders. The objective is to create a shared foundation that enables both human analysts and AI agents to reason consistently and act confidently. A critical component of this role is ownership of the regional and global data localization strategy within our Databricks environment. This includes designing architectural patterns that satisfy regulatory requirements while preserving a unified global data model across priority markets. The platform must reconcile local compliance constraints with global consistency in definitions, metrics, and knowledge artifacts. You will partner closely with Data Science, AI engineering, Product, and Risk teams to ensure the platform supports rapid experimentation, intelligent automation, and high-quality decision-making, transforming raw data into durable knowledge and deployable skills across the organization. Ideal Experience - 15+ years in data or platform engineering, with 5+ years leading engineering teams in complex, multi-region environments. - Proven experience architecting and scaling modern data platforms that extend beyond storage to include semantic layers, metadata systems, or knowledge graphs. - Strong hands-on expertise in data modeling (transactional, event-driven, dimensional, feature tables) with robust data quality, lineage, and observability practices. - Experience designing and operationalizing a governed semantic layer with standardized, auditable business metric definitions. - Track record of building reusable, programmatic capabilities on top of data platforms (APIs, orchestration frameworks, analytical workflows, agent-callable tools). - Deep familiarity with modern lakehouse architectures, particularly within a Databricks environment. - Experience implementing regional data localization and residency strategies while maintaining a unified global data model. - Strong understanding of data governance, privacy, and regulatory controls in multi-jurisdictional contexts. - Platform-as-product mindset, with experience driving adoption, improving developer experience, and operating with clear SLAs/SLOs and measurable impact. Applicant Safety Policy: Fraud and Third-Party Recruiters To protect you from recruitment scams, please be aware that Airwallex will not ask for bank details, sensitive ID numbers (i.e. passport), or any form of payment during the application or interview process. All official communication will come from an @airwallex.com email address. Please apply only through careers.airwallex.com or our official LinkedIn page. Airwallex does not accept unsolicited resumes from search firms/recruiters. Airwallex will not pay any fees to search firms/recruiters if a candidate is submitted by a search firm/recruiter unless an agreement has been entered into with respect to specific open position(s). Search firms/recruiters submitting resumes to Airwallex on an unsolicited basis shall be deemed to accept this condition, regardless of any other provision to the contrary. Equal opportunity Airwallex is proud to be an equal opportunity employer. We value diversity and anyone seeking employment at Airwallex is considered based on merit, qualifications, competence and talent. We don't regard color, religion, race, national origin, sexual orientation, ancestry, citizenship, sex, marital or family status, disability, gender, or any other legally protected status when making our hiring decisions. If you have a disability or special need that requires accommodation, please let us know.
Senior Staff Data Engineer
Scratch FinancialScratch Financial is the world's simplest patient financing solution.
Company Description NBCUniversal is one of the world's leading media and entertainment companies. We create world-class content, which we distribute across our portfolio of film, television, and streaming, and bring to life through our global theme park destinations, consumer products, and experiences. We own and operate leading entertainment and news brands, including NBC, NBC News, NBC Sports, Telemundo, NBC Local Stations, Bravo, and Peacock, our premium ad-supported streaming service. We produce and distribute premier filmed entertainment and programming through our powerhouse film and television studios, including Universal Pictures, DreamWorks Animation, and Focus Features, and the four global television studios under the Universal Studio Group banner, and operate industry-leading theme parks and experiences around the world through Universal Destinations & Experiences, including Universal Orlando Resort, home to Universal Epic Universe, and Universal Studios Hollywood. NBCUniversal is a subsidiary of Comcast Corporation. Visit www.nbcuniversal.com for more information. Our impact is rooted in improving the communities where our employees, customers, and audiences live and work. We have a rich tradition of giving back and ensuring our employees have the opportunity to serve their communities. We champion an inclusive culture and strive to attract and develop a talented workforce to create and deliver a wide range of content reflecting our world. Job Description We are seeking a Senior Staff Data Engineer looking to build the next generation of data pipelines and applications across the development of innovative new systems and solutions using a rapidly changing landscape of emerging technologies including generative AI and large language models. Working across the practices, techniques and tools used for the operational management of large language models in production environments - the Senior Staff Data Engineer role is proper for you if you're a subject matter expert in designing data integration frameworks and pipelines and still love to jump in and be "hands-on" when needed. This team is focused on proving the value of new tech and bringing it to production quickly. In the Senior Staff Data Engineer role, you'll have the opportunity to partner with internal stakeholders, data engineers, visualization experts, data scientists, and other technologists across the businesses. You've come to the right place if you love to take large, disparate data sets and build them into flexible and scalable analytics applications and warehouses. Here, you can create the extraordinary. Join us. The ideal candidate should be well-versed in designing, building, and supporting APIs, machine learning services and frameworks, LLMs, lang-chain, and foundational data warehousing technologies. In addition, the candidate should be excited about the possibilities that Generative AI can be leveraged to accelerate various parts of the business. Your primary focus will be building reliable, scalable, and efficient pipelines for use in LLMs and crafting our vision for LLM analytics. You will be essential in defining the team's strategy, evaluating, and integrating data patterns and technologies, and building pipelines alongside domain experts and data scientists. Responsibilities: - Design, build, and scale data pipelines across a variety of source systems and streams (internal, third-party, and cloud-based), distributed/elastic environments, and downstream applications and self-service solutions. - Deep understanding of Machine Learning best practices (e.g., training/serving, feature engineering, feature/model selection, imbalance data, RAG patterns) and algorithms (e.g., deep learnings, optimization) - Solid understanding of data modeling, warehousing, and architecture principles. - Implement appropriate design patterns while optimizing performance, cost, security, and scale and end-user experience. - Collaborate with cross-functional teams to understand data requirements and develop efficient data acquisition and integration strategies. - Interface with other technology teams to extract, load, and transform data from a wide variety of data sources using cloud-native data engineering principles. - Become a subject matter expert for data engineering-related technologies and designs. - Coach and guide others within the organization to build scalable pipelines based on foundational data engineering principles. - Participate in development sprints, demos, and retrospectives alongside releases and deployment. - Build and manage relationships with supporting engineering teams to deliver work products to production effectively. - Have worked well with data scientists, business analysts, and machine learning infrastructure to connect the dots between business and technology partners. - Develop automated tests for your code, ensuring every function, service, and object is compatible with your team's work and with the many systems within the NBCUniversal system portfolio and cross-device and browser compatibility. - Create documentation for developers and business users to help them understand our products. - Work collaboratively with a multidisciplinary team within a matrixed organization, leveraging strong interpersonal skills to navigate system complexities and deploy solutions efficiently. - Deploy to cloud-based platforms and troubleshoot application, cloud, and configuration issues when necessary. - Utilize tools for code & test generation to dramatically accelerate the delivery of features and components you create. Qualifications - 10+ years of experience in a data engineering role, with a strong emphasis on leading data engineering teams - Ability to think critically about problems, decipher user preferences versus challenging requirements, and effectively use online and onsite resources to find appropriate solutions. - Proven ability to thrive in an agile development environment, adept at incorporating feedback and adjusting to changing priorities. - Understanding REST-based APIs, vectorized embeddings, and other Retrieval Augmented Generation AI workload components. - Direct experience with data modeling, ETL/ELT development principles, cloud development, and data warehousing concepts - Knowledge of cloud technologies such as AWS, Azure, GCP - Knowledge of data management fundamentals and data storage principles - Experience in building data pipelines using Python/SQL or similar programming languages. - General understanding of cloud data engineering design patterns and use cases - Bachelor's degree in computer science, Data Science, Statistics, Informatics, Information Systems or related field. Desired Characteristics: - Familiarity with integrating large language models and AI-generated content technologies into applications. - Familiarity with the development ecosystem evolving around LLM integration, such as langchain. - Proven adaptability in a fast-paced, evolving technology landscape, with a strong problem-solving ability and quick learning curve. - Effective communication skills, capable of working collaboratively across diverse teams and navigating a large, matrixed organization efficiently. - Ability to translate business needs into clear technical requirements. - Analytical - You have experience in delivering self-service analytics solutions that promote data discovery. - Experience with Snowflake, Amazon Web Services, or related cloud platforms a plus - Understanding of big data technology stacks (Hive / Spark etc) is a plus - Experience moving on prem technologies to the cloud is a plus - Action-oriented - You're constantly figuring out new problems and are regularly showing results with a positive attitude, always displaying ethical behavior, integrity, and building trust - Strong understanding of Agile principles and best practices - You've dealt with ambiguity and can make quality decisions in a dynamic, fast-paced environment Additional Requirements: - Fully Remote: This position has been designated as fully remote, meaning that the position is expected to contribute from a non-NBCUniversal worksite, most commonly an employee's residence. This position is eligible for company sponsored benefits, including medical, dental and vision insurance, 401(k), paid leave, tuition reimbursement, and a variety of other discounts and perks. Learn more about the benefits offered by NBCUniversal by visiting the Benefits page of the Careers website. Salary range: $150,000 - $185,000 (bonus eligible) We are accepting applications for this position on an ongoing basis. Additional Information As part of our selection process, external candidates may be required to attend an in-person interview with an NBCUniversal employee at one of our locations prior to a hiring decision. NBCUniversal's policy is to provide equal employment opportunities to all applicants and employees without regard to race, color, religion, creed, gender, gender identity or expression, age, national origin or ancestry, citizenship, disability, sexual orientation, marital status, pregnancy, veteran status, membership in the uniformed services, genetic information, or any other basis protected by applicable law. If you are a qualified individual with a disability or a disabled veteran, you have the right to request a reasonable accommodation if you are unable or limited in your ability to use or access nbcunicareers.com as a result of your disability. You can request reasonable accommodations by emailing AccessibilitySupport@nbcuni.com. For LA County and City Residents Only: NBCUniversal will consider for employment qualified applicants with criminal histories, or arrest or conviction records, in a manner consistent with relevant legal requirements, including the City of Los Angeles' Fair Chance Initiative For Hiring Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act, where applicable.

