Job Closed

This listing is no longer active.

Senior Data Engineer

Data EngineerData EngineerFull TimeRemoteSeniorTeam 51-200Since 2002H1B No SponsorCompany SiteLinkedIn

Location

Portugal

Posted

64 days ago

Salary

0

Seniority

Senior

Bachelor Degree5 yrs expEnglishCloudPythonSQL

Job Description

Senior Data Engineer

VFX Financial PLC

• Own the end to end data platform including ingestion, transformation, storage, and consumption. • Design and maintain scalable, reliable, and cost efficient data pipelines. • Define and enforce data modelling standards including dimensional models and semantic layers. • Build and maintain dbt projects including models, tests, macros, and documentation. • Establish strong DataOps practices including CI/CD, automated testing, deployment workflows, and version control. • Implement and enforce data contracts, SLAs, and data quality standards. • Drive observability across the data platform including monitoring, alerting, lineage, and incident response. • Lead root cause analysis for data issues and eliminate systemic failures. • Optimise performance and cost across the data platform, with a strong focus on warehouse usage. • Partner with product, analytics, and engineering teams to define and deliver reliable data products. • Contribute to data platform strategy, architecture decisions, and tooling selection.

Job Requirements

  • 5+ years of experience in data engineering or closely related roles.
  • Advanced SQL skills and strong programming ability in Python or an equivalent language.
  • Proven experience running dbt in production environments.
  • Deep experience with modern cloud data warehouses. Snowflake strongly preferred.
  • Strong understanding of DataOps including CI/CD, testing strategies, and deployment pipelines.
  • Demonstrated experience designing data models for analytics and product use cases.
  • Track record of improving reliability, observability, and performance of data systems.
  • Ability to operate autonomously and drive technical decisions across teams.

Benefits

  • Generous Profit Share Plan (PSP)
  • Equity via the Company Share Option Plan (CSOP)
  • Competitive salary
  • Annual all-expenses paid company incentive trip abroad
  • Flexible learning & development budget

Related Categories

Related Job Pages

More Data Engineer Jobs

HII's Mission Technologies division logo

Military Advisor- Big Data & Systems Engineer (Part Time/ Remote) (Mission Assurance 4)- 27692

HII's Mission Technologies division

HII works within our nation’s intelligence and cyber operations communities to defend our interests in cyberspace and anticipate emerging threats. Our capabilities in cybersecurity, network architecture, reverse engineering, software and hardware development uniquely enable us to support sensitive missions for the U.S. military and federal agency partners.

Data Engineer64 days ago
Full TimeRemoteTeam 5,001-10,000

Requisition Number: 27692 Required Travel: 51 - 75% Employment Type: Part Time/Hourly/Non-Exempt Anticipated Salary Range: $106,124.00 - $150,000.00 Security Clearance: Ability to Obtain Level of Experience: Senior HI This opportunity resides with All-Domain Operations (ADO), a business group within HII’s Mission Technologies division. All-Domain Operations comprises multi-domain operations, platforms and logistics, and intelligence operations. HII designs, develops, integrates and manages the sensors, systems and other assets necessary to support integrated ISR operations and accelerated decision-making. With data fusion and mission management capabilities for the Department of Defense, the combatant commands and the intelligence community, HII advances the mission around the globe. Meet HII’s Mission Technologies Division Our team of more than 7,000 professionals worldwide delivers all-domain expertise and advanced technologies in service of mission partners across the globe. Mission Technologies is leading the next evolution of national defense – the data evolution - by accelerating a breadth of national security solutions for government and commercial customers. Our capabilities range from C5ISR, AI and Big Data, cyber operations and synthetic training environments to fleet sustainment, environmental remediation and the largest family of unmanned underwater vehicles in every class. Find the role that’s right for you. Apply today. We look forward to meeting you. To learn more about Mission Technologies, click here for a short video: https://vimeo.com/732533072 Summary HII-Mission Technologies is seeking an experienced and skilled Military Advisor- Big Data Analytics & Systems Engineer to provide expert guidance and support to our military clients! As a Military Advisor, you will be responsible for providing technical expertise, developing and delivering training programs, and conducting operational assessments. In this role, you will support large-scale data collection, processing, and analysis efforts focused on understanding population sentiment, digital trends, and information environments. The selected candidate will design and implement systems that capture, process, and analyze high-volume data from scraping, collection, and digital monitoring efforts. These insights will support programs designed to build situational awareness of the digital environment, identify emerging trends, and inform strategic messaging, engagement, and influence activities. This role combines data engineering, analytics, and digital environment analysis, requiring both technical expertise and the ability to translate large datasets into actionable insights. Come join our growing team today! *Position: Remote and part time. *Travel: This position requires episodic travel to OCONUS locations, often to remote and challenging environments. Expect deployments lasting several weeks to months at a time. Travel may include locations with limited infrastructure and security concerns. What you will do - Develop and maintain systems to capture and process large-scale datasets from scraping, automated collection, and external data feeds - Design data pipelines that ingest structured and unstructured data at scale - Manage ETL processes to clean, normalize, and integrate multiple data sources - Analyze large datasets to identify population sentiment, behavioral patterns, and digital engagement trends - Apply statistical analysis, machine learning, and natural language processing techniques to extract insights from text and social media data - Monitor shifts in online discourse and emerging narratives - Design and implement scalable big data architectures to support large analytical programs - Integrate data systems into platforms used for digital awareness and influence analysis programs - Ensure systems support high-volume processing and rapid analytical outputs - Translate complex datasets into actionable insights for program planners and decision makers - Develop dashboards, visualizations, and analytical reports - Support program efforts aimed at understanding information flows, messaging effectiveness, and audience behavior - Additional duties as assigned or required What we are looking for - 9 years relevant experience with Bachelors in related field; 7 years relevant experience with Masters in related field; 4 years relevant experience with PhD or Juris Doctorate in related field; or High School Diploma or equivalent and 13 years relevant experience - Experience with large-scale data analytics and distributed data systems - Strong proficiency in Python and SQL - Experience working with large datasets from scraping, APIs, or automated collection systems - Experience designing data pipelines and big data processing workflows - Strong communication skills to translate analytics into operational insights - Excellent presentation and interpersonal skills - Ability to work effectively in a fast-paced, dynamic environment - Willingness to deploy up to 50% of the time as required by mission needs - Clearance: Must be able to obtain and maintain a Secret clearance Bonus points for... - Instructor experience, with a proven ability to develop and deliver effective training programs - Ability to identify patterns and insights in large, noisy datasets - Understanding of digital ecosystems and online behavioral trends - Experience building analytical tools for monitoring and assessing information environments - Experience with social media analytics or sentiment analysis - Experience applying natural language processing (NLP) to large text datasets - Experience with machine learning techniques for trend detection or classification - Experience with web scraping frameworks and large-scale data collection systems - Experience with distributed data environments such as Spark, Hadoop, or Kafka - Clearance: Possess and maintain a Secret clearance Physical Requirements May require working in an office, industrial, shipboard, or laboratory environment. Capable of climbing ladders and tolerating confined spaces and extreme temperature variances. HII is more than a job - it’s an opportunity to build a new future. We offer competitive benefits such as best-in-class medical, dental and vision plan choices; wellness resources; employee assistance programs; Savings Plan Options (401(k)); financial planning tools, life insurance; employee discounts; paid holidays and paid time off; tuition reimbursement; as well as early childhood and post-secondary education scholarships. Bonus/other non-recurrent compensation is occasionally offered for qualified positions, and if applicable to this role will be addressed by the recruiter at the screening phase of application. Why HII We build the world’s most powerful, survivable naval ships and defense technology solutions that safeguard our seas, sky, land, space and cyber. Our workforce includes skilled tradespeople; artificial intelligence, machine learning (AI/ML) experts; engineers; technologists; scientists; logistics experts; and business administration professionals. Recognized as one of America’s top large company employers, we are a values and ethics driven organization that puts people’s safety and well-being first. Regardless of your role or where you serve, at HII, you’ll find a supportive and welcoming environment, competitive benefits, and valuable educational and training programs for continual career growth at every stage of your career. Together we are working to ensure a future where everyone can be free and thrive. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, physical or mental disability, age, or veteran status or any other basis protected by federal, state, or local law. Do You Need Assistance? If you need a reasonable accommodation for any part of the employment process, please send an e-mail to buildyourcareer@hii-co.com and let us know the nature of your request and your contact information. Reasonable accommodations are considered on a case-by-case basis. Please note that only those inquiries concerning a request for reasonable accommodation will be responded to from this email address. Additionally, you may also call 1-844-849-8463 for assistance. Press #3 for HII Mission Technologies.

United States
$106K - $150K / year
Job Closed
Airbnb logo

Data Engineer, BizTech

Airbnb

Airbnb is a community based on connection and belonging.

Data Engineer64 days ago
Full TimeRemoteTeam 5,001-10,000Since 2007H1B Sponsor

Airbnb was born in 2007 when two hosts welcomed three guests to their San Francisco home, and has since grown to over 5 million hosts who have welcomed over 2 billion guest arrivals in almost every country across the globe. Every day, hosts offer unique stays and experiences that make it possible for guests to connect with communities in a more authentic way. Data Engineer: Airbnb is a mission-driven company dedicated to helping create a world where anyone can belong anywhere. It takes a unified team committed to our core values to achieve this goal. Airbnb's various functions embody the company's innovative spirit and our fast-moving team is committed to leading as a 21st century company. The Community You Will Join: The BizTech team at Airbnb is crucial to the company's operations, handling critical data related to compliance with Tax, Payments, and Legal regulations. We also manage application data for tools such as CRM, Jira, and Workday, which are essential for Airbnb’s business. Joining this team means working with cross-functional stakeholders, designing scalable solutions, and contributing to a world-class data engineering environment with an emphasis on quality, scalability, and robust engineering practices. The Difference You Will Make: We are looking for a hands-on expert to provide technical leadership in addressing BizTech’s diverse data engineering needs and driving long-term strategies and best practices. This key leadership role requires strong collaboration and influence across teams. You'll play a crucial role in understanding business needs, identifying the right data sources, designing efficient data models, and building reliable, scalable data pipelines. As technology continues to evolve, you'll help shape and maintain significant parts of BizTech’s critical data ecosystem. Your contributions will not only address complex business challenges but also help refine and advance Airbnb’s Data Engineering Paved Path, benefiting the entire data community at Airbnb. We believe in solving problems and contributing back to our data community to continuously improve. A Typical Day /Responsibilities: - Lead the design, implementation, and testing of data systems, from architecture to production. - Build batch and real-time data systems that support business needs and critical products. - Ensure data systems' quality, performance, and stability through rigorous monitoring and quality assurance practices. - Design and optimize data models to efficiently meet business and product requirements. - Collaborate with cross-functional teams, including product managers, data scientists, and engineers, to develop scalable systems and drive data-driven decisions. - Maintain strong partnerships with backend, data science, and machine learning teams to ensure seamless integration of data systems. - Contribute to long-term data strategies and influence data engineering practices across the organization. - Mentor and guide team members, fostering best practices for data quality and governance. - Advance 3rd party data integrations, enhancing frameworks for data exchange, governance, and lineage. Your Expertise: - 3+ years of relevant experience with a Bachelor's/Master’s degree in CS/EE Extensive experience in designing, building, and operating distributed data platforms (e.g., Spark, Kafka, Flink) at a large scale. - Proficiency in Java, Scala, or Python, along with strong skills in data processing and SQL querying. - Proven track record of designing and optimizing batch and real-time data pipelines. - Strong collaboration skills with the ability to work with product managers, data scientists, and engineers. - Advanced problem-solving and analytical skills, with a focus on data quality, governance, and system reliability. - Excellent written and verbal communication, with the ability to influence stakeholders and convey complex technical concepts. - Expertise in data modeling, warehousing, and working with relational and columnar databases (e.g., PostgreSQL, MySQL, Redshift, BigQuery). - Experience with integrating machine learning models into data systems (preferred). - Strong leadership and mentorship capabilities, with experience guiding teams on best practices and technical strategies. - Flexible and innovative, with the ability to adopt new technologies to enhance data systems and processes. How We'll Take Care of You: Our job titles may span more than one career level. The actual base pay is dependent upon many factors, such as: training, transferable skills, work experience, business needs and market demands. The base pay range shown below is annualized, is inclusive of allowances and is subject to change and may be modified in the future. This role may also be eligible for bonus or incentives, one or more equity programs, benefits, and Employee Travel Credits. India Annual Pay Range ₹3,050,000—₹4,350,000 INR

India
₹3,050K - ₹4,350K / year
Job Closed

Role Description The Senior Data Engineer is responsible for managing the development and maintenance of the company’s data infrastructure and analytics pipelines. This role focuses on creating simple, scalable, and high-performing data solutions to support business intelligence and AI initiatives. - Architect and oversee data warehouse technical designs in Snowflake to ensure scalability, stability, and security. - Develop and maintain automated data integration pipelines using ETL platforms and Snowflake to ingest data from various business systems. - Build and optimize transformation layers and data models to support reporting and visualization in Power BI. - Contribute directly to the design, development, and deployment of AI tools and machine learning datasets. - Enforce code quality standards and peer review processes to ensure the stability of the data environment. - Maintain technical documentation for all data models, integrations, and transformation logic. - Troubleshoot data discrepancies and pipeline failures, developing long-term fixes rather than temporary workarounds. - Collaborate extensively with the Chief Analytics Officer and project teams to translate business requirements into technical data solutions. - Research and provide feedback on new AI/ML technologies and data tools being considered for implementation. - All other duties as assigned. Qualifications - Strong knowledge of the software development lifecycle (SDLC) and data engineering best practices. - 3-4 years of experience with advanced Database administration and development. - Extensive knowledge of SQL for complex data transformation and optimization. - 3-4 years of experience writing Python code for data automation and scripting. - Experience with enterprise integration platforms and BI tools. - Demonstrated ability to research and resolve complex data problems using a variety of resources. - Strong planning and organizational skills to manage multiple data work efforts simultaneously. Working Conditions - On-call availability for rotation during the week and weekends. - Remote work. Physical Requirements - Employee may experience the following physical demands for extended periods of time: Sitting for extended periods of time; use of hands and fingers to operate a computer keyboard, mouse, sorter, power tools, and to handle other computer components; occasional climbing or bending to inspect cables in floors and ceilings; lifting and transporting of moderately heavy objects, such as computers and peripherals. Direct Reports - N/A Equal Opportunity Employer We are an equal opportunity employer. Export Control Compliance Notice This position may involve access to technology or software source code subject to U.S. export control laws (ITAR/EAR). Employment is contingent on verifying U.S. Person status or obtaining any necessary export license/confirming the availability of a license exception. Applicants must provide information for export control screening, which will be reviewed for compliance. Palmetto State Armory may elect not to pursue a license or exception and may decline to proceed with an applicant on that basis.

United States
Job Closed
Sweed POS logo

Data Engineer

Sweed POS

The all-in-one retail cannabis software solution

Data Engineer64 days ago
Full TimeRemoteTeam 11-50H1B No Sponsor

• Design, build, and maintain data pipelines using Airflow, and Trino to ingest and process data from multiple systems (databases, APIs, event streams, 3rd-party integrations). • Improve data quality and reliability – implement monitoring, validation, and alerting for pipelines to ensure accuracy and consistency. • Develop and maintain the platform – deploy, monitor and maintain services in our aws cloud • Collaborate with cross-functional teams – work closely with Product Analytics, Data Architecture, and Engineering teams to define data requirements and deliver them effectively. • Optimize performance and cost – fine-tune queries, pipelines, and storage for speed and efficiency. • Document data assets – maintain clear documentation for data sources, pipelines, and models.

United States
Job Closed