DysrupIT logo
DysrupIT

We partner with clients to build bespoke cloud technology teams that solve business challenges. Resources as a Service.

Databricks Engineer

EngineerEngineerFull TimeRemoteMid LevelTeam 51-200Since 2016H1B No SponsorCompany SiteLinkedIn

Location

Philippines

Posted

51 days ago

Salary

0

Seniority

Mid Level

Bachelor Degree2 yrs expEnglishAWSAzureCloudETLGoogle Cloud PlatformPythonSQL

Job Description

Databricks Engineer

DysrupIT

• Design, develop, and maintain data pipelines using Databricks and related technologies • Build and optimize ETL/ELT processes for large-scale data processing • Work with structured and unstructured data across multiple data sources • Develop and manage data models to support analytics and reporting requirements • Collaborate with stakeholders including data analysts, developers, and business teams to understand data needs • Ensure data quality, integrity, and governance across data platforms • Monitor and troubleshoot data workflows and performance issues • Contribute to continuous improvement of data engineering practices and standards

Job Requirements

  • Minimum 2+ years of experience in data engineering
  • Hands-on experience with Databricks
  • Strong proficiency in Python and/or SQL
  • Experience with data pipeline development and data transformation frameworks
  • Familiarity with cloud platforms (e.g., Azure, AWS, or GCP)
  • Understanding of data warehousing concepts and modern data architectures
  • Experience with version control tools (e.g., Git)
  • Strong problem-solving skills and attention to detail.

Related Categories

Related Job Pages

More Engineer Jobs

Thermo Fisher Scientific logo

AI Engineer

Thermo Fisher Scientific

The World Leader In Serving Science

Engineer51 days ago
Full TimeRemoteTeam 10,001+Since 1956H1B Sponsor

Title: AI Engineer (North Carolina) Location: Remote North Carolina United States of America Full time Remote The Clinical Research Group (CRG) of Thermo Fisher Scientific delivers industry-leading clinical trial services to pharmaceutical, biotechnology, and medical device organizations. CRG Digital is an enterprise-wide digital function dedicated to accelerating CRG’s transformation into the most digitally enabled CRO in the industry. CRG Digital leads the strategy, governance, development, and lifecycle management of digital, data, and AI products across the organization. Our mission is to power clinical development with modern digital capabilities, improving operational efficiency, enhancing customer experience, unlocking insights from data, and enabling next-generation clinical innovation. Position Summary We are seeking a highly motivated AI Engineer to help design, build, deploy, and optimize AI solutions that advance CRG’s digital strategy. In this role, you will design, implement, and optimize AI models that support data analysis, automation, and innovation within clinical research and development operations. You’ll collaborate with data scientists, software engineers, and domain experts to translate business needs into scalable, intelligent solutions. The ideal candidate will be proficient in applying statistics, programming, data modeling, simulation, and advanced mathematics to business questions, with a specific focus on Generative AI. Proven experience with exploratory data analysis techniques, machine learning algorithms (including generative models), model validation techniques, and data visualization techniques. Strong knowledge in technical areas such as SQL, Python, Spark, Jupyter, and associated packages and libraries, specifically tailored to Generative AI. This is a remote position in North Carolina. Responsibilities: AI and Machine Learning Development - Design, develop, and deploy machine learning and generative AI models to support CRG Digital priorities including predictive analytics, text/NLP solutions, automation, and intelligent decision support. - Apply statistics, programming, data modeling, simulation, and advanced mathematics to business problems. - Evaluate and optimize model performance using appropriate validation metrics and techniques. - Build reusable model pipelines, APIs, and components for scalable AI product deployment. Data Engineering and Data Management - Preprocess, clean, transform, and integrate structured and unstructured datasets from clinical and operational sources. - Build and maintain ETL/data workflows that support ML and generative AI workloads. - Work with relational, document, columnar, graph, and object store systems; design schemas for AI and analytics use cases. - Ensure data quality, reproducibility, lineage, and governance compliance. Digital Product Integration and Lifecycle Management - Collaborate with software engineering and platform teams to integrate AI models into production systems with appropriate monitoring and observability. - Support documentation, traceability, and regulatory readiness (e.g., auditability, GxP considerations). - Contribute to CRG Digital’s product development lifecycle including discovery, prototyping, testing, deployment, and iteration. Innovation, Partnerships, and Enablement - Stay current on emerging AI and ML technologies, evaluating opportunities for CRG Digital roadmaps. - Contribute to an innovative ecosystem involving external partners and technology collaborators. - Support internal digital and AI upskilling through documentation, best practices, and knowledge sharing. Tools, Technologies, and Platforms Programming: Python, SQL, Spark Libraries and Frameworks: TensorFlow, PyTorch, Keras, scikit-learn, LangChain/LangGraph, OpenAI/other LLM SDKs Data Tools: Pandas, NumPy, Jupyter Cloud and Platforms: Databricks, AWS, Azure GCP; S3 or Azure Blob Storage Version Control: Git/GitHub Education and Experience: - Bachelor's degree or equivalent and relevant formal academic/vocational qualification - Master's degree preferred. - Previous experience in machine learning, AI model development, or data science that provides the knowledge, skills, and abilities to perform the job (comparable to 2+ years). - In some cases, an equivalency, consisting of a combination of appropriate education, training, and/or directly related experience, will be considered sufficient for an individual to meet the requirements of the role. Knowledge, Skills and Abilities: - Proficiency in modern SQL, Python, Spark, and associated AI/ML packages. - Experience with generative AI, large language models, NLP, prompt engineering, and LLMOps best practices. - Strong exploratory data analysis skills: ability to validate, visualize, and communicate model behavior. - Experience with cloud architecture, distributed computing, and modern ML platforms. - Familiarity with data governance, data security, and compliance requirements (preferably in a regulated or clinical environment). - Ability to manage multiple priorities in a matrixed environment. - Excellent analytical thinking, problem-solving, and communication skills. - Ability to work independently with minimal supervision and collaborate effectively with cross-functional teams. At Thermo Fisher Scientific, we are committed to fostering a healthy and harmonious workplace for our employees. We understand the importance of creating an environment that allows individuals to excel. Please see below for the required qualifications for this position, which also includes the possibility of equivalent experience: - Able to communicate, receive, and understand information and ideas with diverse groups of people in a comprehensible and reasonable manner. - Able to work upright and stationary for typical working hours. - Ability to use and learn standard office equipment and technology with proficiency. - Able to perform successfully under pressure while prioritizing and handling multiple projects or activities. - May require as-needed travel (0-20%). Location: Remotely based in North Carolina, no relocation sponsored.

North Carolina
Zscaler logo

Staff Escalation Engineer

Zscaler

Zscaler helps leading organizations in 180+ countries securely transform their networks and applications for a mobile and cloud-first world. Founded in 2008, the company operates o

Engineer51 days ago
Full TimeRemoteTeam 8,697Since 2007

About Zscaler Zscaler accelerates digital transformation to ensure our customers can be more agile, efficient, resilient, and secure. As an AI-forward enterprise, we are constantly pushing the envelope, leveraging the world’s largest security data lake to power our cloud-native Zero Trust Exchange platform. This innovation protects our customers from cyberattacks and data loss by securely connecting users, devices, and applications in any location. Here, impact in your role matters more than title and trust is built on results. We say, impact over activity. We seek innovators who actively use AI to amplify their impact and who thrive in an environment where we leverage intelligent systems to stay ahead of evolving threats. We believe in transparency and value constructive, honest debate—we’re focused on getting to the best ideas, faster. We build high-performing teams that can make an impact quickly and with high quality. To do this, we are building a culture of execution centered on customer obsession, collaboration, ownership, and accountability. We value high-impact, high-accountability with a sense of urgency where you’re enabled to do your best work and embrace your potential. If you’re driven by purpose, thrive on solving complex challenges, and want to be part of the team that’s helping to secure the AI age, we invite you to bring your talents to Zscaler and help shape the future of cybersecurity. We are looking for a Staff Escalation Engineer to join our Shared Platform Services team. This is a hybrid role based out of either our San Jose, CA office (3 days a week), reporting to the Sr. Manager, Software Engineering QA. You will be instrumental in taking the Zscaler Client Connector Cloud service to the next level in terms of reliability, availability, and scalability. As part of the team that built the world’s largest cloud security platform, you will bring your vision and passion to enable organizations worldwide to harness speed and agility with a cloud-first strategy. What you’ll do (Role Expectations) - Own and resolve escalated cloud incidents end-to-end, including impact analysis, debugging, implementing solutions, and communicating with stakeholders - Collaborate with development, security, and operations to design and implement code/configuration fixes for complex system issues - Monitor system health, performance, and security via PagerDuty and enhance alerting to meet SLOs - Build diagnostic tools, dashboards, and documentation to enable faster, more effective incident resolution across the team - Lead production service ownership and supportability by deploying critical fixes, making key deployment decisions, and responding to high-pressure off-hours events Who You Are (Success Profile) - You thrive in ambiguity. You're comfortable building the path as you walk it. You thrive in a dynamic environment, seeing ambiguity not as a hindrance, but as the raw material to build something meaningful. - You act like an owner. Your passion for the mission fuels your bias for action. You operate with integrity because you genuinely care about the outcome. True ownership involves leveraging dynamic range: the ability to navigate seamlessly between high-level strategy and hands-on execution. - You are a problem-solver. You love running towards the challenges because you are laser-focused on finding the solution, knowing that solving the hard problems delivers the biggest impact. - You are a high-trust collaborator. You are ambitious for the team, not just yourself. You embrace our challenge culture by giving and receiving ongoing feedback—knowing that candor delivered with clarity and respect is the truest form of teamwork and the fastest way to earn trust. - You are a learner. You have a true growth mindset and are obsessed with your own development, actively seeking feedback to become a better partner and a stronger teammate. You love what you do and you do it with purpose. What We’re Looking for (Minimum Qualifications) - Expert troubleshooting, debugging, and root-cause analysis for complex, high-priority incidents, with experience using CPU/memory profilers to diagnose resource exhaustion - Strong hands-on skills in Python, Bash, and Java; cloud platforms (GCP, AWS, Azure); and IaC/configuration tools (Terraform, Ansible) - Ability to write complex MySQL queries and generate business reports - Experience with authentication protocols such as SAML and OAuth - Solid networking fundamentals (TCP/IP, UDP, ICMP) and debugging with Postman and packet captures, along with proficiency in monitoring tools like Grafana What Will Make You Stand Out (Preferred Qualifications) - Experience developing applications with Java, REST APIs, MySQL, and jQuery - Bachelor’s degree in Computer Science or Computer Engineering (or related field); MS in CS/CE preferred #LI-JM1 #LI-Remote Zscaler’s salary ranges are benchmarked and are determined by role and level. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations and could be higher or lower based on a multitude of factors, including job-related skills, experience, and relevant education or training. The base salary range listed for this full-time position excludes commission/ bonus/ equity (if applicable) + benefits. Base Pay Range $129,500—$185,000 USD At Zscaler, we are committed to building a team that reflects the communities we serve and the customers we work with. We foster an inclusive environment that values all backgrounds and perspectives, emphasizing collaboration and belonging. Join us in our mission to make doing business seamless and secure. Our Benefits program is one of the most important ways we support our employees. Zscaler proudly offers comprehensive and inclusive benefits to meet the diverse needs of our employees and their families throughout their life stages, including: - Various health plans - Time off plans for vacation and sick time - Parental leave options - Retirement options - Education reimbursement - In-office perks, and more! Learn more about Zscaler’s Future of Work strategy, hybrid working model, and benefits here. By applying for this role, you adhere to applicable laws, regulations, and Zscaler policies, including those related to security and privacy standards and guidelines. Zscaler is committed to providing equal employment opportunities to all individuals. We strive to create a workplace where employees are treated with respect and have the chance to succeed. All qualified applicants will be considered for employment without regard to race, color, religion, sex (including pregnancy or related medical conditions), age, national origin, sexual orientation, gender identity or expression, genetic information, disability status, protected veteran status, or any other characteristic protected by federal, state, or local laws. See more information by clicking on the Know Your Rights: Workplace Discrimination is Illegal link. Pay Transparency Zscaler complies with all applicable federal, state, and local pay transparency rules. Zscaler is committed to providing reasonable support (called accommodations or adjustments) in our recruiting processes for candidates who are differently abled, have long term conditions, mental health conditions or sincerely held religious beliefs, or who are neurodivergent or require pregnancy-related support.

California
$129.5K - $185K / year
Job Closed
Full TimeRemoteTeam 201-500H1B Sponsor

• Responsible for technical supplier oversight regarding manufacturing and manufacturing development projects for nuclear instrumentation & control (I&C) systems and electrical components. • Provide consultation to NuScale design organizations regarding manufacturing, specify and collect product manufacturing requirements including all standards and specifications. • Act as a primary point of contact between NuScale design organizations and manufacturing suppliers for technical information and communications. • Apply industry expertise, codes and standards, and regulatory guidance in the general area of I&C manufacturing and supply chain development. • Interact daily with NuScale design organizations to interpret their needs and requirements to manufacturing entities. • Perform subcontract technical lead duties by preparing requirements documents and schedules, coordinating and monitoring the technical aspects of assigned manufacturing and manufacturing development projects. • Review manufacturing documentation of supplier to ensure compliance with specifications, codes, standards, and QA/QC requirements.

United States
$111.1K - $134.1K / year
Job Closed
Full TimeRemoteTeam 11-50

Dans le cadre d’un projet R&D, vous intervenez en tant que référent technique en conception robuste et validation afin de garantir la robustesse et la fiabilité des sous-ensembles électromécaniques, de la conception jusqu’à la validation expérimentale. Votre rôle consiste notamment à assurer : - La maîtrise des dispersions dimensionnelles - L’analyse de fiabilité des conceptions - Le pilotage des essais mécaniques - Le suivi des indicateurs de performance technique Localisation : Full remote (100% télétravail) Missions principales 1. Pilotage technique & performance produit - Analyser les exigences de fiabilité - Vérifier l’identification des fonctions et cotes critiques - Définir les objectifs de robustesse et de durabilité - Mettre en place et piloter les indicateurs de performance R&D : - Taux de réussite des essais de validation - Taux de conformité des cotes critiques - Nombre d’itérations de conception - Fiabilité mesurée après essais (taux de défaillance) - Respect du planning 2. Conception mécanique avancée - Concevoir et modéliser les sous-ensembles sous Enventive - Réaliser les chaînes de cotes fonctionnelles avec modélisation des contraintes physiques - Étudier la dispersion des composants dans les chaînes cinématiques - Analyser la propagation des cotes nominales, des tolérances et leurs impacts fonctionnels 3. Analyse de fiabilité & maîtrise statistique - Réaliser des analyses statistiques (Monte Carlo) - Conduire des plans d’expériences (DOE) - Évaluer la capabilité des cotes critiques (Cp, Cpk) - Alimenter et enrichir les AMDEC produit orientées fiabilité - Analyser les défaillances issues des essais et proposer des optimisations - Corréler résultats expérimentaux et hypothèses de calcul 4. Validation expérimentale - Définir et appliquer les protocoles d’essais mécaniques (endurance, fatigue, vibratoire, thermique) - Piloter les campagnes de validation - Analyser les résultats et mesurer les taux de réussite - Identifier les causes racines en cas de non-conformité - Proposer et suivre les plans d’amélioration - Rédiger les rapports finaux de validation Profil recherché - Diplôme d’ingénieur en mécanique, mécatronique ou équivalent - Expérience en conception mécanique et analyse de tolérances - Maîtrise des méthodes de fiabilité (AMDEC, DOE, Monte Carlo) - Bonne connaissance des essais mécaniques et validation produit - Maîtrise impérative du logiciel Enventive - Esprit analytique, rigueur et capacité à piloter des sujets techniques complexes Nous recherchons un ingénieur spécialisé en analyse de variabilité de chaîne de cotes sur mécanismes complexes, maîtrisant impérativement ENVENTIVE, pour renforcer nos études de robustesse design — postulez dès maintenant ! 🚀

France