Authority Partners logo
Authority Partners

Authority Partners is a leading and global IT services company with over 26 years of experience, serving clients within the financial, healthcare, insurance, mortgage, and technology sectors among many others. We are committed to building relationships with IT professionals who possess integrity, dedication, teamwork, and the desire to learn and grow with us. We specialize in placement for long-term contracts and permanent opportunities and helping our consultants achieve their career success. Authority Partners is an equal opportunity employer and is committed to providing a workplace that is free from all types of discrimination, as well as from abusive or offensive behavior and harassment.

Senior Databricks Engineer

Location

Worldwide

Posted

52 days ago

Salary

0

Seniority

Senior

Job Description

Senior Databricks Engineer

Authority Partners

Role Description Authority Partners is seeking an experienced Data Engineer to join our team. You will design, expand, and optimize data pipelines and architectures to support cross-functional teams. The ideal candidate is skilled in building and enhancing data systems, supporting developers, analysts, and scientists, and ensuring seamless data delivery across projects. Up for the challenge? Then read on and apply! - Design, build, and maintain scalable data pipelines for ingesting, transforming, and delivering structured and unstructured data. - Collaborate with stakeholders in an Agile environment to gather requirements and design data solutions and technology roadmaps aligned with business goals. - Define and implement best practices for data quality, governance, and security within Azure Databricks. - Provide expertise on advanced concepts including medallion architecture, Delta Live Tables (DLT), and Unity Catalog. - Lead and participate in code reviews, documentation, and knowledge-sharing sessions. - Identify opportunities to add value through effective information management. - Build relationships with key stakeholders responsible for information and performance management. Qualifications - 7+ years of experience in enterprise data engineering, designing, and building scalable data platforms. - Strong hands-on experience with Azure Databricks and PySpark for developing and optimizing data pipelines and platforms. - Extensive experience with Azure Databricks fundamentals and architecture, including cluster configuration, performance tuning, and optimization of Data Engineering and SQL Warehouse modules. - Experience building scalable solutions for data migration, batch processing, and real-time data ingestion. - Strong expertise in architecting big data solutions using Data Lakes, Data Warehouses, and Data Products. Requirements - Experience or knowledge of integrating Databricks with Collibra for metadata ingestion, lineage propagation, and data quality rule mapping. - Client management skills. Education - Bachelor’s degree in Computer Science or a related field, or equivalent education and experience. Company Description Authority Partners is a leading and global IT services company with over 26 years of experience, serving clients within the financial, healthcare, insurance, mortgage, and technology sectors among many others. We are committed to building relationships with IT professionals who possess integrity, dedication, teamwork, and the desire to learn and grow with us. We specialize in placement for long-term contracts and permanent opportunities and helping our consultants achieve their career success. Authority Partners is an equal opportunity employer and is committed to providing a workplace that is free from all types of discrimination, as well as from abusive or offensive behavior and harassment.

Related Categories

Related Job Pages

More Engineer Jobs

Insight logo

Microsoft 365 Messaging Engineer

Insight

Now is the time to bring your expertise to Insight. We are not just a tech company; we are a people-first company. We believe that by unlocking the power of people and technology, we can accelerate transformation and achieve extraordinary results. Fortune 500 Solutions Integrator with deep expertise in cloud, data, AI, cybersecurity, and intelligent edge. Guiding organizations through complex digital decisions.

Engineer52 days ago
Full TimeRemoteTeam 10,001

Requisition Number: 104491 Microsoft 365 Messaging Engineer Location: You will have the flexibility to work fully remote from anywhere across the US. Insight at a Glance - 14,000+ engaged teammates globally - $8.2 billion in revenue in 2025 - Placed on Newsweek’s America’s Greatest Workplaces for 2025 Now is the time to bring your expertise to Insight. We are not just a tech company; we are a people-first company. We believe that by unlocking the power of people and technology, we can accelerate transformation and achieve extraordinary results. As a Fortune 500 Solutions Integrator with deep expertise in cloud, data, AI, cybersecurity, and intelligent edge, we guide organisations through complex digital decisions. About the role As a Microsoft 365 Messaging Engineer Sr at Insight, you will deliver and lead complex Microsoft 365 Messaging solutions for enterprise clients. This role is primarily focused on messaging platforms and messaging migrations, while also supporting Copilot and AI readiness through secure messaging architecture, identity integration, and compliance alignment. This position sits within Insight’s Modern Workplace delivery organization and is a client-facing consulting role, requiring deep technical expertise, strong communication skills, and the ability to influence technical outcomes across messaging, identity, security, and governance. This role is ideal for a messaging expert who wants to be a go-to authority for Microsoft 365 Messaging and migrations, expand into identity, security, compliance, and Copilot readiness, and shape client outcomes through thoughtful architecture and governance decisions. Key Responsibilities Messaging & Migration (Primary Focus) - Design, implement, and support Microsoft Exchange and Microsoft 365 Messaging solutions - Lead and execute email and messaging migrations including Exchange, Google Workspace/Gmail, Lotus Domino, and other legacy platforms - Architect and deliver hybrid Exchange environments, coexistence strategies, tenant consolidations, and tenant-to-tenant migrations - Troubleshoot complex messaging issues related to mail flow, security, compliance, and hybrid identity dependencies Identity, Security, Compliance & Copilot Readiness - Provide senior-level engineering expertise across Active Directory, Microsoft Entra ID, Microsoft Purview, and Microsoft Defender - Ensure messaging and collaboration data is secure, compliant, and appropriately scoped for Microsoft Copilot and AI workloads - Advise clients on Copilot readiness including identity controls, oversharing risks, and compliance considerations - Align messaging architecture with Zero Trust and AI governance principles Consulting & Delivery Leadership - Act as a trusted technical advisor to clients - Lead technical discovery and solution design sessions - Translate business and technical requirements into secure, scalable architectures - Own technical delivery quality and identify risks and mitigation strategies - Support pre-sales activities with architecture input, effort estimation, and complexity assessment What we’re looking for - 5+ years of Microsoft infrastructure or Microsoft 365 experience - 3+ years of consulting or professional services delivery experience - Deep expertise with Microsoft Exchange, Microsoft 365 Messaging, and messaging migrations - Strong understanding of hybrid identity and Microsoft 365 service architecture - Excellent written and verbal communication skills Preferred Qualifications - Experience with Microsoft Entra ID, Purview, Defender for Office 365, and Intune - Broader Microsoft 365 experience including Teams, SharePoint Online, OneDrive, and Microsoft 365 Security & Compliance - Exposure to Copilot readiness, AI governance initiatives, enterprise migrations, or tenant consolidations Education & Certifications - Bachelor’s degree in computer science, Information Technology, or equivalent experience - Microsoft certifications preferred including Messaging, Enterprise Administrator, Security, Identity, or Compliance What you can expect We’re legendary for taking care of you, your family and to help you engage with your local community. We want you to enjoy a full, meaningful life and own your career at Insight. Some of our benefits include: - Freedom to work from another location—even an international destination—for up to 30 consecutive calendar days per year. - Full medical, dental, vision, and company 401k match. But what really sets us apart are our core values of Hunger, Heart, and Harmony, which guide everything we do, from building relationships with teammates, partners, and clients to making a positive impact in our communities. Join us today, your ambITious journey starts here. When you apply, please tell us the pronouns you use and any reasonable adjustments you may need during the interview process. At Insight, we celebrate diversity of skills and experience so even if you don’t feel like your skills are a perfect match - we still want to hear from you! Insight does not accept unsolicited resumes from recruiters or employment agencies. Unsolicited resumes will be treated as direct applications from the candidate, and recruiters or agencies who submit candidates for this position without a prior, written vendor agreement will not be eligible for any form of compensation, even if the candidate is hired. Salary Range - $130,000 - $145,000 The position described above provides a summary of some the job duties required and what it would be like to work at Insight. For a comprehensive list of physical demands and work environment for this position, click here. Insight is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veteran status, sexual orientation or any other characteristic protected by law. Posting Notes: Remote || Arizona (US-AZ) || United States (US) || IT Infrastructure & Support || None || Remote ||

United States
$130K - $145K / year
E Tech Group logo

Controls Engineer

E Tech Group

E Tech Group is an Equal Opportunity Employer. Applicants are considered for employment without regard to race, color, religion, sex, age, disability, military status, genetic information, gender identity, sexual orientation, citizenship status, or any other basis prohibited by law. E Tech Group will provide reasonable accommodations to qualified individuals with disabilities and for religious beliefs. E Tech Group is an Affirmative Action Employer of individuals with disabilities and protected veterans.

Engineer52 days ago
Full TimeRemoteTeam 501-1,000

At E Tech Group, joining our team means joining a group of passionate and forward-thinking experts. We’re one of the largest engineering and system integration firms in the United States providing value for our clients through IT automation and control solutions for more than 30 years to the Life Sciences, Mission Critical, Metals & Mining, Warehousing & Distribution, and CPG/Food & Beverage industries. Our national and global scale allows us to help our clients develop and implement standardized solutions at any of their facilities regardless of physical location or the local resources available at that site. We are seeking an enthusiastic and experienced Controls Engineer to be responsible for leading the design and execution of automation and control projects within the Food and Beverage industry. This includes developing detailed control system design specifications, programming PLC and SCADA applications, providing control system startup and commissioning services, and troubleshooting existing control systems. This is a fantastic opportunity to lead/work on projects from concept through commissioning phases. Location: Remote, must be located in midwest with 30-40% travel You Will: - Provide application/control systems design and development for systems of varying complexity. - Develop and evaluate alternative system solutions that meet stated requirements - Modify existing program/system logic involving multiple systems and subsystems - Interact with customers to gain an understanding of the business environment. Define scope, plans, and deliverables for assigned work - Work successfully in a team environment; focused strongly on customer service and continuous improvement - Enjoy going to local sites; Appreciate the documentation and planning aspects of engineering in a regulated environment - Up to 30-40% travel required - Be an ambassador who embodies our Core Values, prioritizing the success of E Tech Group, our clients, and the professional development of our associates. You Have: - Bachelor's Degree in Engineering or related Engineering fields. - 5 years of experience, or equivalent combination of education - Proficiency in troubleshooting control systems and an understanding of process controls - Control system validation experience of Food and Beverage systems a plus - Rockwell experience with products such as: ControlLogix, CompactLogix, PlantPAx, Factory Talk Software Suite, Studio 5000, PLC5, SLC500, RSView, PanelView Plus, etc. - Other SCADA and HMI package experience (Ignition and Wonderware) - Experience implementing detailed control system electrical design packages - Working knowledge of control system networks (Ethernet, ControlNet, DeviceNet, etc.) - Experience with Ethernet network design and implementation (Stratix or Cisco managed switches) - Understanding of Food and Beverage processes, GMP and validation - Knowledge of S88 Batch standards and experience implementing batch systems - Instrumentation experience - Excellent written and verbal communication skills - A DNA comprised of collaboration and teamwork Benefits & Perks: - 401k + match + prompt enrollment.  E Tech Group employees are 100% vested upon entry. - Prompt enrollment into Medical, Dental, and Vision benefits. - Generous paid time off that includes paid vacation, paid holidays, paid family leave and sick time off. - Learning and growth are key parts of the E Tech culture. We provide you with training and continuing education from day one, so you can advance your career. As an E Tech associate, you can unlock your greatest potential through challenges and opportunities. E Tech Group is an Equal Opportunity Employer. Applicants are considered for employment without regard to race, color, religion, sex, age, disability, military status, genetic information, gender identity, sexual orientation, citizenship status, or any other basis prohibited by law. E Tech Group will provide reasonable accommodations to qualified individuals with disabilities and for religious beliefs. E Tech Group is an Affirmative Action Employer of individuals with disabilities and protected veterans.

United States
Dragos logo

Staff Protocol Dissection Engineer

Dragos

Dragos is a computer and network security company specializing in industrial cybersecurity, incident response, threat intelligence, and security software. Past flexible jobs at Dra

Engineer52 days ago

Dragos is on a relentless mission to defend industrial organizations that provide us with the necessities of modern civilization; running water, functioning electricity, and safe industrial working environments. As the market leader in ICS/OT Cybersecurity, we are dedicated to arming our customers with best-in-class technology, threat intelligence, and services to protect their systems as effectively and efficiently as possible. We’re a remote-first culture with operations in North America, Europe, the Middle East, and APAC. We’re looking for mission-oriented teammates who embody our core values of authenticity, transparency, and trust. Are you ready to make a difference? Come join a mission that can save the world! About the Role: We are seeking a highly skilled Staff Protocol Dissection Engineer to join our team. In this role, you will be responsible for dissecting and analyzing various communication protocols, engaging with customers to understand their needs, rapidly prototyping solutions, and collaborating with cross-functional teams, including product, reverse engineering, and sales. Responsibilities: - Design, develop, and maintain high-performance, scalable backend systems and products using Rust - Collaborate closely with cross-functional teams to build and deliver features rapidly - Optimize system performance, ensuring low-latency and high-throughput applications - Identify and suggest solutions to problems impacting the team - Develop production code for new features and bug fixes - Design and write automated tests that will ensure the integrity of our software Qualifications: - 6+ years of experience in the design, development, and debugging of distributed software - Ability to thrive in a fast-paced, evolving environment with minimal supervision - Working knowledge of connection oriented and connectionless network protocol stacks (bonus for ICS network protocols) - Solid understanding of memory safety, performance optimization, and ownership model in Rust - Familiarity with design choices and best practices in Rust - Experience working in protocol dissection, networking, and Linux systems programming - Experience with microservice system architecture and design patterns - Experience with unit and automated testing frameworks - Understanding of network security or a desire to learn about network security Compensation: - Salary: $192,000 - Competitive Equity Package - Comprehensive Benefits Plan #LI-NH1 #LI-REMOTE Dragos is an Equal Opportunity Employer and considers applicants for employment without regard to race, color, religion, sex, orientation, national origin, age, disability, genetics, or any other basis forbidden under federal, state, or local laws. All new hires must pass a background check as a condition of employment.

United States
$192K / year
Columbia Shipmanagement logo

2nd Engineer, LNG FSU Tanker

Columbia Shipmanagement

A leading organisation with 45 years of experience providing world-class ship management and maritime services globally

Engineer52 days ago
ContractRemoteTeam 10,001+Since 1978H1B No Sponsor

• CSM Rijeka is looking for self-motivated and skilled seafarers to join our expanding fleet of Columbia Shipmanagement. • Responsible for proper operation and maintenance of Engines room and other machinery equipment. • Experience in repairs and dry docking is required. • Experience with multicultural working environment. • Holder of valid STCW certifications required for the position. • Good communication and leadership skills. • Effective English communication. • Safety culture and mindset.

Croatia