Reshaping the future of your business with technology solutions. Harness the power of your data.
Senior Solution Architect- Spark & Databricks Expert
Location
United States
Posted
67 days ago
Salary
0
Seniority
Senior
Job Description
Senior Solution Architect- Spark & Databricks Expert
Koantek
Role Description We are seeking a Senior Data Solutions Consultant with deep expertise in Apache Spark and Databricks. This role requires a decisive, agentic-forward approach to problem-solving. You will independently lead complex customer engagements, bridging hands-on data engineering excellence with strategic technical leadership. As a trusted advisor, you will proactively build and implement solutions that unlock significant value for our customers. Key Responsibilities - Customer Leadership: Lead engagements from discovery to delivery with full ownership and accountability. - Architecture & Optimization: Architect, implement, and optimize large-scale Spark/Databricks workloads focusing on scalability and cost-efficiency. - Spark Expertise: Apply expert-level Spark fundamentals to troubleshoot and tune distributed data jobs and SQL workloads. - Proactive Delivery: Design and execute PoCs and workshops to demonstrate solution vision and inspire customer confidence. - Strategic Advocacy: Act as a technical advocate for customers, anticipating issues and applying creative, data-driven solutions. - Cross-functional Partnership: Collaborate with product and engineering teams to improve customer experience and platform features. - Mentorship: Champion best practices in PySpark, Databricks, and Lakehouse design while mentoring junior engineers. Qualifications - 5–10 years in data engineering or analytics solution delivery. - 3+ years of hands-on expertise in Databricks, including job optimization, debugging, and workload governance. - Deep understanding of Spark Internals, PySpark, and Databricks SQL (DBSQL) performance tuning. - Strong knowledge of Delta Lake, Structured Streaming, and cloud infrastructure. - Proven ability to identify and solve complex technical problems with minimal oversight. - Exceptional skills to simplify technical complexity for business leaders. Preferred Qualifications - Databricks Certified Data Engineer Professional. - Experience with Delta Live Tables (DLT) and Unity Catalog (UC). - Experience in large-scale data migration or AI-assisted analytics in enterprise environments.
Related Guides
Related Categories
Related Job Pages
More Solutions Engineer Jobs
Lead Solutions Architect
Veeam SoftwareYour Single Backup and Data Management Platform for Cloud, Virtual and Physical
• Engage with sales teams in supporting sales opportunities from pre-sales through post-sales relationships • Provide architectural designs and engage in large scale proof of concepts, technical alliance validations, and post-sales deployments supporting Veeam service delivery partners • Provide subject matter expertise in the Veeam product suites to customers, partners, and internal Veeam teams • Develop whitepapers, best practice guides, competitive analysis documentation, and compete strategies as required to support deployment engagements and sales opportunities • Be an active contributor in the Veeam Community Forums • Attend marketing and technical presentations representing Veeam at a subject matter expert level
• Partner with Sales Directors to conduct in-depth customer discovery, mapping business challenges and identifying ideal AI-driven solutions • Act as a strategic liaison between medical affairs teams and our AI solutions, translating complex medical requirements into actionable technological implementations • Maintain comprehensive best practice guides and playbooks to optimize process readiness for AI solution adoption • Support and guide AI roadmap development for pharmaceutical customers by understanding their strategic vision • Assess and inform internal capabilities in the area of medical affairs • Aligning future goals with AI technological potential • Work closely with Customer Success project leads in contracted project implementation, enabling: • Precise adherence to customer requirements • Consistent delivery against agreed project scope • Facilitate customer understanding of Responsible AI tool applications • Co-Lead training and change management initiatives with the client • Collaborate closely with technology and product teams to: • Align product features with key customer requirements • Serve as the primary medical affairs subject matter expert, representing client needs • Be able to assist customers in defining and designing solutions • Provide expert guidance in medical affairs areas including: • Field excellence • Insights management • Key Opinion Leader (KOL) engagement strategies • Publication planning and delivery • Congress management • Impact demonstration • Support the usage of the platform by different medical personas, proactively identifying adoption barriers and resolution strategies • Maintain best practice guides and playbooks to optimise process readiness for AI solution adoption • Contribute to AI roadmap development for pharmaceutical customers by grounding technology direction in real-world Medical Affairs needs
Senior Solution Engineer
CoveoCoveo is a premier leader in intelligent insights and intelligent search. The company helps its customers succeed by creating high-performance contact centers, cultivating companyw
• Guide prospective customers in understanding, comparing, and evaluating Coveo’s Commerce solutions • Conduct deep technical and business discovery • Build and deliver tailored, competitive demos • Lead the technical components of Proofs of Concept • Act as the technical owner for RFIs and RFPs
• Lead technical evaluations and demonstrations of the Domino platform for Enterprise customers in a multitude of industry verticals • Design and execute proof-of-concept deployments tailored to each customer’s environment and mission needs, showcasing Domino’s integration with their data science workflows and infrastructure • Collaborate with account executives to craft solution architectures that meet industry-specific security and compliance standards (e.g., FedRAMP, IL5) • Develop and maintain reusable demonstration environments and technical assets that accelerate future sales cycles • Drive post-POC adoption readiness by partnering with Customer Success and Solutions Architects to ensure a smooth handoff into deployment • Success will be evident through higher technical win rates, reduced time to close, and increased adoption within key prospect accounts



