Success Oriented Solutions
Senior Data Engineer
Location
India
Posted
12 days ago
Salary
0
Seniority
Senior
Job Description
Senior Data Engineer
Everest Technologies, Inc
• Design and optimize data schemas for LLM consumption • Build robust data pipelines using Python and C#/.NET • Implement and maintain Vector Databases to support Retrieval-Augmented Generation • Work with Gravitee API Gateway to enforce data masking and access control • Manage the OpenAPI and MCP metadata for AI agents
Job Requirements
- 5+ years of experience
- Expert-level Python (Pandas, PySpark, SQLAlchemy)
- Strong familiarity with C# for interacting with .NET-based data layers
- Hands-on experience with Vector Databases and embedding models
- Understanding of data exposure through Gravitee APIM
- Experience with SQL/NoSQL databases, dbt, and cloud data warehouses (Snowflake, BigQuery, or Databricks)
- Familiarity with the Model Context Protocol (MCP)
Benefits
- Professional development opportunities
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Senior Data Engineer
Solidus LabsAt Solidus, we are shaping the financial markets of tomorrow by providing cutting-edge trade surveillance technology that protects investors, enhances transparency, and ensures regulatory compliance across traditional financial assets, prediction and crypto markets. With over 20 years of experience in developing Wall Street-grade FinTech, our team delivers innovative solutions that financial institutions and regulators worldwide rely on to detect, investigate, and report market manipulation, financial crime, and fraud. Headquartered in Wall Street, with offices in Singapore, Tel Aviv, and London, we safeguard millions of retail and institutional entities globally, monitoring over a trillion events each day.
Role Description We’re looking for a strong Software Engineer with experience in Data Engineering. Someone who is proficient in building robust, scalable, maintainable, and thoroughly monitored data pipelines on cloud environments. As an ambitious start-up in an extremely dynamic space, we pride ourselves on being independent, accountable, and organized, with a self-starter attitude and a willingness to get our hands dirty with day-to-day work that might fall outside our official scope, while keeping an eye on our goals and the big picture. Responsibilities: - Design and optimize the ClickHouse data layer - including table engines, partition strategies, materialized views, and storage policies - to ensure high performance at billions-of-events scale. - Own ClickHouse clusters sizing, topology decisions, and capacity planning across both real-time ingestion and T+1 batch workloads, balancing cost, latency, and throughput. - Drive data reliability and deduplication strategies within ClickHouse, leveraging engine-level features (ReplacingMergeTree, CollapsingMergeTree, etc.) and pipeline-level controls to guarantee data completeness and consistency. - Establish and continuously improve monitoring, alerting, and observability for the ClickHouse layer — covering replication health, merge performance, query latency, and resource utilization. - Serve as the internal ClickHouse authority, coaching engineering teams across the organization on query optimization, data modeling best practices, and efficient use of ClickHouse-specific constructs. - Act as the primary liaison with the ClickHouse vendor team - triaging issues, incorporating product feedback, evaluating new features, and translating vendor guidance into actionable improvements for our deployment. - Collaborate with downstream consumers (analytics, ML, product) to understand access patterns and continuously refine how data is stored and served — improving query performance, schema design, and data formats for diverse client needs. - Define and enforce schema versioning and governance standards within the ClickHouse environment, ensuring schema evolution does not compromise pipeline reliability or consumer compatibility. Qualifications - BSc. in Computer Sciences. - Strong background as a software engineer with at least 5+ years of hands-on experience with Java, Rust, or Python. - 8+ years in data engineering and data pipeline development on high-volume, low-latency production environments. - Experience working in low-latency, real-time systems processing billions of events a day. - Deep, hands-on ClickHouse expertise - including cluster architecture, table engine selection, replication, sharding, and query optimization. Experience engaging with the ClickHouse vendor team or community is a strong plus. - Proficiency across the broader data engineering stack: Apache Kafka, Spark, Airflow, Kubernetes, Redis, Snowflake, and caching technologies. - Expert-level SQL and query optimization skills, with a strong emphasis on ClickHouse-specific patterns - materialized views, projections, TTLs, and merge tree tuning. - Experience with monitoring and observability tools (Prometheus, Grafana, or similar), with the ability to define and own operational health metrics for a ClickHouse deployment. - Curiosity, ability to work independently, and a track record of proactively identifying and driving solutions. - Excellent verbal and written communication skills, including the ability to coach and influence engineers across teams in a remote environment. Company Description At Solidus, we are shaping the financial markets of tomorrow by providing cutting-edge trade surveillance technology that protects investors, enhances transparency, and ensures regulatory compliance across traditional financial assets, prediction, and crypto markets. With over 20 years of experience in developing Wall Street-grade FinTech, our team delivers innovative solutions that financial institutions and regulators worldwide rely on to detect, investigate, and report market manipulation, financial crime, and fraud. Headquartered on Wall Street, with offices in Singapore, Tel Aviv, and London, we safeguard millions of retail and institutional entities globally, monitoring over a trillion events each day.
Data Migration Specialist
The Back Room Offshoring Inc.Our client is a UK-based accounting firm that provides high-quality accounting, compliance, and financial reporting services to a diverse portfolio of businesses across the UK. The firm is committed to delivering accurate, timely, and client-focused solutions while maintaining strong technical standards and compliance with UK accounting regulations. They foster a collaborative and supportive environment where team members are encouraged to develop their expertise in UK accounting and build long-term careers within the industry.
Role Description As a Data Migration Specialist, you'll play a critical role in helping clients transition their financial information from legacy systems to modern accounting platforms. You'll work closely with clients, internal teams, and implementation specialists to ensure data migrations are completed accurately, efficiently, and on time. Success in this role means delivering seamless migration experiences, maintaining high data integrity standards, and providing exceptional support throughout the onboarding journey. What You'll Do - Assist clients with migrating financial data, including conversion balances, historical transactions, payroll information, and other key datasets. - Validate, cleanse, and reconcile migrated data to ensure accuracy and completeness. - Handle customer queries, technical questions, and migration-related escalations. - Liaise with internal stakeholders to coordinate migration timelines and project requirements. - Participate in regular meetings with implementation, partner, and account management teams. - Manage support tickets and customer requests within established service levels. - Update and maintain CRM records and migration documentation. - Support the ongoing improvement of migration processes, procedures, and client onboarding workflows. Qualifications - Strong understanding of accounting principles and financial transactions. - Previous experience working with accounting software and financial data. - Advanced Microsoft Excel skills, including functions, pivot tables, and data analysis. - Excellent attention to detail and ability to identify discrepancies. - Strong communication skills with the ability to explain technical concepts clearly. - Highly organized with the ability to manage multiple projects and deadlines. - Proactive problem-solving mindset with a strong sense of ownership and accountability. Nice to Have - Experience with accounting platforms such as Xero, MYOB, Sage, QuickBooks, or similar systems. - Background in bookkeeping, accounting, or finance-related roles. - Experience in software implementation, onboarding, or data migration projects. - Familiarity with CRM systems and customer support platforms. Why This Role This is a unique opportunity to combine accounting knowledge with technology and client-facing project work. You'll be part of a global team helping businesses modernize their financial systems while developing valuable expertise in software implementation, data migration, and process improvement within a fast-growing industry. This role is open to Philippine citizens currently based in the Philippines.
Technical Consultant – Data Engineering
vitagroupFür bessere Gesundheit durch digitalen Fortschritt. HEALTH INTELLIGENCE
• You analyze processes and data structures across various medical domains • In close coordination with clinicians, you elicit and systematize clinical (documentation) requirements • You ensure the use and development of clinical information models and terminologies to achieve semantic interoperability, in close cooperation with national and international standardization initiatives • You support the translation between different data models and standards • You create data integration pipelines between proprietary systems and open data standards • You advise internal and external stakeholders on medical data structures, particularly in the context of analytics, machine learning, and decision support systems • You conduct training for internal and external users in the area of data modeling
• Lead, mentor, and develop a team of data engineers and BI developers • Establish delivery standards, performance expectations, and career development plans • Promote a culture of accountability, innovation, and continuous improvement • Foster a high-performing engineering culture focused on accountability, delivery excellence, innovation, operational maturity, and continuous improvement • Own and manage enterprise data platforms including Snowflake, Informatica, and Power BI • Ensure platform performance, scalability, reliability, and security • Drive standardization of data engineering practices, architecture, and delivery frameworks • Drive modernization of enterprise data architecture, integration patterns, and cloud data capabilities • Establish scalable DataOps and platform governance practices to improve reliability, observability, and delivery efficiency • Manage a large portfolio of data and analytics demand across business functions • Prioritize initiatives and ensure alignment with strategic objectives • Design and implement repeatable, scalable solutions to improve speed and consistency of delivery • Develop and maintain multi-year technology roadmaps for data and analytics platforms • Lead annual budget planning, forecasting, and ongoing financial management • Optimize platform costs while maintaining service quality and delivery timelines • Evaluate solution viability including technical feasibility, cost, and long-term sustainability • Continuously improve platforms to increase delivery velocity and operational efficiency • Drive modernization initiatives to enhance data architecture and integration capabilities • Expand AI-enabled services and capabilities within the data platform ecosystem • Enhance business self-service analytics through governed datasets and reporting frameworks • Increase adoption of scalable, reusable data products across the organization • Build strong partnerships across IT (Infrastructure, Applications, Security) and business units • Translate business requirements into technical solutions aligned with enterprise standards • Ensure transparent communication of priorities, progress, risks, and outcomes


