Job Closed
This listing is no longer active.
A leading provider of advanced data, application, and cloud engineering services.
Senior Data Engineer
Location
India
Posted
86 days ago
Salary
0
Seniority
Senior
Job Description
Senior Data Engineer
Enable Data
• Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and Databricks. • Gather and analyze data requirements from business stakeholders and identify opportunities for data-driven insights. • Build and optimize data pipelines for data ingestion, processing, and integration using Spark and Databricks. • Ensure data quality, integrity, and security throughout all stages of the data lifecycle. • Collaborate with cross-functional teams to design and implement data models, schemas, and storage solutions. • Optimize data processing and analytics performance by tuning Spark jobs and leveraging Databricks features. • Provide technical guidance and expertise to junior data engineers and developers. • Stay up-to-date with emerging trends and technologies in cloud computing, big data, and data engineering. • Contribute to the continuous improvement of data engineering processes, tools, and best practices.
Job Requirements
- Bachelor's or Master's degree in computer science, engineering, or a related field.
- 10+ years of experience as a Data Engineer, Software Engineer, or similar role, with a focus on building cloud-based data solutions.
- Strong experience with cloud platforms such as Azure
- Proficiency in Apache Spark and Databricks for large-scale data processing and analytics.
- Experience in designing and implementing data processing pipelines using Spark and Databricks.
- Strong knowledge of SQL and experience with relational and NoSQL databases.
- Experience with data integration and ETL processes using tools like Apache Airflow or cloud-native orchestration services.
- Good understanding of data modeling and schema design principles.
- Experience with data governance and compliance frameworks.
- Excellent problem-solving and troubleshooting skills.
- Strong communication and collaboration skills to work effectively in a cross-functional team.
- Relevant certifications in cloud platforms, Spark, or Databricks are a plus.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Role Description The RIS Data Migration Engineer is responsible for overseeing and executing the migration of data between Radiology Information Systems (RIS), ensuring data integrity, accuracy, and compliance with regulatory standards. The Data Migration Engineer will work closely with IT, clinical, and administrative teams to ensure seamless transitions of data from legacy systems to modern platforms, while optimizing workflows and maintaining the highest standards of patient data privacy and security. - Develop and execute comprehensive strategies for RIS data migration. - Collaborate with stakeholders to gather and analyze migration requirements. - Extract clinical, operational, and administrative data from legacy RIS systems. - Assess and map legacy data structures, including patient demographic records, diagnostic radiology reports, scanned documents, and future appointments. - Assist in assembling and loading RIS system’s master lists including referring physicians, insurance providers, procedure codes, billing codes, organizational structures such as practices, sites, and rooms, and other master look-up tables. - Use ETL tools to clean, transform, and prepare data for migration. - Provide post-migration support for product go-live implementations. - Partner with cross-functional teams, including customers, IT staff, compliance officers, and third-party vendors. - Document the entire migration process, including methodologies, tools, and reports. - Train staff on how to manage, access, and use data in the new RIS system. - Perform comprehensive validation to ensure data completeness and resolve inconsistencies. - Conduct post-migration verification and prepare detailed reports for stakeholders. - Identify and resolve migration-related issues, such as data inconsistencies or system compatibility challenges. Qualifications - Bachelor’s degree in information technology, computer science, healthcare informatics, or related field; or equivalent professional experience. - 3+ years proven experience in data migration within a healthcare environment. - Hands-on experience with data manipulation and/or migration within RIS, PACS, HIS, and EMR systems. - Proficiency in ETL processes, database structures, SQL, and healthcare data standards. - Proficient SQL skills and experience with database management. - Proficiency with Transact SQL, triggers, functions, stored procedures, database schema design, SQL agent jobs, and ad hoc querying. - Experience working with various formats of data such as CSV and other delimited text files, Excel data, SQL databases, Word docs, BMP/JPG files, PDF files. - Excellent technical communication and interpersonal skills, with the ability to effectively communicate with stakeholders at all levels of the organization. - Strong problem-solving and troubleshooting abilities. - Ability to adapt to constantly changing projects. - Attention to detail with a commitment to data accuracy and security. - Proficiency in C# for Windows desktop programming or Python, or similar programming languages to enhance in-house data migration tools. - Familiarity with Linux OS and scripting (Python, Perl, VIM, BASH) to assist with ancillary data migrations taking place in Linux environments. - Mirth skills, particularly with HL7. Requirements - Communicates, cooperates, and consistently functions professionally and harmoniously with all levels of supervision, co-workers, visitors, and vendors. - Demonstrates initiative, personal awareness, professionalism and integrity, and exercises confidentiality in all areas of performance. - Follows all local, regional and country laws concerning employment. - Follows all DeepHealth policies and procedures. - Follows data privacy, compliance, safety and confidentiality standards at all times. - Practices universal safety precautions. - Promotes good public relations on the phone and in person. - Adapts and is willing to learn new tasks, methods, and systems. - Reports to work regularly as scheduled; consistently punctual with respect to working hours, meal and rest breaks, and maintains satisfactory personal attendance in accordance with DeepHealth guidelines. - Completes job responsibilities in a quality and timely manner. Travel - This position requires domestic/international travel up to 10%. Working Environment - Remote. Physical Demands - This position often requires sitting, standing, walking, bending, twisting, reaching with hands and arms, using hands and fingers, handling, or feeling, speaking, listening, and high-level cognitive thinking. - Must be able to lift up to 10 pounds occasionally. Salary - Salary range $100,000-$120,000.
Freelance Polish Data Annotation Specialist
DocPlannerAt Docplanner Group, we’re on a mission to help people live longer, healthier lives. As the world’s largest healthcare platform, each month, we connect 24 million patients with 280k doctors across 13 countries. Our marketplaces, SaaS and AI tools simplify daily tasks and help doctors, clinics and hospitals work more efficiently. Real impact – We help doctors help patients. Your work truly makes a difference. At scale, yet agile – 3,000+ employees, but still fast, flexible, and hands-on. Shape the future, sustain growth – Make a difference now and build for long-term success.
Role Description As a Freelance Polish Data Annotation Specialist at Docplanner, your main focus will be preparing and curating linguistically and medically oriented datasets in Polish to power our machine learning and natural language processing (NLP) initiatives. You will work independently while maintaining clear communication with our NLP experts, ensuring the accuracy and relevance of our data for the Polish market, and contributing directly to the quality and reliability of our AI-driven products in the medical domain. This role is ideal for professionals with a strong linguistic background in Polish who are passionate about working in the healthcare and technology space. The ideal candidate has experience in data annotation, transcription, and text analysis, combined with a basic understanding of medical terminology and concepts. Key Responsibilities: - Prepare and maintain Polish medically oriented datasets for machine learning purposes, ensuring high-quality data annotation and consistency. - Follow and provide feedback on annotation and labeling conventions, as well as perform audio transcriptions in Polish (aligning audio with text and correcting text based on audio). - Implement text patterns to detect and extract named entities in Polish, such as names, addresses, organization names, ID numbers, and medical terms. - Contribute to dictionaries and taxonomies in Polish for use in NLP systems. - Evaluate the correctness and accuracy of Polish words, sentences, and text structures, ensuring linguistic quality and consistency. - Deliver high-quality work within established deadlines and communicate proactively about project progress and challenges. Qualifications - Languages: Native Polish speaker and Full Professional Level of English - Linguistic Expertise: A degree or strong background in Polish linguistics, computational linguistics, or a related field. - Medical Knowledge: Familiarity with Polish medical terminology or prior experience in the healthcare domain. - Data Annotation: Hands-on experience with data annotation, transcription, and labeling tools. - Text Analysis: Proficiency in working with text patterns and dictionaries for NLP purposes. - Attention to Detail: Exceptional ability to assess and improve data quality. - Self-Management: Strong ability to work independently, manage time effectively, and consistently meet deadlines. Requirements - Previous experience in AI, machine learning, or data preparation projects. - Knowledge of multiple languages or dialects beyond Polish and English. - Exposure to medical coding systems (e.g., ICD, CPT) or electronic health records (EHR). - Experience working as a freelancer on similar annotation or linguistic projects. Benefits - Remuneration: 63,57 PLN/h
Data Engineer
RyanRyan of Dallas, Texas, helps clients around the world handle their tax-planning needs. Since 1991, the firm has grown to work with more than 12,000 clients, inc
Title: Data Engineer, ERP Location: Plano United States Full time job requisition id R0019276 Why Ryan? - Hybrid Work Options - Award-Winning Culture - Generous Personal Time Off (PTO) Benefits - 14-Weeks of 100% Paid Leave for New Parents (Adoption Included) - Monthly Gym Membership Reimbursement OR Gym Equipment Reimbursement - Benefits Eligibility Effective Day One - 401K with Employer Match - Tuition Reimbursement After One Year of Service - Fertility Assistance Program - Four-Week Company-Paid Sabbatical Eligibility After Five Years of Service The Data Engineer, ERP is responsible for leading the strategy, design, and delivery of data acquisition, extraction, normalization, and analytics solutions that support client engagements and internal business initiatives. This role oversees the end-to-end data lifecycle, ensuring scalable, efficient, and high-quality data processes across multiple systems and formats. The Data Engineer partners cross-functionally with Data Acquisition, Data Delivery, Consulting, and Technology teams to align data solutions with business objectives while driving operational excellence, automation, and continuous improvement. This position combines technical oversight, project leadership, and people management to deliver reliable and innovative data solutions. Duties and responsibilities, as they align to Ryan’s Key Results People: · Creates and fosters a positive team member experience through leadership, mentorship, and professional development. · Provides direct supervision, including goal setting, performance management, coaching, workload allocation, and career development planning. · Builds team capability through technical guidance, training, and knowledge sharing. · Drives collaboration across Data Acquisition, Extraction, Delivery, Consulting, and Technology teams to ensure alignment and efficiency. · Supports recruitment, onboarding, and skill development initiatives to strengthen team performance. Client: · Partners with internal stakeholders and external clients to define data requirements and solution strategies. · Oversees the successful acquisition, extraction, validation, and delivery of data to support client engagements. · Ensures data accuracy, completeness, and normalization across multiple ERP systems, government entities, and other structured and unstructured data sources. · Manages complex data initiatives, timelines, and stakeholder communications to ensure timely and high-quality deliverables. · Addresses escalated data issues and provides strategic guidance on data-related challenges. Value: · Leads the end-to-end data processing lifecycle, including data acquisition, transformation, normalization, validation, and deployment. · Oversees the development, enhancement, and implementation of scalable data extraction and automation tools. · Establishes data quality standards, governance practices, and process efficiencies to improve operational performance. · Provides technical oversight of large-scale data processing using modern database technologies and ETL frameworks. · Drives continuous improvement initiatives that enhance automation, reduce manual effort, and improve delivery timelines. · Leverages agile project management methodologies to monitor progress, mitigate risks, and communicate status to leadership. · Ensures alignment of data solutions with broader business strategy and client service objectives. Education and Experience: · Bachelor’s degree in Information Systems, Computer Science, Engineering, or other STEM-related field required; advanced degree preferred. · Experience in data engineering, data extraction, data management, or related technical roles. · Demonstrated experience leading complex data projects and cross-functional initiatives. · Prior client-facing or consulting experience strongly preferred. · Experience working with enterprise databases, ERP systems, or large-scale structured data environments required. · Previous people management or team leadership experience preferred. Computer Skills: · Advanced knowledge of SQL and relational database systems. · Working knowledge of Python and/or other scripting languages. · Experience with ETL tools and modern data processing platforms. · Proficiency in Microsoft Office Suite. Required Skills: · Strong leadership and team development capabilities. · Project and stakeholder management expertise. · Deep understanding of data lifecycle management and data quality principles. · Ability to manage large, complex datasets across multiple formats and systems. · Strong analytical, problem-solving, and decision-making skills. · Excellent written and verbal communication skills. · Ability to manage multiple priorities in a fast-paced environment. Preferred Skills: · Experience with automation strategy and process optimization. · Implementation experience with major ERP systems. · Knowledge of agile project management methodologies. · Experience working with government data sources or regulated data environments. · Property tax or related domain experience. Certificates and Licenses: · Valid driver’s license required. Supervisory Responsibilities: May provide supervision to data professionals, including assigning work, managing performance, conducting evaluations, and ensuring quality and timeliness of deliverables. Work Environment: · Standard indoor working environment. · Occasional long periods of sitting while working at computer. · Position requires regular interaction with employees via e-mail, video call, and telephone. · Independent travel requirement: Up to 10%. Compensation Pay Transparency: - For certain California based roles, the base salary hiring range for this position is $100,000.00 - $132,000.00 - For other California based roles, the base salary hiring range for this position is $92,000.00 - $121,000.00 - For Colorado based roles, the base salary hiring range for this position is $88,000.00 - $115,500.00 - For Illinois based roles, the base salary hiring range for this position is $92,000.00 - $121,000.00 - For other Illinois based roles, the base salary hiring range for this position is $88,000.00 - $115,500.00 - For Maryland based roles, the base salary hiring range for this position is $88,000.00 - $115,500.00 - For Massachusetts based roles, the base salary hiring range for this position is $92,000.00 - $121,000.00 - For other Massachusetts based roles, the base salary hiring range for this position is $88,000.00 - $115,500.00 - For New Jersey based roles, the base salary hiring range for this position is $100,000.00 - $132,000.00 - For New York based roles, the base salary hiring range for this position is $100,000.00 - $132,000.00 - For other New York based roles, the base salary hiring range for this position is $84,000.00 - $110,000.00 - For Washington based roles, the base salary hiring range for this position is $92,000.00 - $121,000.00 - The Firm makes offers based on many factors, including qualifications and experience. Roles may be eligible for incentive compensation. Equal Opportunity Employer: disability/veteran #DICE
Senior Data Engineer
SynoptekWe are proud to be an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, age, veteran status, sexual orientation, gender identity, marital status, pregnancy, genetic information, or any other characteristic protected by law and will not be discriminated against on the basis of disability.
Role Description We are seeking a highly skilled Senior Analyst, BI & Data Insights to join our growing team. In this critical role, you will play a key role in building and maintaining a best-in-class data platform that drives innovation and growth for our transportation and logistics business. You will leverage your expertise in end-to-end Azure data engineering, Snowflake, and a variety of data engineering tools to design, develop, and implement scalable data pipelines for ingesting, transforming, and loading (ETL/ELT) large datasets. You will partner closely with stakeholders across the organization to understand their needs and translate them into clear and concise data visualizations through Data engineering solutions. The ideal candidate will have 6 to 8 years of hands-on experience designing, building, and maintaining scalable data pipelines and cloud-based data platforms, with a solid understanding of Medallion Architecture (Bronze, Silver, Gold) for organizing and delivering reliable, governed data across the organization. You will collaborate closely with business stakeholders to ensure the reliable delivery of high-quality data across the organization. Beyond individual contribution, this role carries meaningful technical leadership responsibilities like mentoring junior and mid-level data engineers, establishing platform standards, driving architectural decisions, and delivering high-quality, business-critical data assets. It also offers an exciting opportunity to work with modern data technologies including Snowflake, Databricks, and real-time streaming architecture. Qualifications - 6 to 8 years of professional experience in data engineering or a related field - Proven track record working with cloud-native data platforms (Snowflake, Databricks, or equivalent) - Deep, production-proven expertise in designing and operating Medallion Architecture (Bronze/Silver/Gold) at scale using Databricks Delta Lake and/or Snowflake multi-layer schemas - Extensive experience with Snowflake — advanced data modelling, performance optimisation, dynamic data masking, and row-level security - Strong expertise in Databricks — cluster management, Delta Live Tables, and Unity Catalog - Experience with real-time and streaming data architectures in production environments - Knowledge of data orchestration tools such as Azure Data Factory - Hands-on experience designing and building ETL/ELT pipelines for large-scale data environments - Familiarity with data warehousing concepts, dimensional modeling, and data lake architecture - Experience working in Agile/Scrum development environments - Exposure to CI/CD pipelines and DevOps practices for data workflows - Proficiency in PySpark and/or Python for data transformation and pipeline development - Strong SQL skills including query optimization, window functions, and complex joins - Experience with cloud platforms such as Azure, AWS, or GCP Requirements - Own the end-to-end design and evolution of the Medallion Architecture - Design, develop, and maintain scalable, high-performance data pipelines - Develop and optimize Snowflake schemas, views, and data models aligned with the Medallion pattern - Build and optimize data models, tables, and views within Snowflake - Lead the design and implementation of real-time streaming data solutions - Develop and manage Databricks workflows, notebooks, and Delta Lake pipelines - Establish and maintain data governance practices across all Medallion tiers - Mentor and technically guide junior and mid-level data engineers - Collaborate with business stakeholders to understand requirements - Apply CI/CD best practices and manage code through Git version control - Monitor, troubleshoot, and optimize data pipeline performance - Willingness to participate in developing the AI agents Benefits - Work hard, play hard motto - Support for both professional and personal goals - Opportunity for process improvement and leveraging technology - Flexible working environment (office or remote) - Potential for occasional travel Company Description We are proud to be an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, age, veteran status, sexual orientation, gender identity, marital status, pregnancy, genetic information, or any other characteristic protected by law and will not be discriminated against on the basis of disability.



