Leading global provider of business decisioning data and analytics, enabling companies to improve business performance.
Senior Big Data Engineer
Location
India
Posted
5 days ago
Salary
0
Seniority
Senior
No structured requirement data.
Job Description
Senior Big Data Engineer
Dun & Bradstreet
Title: Senior Big Data Engineer (R-19335) Location: Hyderabad - India Workplace: hybrid Category: Technology Job Description: Shape the Future with Dun & Bradstreet At Dun & Bradstreet, we believe data has the power to create a better tomorrow. As a global leader in business decisioning data and analytics, we help companies worldwide grow, manage risk, and innovate. For over 180 years, businesses have trusted us to turn uncertainty into opportunity. We’re a diverse, global team that values creativity, collaboration, and bold ideas. Are you ready to make an impact and help shape what’s next? Join us! Explore opportunities at dnb.com/careers. Designation: Senior Software Engineer – Big Data Location: Hyderabad About Us: We are a global organization driven by a diverse community of professionals who bring unique experiences and perspectives to everything we do. Whether working from a corporate office or remotely, we stay connected by listening to our customers and collaborating on impactful solutions. Our products and services power businesses of all sizes, across industries. At the core of our operations are our values: being data-inspired, relentlessly curious, and inherently generous. These values guide our decisions, shape our culture, and define how we work together. Role Overview: We are looking for a Senior Software Engineer – Big Data to design, build, and optimize modern data platforms and pipelines. This role requires strong expertise in big data technologies, cloud environments, and data engineering best practices, with a focus on scalability, performance, and innovation. Key Responsibilities : - Design, build, deploy, and document scalable data pipelines within big data ecosystems - Develop ETL/ELT pipelines using modern data processing frameworks and tools - Work with data lake architectures and modern data warehousing concepts such as virtual data warehouses and push-down analytics - Build and optimize data solutions using file formats such as Parquet, Iceberg, and Delta - Develop high-performance solutions using Python, Databricks, and Apache Spark - Work with cloud infrastructure, primarily on GCP Design and manage relational databases including DB2, Oracle, and SQL Server with strong SQL expertise - Implement workflow scheduling and orchestration using Apache AirflowManage big data clusters including installation, configuration, monitoring, security, resource allocation, and performance tuning - Create detailed design documents and proof of concepts for new capabilities - Collaborate with platform and infrastructure teams to deploy solutions into production - Optimize workloads, manage multi-tenant environments, and ensure SLA adherence - Participate in planning, data science initiatives, and continuous platform improvement Key Requirements: - Minimum 8 years of experience in ETL/ELT technologies - 4+ years of hands-on experience with big data technologies such as Databricks and Apache Spark - Minimum 6 years of experience working with cloud platforms, preferably GCP - Strong programming expertise in Python - Experience with relational databases and complex SQL development - Exposure to NoSQL and graph databases is a plus - Experience with access control mechanisms such as role-based and attribute-based access - Familiarity with BI tools such as Tableau, Power BI, or Looker - Hands-on experience managing and deploying cloud-based solutions - Experience working in a global environment and DevOps model is an advantag Notice to Applicants: Please be advised that this job posting page is hosted and powered by Lever, a subsidiary of Employ Inc. Your use of this page is subject to Employ's Privacy Notice and Cookie Policy, which governs the processing of visitor data on this platform.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Senior Data Engineer
AtlassianAtlassian is a publicly-traded computer software business specializing in collaboration, development, and issue-tracking software for teams. As an employer, Atlassian maintains a t
Working at Atlassian Atlassians can choose where they work - whether in an office, from home, or a combination of the two. That way, Atlassians have more control over supporting their family, personal goals, and other priorities. We can hire people in any country where we have a legal entity. Our Product DE organization is looking for a Senior Data Engineer reporting to Senior Data Engineering Manager. You will be responsible for designing premier data architecture and solutions that drive strategic decision-making. Beyond technical execution, you will collaborate with business stakeholders to translate operational needs into technical requirements and spearhead initiatives to improve overall system efficiency. In this role, you will: - Partner across engineering organizations to spearhead and execute high-impact, company-wide initiatives, - Mentor and upskill junior engineers, fostering a culture of technical excellence and continuous growth. - Collaborate with leadership, product engineers, program managers, and data scientists to deeply understand and prioritize business data requirements. - Leverage deep technical expertise to design and architect scalable, high-performance data solutions. - Develop, launch, and optimize highly efficient, reliable ELT/ETL pipelines capable of processing both large-scale and specialized datasets. - Intelligently design robust data models optimized for high-speed storage, accessibility, and downstream retrieval. - Implement and deploy rigorous data quality frameworks to guarantee data accuracy, freshness, and trust. - Maintain full technical ownership of the end-to-end data engineering lifecycle for your team's solutions. - Participate in the team's on-call rotation to ensure platform stability and support operational health. - Partner with software engineering teams to design and build next-generation data systems that enable rapid, self-service data consumption. - A BE in Computer Science or equivalent with 6+ years of professional experience as a Data Engineer or in a similar role - Experience building scalable data pipelines in Spark using Airflow scheduler/executor framework or similar scheduling tools. - Experience with Databricks and its APIs. - Experience with modern databases (Redshift, Dynamo DB, Mongo DB, Postgres or similar) and data lakes. - Proficient in one or more programming languages such as Python/Scala and rock-solid SQL skills. - Champion automated builds and deployments using CICD tools like Bitbucket, Git - Experience working with large-scale, high-performance data processing systems (batch and streaming) - Experience working for SAAS companies - Experience with Machine Learning - Committed code to open source projects - Experience building self-service tooling and platforms Benefits & Perks Atlassian offers a wide range of perks and benefits designed to support you, your family and to help you engage with your local community. Our offerings include health and wellbeing resources, paid volunteer days, and so much more. To learn more, visit go.atlassian.com/perksandbenefits . About Atlassian At Atlassian, we're motivated by a common goal: to unleash the potential of every team. Our software products help teams all over the planet and our solutions are designed for all types of work. Team collaboration through our tools makes what may be impossible alone, possible together. We believe that the unique contributions of all Atlassians create our success. To ensure that our products and culture continue to incorporate everyone's perspectives and experience, we never discriminate based on race, religion, national origin, gender identity or expression, sexual orientation, age, or marital, veteran, or disability status. All your information will be kept confidential according to EEO guidelines. To provide you the best experience, we can support with accommodations or adjustments at any stage of the recruitment process. Simply inform our Recruitment team during your conversation with them. To learn more about our culture and hiring process, visit go.atlassian.com/crh .
Oncology Data Specialist - Certified
GuidehouseSolving big problems, building trust in society, and empowering our clients to shape the future.
Role Description The remote Oncology Data Specialist will review clinical documentation as appropriate to extract data and apply ICDO-O codes. Responsibilities include: - Code, stage, and abstract cases of cancer and reportable benign tumors diagnosed and/or treated. - Participate in research, education, and monitoring for quality improvement activities to ensure data integrity and compliance with the American College of Surgeons Committee on Cancer guidelines. - Translate medical terminology into standardized codes to capture patient diagnosis and treatment information. - Code, stage, and enter data into the registry database utilizing ICD-O, ICD-10-CM, AJCC TNM (Tumor, Nodes, Metastasis), Site-Specific Data Items (SSDI), STORE (Standards for Oncology Registry Entry), and SEER (Surveillance of Epidemiology and End Results) guidelines. - Comply with state and federal mandates that require reporting all diagnosed and/or treated malignancies and reportable benign tumors. - Perform data quality control activities on registry data. - Retrieve and comply with data for preparation of annual reporting and may collaborate in generating reports for special studies. - Prepare minutes for multi-disciplinary Tumor Conference every week. - Contact patient providers and state registries per the database to gather follow-up information and verify or correct patient information. - Maintain the highest degree of confidentiality of all information encountered including verbal, written, and computerized. - Report to the manager any failure by anyone to protect confidential information. - Perform other duties as assigned. Qualifications - High School Diploma or equivalent. - Currently certified as an Oncology Data Specialist (ODS) formerly a Certified Tumor Registrar (CTR) by the National Cancer Registrars Association (NCRA). - 5+ years experience working in tumor registry as an ODS (CTR). - Experience working for a COC accredited hospital. - Ability to work a minimum of 20 hours per week, flexible hours available. Requirements - NCI experience. - Strong conceptual, as well as quantitative and qualitative analytical skills. - Basic knowledge of Microsoft applications. - Excellent written and verbal communication skills. Benefits - Medical, Rx, Dental & Vision Insurance. - Personal and Family Sick Time & Company Paid Holidays. - Position may be eligible for a discretionary variable incentive bonus. - Parental Leave. - 401(k) Retirement Plan. - Basic Life & Supplemental Life. - Health Savings Account, Dental/Vision & Dependent Care Flexible Spending Accounts. - Short-Term & Long-Term Disability. - Tuition Reimbursement, Personal Development & Learning Opportunities. - Skills Development & Certifications. - Employee Referral Program. - Corporate Sponsored Events & Community Outreach. - Emergency Back-Up Childcare Program.
Associate Data Engineer – Artificial Intelligence, AI
CotivitiFounded in 1979, Cotiviti provides analytics-driven payment and network solutions for the healthcare and retail industries, offering services that help payers, risk-bearing healthc
• Create, maintain and execute basic to intermediate Spark and SQL scripts for data management and data validation, and data integration. • Optimize the queries to improve the efficiency of daily tasks. • Perform data analysis and identify any issues. • Work with other groups such as Engineering team, DBA, Cloud ops, etc. to troubleshoot and resolve any environmental or network issues that impact your work. • Extend your support to after – hours or weekends as needed. • Assist in the creation and maintain data pipelines as needed. • Validates the tasks results to ensure that all the requirements are met. • Adhere to all the industry level and organization level compliance rules and regulations to maintain data integrity.
Role Description ESS Companies runs on data spread across six operating subsidiaries and a stack of source systems — ERP, HR/HCM, and others. We've built a cloud data warehouse that turns that sprawl into a single analytical source of truth, and the business increasingly leans on it for job costing, finance, HR, and operational reporting. We need someone to own that platform end to end: - Own the data pipelines. - Source data lands in the warehouse through automated replication and ingestion. - Keep data flows reliable, monitor for failures, handle schema changes, and add new sources as needed. - Own the platform architecture. - Organize the warehouse with a layered transformation framework. - Make architectural calls that maintain cleanliness as it grows across subsidiaries. - Own the data modeling. - Design and maintain dimensional models that power reporting and analytics. - Work directly with business owners in Finance, HR, and Operations. - Keep the whole thing trustworthy. - Engineer the warehouse for testing, documentation, data quality, and lineage. Qualifications - Solid data engineering fundamentals: clean, maintainable SQL and Python. - Hands-on experience with a cloud data warehouse (BigQuery preferred; Snowflake, Redshift, or similar is fine). - Experience with a transformation framework (dbt strongly preferred). - Dimensional modeling skill: understanding of facts and dimensions, and when to use a star schema. - Experience with data replication / ELT tooling (Fivetran or similar). - Ability to communicate with non-technical business owners and extract real requirements. - Comfortable owning decisions and operating with minimal oversight. Requirements - Experience with the broader Google Cloud Platform stack (Cloud Run, Cloud SQL / PostgreSQL, Pub/Sub, Cloud Scheduler, Secret Manager). - Experience integrating enterprise source systems such as ERP (Viewpoint Vista or similar) and HCM platforms (Workday). - Familiarity with version-controlled, CI/CD-driven data workflows. - An eye for warehouse cost management. - Construction, engineering, or operations-heavy industry experience. Who thrives here The person who does well here likes owning the whole thing rather than a corner of it, cares more about whether the numbers are right than whether the pipeline is clever, and would rather ship a model the finance team actually uses than a perfect one nobody asked for. You're comfortable being the person who knows how the data fits together, and you treat "the business owner doesn't quite know what they want yet" as part of the job rather than a blocker. Equal Opportunity Employer/Protected Veterans/Individuals with Disabilities The contractor will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant.



