Job Closed

This listing is no longer active.

SysMap Solutions logo
SysMap Solutions

#sejaSysMap #SysMap #soulSysMap

Data Engineer, Databricks

Data EngineerData EngineerFull TimeRemoteSeniorTeam 1,001-5,000Since 1999Company SiteLinkedIn

Location

Brazil

Posted

92 days ago

Salary

0

Seniority

Senior

PortugueseAzureCloud

Job Description

Data Engineer, Databricks

SysMap Solutions

• Maintain data environments and processes in Azure and on-premises, ensuring continuous and reliable operation; • Perform advanced administration and support for Databricks (Azure), including troubleshooting and operational tuning; • Monitor and track pipelines, jobs, integrations, and data routines with a preventive and corrective approach; • Implement fixes and improvements to existing processes, focusing on root cause analysis and recurrence reduction; • Lead incident management and resolution (SLA, prioritization, communication, follow-up until stabilization); • Support BI and development teams, ensuring environments are ready for new releases and demands; • Continuously evolve and improve DataOps/CI-CD pipelines for data (governance, quality, and reliability); • Collaborate with infrastructure and architecture teams when needed (capacity, access, security, network, performance); • Ensure adherence to best practices for security, governance, and compliance in the data context; • Propose and implement improvements to observability, monitoring, and alerts (metrics, logs, traceability).

Job Requirements

  • Senior experience in Data Engineering with a focus on support/operations (not only greenfield projects);
  • Strong experience with Databricks, including troubleshooting and maintaining jobs/pipelines;
  • Experience in cloud environments, preferably Microsoft Azure;
  • Experience supporting pipelines, integrations, and data processes in production;
  • Knowledge of monitoring, incident management, and problem management (SLA, prioritization, response, and post-incident).

Related Categories

Related Job Pages

More Data Engineer Jobs

Senior Data Engineer

Berkeley Payment Solutions Inc.

Berkeley Payments is a leading payment technology provider specializing in innovative solutions for businesses to manage and process payments seamlessly. We pride ourselves on offering cutting-edge financial technology to our clients, empowering businesses to streamline operations and improve their payment processes.

Data Engineer92 days ago

Role Description We are looking for an experienced and highly capable Senior Data Engineer to join our technology team. In this role, you will own the design, development, and operation of our data infrastructure, ensuring data is reliable, scalable, and trusted across the organization. You will play a key role in shaping data architecture, setting engineering standards, and enabling analytics, finance, and product teams to make data-driven decisions. This role is suited for someone who has built production data systems and is ready to take full ownership in a fast-paced fintech environment. - Design, build, and maintain scalable and fault-tolerant data pipelines using AWS services. - Own and evolve the architecture for data ingestion, transformation, and storage. - Design and maintain data models, data warehouses, and data marts to support analytics and financial reporting. - Develop and operate robust ETL processes ensuring timely, accurate, and auditable data ingestion. - Partner with analytics, finance, product, and engineering teams to translate business requirements into durable data solutions. - Optimize data pipelines and infrastructure for performance, reliability, and cost efficiency. - Establish data quality checks, monitoring, and alerting to ensure trust in data. - Ensure data security, integrity, and compliance across the full data lifecycle. - Build and manage data infrastructure using Terraform and infrastructure-as-code practices. - Support and improve executive dashboards, financial reporting, and operational analytics. - Troubleshoot complex data issues and lead root cause analysis and resolution. - Mentor junior team members and set best practices for data engineering across the organization. - Stay current with industry trends and continuously improve data platform capabilities. Qualifications - Bachelor’s degree in Computer Science, Engineering, Information Technology, or equivalent practical experience. - 5+ years of experience in data engineering or building backend data systems. - Strong hands-on experience designing and operating production data pipelines. - Deep proficiency in SQL and strong understanding of relational databases. - Strong programming skills in Python for data processing and automation. - Experience with AWS data services such as S3, RDS, Lambda, and related tooling. - Hands-on experience using Terraform or similar infrastructure-as-code tools. - Solid understanding of data warehousing concepts, dimensional modeling, and ETL best practices. - Strong problem-solving skills with the ability to reason about system trade-offs. - Clear communication skills and ability to work cross-functionally with technical and non-technical stakeholders. Preferred Skills - Experience in fintech, payments, or financial reporting environments. - Familiarity with business intelligence tools such as Tableau or Power BI. - Experience supporting compliance, audit, or financial reporting workflows. - Understanding of Agile development methodologies. Benefits - Competitive Compensation: We offer a salary package that reflects your experience and contributions. - Comprehensive Benefits: Enjoy health, dental, and vision coverage, along with paid time off. - Fully Remote Environment: We are a fully remote company, allowing you to work from anywhere. - Professional Development: We invest in your growth through ongoing learning opportunities, mentorship, and chances to work with cutting-edge technologies. - Ownership and Impact: Be a part of a small, agile team where your work has direct and visible impacts on our products and customers. - Inclusive Culture: We are committed to fostering a diverse and inclusive workplace where everyone’s voice is heard and valued. - Exciting Fintech Landscape: Join a dynamic industry at the forefront of payments technology, where you’ll tackle complex problems and contribute to innovative solutions that shape the future of fintech. Company Description Berkeley Payments is a leading payment technology provider specializing in innovative solutions for businesses to manage and process payments seamlessly. We pride ourselves on offering cutting-edge financial technology to our clients, empowering businesses to streamline operations and improve their payment processes.

Worldwide
Qualitest Group logo

Data Architect

Qualitest Group

Qualitest Group is a global engineering company whose services and expertise are powered by artificial intelligence. Qualitest Group helps businesses reach thei

Data Engineer92 days ago

Role Description We are looking for a Data Architect to join our growing team! - Proven experience designing enterprise-scale data architecture. - Strong experience designing enterprise data architecture solutions, including: - Data models - Integration patterns - Platform architecture - Scalable data pipeline frameworks - Hands-on experience with cloud platforms such as AWS, Azure, OCI, or GCP, with the ability to design scalable and secure cloud-based data solutions. - Good understanding of modern data management platforms and solutions such as: - Databricks - Snowflake - Cloud data lakes - Lakehouse platforms - Similar technologies - Ability to define and implement data architecture standards, patterns, and best practices across: - Ingestion - Transformation - Storage - Consumption - Analytics layers - Strong understanding of data governance, including: - Data quality - Metadata management - Lineage - Access controls - Privacy - Security - Compliance requirements - Experience with Medallion Architecture and modern data engineering patterns, including bronze, silver, and gold layers for reliable and reusable data products. - Ability to partner with engineering teams on data pipeline design, performance optimization, autoscaling, CI/CD, DevOps, Terraform, Azure DevOps, and infrastructure-as-code practices. - Strong solutioning skills with the ability to translate business and technical requirements into scalable, secure, and cost-effective data platform solutions. Benefits - Be a part of a company that supports diversity and inclusion in the workplace. - Local and global opportunities for internal rotation and international mobility. - Clear view of your career progression with the company. - Flexible and casual culture with employee events and amenities. - 401k plan with company match to accelerate your savings plan. - Competitive healthcare benefits with HSA matching. - Access to Qualitest Tech Academy with 3000+ training courses, mentorship programs, and leadership programs. - Corporate Wellness Program that pays for gym memberships and offers additional vacation time for attendance. - Salary of $160,000 - $170,000 annually. - Bonuses via Client Referral and Employee Referral Programs. - Access to Qualitest Employee Perks for discounts on travel, electronics, and more.

United States
$160K - $170K / year
Job Closed

Senior Data Engineer

Softchoice

Based in Toronto, Canada, Softchoice is a privately held information technology and services company specializing in advanced solution design, consulting, and d

Data Engineer92 days ago

Role Description As a senior member of the Data Engineer team, you will be responsible for leading the design, development, and optimization of enterprise-grade data solutions within the Microsoft Fabric ecosystem. This role requires deep technical expertise, strategic thinking, and the ability to mentor junior engineers while collaborating with cross-functional teams. You will work closely with data scientists, analysts, and other stakeholders to ensure seamless data integration, transformation, and storage, enabling data-driven decision-making across the organization. What you’ll do: - Design and orchestrate complex integrations across Data Factory, REST APIs, and other enterprise data services. - Lead scalable ELT strategies using Spark Notebooks, Data Factory, and Synapse Pipelines. - Architect multi-domain Lakehouse environments, including structure, metadata, and governance standards. - Optimize Data Warehousing workloads and configure performance settings for high-throughput environments. - Design enterprise-grade data models and refresh strategies for scalable, governed Power BI reporting. - Define and enforce modeling standards and best practices across engineering and analytics teams. - Develop reusable, optimized Spark jobs and configure compute pools for cost-efficient performance. - Establish naming conventions, workspace governance, and CI/CD deployment strategies across Fabric. - Lead data governance frameworks, including sensitivity classifications and access-control standards. - Build monitoring dashboards, alerts, and automated testing for Fabric pipelines and operations. - Demonstrate expert-level platform knowledge with the ability to troubleshoot, automate, and optimize end-to-end Fabric solutions. - Partner with architects, data scientists, and business stakeholders to align technical strategy with business needs. - Mentor engineers, review notebooks and data models, and drive adoption of Microsoft Fabric best practices. - Align Microsoft Fabric capabilities with enterprise data strategy, roadmaps, and long-term growth plans. - Lead cross-team data initiatives and influence architectural direction, governance decisions, and platform evolution. - Leverage AI coding agents and AI-assisted development tools (e.g., GitHub Copilot, Windsurf, or similar) to accelerate data engineering workflows, automate repetitive tasks, and improve code quality across the Fabric ecosystem. - Author and review advanced DAX measures, calculated columns, and time-intelligence logic to support complex, governed Power BI semantic models. - Translate ambiguous business problems into clear technical requirements, adapting communication style to audiences ranging from executive sponsors to frontline analysts with varying levels of data literacy. Qualifications - 5+ years of experience with deep expertise across the Microsoft data ecosystem, including Microsoft Fabric, Data Factory, Spark, Synapse, and Power BI. - Proven ability to design and orchestrate complex data integrations, leveraging Data Factory, REST APIs, and other enterprise data sources. - Leadership in defining and executing scalable ELT strategies using Spark notebooks, Data Factory, and Synapse pipelines. - Experience architecting multi-domain Lakehouse environments, with strong governance around structure, metadata, and reuse. - Advanced knowledge of data warehousing optimization, including performance tuning and workload configuration. - Expertise in designing scalable Power BI semantic models, refresh strategies, and governed reporting solutions. - Ability to define and enforce data modeling standards and best practices across multiple teams. - Strong skills in writing reusable, high-performance Spark jobs and configuring compute pools for optimal performance and cost efficiency. - Experience establishing naming conventions, workspace governance, and CI/CD deployment strategies. - Leadership in data governance, including sensitivity classifications, security models, and access control frameworks. - Ability to build and maintain monitoring, alerting, and automated testing for Fabric pipelines and data assets. - Expert-level understanding of the Fabric platform, with the ability to troubleshoot, automate, and optimize end-to-end solutions. - Strong partnership skills, collaborating with architects, data scientists, and business stakeholders to align technical solutions with business goals. - A passion for mentoring and technical leadership, including code reviews, model reviews, and driving adoption of new Fabric capabilities. - Ability to align Microsoft Fabric implementations with enterprise data strategy and long-term growth plans. - Hands-on experience using AI coding agents and AI-assisted development tools in a data engineering context; comfort integrating AI into daily development workflows and evangelizing adoption across the team. - Advanced DAX proficiency, including complex measure authoring, calculation groups, and optimization techniques for large-scale Power BI semantic models. - Strong business acumen with a genuine interest in understanding business domains, KPIs, and decision-making processes. - Preferred Microsoft Fabric certification – DP600, DP700. - Proven experience leading cross-team data initiatives, influencing platform architecture and governance direction. - Strong problem-solving skills and ability to work in a collaborative environment. - Excellent verbal, written, communication, presentation, organizational, and interpersonal skills. Compensation A reasonable estimate of the current base pay range for this position in Ontario is $91,200 to $114,000 annually. Actual salary will be based on a variety of factors, including location, experience, skill set, education, and related certification. The range for this position in other geographic locations may differ. Benefits - Health and Wellbeing: Medical and Dental Care, Employee & Family Assistance Program. - Financial Benefits: RRSP/DPSP Retirement Savings Plan with Company Matching, Life and Disability Insurance. - Paid Time Off: Vacation and Sick Leave, Holidays, Parental Leave, Volunteer Days, Bereavement Leave. - Additional Perks: Employee Discount Program.

Canada
C$91.2K - C$114K / year
Job Closed
TEKsystems logo

Data Entry/Auditing Healthcare

TEKsystems

We're partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia.

Data Engineer92 days ago
ContractRemoteTeam 10,001H1B No Sponsor

Role Description This role is responsible for performing quality testing on all benefit plans. The position works closely with the AIS team throughout the plan‑build process to ensure each plan is configured accurately and meets client specifications. - Review plan setups across multiple systems. - Identify issues such as incorrect deductibles, out‑of‑pocket amounts, or mail pricing discrepancies. - Partner with AIS counterpart to resolve errors found. - Requires a high level of attention to detail. - No phone work; communication is limited to internal collaboration with team members and AIS representatives. - After training, measured through a scorecard; expected to complete approximately 25 plan reviews per week. - This is a non‑IT role within the Operations organization. Qualifications - Bachelor or Associates degree required. - 1+ year of Excel experience filtering through large sets of data. - 3+ years of health insurance preferred. - Medical terminology & provider language knowledge is preferred. - Experience in a production-based environment is a plus. - Not looking for someone coming from call center or QA in call center. Requirements - Start: 7/6 - Pay: $24.00/Hr - Schedule: Must be available for an 8-Hour shift Monday - Friday between 7:00am - 6:00pm CST. - Must be available during Peak Season Mandatory OT weekends between October - December. - Location: 100% Remote. Equipment will be provided. - Duration: Contract through the end of the year. Benefits - Medical, dental & vision. - Critical Illness, Accident, and Hospital. - 401(k) Retirement Plan – Pre-tax and Roth post-tax contributions available. - Life Insurance (Voluntary Life & AD&D for the employee and dependents). - Short and long-term disability. - Health Spending Account (HSA). - Transportation benefits. - Employee Assistance Program. - Time Off/Leave (PTO, Vacation or Sick Leave). Application Deadline This position is anticipated to close on May 12, 2026.

CST (UTC-6)
$24 / hour