SysMap Solutions logo
SysMap Solutions

#sejaSysMap #SysMap #soulSysMap

Data Engineer (Mid/Senior) – Databricks

Data EngineerData EngineerFull TimeRemoteSeniorTeam 1,001-5,000Since 1999Company SiteLinkedIn

Location

Brazil

Posted

1 day ago

Salary

0

Seniority

Senior

Bachelor DegreePortugueseDockerKubernetesPythonTensorflow

Job Description

Data Engineer (Mid/Senior) – Databricks

SysMap Solutions

• Contribute to structuring and evolving Data Lake environments, ensuring data scalability and governance; • Design and build modern, modular data warehouses prepared for growth and high performance; • Develop data schemas and resilient architectures, following data engineering best practices; • Define and evolve data architecture, ensuring reliable, scalable, and well-structured environments; • Perform exploratory data analysis and support the development of predictive models; • Participate in building data-driven recommendation engines and processes; • Support business squads with structured, reliable, production-ready data that delivers value; • Act as a technical reference, mentoring and developing more junior professionals; • Collaborate actively with the team to solve complex problems and turn data into actionable decisions.

Job Requirements

  • Experience developing ETL architectures;
  • Knowledge of architectures for performance improvement and data operations;
  • Practical knowledge of operational and relational data management;
  • Previous experience with DataOps;
  • Practical knowledge of programming languages and algorithms (Python, TensorFlow);
  • Experience in data development and operations, including integration and operationalization with Docker and/or Kubernetes;
  • Experience in projects using Databricks;
  • Bachelor's degree in IT or a related field.

Related Categories

Related Job Pages

More Data Engineer Jobs

Enroute logo

Data Engineer: Integration Migration

Enroute

We deliver IT services and solutions provided by a team of passionate problem solving individuals highly skilled.

Data Engineer1 day ago
Full TimeRemoteTeam 51-200H1B Sponsor

Role Description At Enroute, we are looking for a Data Engineer: Integration Migration to join a high-impact team responsible for designing, building, and evolving a customer-facing application. The ideal candidate is confident contributing code while also participating actively in design discussions and proactive cross-team collaboration. Qualifications - Strong hands-on experience with Azure Data Factory. - Experience designing, developing, and supporting ETL / ELT pipelines. - Experience with Boomi or similar integration platforms. - Experience integrating with databases, flat files, APIs, cloud storage, and enterprise applications. - Strong SQL skills and experience working with relational databases. - Understanding of pipeline orchestration, dependencies, scheduling, monitoring, retry logic, and error handling. - Experience with data mapping, transformation logic, data validation, and migration testing. - Ability to analyze existing integration processes and rebuild them in a new platform. - Strong troubleshooting, documentation, and communication skills. - Ability to collaborate with database engineers, QA, architecture, and business teams. Requirements - Analyze existing Boomi integrations, workflows, mappings, transformations, schedules, and dependencies. - Design and develop equivalent data pipelines in Azure Data Factory. - Rebuild data ingestion, transformation, orchestration, and data movement processes from Boomi into ADF. - Connect ADF pipelines to source and target systems, including Oracle, Azure SQL, files, APIs, and other relevant systems. - Implement pipeline scheduling, parameterization, monitoring, alerting, retry logic, and error handling. - Collaborate with database migration engineers to ensure pipelines align with migrated Azure SQL data structures. - Support source-to-target mapping, data transformation logic, and technical documentation. - Perform pipeline testing, data validation, and defect resolution. - Optimize ADF pipelines for reliability, performance, and maintainability. - Support deployment, production cutover, and post-migration stabilization activities. Benefits - Year-end Bonus - IMSS, AFORE, INFONAVIT - Major Medical Expenses Insurance - Life Insurance - Funeral Expenses Coverage - TDU Membership - MediAccess - Health Check-Up Subsidy - Preferential rates for car insurance - Vacations - Official Mexican Holidays - Life Happens Days - Bereavement Leave - Civil Marriage Leave - English Classes - Certifications - Educational Agreements (Talisis, U-ERRE, UNID, TecMilenio, Tec de Monterrey, UDEM, SPIS) - Corporate Agreements & Discounts (Sorteos Tec, Envia Flores, TopGolf) - Taquitos Rewards - Birthday Bonus - Work-from-home Bonus - Laptop Policy Company Description Enroute is committed to providing equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training.

Mexico
Coursera logo

Chief of Staff, Data

Coursera

A fast-growing leader in online education, Coursera is an education-focused technology company headquartered in Mountain View, California. Founded in 2012, Coursera is backed by Si

Data Engineer1 day ago

Role Description We are looking for a Chief of Staff to join our team and serve as a strategic integrator for the Chief Data Officer, operating across a major function or business domain to connect strategy and execution. This role ensures that the Data organization scales effectively, translating company strategy into a cohesive operating system that drives alignment, accountability, and results across multiple teams. At Coursera, we’re evolving how we operate to enable sustained growth and agility. The Chief of Staff plays a central role in that evolution, designing and improving the frameworks that underpin performance, including planning, governance, decision-making, and resource allocation. Operating at the intersection of strategy and operations, this role enables the executive and leadership team to deliver Coursera’s goals with greater clarity, speed, and discipline. Objectives of this role: - Translate company strategy into functional operating systems that connect priorities, plans, and execution across teams. - Drive cross-functional alignment within and adjacent to the Data organization, ensuring shared accountability for results. - Design and evolve frameworks that bring structure, discipline, and visibility to planning, goal-setting, and performance tracking. - Enable high-quality decision-making through data, narratives, and governance models that clarify tradeoffs and resource allocation. - Ensure organizational readiness and adaptability, balancing scale with speed as Coursera continues to evolve. - Strengthen the leadership system within the Data org, increasing focus, follow-through, and clarity across teams. Responsibilities: - Manage and continuously improve the CDO Org operating rhythm, including timely review and action of key performance indicators (KPIs). - Partner with executive-enabling function - People, Finance, Administration - to drive CDO’s strategic change and improvement initiatives org-wide. - Drive the strategic and operational planning system for the CDO organization, defining and continuously improving processes that enable the CDO to effectively and efficiently manage their large team with ongoing visibility into results and impact. - Oversee a portfolio of strategic projects, structuring and driving to completion complex, ambiguous initiatives, steering large, cross-functional projects, and building consensus with senior leadership across the organization. - Lead employee engagement strategy, in collaboration with People Business Partner, crafting initiatives that foster a positive, inclusive, and dynamic work environment. Plan and execute internal communications within the team, ensuring that all team members are informed, aligned, and motivated. - Create cross-functional connections between the principal’s org and adjacent functions to accelerate decision-making and remove friction. - Facilitate strategic meetings, ensuring alignment and clarity on objectives, and drive follow-through on action items. Represent the CDO in certain cross-functional meetings and projects, advocating for their priorities and ensuring alignment with overall company strategy. - Build and develop relationships with the CDO’s direct reports and other individuals in critical roles - providing an unbiased ear - to understand the need and opportunities in existing ways of working and helping define new strategies to address. Qualifications - 12-15 years in a business or executive management role. - In-depth experience driving results in a Data organization. - Extremely versatile, dedicated to efficient productivity. - Experience defining, planning, and driving top-level strategic initiatives. - Excellent communicator in written and verbal form. - Demonstrated experience organizing and directing multiple teams and departments. - Proven track record of data-driven approach to complex decision-making. Preferred Qualifications - Master’s degree in Business Administration or similar field. - Experience with data analysis. - Experience with budget management. - Consulting experience with a focus on operations management. - Proven success in a project management role. - Nimble business mind with a focus on developing creative solutions. - Strong project reporting skills, with a focus on interdepartmental communication. Compensation This role is available in the following US Pay Zones: - US Zone 1: $188,480 - $235,600 - US Zone 2: $180,120 - $225,150 - US Zone 3: $167,200 - $209,000 - US Zone 4: $155,420 - $194,275 At Coursera, we offer competitive, zone-based pay aligned to your location, experience, and role level across four U.S. pay zones. Our total rewards package goes beyond salary, with comprehensive health and wellness benefits, bonus and RSU equity programs, and global perks designed to help you grow and thrive wherever you are.

United States
$155.4K - $235.6K / year
Spotify logo

Data Engineer – Wrapped – Fixed Term

Spotify

Passionate music fans. Innovative tech pros. Perfect harmony. Join our band.

Data Engineer1 day ago
ContractRemoteTeam 5,001-10,000Since 2008H1B Sponsor

• Design, build, and maintain distributed data pipelines that power Spotify Wrapped data stories and personalized experiences for more than 300M users globally • Partner with Data Scientists to evaluate and operationalize new Wrapped story concepts, balancing personalization, scalability, and eligibility requirements • Build scalable systems that process large-scale listening data and generate insights celebrating users’ unique listening journeys • Develop and optimize pipelines supporting AI-powered personalized playlist experiences and recommendation technologies • Collaborate with partner teams to integrate social and shared listening experiences into Wrapped and adjacent user experiences • Contribute to technical excellence by improving reliability, observability, performance, and development velocity across the squad’s data systems • Support experimentation and iteration on new storytelling concepts beginning early in the product development cycle • Work cross-functionally with engineering, product, design, and music domain experts to bring large-scale personalized experiences to life

New York
Miratech logo

Middle Data Engineer

Miratech

Helping Visionaries Change the World

Data Engineer1 day ago
Full TimeRemoteTeam 501-1,000Since 1989H1B No Sponsor

Role Description We are looking for a Middle Data Engineer specialized in Azure Databricks to join our data platform team. The candidate will design and develop modern data pipelines and Lakehouse architectures, leveraging Azure Databricks, Spark, and Azure Data Factory, while integrating with existing SQL Server-based data warehouse environments, also evolving our data platform towards scalable, cloud-based data architectures, enabling advanced analytics and business intelligence. - Design, develop, and maintain data pipelines using Azure Databricks - Build and optimize data transformations using PySpark and SQL in Databricks - Implement and maintain Lakehouse architectures using Delta Lake - Develop ETL/ELT pipelines orchestrated through Azure Data Factory - Integrate data from multiple sources into the data platform and analytical layers - Design and maintain data models and data warehouse structures for analytics - Ensure data quality, scalability, and performance of large-scale data processing pipelines - Collaborate with BI teams to support Power BI and reporting platforms - Support and evolve existing SQL Server data platforms and ETL solutions (SSIS) when required - Contribute to the design of modern cloud-based data architectures Qualifications - 3+ years of experience in Data Engineering or Data Warehouse development - Experience with Azure Databricks - Experience developing data pipelines using PySpark and Spark SQL - Solid understanding of distributed data processing and big data concepts - Experience working with Delta Lake and Lakehouse architectures - Strong SQL skills and experience with SQL Server relational databases - Experience building data pipelines using Azure Data Factory - Experience handling large datasets and performance optimization Requirements - Nice to have: Experience with Spark optimization techniques (partitioning, caching, cluster tuning) - Experience with structured streaming in Databricks - Knowledge of CI/CD pipelines for data platforms (Azure Devops) - Familiarity with Power BI - Experience in migrating from traditional ETL process to cloud architectures Soft Skills - Strong analytical and problem-solving skills - Ability to work in collaborative environments and to adapt - Committed to continuous learning and professional development, with a keen focus on advancing cloud computing expertise - Team player - Good communication skills with technical and non-technical roles - Proactive, actively identifying improvements and proposing solutions - Comfortable working in dynamic environments where priorities and technologies evolve Benefits - Culture of Relentless Performance: join an unstoppable technology development team with a 99% project success rate and more than 30% year-over-year revenue growth - Competitive Pay and Benefits: enjoy a comprehensive compensation and benefits package, including health insurance, and a relocation program - Work From Anywhere Culture: make the most of the flexibility that comes with remote work - Growth Mindset: reap the benefits of a range of professional development opportunities, including certification programs, mentorship and talent investment programs, internal mobility and internship opportunities - Global Impact: collaborate on impactful projects for top global clients and shape the future of industries - Welcoming Multicultural Environment: be a part of a dynamic, global team and thrive in an inclusive and supportive work environment with open communication and regular team-building company social events - Social Sustainability Values: join our sustainable business practices focused on five pillars, including IT education, community empowerment, fair operating practices, environmental sustainability, and gender equality

Worldwide