Job Closed
This listing is no longer active.
Somos Humanos. Somos Digitais. Somos Verity!
Data Architect
Location
Brazil
Posted
87 days ago
Salary
0
Seniority
Senior
Job Description
Data Architect
Verity Group
• Define and evolve the data architecture and integrations, with a focus on cloud cost efficiency (FinOps). • Conduct technical analyses of the current environment (Azure), identifying inefficiencies, bottlenecks, and opportunities for optimization. • Lead the strategy to migrate ETL pipelines from Azure Data Factory to GCP, ensuring performance, scalability, and cost reduction. • Work directly on building and evolving data pipelines, supporting the team in technical decisions and implementations. • Perform root cause analysis (RCA) for performance, cost, and availability issues, proposing structural solutions. • Define standards for data ingestion, processing, and consumption, balancing cost, performance, and complexity. • Define the target data architecture focused on cost reduction and cloud resource optimization. • Ensure the correct selection of technologies and approaches (batch vs streaming, relational vs non-relational, caching, etc.). • Lead and provide technical support for migrating ETLs to GCP (e.g., Dataflow, Composer, BigQuery, etc.). • Work hands-on reviewing and optimizing pipelines, queries, and jobs. • Work closely with the engineering team to ensure consistent and sustainable technical execution. • Define and monitor efficiency indicators (cost per pipeline, resource consumption, performance). • Document architectural decisions and build a reusable knowledge base. • Support technical prioritization with Delivery and Product, considering financial and operational impact.
Job Requirements
- Solid experience as a Data Architect or Senior Data Engineer with strong architectural involvement.
- Practical experience with cloud environments (Azure and/or GCP).
- Knowledge of orchestration and ETL tools (Azure Data Factory, Airflow, etc.).
- Experience with data modeling and relational and non-relational databases.
- Experience with data pipelines (batch and/or streaming).
- Strong problem analysis skills (RCA) and ability to identify technical bottlenecks.
- Experience optimizing queries, pipelines, and cloud resource usage.
- Hands-on profile, able to work on both definition and technical execution.
- Practical experience with Python and PySpark for building and optimizing large-scale data pipelines.
Benefits
- Meal allowance
- Food allowance
- Home office allowance
- Health insurance
- Dental insurance
- Life insurance
- Discount partnerships
- Agreements with vendors and educational institutions
- Recurring agile training
- Intervalor Verity
- #VerityWithYou
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
• You’ll help design, build, and maintain data solutions that power reporting and decision-making across the business. • Building and maintaining data pipelines using Google Cloud Platform (BigQuery, Cloud Functions, Cloud Composer, Cloud Scheduler). • Cleaning, transforming, and organising data from multiple sources (APIs, spreadsheets, internal systems). • Automating ETL / ELT workflows to improve reliability and efficiency. • Writing Python (and some Bash) scripts to support data processing and internal tools. • Building and maintaining dashboards and KPI reports using Looker Studio (and supporting data visualisation needs). • Preparing datasets for simple predictive or forecasting use cases as the team evolves. • This is a hands-on role — you’ll be writing code, fixing issues, improving pipelines, and seeing your work used by real teams.
Senior Data Engineer
Cox EnterprisesCox Enterprises, a top media, communications, and automotive repair company, operates via three major divisions: Cox Media Group, Cox Communications, and Cox Au
The Insights & Advisory team at Cox Automotive is seeking a highly skilled and forward-thinking Senior Data Engineer to design, build, and optimize data architecture and pipelines that power strategic decision-making across the enterprise. This role combines deep technical expertise with a strong focus on data quality and integrity, ensuring that data is accessible, trusted, and actionable for internal teams and automotive OEM clients. You'll play a critical role in shaping the data infrastructure roadmap, enabling advanced analytics through AI, machine learning, and big data technologies, while embedding rigorous testing and validation practices into every stage of the data lifecycle. Key Responsibilities: Data Architecture & Engineering - Design and implement robust data architectures supporting structured and unstructured data from internal and external sources. - Build and maintain scalable, secure data pipelines using cloud-based and distributed technologies. - Establish data structures and routing mechanisms based on business and technical requirements. - Ensure alignment with enterprise architecture standards and business goals Data Quality & Automated Testing - Develop and execute automated test cases to validate ETL workflows, data pipelines, and reporting logic. - Create regression test suites to ensure ongoing data integrity and system stability. - Monitor and troubleshoot data anomalies, proactively identifying root causes and implementing fixes. - Maintain high standards of data quality across all reporting and analytical outputs. Advanced Data Solutions - Develop tools and programming to cleanse, organize, and transform data using AI, ML, and big data techniques. - Automate manual data processes, transforming them into repeatable, scalable capabilities. - Collaborate on application development projects to evolve database architecture and design. Data Analysis & Reporting - Analyze current and historical performance data to identify trends, variances, and opportunities. - Support dashboard and reporting development using tools like Tableau, Power BI, or Domo. - Fulfill routine and ad-hoc reporting requests using accepted metrics and methodologies. Collaboration & Stakeholder Engagement - Partner with data consumers, project managers, and business stakeholders to define logical and physical database designs for analytics models. - Collaborate with internal and external data providers to validate data, provide feedback, and customize data feeds and mappings. - Communicate findings and test results clearly to both technical and non-technical audiences. Process Improvement & Innovation - Identify and implement improvements in internal data management and testing processes. - Influence the data infrastructure roadmap through technical leadership and innovation. - Contribute to the development of design standards and assurance processes for software, systems, and applications. Minimum Qualifications - Bachelor's degree in a related discipline and 4+ years of experience in data engineering or architecture. The right candidate could also have a different combination, such as a master's degree and 2 years' experience; a Ph.D. and up to 1 year of experience; or 16 years' experience in a related field - Proven experience designing and building data pipelines and architectures in cloud environments (e.g., AWS, Azure, Snowflake). - Strong programming skills in Python, Scala, or Java, and proficiency in SQL. - Experience with big data technologies (e.g., Spark, Kafka, Hadoop) and machine learning frameworks. - Familiarity with ETL processes, data modeling, and data warehousing concepts. - Experience with automated testing frameworks (e.g., PyTest, Selenium, dbt tests) and data validation techniques. - Excellent problem-solving skills and ability to communicate technical concepts to non-technical stakeholders. - Experience supporting cross-functional teams including Finance, Sales, and Product Development is a plus. Preferred Skills - Experience with AI/ML frameworks (e.g., TensorFlow, PyTorch, Scikit-learn) for data transformation and predictive modeling. - Familiarity with data orchestration tools such as Apache Airflow, dbt, or Dagster. - Hands-on experience with cloud-native data platforms (e.g., Snowflake, AWS Redshift, Azure Synapse). - Knowledge of data governance and metadata management best practices. - Experience integrating external data sources and APIs into enterprise data ecosystems. - Strong understanding of CI/CD pipelines and DevOps practices for data engineering. - Ability to work in Agile environments and contribute to sprint planning and backlog grooming. - Exposure to real-time data streaming technologies (e.g., Kafka, Kinesis) is a plus. Why Join Cox Automotive? At Cox Automotive, data is at the heart of every decision. As a Sr Data Engineer, you'll be part of a collaborative team that values innovation, precision, and impact. This role offers the opportunity to shape the future of data infrastructure and empower business leaders with trusted, high-quality data solutions. USD 101,500.00 - 169,100.00 per year Compensation: Compensation includes a base salary in the range of $101,500.00 - $169,100.00. The base salary may vary within the anticipated base pay range based on factors such as the ultimate location of the position and the selected candidate's knowledge, skills, and abilities. Position may be eligible for additional compensation that may include an incentive program. Benefits: The Company offers eligible employees the flexibility to take as much vacation with pay as they deem consistent with their duties, the company's needs, and its obligations; seven paid holidays throughout the calendar year; and up to 160 hours of paid wellness annually for their own wellness or that of family members. Employees are also eligible for additional paid time off in the form of bereavement leave, time off to vote, jury duty leave, volunteer time off, military leave, and parental leave. Application Deadline: 03/18/2026
Software Engineer (Python), Data Platform
DoximityThe leading digital platform for medical professionals.
Doximity is transforming the healthcare industry. Join our mission to help every physician be more productive and provide better care for their patients. As medicine's largest network in the United States, there's an elevated level of responsibility in everything we do. We don't take that responsibility lightly and are committed to building diverse teams with an inclusive culture that can make a direct impact on the healthcare system. One of Doximity's core values is stretching ourselves. Even if you don't check off all the boxes below we encourage you to apply. Doximity is full of exceptional people who bring their own unique experiences to work everyday and make us all better for it! Engineers on our data platform team provide standardized tools, frameworks and libraries to empower data pipelining and analytics endeavors through a horizontally scalable data stack. The data platform team is responsible for continuously improving the software environment for our data analysts, machine learning engineers, and data engineers at Doximity. Effectively maintaining and evolving the software layer on which all data teams at Doximity use to build their solutions. This role can be filled in our San Francisco headquarters OR remotely in the U.S, Central or South America. How you’ll make an impact - You will work closely with data analysts, data engineers, and machine learning engineers, understanding their future needs and current challenges. Your role will be pivotal in ensuring that the Doximity data stack evolves to meet these future requirements and alleviate existing obstacles. - Understand what our data product teams are trying to achieve. Principally, to help you propose, architect, design, and implement solutions and best practices to maximize the time they can spend on their immediate goals, while minimizing the time they need to spend on unrelated or redundant technical hurdles. - You will play a key role in continuously enhancing our software engineering culture within the data organization. Your leadership by example will be instrumental in this process. - Working with other teams, you will help isolate and understand development, performance, and stability issues. Alongside the data infrastructure team, you will form the last line of defense in resolving problems facing members of our data teams. What we’re looking for - We're seeking a highly experienced Python engineer who brings a wealth of professional experience in internal tooling and automation, with a proven track record of supporting multiple product teams simultaneously. - The ideal candidate will demonstrate expert fluency in Python and, ideally SQL, coupled with an understanding of programming language internals. - Advanced knowledge of software engineering practices, and testing methodologies is a must; you are foremost an engineer, making you passionate about high-quality code, automated testing, and software engineering best practices. - Your ability and drive to self-manage, prioritize tasks, and deliver functional solutions will be crucial to succeeding in this role. - You believe successful teamwork requires clear and effective communication, both written and verbal. - You possess advanced knowledge in one or more of: container-based software development workflows (Kubernetes, Docker, Podman), Snowflake, AWS, Apache Airflow, & Kafka. - You have experience with SQL, analytical databases and data analytics. Compensation The US total compensation range for this full-time position is $134,000 to $183,000 (inclusive of salary and equity). Our ranges are determined by role and level. The range displayed on each job posting reflects the approximate total target compensation for the position across the U.S. Within the range, individual pay is determined by factors including relevant skills, experience, and education/training. More on Benefits & Perks Doximity is proud to offer industry-leading benefits to our full time employees. Some of our offerings include: - Medical, dental, vision offerings for you and your family - 401k with matching program - Employee stock purchase plan - Family planning support, Childcare FSA, and parental leave - Life, AD&D, and Disability - Generous time off, holidays and paid company trips - Wellness benefits…plus many more! More About Doximity… For the past decade, it’s been our mission to help every physician be more productive so they can provide better care for their patients. We believe that when doctors are connected, the healthcare system works better and patients benefit. Doximity enables our verified clinician members to collaborate with colleagues, stay up-to-date with the latest medical news and research, manage their careers, and conduct virtual patient visits. Today, Doximity is the leading digital platform for U.S. medical professionals, with over 80% of physicians, 50% of all nurse practitioners and physician assistants, and 90% of graduating medical students as members. Joining Doximity means being part of an incredibly talented and humble team passionate about improving inefficiencies in our $4.3 trillion U.S. healthcare system. We are a team of doers who solve problems everyday by treating obstacles like an adventure, and we love creating technology that has a real, meaningful impact on people’s lives. Doxers are committed to working towards a more equitable world both within and beyond our office walls. This starts by fostering an inclusive and diverse work environment where differences are valued and all employees are encouraged to bring their full, authentic selves to work daily. To learn more about our team, culture, and users, check out our careers page, company blog, and engineering blog. We’re growing fast, and there’s plenty of opportunity for you to make an impact—join us! For more information, visit Doximity.com. ____________________________________________ EEOC Statement Doximity is proud to be an equal opportunity employer, and committed to providing employment opportunities regardless of race, religious creed, color, national origin, ancestry, physical disability, mental disability, medical condition, genetic information, marital status, sex, gender, gender identity, gender expression, pregnancy, childbirth and breastfeeding, age, sexual orientation, military or veteran status, or any other protected classification. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law
Freelance Web Scraping Engineer (Vibe Coding)
MindriftApply → Pass qualification(s) → Join a project → Complete tasks → Get paid. Project time expectations: Tasks are estimated to require around 10–20 hours per week during active phases, based on project requirements; This is an estimate, not a guaranteed workload, and applies only while the project is active. Note: Rates vary based on expertise, skills assessment, location, project needs, and other factors. Higher rates may be offered to highly specialized experts. Lower rates may apply during onboarding or non-core project phases. Payment details are shared per project.
This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project (https://tendem.ai/) and drive specialized data scraping workflows within our hybrid AI + human system. In this role, as an AI Pilot – that’s how we refer to this role at Mindrift – you’ll collaborate with Tendem Agents that handle repetitive tasks, while you provide critical thinking, domain expertise, and quality control to deliver accurate and actionable results. This part-time remote opportunity is ideal for technical professionals with hands-on experience in web scraping, data extraction and processing. What we do The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe. About the Role This is a freelance role for a Tendem project. As a Vibe Code specialist, you'll handle data scraping tasks requiring technical precision for web extraction and processing, utilizing various tools such as our provided Apify and OpenRouter alongside your own resourceful approaches. Key Responsibilities - Own end-to-end data extraction workflows across complex websites, ensuring complete coverage, accuracy, and reliable delivery of structured datasets. - Leverage internal tools (Apify, OpenRouter) alongside custom workflows to accelerate data collection, validation, and task execution while meeting defined requirements. - Ensure reliable extraction from dynamic and interactive web sources, adapting approaches as needed to handle JavaScript-rendered content and changing site behavior. - Enforce data quality standards through validation checks, cross-source consistency controls, adherence to formatting specifications, and systematic verification prior to delivery. - Scale scraping operations for large datasets using efficient batching or parallelization, monitor failures, and maintain stability against minor site structure changes. Compensation On this project, contributors can earn up to $32 per hour equivalent, depending on their level and pace of contribution. Compensation varies across projects depending on scope, complexity, and required expertise. Please note that other projects on the platform may offer different earning levels based on their requirements. How to get started Simply apply to this post, qualify, and get the chance to contribute to projects that match your technical skills, on your own schedule. From coding and automation to fine-tuning AI outputs, you’ll play a key role in advancing AI capabilities and real-world applications.



