Transformando dados em conhecimento
Senior Data Engineer – Support
Location
Brazil
Posted
1 day ago
Salary
0
Seniority
Senior
Job Description
Senior Data Engineer – Support
Dadoteca
• Maintain and enhance data pipelines and solutions • Modernize processes and workflows currently supported by legacy technologies • Develop and optimize data processing and transformation routines • Design data structures using dimensional modeling • Identify opportunities to improve data performance, quality, and governance • Collaborate with cross-functional teams to define and implement technical solutions • Ensure stability, reliability, and efficiency of data environments
Job Requirements
- Proven experience as a Senior Data Engineer
- Strong proficiency with Databricks
- Advanced experience with Python
- Knowledge of dimensional modeling
- Strong experience with databases, particularly MongoDB
- Strong analytical skills, autonomy, and a problem-solving mindset
Benefits
- Remote
- Full-time
- Outsourcing
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Web Data Engineer
Privia HealthA health management technology company, Privia Health is a national practice led by physicians. The company was founded in 2007 to provide physician groups with resources dedicated
Role Description The Full Stack Engineer is a highly skilled developer equally at home in Ruby and SQL. Our team develops and maintains a stable of Rails applications that power our core patient- and provider-facing digital products. You will act as the data backbone supporting real-time and operational products, with examples as: - Patient automated actions - MyPrivia patient portal - Privia Insights (embedded inside athenaOne) - Online scheduling - Communication orchestration layers We are looking for an engineer who actively integrates AI-assisted coding tools to accelerate development, optimization, and testing. You must have experience translating complex business requirements into scalable, secure, cloud-native data architectures while partnering with a distributed team of engineers. Our team is currently 7 developers. We all work remotely, and have for more than 10 years. Our team is highly collaborative, we succeed and fail together, not as individuals. We maintain a stable of Rails/React applications ranging from microservices to majestic monoliths. We have a culture of mentorship and knowledge sharing. We work using the Scrum process, in two week sprints. We proudly have a trans-inclusive and family friendly health plan, plus a lot of other great benefits. Primary Job Duties: - Product-Driven Engineering: Design, build, and maintain high-performing rails and javascript applications that power core application features and support our mobile applications. - Data Modelling and Development: Provide hands-on development of data models, data load pipelines and SQL scripts in MySQL and Snowflake. - AI-Augmented Development: Integrate AI-assisted programming tools (e.g., Gemini) into daily development workflows to optimize SQL queries, accelerate application development, and build robust automated test suites. - Data Integrity & Quality Assurance: Build and maintain unit and integration tests for the applications and databases we support. - Agile Collaboration: Collaborate directly with product owners and business analysts to plan and define data requirements, actively participating in and contributing to Scrum/Agile ceremonies. Qualifications - 4+ years of experience with Ruby On Rails - 5+ years of experience with SQL database development, ideally in a cloud environment such as Google Cloud or Snowflake - Strong hands-on experience utilizing public cloud services (AWS, Azure or GCP) alongside modern data platforms like Snowflake. - Experience using AI development assistants to write, optimize, and debug code. - Proven experience delivering value within an Agile/Scrum team structure. Requirements - Experience engineering data workflows specifically for patient engagement, digital health portals, or automated scheduling products. - Deep, practical knowledge of healthcare data ecosystems (claims data, clinical EHR workflows, patient scheduling patterns) and strict compliance with HIPAA rules and regulations. - Experience with modern data transformation orchestration tools (such as dbt, Airflow, or Prefect). - Prompt engineering skills or experience fine-tuning AI tools for development workflows. Benefits - Trans-inclusive and family friendly health plan - Annual bonus targeted at 15% - Expense reimbursement for remote work-related costs Additional Information All your information will be kept confidential according to EEO guidelines. The salary range for this role is $110,000.00 to $130,000.00 in base pay and exclusive of any bonuses or benefits (medical, dental, vision, life, and pet insurance, 401K, paid time off, and other wellness programs). The base pay offered will be determined based on relevant factors such as experience, education, and geographic location. In order to successfully work remotely, supporting our patients and providers, we require a minimum of 5 MBPS for Download Speed and 3 MBPS for the Upload Speed. This should be acquired prior to the start of your employment. The best measure of your internet speed is to use online speed tests like https://www.speedtest.net/ . Employees who regularly work from home offices are eligible for expense reimbursement to offset this cost. Privia Health is committed to creating and fostering a work environment that allows and encourages you to bring your whole self to work. We understand that healthcare is local and we are better when our people are a reflection of the communities that we serve. Our goal is to encourage people to pursue all opportunities regardless of their age, color, national origin, physical or mental (dis)ability, race, religion, gender, sex, gender identity and/or expression, marital status, veteran status, or any other characteristic protected by federal, state or local law.
• Participar de ponta a ponta no ciclo de dados: desde a compreensão das necessidades com desenvolvedores e/ou fontes externas até a criação de pipelines e modelagem de dados; • Contribuir em discussões orientadas a dados, apoiando tanto a equipe de Engenharia quanto outras áreas de negócio; • Implementar e disseminar boas práticas de engenharia, como versionamento de código, testes automatizados, validação de dados e documentação de metadados; • Atuar como facilitador na integração entre equipes de tecnologia, analytics, data science e áreas de negócio; • Documentar detalhadamente processos, fluxos e entregas, promovendo transparência e compartilhamento de conhecimento; • Executar extrações, transformações e análises de dados, assegurando qualidade, consistência e confiabilidade das informações. • Experiência em integração com times de Data Science, Analytics ou Produto será considerado diferencial.
Senior Staff Data Engineer
BILLAt BILL, we believe in empowering the businesses that drive our economy. By replacing outdated financial processes with innovative tools, we help businesses—from startups to established brands—make smarter decisions and gain control of their operations. We value purpose, drive, and curiosity—and we thrive in a fast-paced, ever-changing environment. BILL builds high performing teams and we seek to hire the best talent for every role.
Role Description The Data Platform team builds and operates BILL’s core data infrastructure, providing the end-to-end foundation that collects, stores, processes, governs, and serves data so every team at BILL can use it. We own the full data stack: inbound and outbound data lake, real-time streaming pipelines, batch processing, and data access layers including a Starburst query engine, Databricks Feature Store, Neo4j Knowledge Graph, and OpenSearch. Some capabilities require real-time access with strict low-latency SLAs. Our charter is to simplify the data landscape and power AI at BILL. To achieve this, we focus on building scalable platform capabilities rather than creating one-off pipelines or analytics reports. Engineers here work at the systems level: designing architectures, incubating new capabilities, setting standards, and enabling the rest of BILL to self-serve. The team sits within the CTO organization. Responsibilities - Operate at the architectural level, driving platform-wide technical decisions and mentoring the team. - Own and evolve critical infrastructure across the full data lifecycle, spanning ingest, store, enrich, query, and serve. - Architect and own critical data platform capabilities end-to-end, from inbound ingestion through data lake storage to downstream serving, including the feature store, query engine, knowledge graph, and search. - Define technical direction for the team’s most complex, cross-cutting problems, such as streaming versus batch trade-offs, schema contracts, data access patterns, and real-time serving architectures. - Drive design and delivery of new capabilities from inception to GA, including reference implementations, SLAs, and clear ownership handoff models. - Establish and maintain architectural standards and engineering patterns adopted across the organization. - Lead multi-phase technical migrations at enterprise scale, including compute platform upgrades, warehouse-to-lake migrations, and infrastructure modernization. - Partner with engineering teams across BILL, such as ML/AI, Risk, Payments, and Analytics, to translate diverse data needs into durable platform solutions. - Mentor senior and staff engineers, actively shaping the technical culture and engineering quality bar of the team. - Own and continuously improve critical production systems with a focus on reliability, cost efficiency, and a self-serve developer experience. Qualifications - Bachelors degree in Computer Science, Engineering, Mathematics, or equivalent work experience. - 8+ years of experience in data engineering, distributed systems, or software engineering with a heavy focus on data infrastructure. - 5+ years of experience specifically on data platform, data infrastructure, or data systems teams, rather than purely analytics or BI roles. - Expertise in distributed systems design for data workloads, including a deep understanding of streaming, batch, and real-time serving trade-offs. - Hands-on experience with event streaming platforms (such as Kafka, Flink, Spark Streaming, or equivalent) and CDC-based ingestion patterns. - Strong proficiency with batch processing stacks (such as Airflow, dbt, Spark/Glue, or equivalent). - Experience with modern open table formats and data lake architectures, including Apache Iceberg, Delta Lake, or equivalent frameworks. - Familiarity with data access and serving layers, including query engines (Trino/Starburst, Presto), feature stores, vector stores, or graph databases. - Expert-level SQL and strong Python skills, backed by solid software engineering fundamentals such as CI/CD, testing, and observability. - Demonstrated experience architecting and operating large-scale, production-grade data platforms. - A proven track record operating as a technical lead, with the ability to drive ambiguous, high-impact projects from first principles to production. - The ability to define technical standards that hold across organizational boundaries rather than just within a single team. Desired Qualifications - 3+ years of experience in financial services, fintech, or SaaS companies. - Experience building self-serve data platforms or developer-facing infrastructure tooling. - Experience working in fintech, financial data, or highly regulated data environments. Benefits - 100% paid employee health, dental, and vision plans (choose HMO, PPO, or HDHP). - HSA & FSA accounts. - Life Insurance, Long & Short-term disability coverage. - Employee Assistance Program (EAP). - 11+ Observed holidays and wellness days and flexible time off. - Employee Stock Purchase Program with employee discounts. - Wellness & Fitness initiatives. - Employee recognition and referral programs. - And much more.
• Design and deploy high-performance, distributed web scrapers using Python and Scrapy • Utilize Browser Scripting tools to navigate, interact with, and extract data from websites • Deploy, scale, and manage scraping workloads on Kubernetes • Define strict JSON Schemas and leverage Pydantic for data validation • Build and optimize search and storage pipelines using Elasticsearch • Architect robust pipeline workflows to manage the end-to-end data lifecycle • Manage complex proxy rotation and session handling to maintain high success rates



