EXTRACTTA | Informações que geram Soluções
Engenheiro de Dados Sênior
Location
Brazil
Posted
3 days ago
Salary
0
Seniority
Senior
Job Description
Engenheiro de Dados Sênior
Extractta
• Traduzir demandas de negócio em problemas e soluções de engenharia de dados. • Projetar, desenvolver e implementar pipelines de dados escaláveis e resilientes. • Construir e manter processos de ingestão, transformação e disponibilização de dados. • Garantir a qualidade, performance e governança das soluções implementadas. • Participar da definição de arquiteturas e padrões de engenharia de dados. • Atuar em conjunto com times multidisciplinares, apoiando iniciativas orientadas a dados. • Realizar troubleshooting e otimização de processos e ambientes de dados. • Ser referência técnica para o time, apoiando decisões arquiteturais e melhores práticas. • Mentorar profissionais de menor senioridade, promovendo evolução técnica da equipe. • Conduzir o desenho e a evolução de soluções de engenharia de dados alinhadas às necessidades do negócio.
Job Requirements
- Experiência sólida em Engenharia de Dados.
- Domínio de **PySpark** para processamento distribuído de dados.
- Experiência com **Apache Airflow** para orquestração de pipelines.
- Conhecimento em **Amazon EMR**.
- Experiência com ambientes baseados em **Kubernetes**.
- Conhecimento em **Apache Kafka** para processamento e integração de dados.
- Domínio de **SQL**.
- Conhecimentos de **Engenharia de Software**, incluindo boas práticas de desenvolvimento, versionamento e Clean Code.
- Experiência com arquitetura e implementação de soluções de dados em ambientes corporativos.
- Capacidade de mentoria e desenvolvimento de equipes.
- Habilidade de orientação técnica e disseminação de conhecimento.
- Influência positiva na tomada de decisões técnicas.
- Experiência com ambientes cloud AWS.
- Conhecimento em Data Lake, Data Warehouse e arquiteturas modernas de dados.
Benefits
- Vale Alimentação e/ou Vale Refeição
- Parcerias com Sesi e Sesc, oferecendo acesso a serviços de saúde, bem-estar e lazer
- Parceria com Instituições de Ensino, com descontos exclusivos em cursos e programas educacionais
- Possibilidade de crescimento na empresa e de participação em projetos estratégicos
- Oportunidade de trabalhar em uma empresa do mercado em plena expansão
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Data Architect
State of ColoradoThe State of Colorado is located in the Rocky Mountain region of the western United States. It entered the 100-year-old Union in 1876, earning the nickname "Cen
Role Description This position is term limited with an anticipated end date of approximately two (2) years from the date of hire. This position is eligible for State employee benefits and may be extended as the situation warrants. We’re looking for a strategic and collaborative Data Architect to advise, develop and facilitate data architecture strategy including cloud, advanced technologies & platforms for OIT and partner agencies. In this role you will support efforts as an expert and leverage technology and innovation to provide scalable solutions to complex and diverse business problems. You will approve all relevant data architecture decisions and ensure alignment with agency needs, considering both the current and future needs of the agency. - Consulting as a resource on data strategy and architecture to OIT and agency partners. - Driving innovations, collaborations, and insights establishing a strong data-driven approach to decision-making across the organization. - Bringing best-in-class technologies, innovation, and creativity to the table in developing technical solutions to solve complex multi-dimensional problems. - Providing technology expertise by architecting, prototyping, researching, recommending, documenting, and assisting in implementing and evaluating technical solutions for business issues whether purchased or developed. - Assessing new data initiatives to determine compliance with the architecture, information security and data standards. - Interfacing with vendor technology/solutions throughout the entire project lifecycle. - Performing Data Management Maturity Assessments (DMMA). - Authoring artifacts including Conceptual, Logical & Physical Models, Data Flows, Data Dictionaries, Business Data Glossary, etc. - Supporting and guiding Data Engineers, Data Analysts, Data Scientists, and Data Visualization Designers in the execution of their duties. - Managing multi-agency schema integration, requiring the reconciliation of data definitions and structures across datasets from various agencies across the state. - Maintaining strong stakeholder management skills and collaborating with multiple agencies and vendors. - Working with large, complex datasets. Qualifications - A minimum of five (5) years of experience in data architecture (solution architecture), data management and information classification at the enterprise level. - Demonstrated experience designing solutions in modern data technology platforms including Cloud (Snowflake, Informatica, AWS, Azure, GCP) based solutions. - Experience in developing and operationalizing architectural and data designs, including data, technology and infrastructure. - Experience with identifying, monitoring, and rectifying data quality concerns using data governance tools. Requirements - Additional appropriate education will substitute for the required experience on a year-for-year basis. - Training or Certification related to the work assigned to the position will be assigned credit towards substitution for experience and/or education. - If the minimum qualifications include a degree requirement, additional appropriate paid or unpaid experience will substitute for the required education on a year-for-year basis. Benefits - This position may require travel within the specified geographic area, and to locations across the state as needed. - This position may require on-call duties as needed by the position.
Role Description The Data Security Specialist is responsible for protecting the confidentiality, integrity, and availability of the firm’s data assets across cloud and on-premises environments. This role designs, implements, and maintains controls that safeguard sensitive client, legal, and corporate information against unauthorized access, loss, and exfiltration — including emerging risks from generative AI and large language model (LLM) usage. Responsibilities - Data Protection & Governance - Design and operate data loss prevention (DLP) policies across email, endpoints, and cloud services (Microsoft Purview, M365, Azure). - Implement and tune data classification, labeling, and encryption frameworks aligned with firm policy and regulatory requirements. - Manage rights management (IRM/MIP), tokenization, and key management solutions. - Design and enforce AI data leakage prevention controls governing how sensitive data is used with Microsoft 365 Copilot, ChatGPT Enterprise, and other GenAI/LLM tools. - Monitor prompt and response, enforce sensitivity-label, and block unsanctioned AI services. - Monitoring & Incident Response - Investigate data security incidents, perform root-cause analysis, lead containment and remediation. - Monitor SIEM, CASB, and DLP alerts; triage events and escalate per the incident response plan. - Partner with the SOC and forensics teams on insider threat and exfiltration investigations. - Detect and respond to AI-related data exposure events, including sensitive data submitted to public LLMs, prompt injection, and shadow AI usage. - Risk & Compliance - Support compliance with GDPR, CCPA, NYDFS Part 500, SOC 2, and client security obligations. - Conduct data risk assessments for new applications, vendors, and AI/LLM use cases. - Maintain evidence and artifacts for internal and external audits. - Contribute to the firm’s AI governance program, aligning controls with frameworks such as NIST AI RMF and ISO/IEC 42001. - Engineering & Automation - Develop scripts and automations (PowerShell, Python, KQL) to scale data security operations. - Integrate data security controls into CI/CD, SaaS onboarding, and identity workflows. - Maintain documentation, runbooks, and control mappings. Compensation The anticipated base salary range offered for this role will be between $140,000 to 160,000 and represents the firm’s good faith and reasonable estimate of the range of possible base compensation. Actual base compensation will be dependent upon several factors, including but not limited to the candidate’s relevant experience, performance, qualifications, degrees, and location, as well as the needs of the firm. Qualifications - Bachelor’s degree in computer science, Information Security, or related field (equivalent experience accepted). - 4+ years in information security with at least 2 years focused on data protection, DLP, or data governance. - In-depth, hands-on experience with a range of enterprise DLP and rights management platforms, with deep expertise in the Microsoft M365 stack. - Experience tuning policies, authoring custom sensitive information types (SITs), trainable classifiers, and integrating Purview with Defender for Cloud Apps (MCAS) is required. - Experience with Microsoft Purview Insider Risk Management, Communication Compliance, eDiscovery (Premium), and Data Lifecycle Management. - Demonstrated experience with AI data leakage prevention — protecting sensitive data from exposure to generative AI and LLM services. - Working knowledge of third-party DLP/IRM tools (e.g., Symantec/Broadcom DLP, Forcepoint, Netskope, Zscaler, Digital Guardian) and how they complement or integrate with M365 controls. - Hands-on experience with at least one major cloud (Azure, AWS, or GCP). - Working knowledge of encryption standards, PKI, IAM, and Zero Trust principles. - Familiarity with regulatory frameworks: GDPR, CCPA, HIPAA, NYDFS, SOC 2, ISO 27001. - Strong analytical, written, and verbal communication skills. Preferred Qualifications - Industry certifications: SC-400 (Microsoft Information Protection Administrator), CISSP, CIPP, CCSP, AZ-500, or GIAC equivalents. - Experience in a law firm, financial services, or other highly regulated environment. - Scripting/automation proficiency (PowerShell, Python, KQL).
Databricks Data Engineer
Horizon IndustriesHorizon Industries Limited was founded in 1996 and is based in Vienna, Virginia. Horizon is a dynamic, SBA-certified Small Disadvantaged Business (SDB) with professional and talented strategists, technologists, and consultants across diverse domains. Expertise in IT, analysis and evaluation, data analytics, business process management Acquisition and financial management, cost and risk assessments Independent Verification & Validation, program management, systems engineering and design Database management, logistical warehouse services, and administrative support Capabilities in financial, operational, and technology consulting Risk management services, strategic planning, leadership effectiveness Anti-fraud waste and abuse programs, financial and operational assessments Regulatory compliance, workflow automation, and audit readiness services Equal Employment Opportunity Horizon is an Equal Employment Opportunity employer. It is our policy to consider all applicants for employment without regard to sex, race, color, creed, religion, national origin, sexual orientation, marital status, age, disability, veteran status, alienage, ancestry, citizenship status, or any other factor prohibited by law. Horizon will not discharge or discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant, consistent with applicable law.
Role Description We are seeking a Databricks Data Engineer for a full-time position supporting our various clients. We are committed to your growth and success in the IT software development industry. We are looking for a Databricks Data Engineer ready to assume leadership responsibilities in a supportive team environment focused on your success as a function of client success. - Build end-to-end implementation of multiple ETL/ELT pipelines, demonstrating efficient data transformation and ingest patterns to move raw data from data producers to an enterprise data ecosystem, with a focus on performance and reliability. - Assess and understand the ETL jobs, workflows, BI tools, and reports. - Address technical inquiries concerning customization, integration, enterprise architecture and general feature/functionality of data products. - Experience in crafting database/data warehouse solutions in the cloud (Preferably AWS, Azure, Alternatively GCP). - Key must-have skill sets: Python, SQL, Databricks, AWS Data Services. - Experience with message queuing, stream processing, and highly scalable ‘big data’ data stores. - Experience manipulating, processing, and extracting value from large, disconnected datasets. - Experience manipulating structured and unstructured data for analysis. - Experience with data modeling tools and processes. - Experience aggregating and transforming data from multiple datasets to create data products. - Support an Agile software development lifecycle. Qualifications - Ability to hold a position of public trust with the US government. - B.S. in Computer Science or equivalent. - 4+ years' experience in data engineering and big data. At least 2 years' of professional services experience interacting directly with clients. - Big data tools: Hadoop, Spark, Kafka, etc. - Relational SQL and NoSQL databases and experience working with relational databases. - AWS cloud services: EC2, S3, RDS, Glue, Step Functions, Lambda, EMR, DynamoDB, DocumentDB, Redshift, Aurora, Athena. - Data Platforms: Databricks. - Data streaming systems: Batch, Kafka, Storm, Spark-Streaming, etc. - Languages: Python, R, Scala, Go. - Ability to inspect existing data pipelines, discern their purpose and functionality, and re-implement them efficiently in Databricks. - Extensive knowledge of data warehousing concepts and hands-on experience deploying pipelines using Databricks. - Data modeling and database design skills and knowledge of version control. - Excellent verbal and written communication skills. - Experience architecting scalable and fault-tolerant data solutions across Azure, AWS, and Databricks. - Databricks Data Engineer Professional certification a plus. - Preference for candidates with Databricks Professional certifications. Requirements - Bachelor’s degree in a technical field such as software engineering, engineering, computer science, etc. Benefits - A comprehensive benefits package including healthcare (medical, dental, vision and disability). - A 401k program where you are 100% vested from day one with an employer match after 90 days. - An Educational Assistance program. - A Student Loan Repayment Program. - Gym Reimbursement Program. - Paid Time off. - Dynamics, passionate, multi-disciplinary team of creative minds to work with, and many more.
Senior Data Engineer
Alkami TechnologyAlkami is the digital sales and service platform provider for financial institutions in the US.
• Participate in the entire data pipeline lifecycle, focusing on building data lakes, data warehouses and related processes • Lead code and design reviews with junior and peer developers • Write clean code to develop data pipelines and necessary infrastructure as code • Collaborate with cross functional teams to understand requirements and effectively design appropriate solutions • Monitor and troubleshoot performance, scalability, and security issues, making improvements as needed • Participate in the evaluation of new technologies and tools that can improve performance of our system • Participate in data governance process • Contribute to the design and documentation of our data lake platform • Proficient in test automation solutions for data and ability to optimize performance • Gather technical and design requirements • Communicate effectively with technical and non-technical team members to ensure alignment and successful execution of projects. • Participate in cross-functional initiatives, promoting a culture of data-driven decision-making and continuous improvement • Participate in an on call rotation


