Data Architect
Location
CET (UTC+1)
Posted
60 days ago
Salary
0
Seniority
Mid Level
Job Description
Data Architect
wynwood tech
Role Description We are currently looking for multiple Data Architects for one of the leading tech companies in Germany. The position is 100% remote and long-term. - Freelancing/Contracting - Start: ASAP - 100% remote - Duration: long-term 12+ months - Capacity: full-time, part-time also possible - Language: English (no German needed!!) - German business hours Requirements - Experience in data architecture, including designing scalable data platforms and data models. - Knowledge of Azure-based data platforms, including Azure Data Factory, ADLS, Synapse, Azure SQL, and Event Hubs. - Experience with Databricks, Apache Spark, and Delta Lake for modern data processing architectures. - Understanding of data modeling approaches, including dimensional, relational, and NoSQL models. - Familiarity with data governance, security, and platform reliability in enterprise environments. - Knowledge of Python, SQL, and DevOps practices such as CI/CD, Terraform, Docker, Kubernetes, or AKS. Qualifications - Please include a self-assessment (0-10, 10 = expert level) in the following areas: - Data Architecture (in general) - Azure-based data platforms - Databricks - Apache Spark - Delta Lake - Data Modeling (dimensional, relational, and NoSQL) - Data Governance & Security - Azure Data Factory - ADLS - Synapse - Azure SQL - Event Hubs - Python - SQL - DevOps - CI/CD - Terraform - Docker - Kubernetes - AKS
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Role Description We are looking for a highly skilled and experienced L2 Data Engineer to join our growing Data & Analytics team. In this role, you will lead the design, development, optimization, and maintenance of scalable enterprise data platforms and cloud-native data solutions. You will work closely with architects, analysts, and business stakeholders to build high-performance data pipelines and modern lakehouse solutions that support advanced analytics, reporting, and data-driven decision-making. This opportunity is ideal for a senior data professional with strong hands-on expertise in Databricks and the Microsoft Azure ecosystem, who is passionate about building reliable, scalable, and optimized data platforms in enterprise environments. Qualifications - 5+ years of professional experience in Data Engineering or related roles. - Strong expertise in Python for enterprise data processing, transformation, and automation. - Advanced hands-on experience with Pandas, PySpark, and Spark SQL for large-scale distributed processing. - Strong experience with Databricks, including cluster management, notebook development, workflow orchestration, Delta Lake, and performance optimization. - Extensive experience building and managing enterprise data pipelines using Azure Data Factory. - Strong working knowledge of Azure Synapse Analytics, particularly Spark pool integration and enterprise data warehousing concepts. - Advanced SQL skills including query optimization, performance tuning, indexing strategies, and troubleshooting. - Strong understanding of data lake architecture, Delta Lake, incremental processing, partitioning, and lakehouse concepts. - Experience implementing data governance, security, access controls, and monitoring within cloud data platforms. - Experience handling production support, troubleshooting, and optimization of enterprise data platforms. Requirements - Design, develop, and optimize enterprise-scale data pipelines and ETL/ELT workflows using Azure and Databricks technologies. - Architect and implement scalable data ingestion, transformation, and orchestration processes using Azure Data Factory, Databricks, and Azure Synapse Analytics. - Develop high-performance data transformation frameworks using PySpark, Python, and Spark SQL for large-scale distributed data processing. - Optimize SQL queries, Spark jobs, and data workflows to improve performance, scalability, and cost efficiency. - Lead data migration initiatives, including SQL Server migrations and modernization of legacy data platforms. - Implement and maintain Delta Lake architecture, incremental data loading strategies, and enterprise data lake best practices. - Collaborate with architects and cross-functional teams to design robust and scalable data models aligned with business and governance standards. - Monitor and troubleshoot production pipelines, perform root-cause analysis, and implement preventive measures for recurring issues. - Support CI/CD implementation and infrastructure automation for data engineering workflows. - Mentor junior engineers and contribute to engineering standards, reusable frameworks, and technical best practices. - Create and maintain technical documentation including architecture diagrams, pipeline documentation, and operational runbooks. - Evaluate and recommend modern data engineering tools, frameworks, and optimization strategies. Benefits - Experience with Terraform for Azure infrastructure provisioning and Infrastructure-as-Code (IaC). - Experience implementing CI/CD pipelines for data engineering deployments. - Exposure to Lakehouse Federation, Delta Sharing, and modern data sharing architectures. - Experience with streaming and near real-time data processing solutions. - Knowledge of DevOps practices and cloud cost optimization strategies. Certification Requirement Candidates are expected to hold or be actively working toward the Databricks Certified Data Engineer Professional certification. This certification validates advanced expertise across the following domains: - Advanced ETL and ELT development using Spark SQL and PySpark - Enterprise-grade pipeline orchestration and optimization - Data modeling and scalable lakehouse architecture - Performance tuning and distributed data processing optimization - Advanced data governance and security implementation - Production-grade data engineering practices within the Databricks ecosystem
Generative AI Engineer - Document Processing of Sensitive Data
NEORISNEORIS is a Digital Accelerator that helps companies step into the future.
Role Description En EPAM NEORIS, creemos que el verdadero cambio nace del talento. Hoy, como parte de EPAM Systems, ampliamos nuestro alcance global y nuestras capacidades, manteniendo lo más importante: una cultura donde cada persona puede crecer, aportar y ser protagonista. No buscamos solo cubrir posiciones. Buscamos talento que quiera superarse, aprender constantemente y dejar huella en proyectos de alto impacto. Estamos en búsqueda de perfiles especializados en IA Generativa y procesamiento documental para incorporarse a un proyecto estratégico e innovador dentro del sector financiero. Principales responsabilidades: - Diseño e implementación de soluciones basadas en IA Generativa y arquitecturas RAG. - Procesamiento masivo y estructuración de documentos complejos. - Definición, mantenimiento y optimización de bases de datos vectoriales. - Desarrollo y optimización de pipelines ETL para tratamiento de información. - Implementación de estrategias de chunking, prompting y reranking. - Participación en la evolución técnica y mejora continua de soluciones IA en producción. - Colaboración con equipos multidisciplinares en entornos ágiles. Qualifications - Excluyentes: - Experiencia real en tratamiento y procesamiento de grandes volúmenes de documentos. - Experiencia en definición, implementación y ciclo de vida/mantenimiento de bases de datos vectoriales (RAG). - Conocimientos en tratamiento de información sensible. - Experiencia en procesos ETL. - Experiencia en optimización de chunking y prompting. - Conocimiento de técnicas de reranker. - Deseables: - Conocimiento de estrategias de caché y optimización de recursos. - Conocimiento de los principales frameworks de IA. - Experiencia en fine tuning de LLMs o SLMs. - Conocimiento de bases de datos basadas en grafos (GraphRAG, KAG, etc.). - Experiencia con Spark. Benefits - Contrato indefinido con salario competitivo. - Modalidad 100% remota. - Plan de carrera personalizado y formación continua. - Participación en proyectos estables con alto componente técnico e innovador. - Flexibilidad horaria y enfoque en la conciliación. - Beneficios sociales adaptados a tus necesidades.
SAP Data Migration Engineer
Bright Vision TechnologiesBright Vision Technologies is a forward-thinking software development company dedicated to building innovative solutions that help businesses automate and optimize their operations. We leverage cutting-edge technologies to create scalable, secure, and user-friendly applications.
Title: SAP Data Migration Engineer (LTMC / SLT / LVM) Location: Remote Job Description: Full Time Experienced Bright Vision Technologies is a forward-thinking software development company dedicated to building innovative solutions that help businesses automate and optimize their operations. We leverage cutting-edge technologies to create scalable, secure, and user-friendly applications. As we continue to grow, we’re looking for a skilled SAP Data Migration Engineer (LTMC / SLT / LVM) to join our dynamic team and contribute to our mission of transforming business processes through technology. This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential. Job Title: SAP Data Migration Engineer (LTMC / SLT / LVM) Location: 100% Remote (Continental United States) Position Type: In-house Bright Vision Technologies SOW engagement (no third-party client or vendor) Salary: $100K - $150K Experience: 5+ years Sponsorship: No new H1B sponsorship available. H1B transfers welcomed for qualified candidates. Employment Type: Full-time, direct W2 with Bright Vision Technologies (no C2C, no 1099, no third-party) Engagement: Long-term, multi-year, aligned to the Bright Vision SOW delivery roadmap Compensation: Competitive base salary commensurate with experience, plus benefits Employment Terms & Visa Policy This is a 100% remote, full-time, direct W2 position with Bright Vision Technologies. This role is part of Bright Vision Technologies’ in-house Statement of Work (SOW) engagement. The client, end customer, and employer for this position is Bright Vision Technologies — there is no third-party client, vendor, or implementation partner involved. We do not engage in C2C, 1099, or third-party arrangements for this role. BUT STRICTLY NO C2C/1099/3RD PARTY COMPANIES. ALL OUR ROLES ARE W2 AND NO 3RD PARTY BROKERING PLEASE. Candidates must be willing to work directly as a full-time W2 employee of Bright Vision Technologies and contribute to our in-house SOW deliverables. No new H1B sponsorship is available for this role. However, candidates who are currently on a valid H1B visa and require a transfer are welcome to apply. We will support H1B transfers for qualified candidates. For every role, a technical coding assessment is mandatory. Please apply only if you are confident in your technical abilities and hands-on experience. Job Summary We are seeking an experienced SAP Data Migration Engineer to design, execute, and support large-scale data migration initiatives within SAP S/4HANA environments. This role focuses on the full data migration lifecycle — extraction, transformation, validation, reconciliation, and cutover — to ensure accurate, complete, and compliant migration of enterprise data from legacy systems into SAP. The ideal candidate will combine strong hands-on experience with SAP LTMC, SLT, LVM, and S/4HANA migration tools with deep understanding of SAP data structures, business processes, and data governance, and will partner closely with functional teams, business owners, and infrastructure stakeholders during all phases of migration. Key Responsibilities - Design and execute SAP data migration strategies for S/4HANA implementations, including conversion and greenfield scenarios. - Perform data extraction from legacy systems using SAP-provided and custom tools and prepare data for ingestion into SAP. - Configure and utilize SAP LTMC (Legacy Transfer Migration Cockpit), including custom migration objects where required. - Implement real-time replication scenarios using SAP SLT (System Landscape Transformation), including transformation rules and filter conditions. - Manage logical system setups and replication configurations for hybrid SAP environments. - Support system refreshes and landscape virtualization activities using SAP LVM (Landscape Virtualization Management). - Design and execute data transformation, cleansing, and enrichment processes prior to migration. - Develop comprehensive validation and reconciliation reports to ensure data accuracy and completeness. - Identify and resolve data inconsistencies, duplicates, and orphan records prior to go-live. - Support mock migrations, dress rehearsals, and the final cutover, including detailed runbook execution and rollback planning. - Optimize performance for large-volume data loads, including parallelization, package sizing, and database tuning. - Collaborate with functional teams to validate master and transactional data against business expectations. - Ensure compliance with enterprise data governance, audit, and privacy standards. - Maintain comprehensive, current technical documentation — including architecture diagrams, design decisions, configuration references, runbooks, and operational procedures — so that the system remains supportable, auditable, and easy to onboard new engineers onto over time. Required Qualifications - Bachelor’s degree in Computer Science, Engineering, or a related technical discipline. - Five or more years of SAP data migration experience. - Strong hands-on experience with SAP LTMC and S/4HANA migration tools. - Experience with SAP SLT replication scenarios. - Working knowledge of SAP LVM for system refresh and landscape management. - Strong understanding of SAP master and transactional data structures. - Experience performing data validation and reconciliation processes. - Strong SQL and data analysis skills. - Experience working in enterprise SAP landscapes during major implementations. - Strong troubleshooting and documentation skills. Preferred Qualifications - Experience participating in S/4HANA greenfield or brownfield implementations. - Exposure to SAP Data Services or other ETL platforms. - Experience with high-volume, multi-source data migrations. - Working knowledge of SAP HANA database structures. - SAP S/4HANA certification. How to Apply Would you like to know more about this opportunity? Learn more about Bright Vision Technologies at www.bvteck.com. We recognize that our people are our strength, and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Bright Vision Technologies is an Equal Opportunity Employer, including Disability/Veterans. Position offered by “No Fee Agency.” Equal Employment Opportunity (EEO) Statement Bright Vision Technologies (BV Teck) is committed to equal employment opportunity (EEO) for all employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other protected status as defined by applicable federal, state, or local laws. This commitment extends to all aspects of employment, including recruitment, hiring, training, compensation, promotion, transfer, leaves of absence, termination, layoffs, and recall. BV Teck expressly prohibits any form of workplace harassment or discrimination. Any improper interference with employees' ability to perform their job duties may result in disciplinary action up to and including termination of employment.
Role Description We are looking for a Middle Data Engineer specialized in Azure Databricks to join our data platform team. The candidate will design and develop modern data pipelines and Lakehouse architectures, leveraging Azure Databricks, Spark, and Azure Data Factory, while integrating with existing SQL Server-based data warehouse environments, also evolving our data platform towards scalable, cloud-based data architectures, enabling advanced analytics and business intelligence. - Design, develop, and maintain data pipelines using Azure Databricks - Build and optimize data transformations using PySpark and SQL in Databricks - Implement and maintain Lakehouse architectures using Delta Lake - Develop ETL/ELT pipelines orchestrated through Azure Data Factory - Integrate data from multiple sources into the data platform and analytical layers - Design and maintain data models and data warehouse structures for analytics - Ensure data quality, scalability, and performance of large-scale data processing pipelines - Collaborate with BI teams to support Power BI and reporting platforms - Support and evolve existing SQL Server data platforms and ETL solutions (SSIS) when required - Contribute to the design of modern cloud-based data architectures Qualifications - 3+ years of experience in Data Engineering or Data Warehouse development - Strong experience with Azure Databricks - Experience developing data pipelines using PySpark and Spark SQL - Solid understanding of distributed data processing and big data concepts - Experience working with Delta Lake and Lakehouse architectures - Strong SQL skills and experience with SQL Server relational databases - Experience building data pipelines using Azure Data Factory - Experience handling large datasets and performance optimization Requirements - Experience with Spark optimization techniques (partitioning, caching, cluster tuning) - Experience with structured streaming in Databricks - Knowledge of CI/CD pipelines for data platforms (Azure Devops) - Familiarity with Power BI - Experience in migrating from traditional ETL process to cloud architectures Benefits - Culture of Relentless Performance: join an unstoppable technology development team with a 99% project success rate and more than 30% year-over-year revenue growth. - Competitive Pay and Benefits: enjoy a comprehensive compensation and benefits package, including health insurance, and a relocation program. - Work From Anywhere Culture: make the most of the flexibility that comes with remote work. - Growth Mindset: reap the benefits of a range of professional development opportunities, including certification programs, mentorship and talent investment programs, internal mobility and internship opportunities. - Global Impact: collaborate on impactful projects for top global clients and shape the future of industries. - Welcoming Multicultural Environment: be a part of a dynamic, global team and thrive in an inclusive and supportive work environment with open communication and regular team-building company social events. - Social Sustainability Values: join our sustainable business practices focused on five pillars, including IT education, community empowerment, fair operating practices, environmental sustainability, and gender equality.

