Job Closed
This listing is no longer active.
Get things Solvd. | Software Development & QA
Data Engineer, Databricks
Location
Argentina
Posted
99 days ago
Salary
0
Seniority
Senior
Job Description
Data Engineer, Databricks
Solvd, Inc.
• Build and maintain scalable data pipelines with Databricks, Spark, and PySpark. • Manage data governance, security, and credentials using Unity Catalog and Secret Scopes. • Develop and deploy ML models with MLflow; work with LLMs and embedding-based vector search. • Apply ML/DL techniques (classification, regression, clustering, transformers) and evaluate using industry metrics. • Design data models and warehouses leveraging dbt, Delta Lake, and Medallion architecture. • Work with healthcare data standards and medical terminology mapping.
Job Requirements
- Hands-on experience with the Databricks platform, including:
- Unity Catalog: Managing data governance, access control, and auditing across workspaces.
- Secret Scopes: Secure handling of credentials and sensitive configurations.
- Apache Spark / PySpark: Writing performant, scalable distributed data pipelines.
- MLflow: Managing ML lifecycle including experiment tracking, model registry, and deployment.
- Vector Search: Working with vector databases or search APIs to build embedding-based retrieval systems.
- LLMs (Large Language Models): Familiarity with using or fine-tuning LLMs in Databricks or similar environments.
- Experience designing and maintaining robust data pipelines:
- Data Modeling & Warehousing: Dimensional modeling, star/snowflake schemas, SCD (Slowly Changing Dimensions).
- Familiarity with dbt, Delta Lake, and the Medallion architecture (Bronze, Silver, Gold layers)
Benefits
- Shape real-world AI-driven projects across key industries, working with clients from startup innovation to enterprise transformation.
- Be part of a global team with equal opportunities for collaboration across continents and cultures.
- Thrive in an inclusive environment that prioritizes continuous learning, innovation, and ethical AI standards.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Senior Data Engineer (Remote)
Kohl'sIt’s no secret that our associates love #LifeAtKohls and we know you will too.
Role Specific Information Job Description About the Role As Senior Software Engineer, you will collaborate closely with design, product and engineering experts to tackle real-world challenges and deliver innovative solutions that elevate Kohl’s retail offerings. What You’ll Do - Lead the development of high-quality applications that are robust, observable and measurable using extreme programming (XP) practices and a user-centric approach - Participate in the entire application lifecycle in collaboration with designers, product managers, and other engineers on the product team - Leverage critical thinking, experimentation, data, and industry best practices to implement desired business outcomes - Facilitate group discussions and team ceremonies and develop a shared context - Give and receive feedback that’s empathetic, actionable and specific - Practice emergent architecture with sane defaults and build software that is easy to use and easy to modify - Establish and lead product engineering and software standards - Ideate a new product from a user perspective, starting with one or more problem spaces and ending with a stack-ranked list of feasible solutions to test - Research and stay up to date on tech market trends and practices - Lead technical initiatives not only on the team but also across the department - Additional tasks may be assigned Addendum SENIOR BIG DATA SOFTWARE ENGINEER - Knowledge of build management tools such as Jenkins or Maven - Demonstrated understanding of source control systems such as GIT - Database Design experience including either SQL, PL/SQL - Implementing ETL process with Big Data Technologies - Required: Spark, Python, Scala and Airflow - Preferred: MapReduce, Pig, Hive, Kafka, Sqoop, and Flume - Experience in designing and creating automation workflows and execution - Knowledge of Apache Airflow Developing DAG, Performance tuning of the DAGs and task implementation - Experience working with distributed caching technologies such as REDIS - Good understanding of MPP databases such as Teradata and Netezza What Skills You Have Required - 4+ years of experience in software development - Understanding of application design patterns, event-driven architecture, database, schemas and testing strategies - In-depth knowledge and experience with continuous integration, continuous deployment and test-driven development Preferred - Bachelor's Degree or equivalent in MIS, Computer Science or related field - Experience with large-scale application troubleshooting and performance tuning - Exposure working with major cloud platforms (GCP, AWS, or Azure) - Familiarity and experience with XP (Extreme Programming) Essential Functions The requirements listed below are representative of functions you will be required to perform, however you may be required to perform additional functions. Kohl’s may revise this job description from time to time. To perform this job successfully, you must be able to perform each essential function satisfactorily. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions, absent undue hardship. - Ability to perform the accountabilities listed in the “What You’ll Do” Section - Ability to comply with dress code requirements - Basic math and reading skills, legible handwriting, and basic computer operation - Ability to maintain prompt and regular attendance and meet scheduling requirements as set by the company - Ability to learn and comply with all company policies, procedures, standards and guidelines - Ability to give direction and to receive, understand and proactively respond to direction from leadership and other company personnel - Ability to work as part of a team and interact effectively and appropriately with others - Ability to maintain composure and work in a fast paced environment while accomplishing multiple tasks within established timeframes - Ability to satisfactorily complete company training programs - Ability to use a personal computer for tasks such as communicating, preparing reports, etc. - Ability to plan, prioritize and monitor activities across business units - Ability to complete or oversee the completion of assigned projects in a timely manner
Sr. Data Engineer
Fidelity & Guaranty Life Insurance CompanySince 1959, Fidelity & Guaranty Life Insurance Company (F&G) has offered annuity and life insurance products to those who are seeking security in retirement and protection during life’s unexpected events. F&G believes in an employee-centric flexible environment, which is why we offer the ability for in-office, hybrid and remote work arrangements. F&G complies with federal and state disability laws and makes reasonable accommodations for applicants and candidates with disabilities, unless such accommodation would cause an undue hardship for F&G. Join our employee-centric hybrid work environment. F&G is a proud equal opportunity employer.
Job Summary The Sr. Data Engineer will implement data integration architecture and solutions and design and develop ETL logic using Informatica Data Management Cloud, Snowflake and various Azure tools to support existing and future deployments. This role will work to independently solve problems and fix technical issues and be responsible for unit test construction and execution. Duties and Responsibilities - Implement data integration architecture and solutions for our Investments and Hedging delivery teams. - Design and develop ETL logic using Informatica Informatica Data Management Cloud, Snowflake and various Azure data tools to support existing and future deployments - Design and execute technical aspects of data management functions including creating, loading, transforming, cleansing, processing, analyzing, and visualizing data - Collaborate directly with teammates and business partners to build technical solutions that solve problems, are reusable, scalable, fast, and maintainable through large datasets, both clean and un-clean - Work with multiple development technologies including SQL - Interact cross-functionally with other technical teams both internally and externally to implement complete technology solutions - Design and develop code to support existing and future deployments - Independently solve problems and fix technical issues - Responsible for unit test construction and execution Experience and Education Requirements - Associate’s/Bachelor's Degree (preferred emphasis in technology, engineering or math related field) or equivalent combination of education and experience - 4-7 years of experience designing, building, and supporting real-time data pipelines and analytical solutions - 2+ years of experience in supporting ETL, production data operations (File processing, data distribution etc.,) including debugging, addressing production issues and performing Root Cause Analysis - Strong ability to write SQL queries, Python scripts, and interpret data models - Experience with Snowflake, SQL Server and/or Oracle - Experience building data structures, solutions and products - Experience writing automated unit, integration, and acceptance tests for data interfaces & data pipelines - Understanding of object-oriented analysis and design Preferred Requirements - Experience with Investments systems (e.g. Aladdin, FactSet, Clearwater, INTEX, and Bloomberg) is a huge benefit. - Exposure to key investment analytics (e.g. yield, duration) and understanding how they influence the portfolio management cycle is a huge benefit. - Experience with database modeling - Preferred to have experience in supporting data transfers from / to external organizations and internal systems using EFT (Electronic File Transfer) - Working knowledge of Informatica Cloud Data Integration, Informatica Cloud Mass Ingestion, Snowflake, Azure data tools. - Experience with database design/modeling tools such as Erwin - Experience within a Financial Services/Insurer’s IT Organization Knowledge, Skills and Abilities - Strong analytical, critical-thinking, and problem-solving skills - Fast, adaptive learner - Ability to collect, organize, analyze, and disseminate significant amounts of information with attention to detail and accuracy - Ability to manage multiple tasks and deadlines simultaneously - Exhibits flexibility and tolerance for ambiguity with the ability to thrive in a rapidly changing business environment - Results-oriented - Dedicated work ethic - Strong interpersonal communication skills, written and verbal Other Requirements - Perform other functions, duties and projects as assigned - Regular and punctual attendance - Minimal travel required (less than 10%) #LI-JB1 #LI-Remote Additional Information Work Environments F&G believes in an employee-centric flexible environment, which is why we offer the ability for in-office, hybrid and remote work arrangements. During the hiring process, you'll work with your leader to decide what works best for your role. F&G complies with federal and state disability laws and makes reasonable accommodations for applicants and candidates with disabilities, unless such accommodation would cause an undue hardship for F&G. If reasonable accommodation is needed to participate in the job application or interview process, please contact talentacquisition@fglife.com. Join our employee-centric hybrid work environment: F&G Careers About F&G Since 1959, Fidelity & Guaranty Life Insurance Company (F&G) has offered annuity and life insurance products to those who are seeking security in retirement and protection during life’s unexpected events. As a national Top Workplace1, an Iowa Top Workplace2 and a proud equal opportunity employer, F&G team members are empowered, collaborative, dynamic and authentic. We believe that by embracing these values, we will continue to build and strengthen the company while continuing to be a great place to work. 1Top Workplaces USA 2022 – 2023 2Des Moines Register Top Workplaces 2018 – 2022 Notice for all Applicants who are California residents under the California Privacy Rights Act. Please click here to review the policy.
• Apoiar a construção, modelagem e manutenção do nosso data lake nas camadas Raw, Bronze e Silver. • Desenvolver e manter pipelines de dados robustos, escaláveis e bem documentados. • Automatizar processos de coleta, transformação, entrega e distribuição de dados internos e externos. • Garantir observabilidade, qualidade, consistência e governança dos dados. • Monitorar e otimizar o desempenho de pipelines, workloads e processos de transformação. • Trabalhar em parceria com analista, cientista de dados, engenheiro e stakeholders de produto. • Apoiar áreas de negócio com dados confiáveis para tomada de decisão. • Aplicar boas práticas de versionamento, testes e CI/CD em projetos de dados.
• Design end-to-end data ecosystem architectures on Google Cloud (Data Lake, Data Warehouse, and Lakehouse); • Define ingestion, processing, and consumption patterns and frameworks to be used by engineering teams; • Ensure Governance and Security by establishing IAM policies, encryption, data lineage, and compliance (LGPD); • Optimize costs and performance (FinOps), monitoring resource usage such as BigQuery, Cloud Run, and Dataproc; • Lead technical decision-making in the selection of tools and technology stack components; • Serve as a bridge between Business and Technology, ensuring data solutions support the client's strategic objectives; • Provide technical mentorship to engineers and analysts, raising the team's maturity in cloud best practices.



