See well. Be well.®
Data Engineer – Snowflake, DataStage
Location
United States
Posted
3 days ago
Salary
$58.8K - $101.9K / year
Seniority
Senior
Job Description
Data Engineer – Snowflake, DataStage
VSP Vision Care
• Create and maintain data pipelines for key data and analytics capabilities in the enterprise • Collaborate within an agile, multi-disciplinary team to develop optimal data integration and transformation solutions • Document and analyze data requirements (functional and non-functional) to develop scalable, automated, fault-tolerant data pipeline solutions for business and technology initiatives • Profile data to assess the accuracy and completeness of data sources and work with business partners to mitigate issues • Build and maintain data pipelines using appropriate tools and practices in development, test, and production environments • Design with modularity to leverage reuse of code wherever possible • Create data mappings, programs, routines, and SQL to acquire data from legacy, web, cloud, and purchased package environments into the analytics environment • Use a mix of ELT, ETL, data virtualization, and other methods to optimize the balance of minimal data movement against performance • Maintain metadata management processes and documentation • Monitor data quality to detect emerging issues and consult with the team to create transformation rules to cleanse against defined rules and standards • Participate in code reviews and unit testing to optimize performance and minimize issues.
Job Requirements
- Bachelor’s degree in computer science, data science, statistics, economics, or related functional area; or equivalent experience
- 4+ years’ experience working in a development team providing analytical capabilities
- 4+ years of hands-on experience in the data space spanning data preparation, SQL, integration tools, ETL/ELT/data pipeline design
- SQL coding experience
- Familiarity with agile development environments (Scrum, Kanban) with a focus on Continuous Integration and Delivery
- Previous experience using a data integration platform (IBM InfoSphere DataStage, Oracle Data Integrator, Informatica PowerCenter, MS SSIS, AWS Glue, Denodo)
- Familiarity with data warehouse MPP platforms such as Snowflake, Netezza, Teradata, Redshift, etc.
- Familiarity with event store and stream processing (Apache Kafka and platforms like Confluent)
- Knowledge of API development and management platforms (MuleSoft, Axway) is also beneficial
- Capable of focusing on specific tasks while ensuring alignment to a broader strategic design
- Exhibits traits of a proactive, self-driven contributor who values continual learning and adoption of new technology.
Benefits
- Eligible bonuses and commissions
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Senior Data Engineer, Microsoft Fabric
VigilWe’re a tech consultancy, expert in software engineering and cloud transformation.
• Design, build and maintain enterprise data solutions using Microsoft Fabric • Develop scalable data ingestion pipelines from APIs, databases and file-based sources • Build and maintain Lakehouse architectures using the Medallion (Bronze, Silver and Gold) approach • Develop robust data models and semantic layers to support business reporting • Create and maintain Power BI semantic models and dashboards • Implement data quality, validation and reconciliation frameworks • Design secure, governed data solutions including Row-Level Security and access controls • Build and maintain PySpark notebooks for data transformation • Develop SQL and Python-based ETL/ELT processes • Configure and maintain Fabric workspaces, OneLake environments and deployment pipelines • Work closely with solution architects to implement scalable platform designs • Produce technical documentation and engineering standards • Collaborate with UK-based stakeholders and delivery teams • Support future client projects across the TXP Data & AI Practice
Data Engineer – Data Conversions, Junior-Mid
EnrouteWe deliver IT services and solutions provided by a team of passionate problem solving individuals highly skilled.
• Play a critical role in migrating insurance policy data from administration systems to a modern policy administration platform. • Perform analysis-first role with a data engineering component. • Deep-dive into data, trace and reconcile information across multiple data layers (databases and files). • Build mappings and transformations that move legacy data into the target format. • Resolve data quality issues to deliver validated loads. • Utilize strong, hands-on command of SQL for analysis, tracing, and transforming data. • Use AI tooling to accelerate work processes. • Receive mentorship from an experienced conversion manager. • Work through entire data migration lifecycle, from initial discovery through production cutover. • Support iterative delivery cycles with effective communication.
Arquitecto de Datos
Sofka TechnologiesTo transform people’s lives being the most trusted technology partner
• Definir la estrategia analítica y el modelo funcional de la solución. • Diseñar y construir el pipeline de ingesta y transformación sobre AWS. • Configurar la seguridad de la infraestructura (IAM). • Diseñar el modelo dimensional (star schema). • Actuar como autoridad técnica frente al cliente.
• Maintain a clear view of each team member's delivery commitments, growth plans, and internal contributions. • Develop and grow team members through regular coaching, clear expectations, and constructive feedback. Build a culture of trust, inclusion, and collaboration. • Monitor team health, morale, and workload balance, acting early to address engagement or performance concerns in partnership with practice leadership. • Maintain regular one-to-one connections with each team member, provide clear feedback, and help them remove blockers related to client work, pursuits, or internal initiatives. • Oversee staffing and resource alignment across teams, balancing utilization, development goals, client needs, and sustainable workloads. • Communicate practice priorities and organizational objectives clearly, ensuring teams understand how their work contributes to broader organizational goals. • Define interview standards and mentorship strategies, training others to apply them consistently and improving hiring outcomes and talent growth at scale. • Create and maintain development plans for team members, including stretch assignments, shadowing, certifications, and opportunities for external visibility. • Lead or support performance reviews, promotion recommendations, and compensation input for your teams, using consistent standards that reflect both impact and behavior. • Represent your teams in leadership forums, communicate expectations and decisions clearly back to the group, and bring forward patterns, risks, and successes that should shape practice strategy. • Lead architecture and technical strategy for large Azure programs and portfolios so solutions meet client goals for value, security, scalability, reliability, performance, and cost. • Define modernization blueprints and reference architectures across applications, platforms, and data, including system and subsystem designs, patterns, and standards that simplify delivery and operations over time. • Translate business and product strategy into cloud architecture roadmaps and execution plans that drive measurable outcomes and adapt based on production feedback and telemetry. • Guide major architecture decisions across programs, promote shared design standards and reusable models, and resolve high-impact technical trade-offs. • Work across teams to connect solutions into cohesive end-to-end architectures with clear ownership boundaries and integration contracts. • Provide architectural oversight during delivery through design reviews, forums, and governance, keeping cross-cutting concerns (security, performance, resilience, availability, compliance, observability, and cost) aligned across teams. • Promote modular design, clear boundaries, testability, CI/CD, and observability so non-functional requirements are treated as first-class and systems remain reliable and maintainable. • Use AI tools to accelerate discovery, design, code, tests, documentation, and analysis, and scale successful practices so teams adopt them consistently. • Define and own enterprise data platform strategy centered on Databricks or equivalent lakehouse architectures. • Establish reference architectures spanning ingestion, lakehouse, analytics, and AI/ML. • Set standards and best practices for: Databricks lakehouse design and workload isolation. Delta Lake optimization and data lifecycle management. Streaming and batch processing patterns. Unity Catalog–aligned governance and security models. Guide multi-workspace and multi-region Databricks deployments. • Ensure tight integration between Databricks, Azure-native services, and downstream analytics tools. • Oversee architectural alignment with complementary platforms (e.g., Snowflake, Fabric, Power BI).




