Wix is the comprehensive platform that gives you total creative freedom online.
Senior Data Engineer
Location
District Of Columbia + 1 moreAll locations: District Of Columbia | Washington
Posted
4 days ago
Salary
0
Seniority
Senior
Job Description
Senior Data Engineer
Wix
• Assist TSD with data products by providing highly skilled and authoritative expertise on data engineering methods and best practices, including code-first development approaches and modern pipeline design patterns. • Design, implement, and maintain an efficient, secure, stable, and flexible data architecture that supports products and end-users, with all assets managed via source control. • Design, implement, and maintain ELT/ETL pipelines for efficient processing of source data in Azure Synapse and Azure Machine Learning (using SDK V1 and SDK V2) • Review, maintain, and improve existing architecture and pipelines, including periodic audits to address bottlenecks, deprecated dependencies, and architecture drift. • Establish quality controls for maintaining all pipelines, and introduce error handling, logging mechanisms, and validation checks. • Incorporate source control for all pipelines and data analytics codebases to enable iterative code development while ensuring data architecture stability. • Optimize the ingestion, processing, and storage of a wide variety of datasets and data types, including modern columnar formats such as Parquet. • Develop self-service capabilities for SBA OIG analysts to query and export data for investigations and audits. • Coordinate with data scientists to ensure the architecture efficiently supports machine learning algorithms and data pipelines in Azure Machine Learning. • Develop robust standard operating protocols (SOPs) dictating the authoring, development, validation, publishing, execution, and monitoring of all data pipelines and assets in Azure environment. • Provide detailed documentation of the data architecture, including data dictionaries, ER diagrams, and pipeline process maps. • Maintain and expand the environment with additional datasets and services upon request, following a defined intake and testing process prior to production deployment. • Stay current with emerging AI tools relevant to data engineering and contribute to exploratory efforts evaluating automation and LLM-assisted capabilities.
Job Requirements
- Five (5) years of hands-on experience in maintaining SQL databases and conducting advanced operations in SQL and T-SQL
- Five (5) years of hands-on experience in designing, implementing, and maintaining ELT/ETL processes in cloud-based data analytics environments
- Three (3) years of hands-on experience in working in Azure Synapse and Azure Machine Learning, with the modern data stack
- Certifications preferred (DP-203 or equivalent)
- Manipulating data in Python. Pandas required. PySpark/Polars preferred.
- Experience developing reusable, modular code preferred.
- Implementing pipelines and infrastructure using code-first approaches (Python SDK, CLI, REST APIs, or IaC tooling)
- Implementing source control and CI/CD workflows
- Demonstrated familiarity with AI coding assistants and LLM integration patterns
Benefits
- Healthcare and Insurance: medical, dental, vision, short- and long-term disability protection, basic life and AD&D insurance
- 401(k) Savings Plan
- Accrued Paid Time Off (PTO)
- Employee Recognition and Rewards
- Employee Referral Bonuses
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
AWS Data Platform Engineer
Poland and Eastern EuropeXebia is a global tech company with a journey in CEE that started with two Polish companies – PGS Software and GetInData. We are a team of 1,000+ experts delivering top-notch work across cloud, data, and software. We work on impactful projects across various sectors including fintech, e-commerce, aviation, logistics, media, and fashion, helping clients build scalable platforms and cutting-edge applications. Our clients include notable names like McLaren, Aviva, Deloitte, Spotify, Disney, ING, UPS, Tesco, Truecaller, AllSaints, Volotea, Schmitz Cargobull, Allegro, and InPost.
Role Description You will be: - Designing and provisioning the lakehouse foundation on AWS: S3 lake zones (raw, canonical, curated), Apache Iceberg tables, Glue Data Catalog, Athena, and Lake Formation. - Delivering all infrastructure as code with Terraform, reproducible from the client's GitHub repositories and CI/CD, across isolated environments (ci, dev, staging, prod). - Building and enforcing the tenant-isolation security gate: Lake Formation row-level security and physical partitioning by CompanyId, separate IAM roles for customer versus internal access, and fail-closed handling that quarantines and alerts on rows with missing or unresolved CompanyId. - Implementing the upstream entitlement mapping (principal to allowed CompanyIds) that drives access control. - Setting up ingestion infrastructure: CDC paths from DynamoDB Streams, AWS DMS extracts from Aurora PostgreSQL, and bulk export to Parquet, supporting the near-real-time (5 min) and batch (4 hr) SLAs. - Standing up workflow orchestration with Apache Airflow and Astronomer Cosmos, including profile-based connections, model-level retries, and lineage emission. - Building CI/CD pipelines (GitHub Actions): dbt compile and slim builds, SQLFluff linting, DAG validation, branch protection, environment promotion, and Git-revert rollback. - Configuring end-to-end governance and observability: catalog and data contracts, OpenLineage capture, and org-wide audit through CloudTrail. - Owning cost governance and monitoring: resource tagging, usage alerting, and right-sizing of compute. - Collaborating with the Data Platform Architect, Data Engineers, and Analytics Engineer, and support knowledge transfer to the client team. Qualifications - Strong experience with AWS data and platform services: S3, Glue (Data Catalog and Jobs), Athena, Lake Formation, IAM, VPC networking, DMS, DynamoDB, Aurora PostgreSQL. - Experience with infrastructure as Code with Terraform, including modular design and YAML-driven configuration. - Knowledge about Apache Iceberg and open table formats on S3. - Experience with security and access control. - Knowledge about CI/CD engineering with GitHub Actions, trunk-based development, and environment promotion. - Solid Python and SQL skills. - Experience with dbt on AWS (dbt-athena, dbt-glue adapters) and analytics-engineering workflows. - Previous exposure to Airflow orchestration, ideally with Astronomer Cosmos. - Data lineage and observability (OpenLineage, dbt-elementary) and data quality tooling (dbt tests, dbt-expectations) skills. - Experience with CDC and streaming ingestion patterns. Requirements - Work from the European Union region and a work permit are required. Nice to have - Exposure to BI serving layers such as QuickSight or Sigma. - Snowflake experience. Recruitment Process - CV review - HR call - Interview - Client Interview - Decision
Mobile Data Visualization Engineer – Interactive Technical Charts
Synmatch AIHire with confidence. Anywhere. With AI.
• Make Large Datasets Feel Light : Implement level-of-detail downsampling, viewport culling, sub-pixel zoom/pan, and time-aligned overlays at interactive frame rates on tablets • Render the PQ Vocabulary : Build oscillographic waveforms with cycle markers, RMS-vs-time strip charts, harmonic spectrum bars to the 50th order, phasor diagrams, harmonic heatmaps, CBEMA/ITIC tolerance curves, scatter/PDF plots, and event timelines • Design Analysis-Grade Interactions : Smooth pinch/scroll on touch, trackpad, and mouse-wheel; crosshair with multi-series readout; brush-to-zoom; synchronized cursors across stacked charts; drill-down on event markers • Get Visual Details Right : Color palettes that work on screen and print, accessible contrast, type and tick spacing respecting expert reading habits • Profile Relentlessly : Performance benchmarking and profiling to improve user experience and optimize metrics footprint • Ship Usable v1, Then Iterate : First cut of a new chart in a week, refined with team and real users in the open • Operate the Chart Engine : Share on-call rotation for rendering and performance regressions, turning each into a permanent benchmark
• Build and operate ingestion, ELT/ETL, and orchestration pipelines that move data from our MongoDB Atlas operational store and other sources into our analytical and AI-serving layers • Implement layered (medallion-style) transformations with idempotent, backfillable, incrementally loaded jobs • Apply deduplication, normalization, and validation so downstream data is high-quality and trustworthy • Modernize legacy / homegrown data flows via incremental, strangler-fig migrations that keep production stable • Build embeddings and vector pipelines, and the feature/retrieval-ready datasets that RAG, semantic search, and agentic workloads depend on • Make production data AI-ready in practice: well-structured, lineage-tracked, and retrieval-friendly, in partnership with ML and application engineering • Implement real-time and change-data-capture flows from MongoDB (Change Streams / CDC) where workloads require fresh data • Implement the canonical data model, schemas, and data contracts defined by the Data Architect — enforced in-repo so other teams build against stable definitions • Exercise sound persistence judgment in execution: land data in the right store (document / NoSQL, vector, analytical) per the architectural direction • Contribute to build-vs-buy decisions by prototyping with proven, industry-standard tooling over custom development • Establish testing, data-quality, and lineage checks for the pipelines you own, with clear alerting and runbooks • Instrument pipeline observability (freshness, volume, schema-drift, cost) so failures are caught before consumers feel them • Use AI-assisted development tools (Claude Code, Copilot, Cursor) as a force multiplier for transformation logic, query tuning, and migration scripting • Partner with database engineering on extracting from and protecting the production store • Partner with the Data Architect on implementing target-state patterns and surfacing what's hard to build • Partner with ML, AI, and application engineers on the data they consume — shaping and governing it so it's safe and ready to build on
• Join a motivated, career-oriented team as a Data Engineer. • Design, build, and maintain ETL pipelines across diverse data sources. • Implement data management standards and ensure data quality practices. • Collaborate with teams to optimize data loading and management processes.


