Simplifying business transformation through thought leadership and innovation. Bring your digital agenda to reality.
Contract - Senior Azure Data Engineer
Location
United States
Posted
68 days ago
Salary
0
Seniority
Senior
Job Description
Contract - Senior Azure Data Engineer
Smartbridge
Senior/Lead Azure Data Engineer (Contract — 3 Months) Location: Remote (U.S.), core overlap with CST Engagement: Contract only (C2C) — no C2H for this role Start: Immediate | Duration: 3 months (extension possible) Comp: Competitive hourly rate (DOE) About Smartbridge Smartbridge simplifies business transformation across App Development, Automation, Data & Analytics, and Modernization. We build production systems for clients in Energy, Life Sciences, and Food & Beverage. The Opportunity Our project needs a senior/lead who can both design and build modern Azure data platforms—someone with strong coding in T-SQL and Python/PySpark, architectural judgment, and deep database chops (modeling, performance, reliability). Because this is contract-only, fit must be tight and immediate impact. What You’ll Own (Architecture + Build) - Architecture: Define the target-state Azure data architecture (ingestion, orchestration, storage zones, serving patterns), security/networking boundaries, cost/perf tradeoffs, and promotion strategy (Dev→Test→Prod). - Pipelines & Code: Implement robust ELT/ETL with ADF/Synapse Pipelines (parameters, reusable templates, CI/CD). Hands-on in T-SQL and Python/PySpark for transformations, utilities, and tests. - Database Excellence: Physical/semantic modeling, partitioning, columnstore strategies, statistics management, query plan analysis, index design, concurrency & transaction isolation, workload management. - Observability & Reliability: SLA/SLO definitions, Azure Monitor / Log Analytics / App Insights dashboards and alerts; error handling, retries/backoff, idempotency, CDC and schema drift strategies. - Security & Governance: RBAC, Key Vault, managed identities, private endpoints/VNet, data masking patterns; document data contracts and access patterns. - Leadership: Code reviews, PR discipline, mentoring, and crisp documentation/runbooks for client handoff. Must-Have (Senior-Level) Experience - 8–12+ years in data engineering (recent Azure focus). - Expert with ADF (linked services, datasets, IRs—including self-hosted), Synapse (SQL pools/serverless, pipelines), and ADLS/Blob. - T-SQL: advanced query tuning, execution plan analysis, windowing, TVFs/stored procs, temp tables vs CTE tradeoffs, cardinality estimator know-how. - Python/PySpark: production data transforms, packaging, and testing. - CI/CD: Azure DevOps or GitHub Actions (multi-stage releases, approvals, infra + data deployments). - Proven delivery of production-grade platforms at scale (TB-level data, strict SLAs). Not a fit: Primarily BI/reporting backgrounds without strong pipeline/build + DB performance experience. Nice to Have - Designed and implemented robust data validation procedures to verify the completeness of data transfers, ensuring all records were successfully migrated and proactively triggering alerts in cases of discrepancies. - Experience with working with large SQL tables (100 million rows) - IaC (Bicep/Terraform) for data resources. - Event-driven integration (Service Bus/Event Grid, CDC tooling). - Certs: DP-203 or AZ-204 are a plus.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Data platform Manager - IT
WescoWesco is a global wholesale distributor of communications, electrical, and utility solutions and supply chain services. As an employer, the company strives to foster an inclusive a
We are seeking an experienced Data Platform Manager with 14+ years of progressive experience to lead, manage, and scale enterprise data platforms. The ideal candidate will have deep expertise in Databricks, Azure data platforms, strong people management skills, and a proven track record in SOX controls, Change Management, and enterprise-grade governance. This role will partner closely with business, security, compliance, and Data engineering teams to ensure reliable, compliant, and scalable data solutions. Responsibilities: - Own and oversee enterprise data platforms built on Databricks and Azure (Azure Data Lake, Synapse, Azure SQL, Azure DevOps). - Define platform architecture standards, best practices, and roadmaps. - Ensure platform scalability, reliability, security, and cost efficiency. - Guide modernization initiatives including cloud migration and platform consolidation. - Lead, mentor, and manage cross-functional data engineering and platform teams. - Drive talent development, performance management, and succession planning. - Foster a high-performing, collaborative, and accountable engineering culture. - Ensure compliance with SOX IT controls, audit requirements, and internal control frameworks. - Partner with Audit, Security, and Compliance teams to design and maintain effective controls. - Support audits by providing documentation, evidence, and remediation plans. - Enforce strong data governance, access control, and data quality standards. - Lead Change Management processes for platform releases, upgrades, and incidents. - Establish and enforce ITIL-aligned processes (Change, Incident, Problem Management). - Drive operational excellence, reliability, and reduced downtime. - Own SLAs, KPIs, and platform operational metrics. - Translate business requirements into platform capabilities and delivery plans. - Collaborate with enterprise architecture, product, analytics, and business leaders. - Manage vendor relationships and strategic technology partnerships. - Contribute to long-term data and analytics strategy. Qualifications: - Bachelors degree required. - 5 years required, 7 years preferred of data processing, system analysis design, and operations experience. - 3 years preferred of supervising work of subordinate employees experience. - Programming and systems analysis. - Solid analytical skills - able to solve problems & interpret instructions in any form - Project management expertise in planning and completing large and small projects - Strong verbal, written, analytical and interpersonal skills. - Leadership ability as a creative, competent team builder. #LI-JB1 #LI-REMOTE This amount is what we reasonably believe we will pay for the position; however, offer amounts may vary based on factors such as geographic location, relevant education, experience, qualifications, skills, shift, or any collective bargaining agreements. For eligible positions, compensation may include participation in a bonus or sales incentive plan, subject to the terms and conditions of the applicable plan documents. For certain sales roles, Wesco also offers a commission structure that provides additional compensation based on sales results, as defined by the applicable commission plan. In addition, Wesco offers a benefits program for eligible employees, which may include paid time off, medical, dental, and vision coverage, and retirement savings plans. Additional details about benefits are available here. At Wesco, we build, connect, power and protect the world. As a leading provider of business-to-business distribution, logistics services and supply chain solutions, we create a world that you can depend on. Our Company’s greatest asset is our people. Wesco is committed to fostering a workplace where every individual is respected, valued, and empowered to succeed. We promote a culture that is grounded in teamwork and respect. With a workforce of over 20,000 people worldwide, we embrace the unique perspectives each person brings. Through comprehensive benefits and active community engagement, we create an environment where every team member has the opportunity to thrive. Learn more about Working at Wesco here and apply online today! Founded in 1922 and headquartered in Pittsburgh, Wesco is a publicly traded (NYSE: WCC) FORTUNE 500® company. Wesco International, Inc., including its subsidiaries and affiliates (“Wesco”) provides equal employment opportunities to all employees and applicants for employment. Employment decisions are made without regard to race, religion, color, national or ethnic origin, sex, sexual orientation, gender identity or expression, age, disability, or other characteristics protected by law. US applicants only, we are an Equal Opportunity Employer. Los Angeles Unincorporated County Candidates Only: Qualified applicants with arrest or conviction records will be considered for employment in accordance with the Los Angeles County Fair Chance Ordinance and the California Fair Chance Act. This posting is for a current, active vacancy intended for immediate hire.
Senior Software Engineer, Data Governance & Foundations
InstacartInstacart invites the world to share love through food. This is how homemade is made.
We're transforming the grocery industry At Instacart, we invite the world to share love through food because we believe everyone should have access to the food they love and more time to enjoy it together. Where others see a simple need for grocery delivery, we see exciting complexity and endless opportunity to serve the varied needs of our community. We work to deliver an essential service that customers rely on to get their groceries and household goods, while also offering safe and flexible earnings opportunities to Instacart Personal Shoppers. Instacart has become a lifeline for millions of people, and we’re building the team to help push our shopping cart forward. If you’re ready to do the best work of your life, come join our table. Instacart is a Flex First team There’s no one-size fits all approach to how we do our best work. Our employees have the flexibility to choose where they do their best work—whether it’s from home, an office, or your favorite coffee shop—while staying connected and building community through regular in-person events. Learn more about our flexible approach to where we work. About the Team Instacarts Data Governance & Foundations team builds and operates the core systems that power the company's data ecosystem — a modern data lakehouse at scale, spanning ingestion, stream processing, analytical compute, and self-serve tooling. You'll join a collaborative team of 6–7 engineers responsible for keeping a highly reliable production platform running today while architecting the infrastructure that will serve the business for the next 3–5 years. This is a high-ownership, high-autonomy role. Architectural decisions carry both technical and financial weight, and you'll be expected to drive direction, not just execute it. You'll work closely with engineering leadership and cross-functional partners across Data Science, ML Platform, Ads Infrastructure, Finance Engineering, and senior stakeholders throughout the organization. About the Job - Define and drive multi-year architecture roadmaps for large-scale data ingestion and processing infrastructure, setting technical direction that balances reliability, scalability, and cost. - Own end-to-end platform initiatives — from build vs. buy decisions and migration design through production rollout and risk management — across Kafka-based streaming and Postgres-based systems. - Partner with vendors (Snowflake, Databricks, Confluent) on technical integration, contract evaluation, and TCO modeling to inform infrastructure investment decisions. - Collaborate with various teams to embed governance and compliance controls (SOX, CPRA, GDPR) directly into platform architecture and data lifecycle management. - Optimize infrastructure spend at scale: identify cost reduction opportunities across compute, storage, and pipeline efficiency; manage multi-million dollar infrastructure budgets. - Write compelling architecture documents, strategy memos, and proposals that drive alignment with engineering leadership and senior stakeholders across the organization. - Mentor engineers on the team, model strong engineering culture, and help grow a high-performing data infrastructure organization. - Collaborate with Data Science, ML Platform, Ads Infrastructure, Finance Engineering, and Product teams to ensure the platform meets evolving needs. About You - 5+ years of software engineering focused on data infrastructure or distributed systems at scale, in a high-growth, data-intensive environment. - Experience in modern data lakehouse architectures and open table formats — Apache Iceberg, Delta Lake, Hudi — with strong understanding of compute/storage trade-offs. - Hands-on experience with distributed query and compute systems (Trino, Spark, ClickHouse) including performance tuning and production reliability work. - Proven depth in event-driven infrastructure: Kafka for high-throughput data ingestion and Flink (or equivalent) for stream processing at scale. - Track record owning and executing major platform transitions, including migration design, phased rollout, and risk management under production constraints. - Experience building business cases for infrastructure investments: cost-benefit analysis, TCO modeling, and presenting recommendations to leadership. - Exceptional written technical communication — clear architecture docs, strategy memos, and cross-team proposals that drive decisions and alignment. - Strong ownership and comfort operating in ambiguity; ability to drive large, multi-team initiatives from concept to production with organizational influence. PREFERRED QUALIFICATIONS - Familiarity with data governance and compliance frameworks (SOX, CPRA, GDPR) and experience designing governance controls into platform architecture. - Experience with FinOps and data platform cost optimization, including managing large infrastructure budgets and negotiating enterprise vendor contracts. - Deep SQL expertise and strong proficiency in Python or Scala for systems-level work. - Experience with orchestration (Apache Airflow) and transformation pipelines (dbt) in large-scale production environments. - Bachelor's, Master's, or PhD in Computer Science, Computer Engineering, Electrical Engineering, or equivalent practical experience. #LI-Remote Instacart provides highly market-competitive compensation and benefits in each location where our employees work. This role is remote and the base pay range for a successful candidate is dependent on their permanent work location. Please review our Flex First remote work policy here. Offers may vary based on many factors, such as candidate experience and skills required for the role. Additionally, this role is eligible for a new hire equity grant as well as annual refresh grants. Please read more about our benefits offerings here. For US based candidates, the base pay ranges for a successful candidate are listed below. CA, NY, CT, NJ $199,000—$210,000 USD WA $191,000—$201,000 USD OR, DE, ME, MA, MD, NH, RI, VT, DC, PA, VA, CO, TX, IL, HI $183,000—$193,000 USD All other states $166,000—$175,000 USD
Senior Software Engineer, Data Engineering
MotionalWe're making driverless vehicles a safe, reliable, and accessible reality.
• Author comprehensive technical design documents to propose, evaluate, and implement scalable infrastructure and tooling solutions. • Build intuitive internal CLI tools, web applications, and Python-based SDKs leveraging Ray. • Architect, deploy, and maintain robust cloud infrastructure on AWS. • Leverage modern data tooling and formats (dbt, Apache Iceberg / Parquet, Redshift) to build highly efficient data pipelines. • Champion continuous integration and deployment best practices using GitLab, while deploying scalable services and workloads. • Act as a technical pillar on the team, establishing standards and mentoring peers.
Data Engineer (Mid/Senior)
GFT TechnologiesAs a pioneer for digital transformation GFT develops sustainable solutions across new technologies.
• Expertly develop backend components in Python; • Design and build scalable data pipelines using AWS services such as S3, Glue, Athena, Lambda, and Step Functions; • Implement data ingestion, transformation, and modeling solutions with a focus on high performance and security; • Collaborate with business and data science teams to translate requirements into efficient technical solutions; • Monitor, optimize, and ensure data quality across pipelines and systems; • Apply DevOps practices to data solutions, leveraging CI/CD and automation; • Ensure compliance with regulations and data governance best practices.




