IntelliTech logo
IntelliTech

With a dedication to innovation and excellence, we're here to make the impossible possible for your organization.

Senior Data Engineer – Analytics, BI Platforms

Data EngineerData EngineerFull TimeRemoteSeniorTeam 1-10Since 2023H1B No SponsorCompany SiteLinkedIn

Location

Washington

Posted

37 days ago

Salary

0

Seniority

Senior

Bachelor Degree4 yrs expEnglishCloudETLPythonSQLTableau

Job Description

Senior Data Engineer – Analytics, BI Platforms

IntelliTech

• Design, develop, and maintain scalable data pipelines to ingest, transform, validate, and operationalize data from a variety of enterprise sources • Build and support data integration workflows across structured and unstructured data sources, including APIs, files, cloud storage, databases, and enterprise platforms • Enable analytics and reporting use cases by preparing curated datasets and supporting integration with BI and analytics tools such as Tableau, Databricks, Palantir, Power BI, Qlik, or similar platforms • Support the development of data models, transformation logic, and reusable engineering patterns that improve data access, decision support, and operational visibility • Collaborate with analysts, engineers, and stakeholders to refine requirements and deliver data products aligned to mission needs • Support testing, debugging, validation, and performance tuning of data pipelines and analytics workflows • Leverage Git-based repositories and version control best practices to manage engineering efforts • Participate in Agile development activities, including sprint planning, backlog refinement, demos, and retrospectives • Document technical designs, data flows, transformation logic, and engineering processes to support maintainability and knowledge transfer • Contribute to secure, scalable, and repeatable delivery practices across cloud and DevSecOps environments.

Job Requirements

  • Active DoD Secret clearance
  • Bachelor’s degree in Computer Science, Data Science, Engineering, Information Systems, or a related technical discipline and 4+ years of relevant experience; or Master’s degree in a related field and 2+ years of relevant experience
  • Strong experience building or supporting data pipelines, ETL/ELT workflows, and data integration solutions in enterprise environments
  • Hands-on experience with Python and SQL
  • Experience with one or more modern analytics, BI, or data platform tools such as Databricks, Palantir, Tableau, Power BI, Qlik, or similar technologies
  • Experience supporting reporting, analytics, dashboarding, or data visualization use cases
  • Familiarity with cloud-based data environments and enterprise data workflows
  • Familiarity with Git-based version control and collaborative development workflows
  • Strong problem-solving and troubleshooting skills
  • Excellent communication and collaboration skills, with the ability to work effectively across cross-functional teams.

Benefits

  • Health, dental, and vision insurance
  • 401(k)
  • Paid time off
  • Professional development opportunities
  • Flexible work arrangements to support work-life balance

Related Categories

Related Job Pages

More Data Engineer Jobs

Instacart logo

Senior Data Engineer, Finance

Instacart

Instacart invites the world to share love through food. This is how homemade is made.

Data Engineer37 days ago
Full TimeRemoteTeam 1,001-5,000Since 2012H1B Sponsor

• You will work closely with finance, accounting, billing, and revenue teams to understand their main pain points and translate them into self-serve, reliable, and scalable data solutions • You are expected to mentor other team members and be a champion of engineering excellence across the organization • You will be part of a small team with a large amount of ownership and autonomy, managing initiatives directly from design through execution • You will have the freedom to suggest and drive organization-wide initiatives that shape the financial data vision and roadmap • You will own critical data integration pipelines and models, ensuring uniform, reliable, timely, and accurate financial reporting

California + 18 moreAll locations: California | Colorado | Connecticut | District Of Columbia | Hawaii | Illinois | Maine | New Hampshire | New Jersey | New York | Oregon | Maryland | Massachusetts | Pennsylvania | Rhode Island | Texas | Vermont | Virginia | Washington
$183K - $232K / year
Job Closed
hireforyou.pro logo

ML Engineer Position: Face Indexing Pipeline

hireforyou.pro

We look forward to receiving your CV and learning more about your experience! Dear Candidates, due to a high volume of applications, only selected candidates will be contacted for interviews. We appreciate your understanding. Thank you for considering a career with us!

Data Engineer37 days ago

Role Description As an ML Engineer, you will join a project to build a face search pipeline for an iOS app that helps people find where their photos appear online. You will play a role in building a leading cybersecurity product that protects users' photos online. The engagement is fully remote, with a weekly demo to the core team. What you will build: - A web crawler that continuously indexes publicly available photos from the open web. - A face inference layer – detection, alignment, embedding – using a model of your choice. - A vector index for fast face-match search across hundreds of millions of embeddings. - A search API that returns matches by uploaded photo, with source URLs. - A re-crawl and monitoring loop that alerts users when new photos of them appear online. You choose the architecture – which face model, which vector database, which crawler framework – and own those choices. Qualifications - Strong experience with Python and modern ML inference stacks (PyTorch, ONNX, TensorRT, or similar). - Strong AI proficiency: you keep up with modern techniques and tools, and you work fast with AI-assisted workflows (LLM coding/debugging, rapid prototyping) while still writing production-quality systems. - Proven experience shipping a face recognition or image similarity system in production. - Experience operating a non-trivial web crawler – you know the difference between one million and one hundred million URLs. - Experience with vector databases and approximate nearest neighbour search (FAISS, Milvus, Qdrant, pgvector, etc.). - Awareness of the legal landscape around open-web face indexing in 2026 (GDPR, BIPA, EU AI Act, takedown obligations). - Comfort working asynchronously and achieving results. Requirements - Experience with GPU serving infrastructure (Triton, BentoML, Ray Serve, Modal, RunPod, etc.). - Experience with distributed crawling frameworks (Scrapy, Playwright, Crawlee) and proxy/residential rotation. - Experience with cost optimisation for GPU and storage at scale. - A portfolio link, a public write-up, or an open-source project we can look at. Benefits - The ability to contribute to making the world’s best technology for protecting people’s photos from deepfakes and identity theft online. - A clearly scoped project with direct access to the founders. - Full ownership of the technical decisions in this domain for the duration of the contract. - Compensation was discussed directly with you. - A clean handoff at the end, with the option to extend the engagement if it works for both sides. We look forward to receiving your CV and learning more about your experience! Dear Candidates, due to a high volume of applications, only selected candidates will be contacted for interviews. We appreciate your understanding. Thank you for considering a career with us.

Worldwide
Aubrant Digital logo

Senior Data Engineer

Aubrant Digital

Creating Digital Businesses

Data Engineer37 days ago
ContractRemoteTeam 51-200Since 2013H1B No Sponsor

Role Description As a Senior Data Engineer, you will design, build, and tune the data layer that powers our clients' mission-critical applications on Azure and SQL Server. You will own complex query performance, indexing strategy, and concurrency design, and you will architect the data access patterns that connect application code to the database through linq2db, LINQ-to-SQL, Entity Framework, and ADO.NET. You will partner with application engineers, architects, and product teams to deliver high-throughput, low-latency data solutions, and you will mentor others on database design, query optimization, and modern data engineering practices. Qualifications - A database craftsperson who treats query performance, indexing, and concurrency as first-class engineering concerns rather than afterthoughts. - A clear communicator who can explain execution plans, locking behavior, and data access trade-offs to engineers, architects, and product stakeholders. - Comfortable operating with ambiguity, capable of profiling production workloads and proposing concrete solutions backed by evidence. - A mentor who raises the bar for the team through code review, query review, and pattern guidance. - Customer-obsessed and outcome-focused, balancing delivery speed with the long-term health and scalability of the data platform. Requirements - Bachelor's Degree in Computer Science or a related discipline, or equivalent experience; MUST be proficient in written and spoken English (85%). - 5 to 8 years of professional data engineering or back-end engineering experience with a strong database focus. - Expert-level proficiency in SQL on SQL Server 2019+, including complex queries, window functions, set-based operations, query plan analysis, indexing strategy, statistics, RCSI, isolation levels, and Change Data Capture. - Expert-level proficiency in database performance tuning, including bottleneck identification, index design, query rewrites, and concurrency design under production load. - Strong proficiency in C# data access using linq2db, LINQ-to-SQL (DBML), Entity Framework, and ADO.NET; ability to choose the appropriate tool for each scenario and avoid ORM performance pitfalls. - Strong proficiency in Python for data engineering tasks, scripting, and automation. - Hands-on experience with Azure data services (Azure SQL, storage, networking, security) and deploying production data workloads in Azure. - Experience with database CI/CD, schema versioning, and migration tooling. - Solid Git, code review discipline, and familiarity with modern engineering practices including testing and observability. - Experience with Azure Data Factory, Synapse, or other Azure analytics services is a plus. - Experience designing event-driven or streaming data architectures is a plus. - Excellent analytical and problem-solving skills; strong communication, collaboration, customer orientation, innovation mindset, and adaptability under ambiguity. Responsibilities - Design and maintain SQL Server 2019+ schemas, indexes, and query patterns that meet performance, scalability, and concurrency requirements. - Analyze execution plans, identify bottlenecks, and tune queries, indexes, and statistics; advise on RCSI and isolation level choices. - Design and operate Change Data Capture (CDC) pipelines and other change-tracking patterns to support downstream consumers. - Implement and review data access using linq2db, LINQ-to-SQL (DBML), Entity Framework, and ADO.NET; choose the right tool for each scenario. - Translate business and application requirements into efficient SQL and C# data access code that is performant, testable, and maintainable. - Partner with application engineers to align ORM usage with database performance characteristics and avoid common anti-patterns. - Design and operate data solutions on Azure, including Azure SQL, storage, networking, and security configurations. - Contribute to CI/CD for database changes through migration scripts, schema versioning, and automated deployments. - Mentor engineers on database design, query optimization, and data access patterns; set standards for the team.

Latin America (LATAM)

Role Description We're Hiring: Senior AWS Redshift Data Engineer We are looking for a seasoned Data Engineer to join our Engineering organization and take ownership of the systems that power our data-driven decisions. You'll architect and maintain high-performance data pipelines and databases across platforms like MSSQL, Redshift, and Snowflake, ensuring data is reliable, accessible, and optimized for scale. If you thrive on solving complex problems, love optimizing systems for performance, and want to be the go-to expert in a collaborative, high-impact environment, we'd love to meet you. What You Will Do: - Design and maintain scalable, efficient, and well-partitioned schemas in MSSQL, Redshift, and Snowflake - Architect and optimize complex queries, stored procedures, indexing strategies, and partitioning for large datasets - Build, monitor, and maintain data pipelines that ensure timely and accurate delivery of data to internal and external consumers - Own and enforce data refresh SLAs, ensuring availability, consistency, and reliability across production and reporting environments - Collaborate with software engineers, analysts, and DevOps teams to ensure data models and queries align with product and reporting requirements - Proactively identify and remediate performance bottlenecks, slow queries, and data inconsistencies - Implement and manage database change workflows using schema migration/versioning tools - Define and promote best practices for data access, security, compliance, and observability Qualifications - 7+ years of experience in database engineering or backend systems development - Deep expertise with MySQL, Amazon Redshift, and Snowflake, including schema design and performance optimization - Design, build, and maintain scalable data pipelines and ETL processes tailored to client needs - Proven track record maintaining data freshness SLAs and data quality across production pipelines - Hands-on experience with T-SQL, LinkSQL, query optimization, and indexing strategies - Experience with query optimization, mapping tables to blocks and partitions, sub-table structure and keying/indexing for efficiency - Experience of relational data modeling and schema versioning in support of software development - Experience as the sole or lead database expert on a development team - Familiarity with source control systems (e.g., Git/Bitbucket) and CI/CD integration - Strong problem solving skills are desirable - Transforming product requirements into workable solutions, in collaboration with several development and testing teams - Writing robust functions, procedures and scripts using SQL - Being heavily involved in the day to day running of the business dealing with support and performance issues - Diagnose and troubleshoot data-related issues, providing quick and effective resolutions - Analyze data workflows and identify areas for improvement, recommending and implementing solutions to optimize performance - Utilize a proactive approach to foresee potential problems and address them before they impact operations Benefits - Work with a fast-growing global data engineering team - Opportunity to learn and grow in advanced cloud and analytics technologies - Competitive salary and performance-based incentives - A collaborative and innovation-driven work environment Interview Process - L1 Technical Discussion: Virtual Discussion Via Gmeet or Teams - L2 Technical Discussion: In-Person (Face-to-Face) at the Chennai/Madurai location - Client Interview: Virtual - HR Discussion: Virtual / In-Person - Onboarding: Mandatory visit to the Chennai/Madurai branch

India