Job Closed
This listing is no longer active.
Forging AI personalities through technology and story.
Lead Data Engineer
Location
United States
Posted
120 days ago
Salary
$110K - $165K / year
Seniority
Senior
Job Description
Lead Data Engineer
Inception Point AI
• Partner with the engineering team to lead the knowledge transfer of "Atlas" (built in Python), taking full architectural ownership and ensuring its continued health and progression. • Using Apache Airflow to manage and optimize the daily ingestion of analytics from multiple disparate sources (social media, podcast platforms, etc.) to ensure a clean, reliable, and "healthy" data stream. • Act as a "data detective" to identify what information we are missing and prioritize new data collection that aligns with our financial stability and growth levers. • Build and maintain intuitive dashboards (e.g., Power BI or custom builds) that allow non-technical peers to answer basic everyday questions without needing manual engineering support. • Transform raw data into structured, "customer-ready" packages to support our heavy push into data licensing. • Utilize your knowledge of the media analytics landscape to guide the organization on whether to build custom internal tools or leverage existing 3rd-party social media analytics solutions.
Job Requirements
- Complete mastery of SQL and Airflow, along with a high proficiency with Python.
- Deep familiarity with typical frameworks for cloud-based data storage and management.
- Proven track record of working with very large datasets and high transaction volumes.
- Ability to perform at least basic analysis on data, identifying issues, transforming datasets, and looking at information from multiple perspectives.
- Strong "people skills" with a genuine interest in interviewing stakeholders to understand the business questions they need the data to answer.
Benefits
- Offers Equity
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Principal Data Engineer
WaymarkThe breakthrough AI production platform that allows anyone to create compelling commercials and spec spots in minutes.
• Architect production-grade data pipelines that integrate clinical data through multiple channels—direct EHR connections (e.g., Epic, Cerner, Athenahealth), health information exchanges (HIEs), health alliance networks, and third-party integration vendors—via FHIR R4 APIs, HL7v2 feeds, CCDA documents, and bulk data exports, while enforcing healthcare standards and clinical terminologies (ICD-10, SNOMED CT, LOINC, RxNorm), targeting sub-hour latency from clinical event to actionable insight and ≥99.9% pipeline reliability. • Lead end-to-end integration efforts with health plan partners, HIEs, health alliance networks, provider organizations, and data integration vendors—owning partner technical evaluation, connectivity, data mapping, validation, and production rollout. • Build and optimize cloud-native data infrastructure (AWS) and ETL/ELT workflows using modern orchestration tools (e.g., Step Functions, dbt) with robust data quality monitoring and lineage tracking. • Develop reusable backend frameworks, libraries, and internal tooling that accelerate onboarding of new data sources—whether direct EHR feeds, HIE connections, or vendor integrations—with the goal of reducing new-partner integration time by 50% or more while improving developer productivity and reducing operational toil across engineering. • Partner with data science and data analytics teams to build and operationalize the data foundations for predictive risk scores, care gap identification, clinical alerting, and patient outreach prioritization. • Collaborate with product and clinical teams to translate care delivery requirements into scalable, production-grade technical solutions and influence. • Ensure all data systems comply with HIPAA, HITECH, and applicable privacy regulations, implementing access controls, audit logging, encryption, and de-identification processes for PHI. • Provide technical leadership and mentorship to engineers across Waymark, raising the bar on healthcare data best practices.
Senior AWS Redshift Data Engineer
Techmango Technology Services Private LimitedData Engineering | Generative AI | Microsoft Dynamics 365 | AI &ML | Application Modernization | Business Intelligence
• Design and maintain scalable, efficient, and well-partitioned schemas in MSSQL, Redshift, and Snowflake. • Architect and optimize complex queries, stored procedures, indexing strategies, and partitioning for large datasets. • Build, monitor, and maintain data pipelines that ensure timely and accurate delivery of data to internal and external consumers. • Own and enforce data refresh SLAs, ensuring availability, consistency, and reliability across production and reporting environments. • Collaborate with software engineers, analysts, and DevOps teams to ensure data models and queries align with product and reporting requirements. • Proactively identify and remediate performance bottlenecks, slow queries, and data inconsistencies. • Implement and manage database change workflows using schema migration/versioning tools. • Define and promote best practices for data access, security, compliance, and observability.
• Own the end-to-end migration workflow for new customers. • Design mapping strategies to transform competitor data into our unified schema. • Build and maintain migration tooling (scripts, internal apps, reusable templates). • Collaborate with Client Success and Product teams to resolve data discrepancies and edge cases. • Optimize and automate recurring migration tasks to drive scalability. • Diagnose and troubleshoot migration issues quickly and systematically. • Continuously refine best practices for schema evolution, error handling, and data validation.
Data Migration Manager – Implementation Specialist
Fundraise UpUnlocking the world's generosity potential
• Lead the full lifecycle of data migration projects, from initial planning to executing the final “red button” push. • Collaborate closely with clients, CRM providers, and payment system representatives to collect, validate, and prepare all required data files. • Determine optimal migration timelines and coordinate schedules that work for all stakeholders. • Maintain transparent and ongoing communication with all parties to provide updates, address concerns, and ensure smooth execution. • Confidently operate software tools and systems related to data migration (no programming required). • Manage multiple complex projects simultaneously, ensuring deadlines and quality standards are met. • Adhere to strict guidelines and agreements, maintaining a high level of accuracy and consistency. • Participate in regular cross-team discussions on product, sales, support, customer feedback, and performance metrics.




