AI Marketing Suite for Brands
Senior Data Engineer
Location
Germany
Posted
61 days ago
Salary
0
Seniority
Senior
Job Description
Senior Data Engineer
Bluefish AI
• Design, build, and maintain scalable data pipelines that ingest, transform, and validate large volumes of data across multiple sources and channels. • Improve the scalability, reliability, and performance of our data pipelines to support rapidly growing workloads and new data streams. • Contribute to the design and implementation of our Data Lake architecture, enabling reliable data storage and reuse across teams. • Manage and optimize data ingestion workflows, including data collected from web scrapers, third-party vendors, and internal systems. • Monitor pipeline health, investigate incidents, and implement improvements to increase system reliability and observability. • Support the onboarding and integration of new AI channels and data sources into the platform. • Collaborate with teams across the organization to ensure data generated by different systems can be reused effectively for analytics and business intelligence. • Identify and resolve performance bottlenecks in distributed systems, including rate limiting, concurrency, and throughput constraints. • Advise engineering and product teams on data architecture, data quality, and best practices for managing scalable data workflows. • Continuously evaluate and improve our data platform to support the company’s rapid growth and evolving product needs.
Job Requirements
- Strong experience building and operating scalable data pipelines in production environments.
- Hands-on experience working with Data Lakes or Data Warehouses (e.g., AWS Athena or similar technologies).
- Experience with data transformation and modeling.
- Strong experience working with AWS.
- Experience using Infrastructure-as-Code tools to manage cloud infrastructure.
- Proficiency in Python for data processing and automation.
- Experience working with distributed systems and managing large-scale data workflows.
- Experience implementing monitoring, observability, and incident response practices for data systems.
Benefits
- Unique opportunity to join on the ground floor of a fast-moving startup building at the center of AI
- Tackle challenging and abstract problems while disrupting the $300BN legacy mar-tech industry
- Join an experienced high-performing team where you will have immediate ownership and impact
- Experience a true meritocracy with significant career growth upside as the business scales
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
• Thoroughly understand all Underwriting and Rebate Administration data sources, fields, and relationships, including historical claims, Medi-Span tables, NCPDP tables, and Capital Rx’s Book of Business data to interpret trends, identify patterns, and conduct complex data analyses in support of Underwriting, Rebate Administration, and Sales business goals • Investigate new data sources for the purpose of building & maintaining data pipelines to clean, transform, and aggregate disparate data • Use agile software development to create, maintain, and improve back-end systems for data extracts, pricing processes, and analytic tools to advance the department’s technical capabilities • Model front-end views and back-end data sources to draw a comprehensive picture of the user experience and analytic pipelines throughout the system and to enable powerful data analysis • Troubleshoot and customize infrastructure code in SQL, R, and Python to diagnose and solve data or process issues • Work closely with our Underwriting and Clinical teams to help build complex algorithms that provide useful insights into our data • Assist in the analysis and development of new models and front-end tools that can be used to make predictions and answer questions for financial modeling & reporting • Collaborate with various teams across the company on data sources and analytic methodology in support of Underwriting, Rebate Administration, and company objectives • Provide standard and ad-hoc analytics to support the Underwriting and Rebate Administration teams for the successful completion of bid opportunities and rebate payment management
Enterprise Data Architect
A.C.Coy CompanyStaffing and consulting firm specializing in IT, Accounting & Finance, Engineering and Sales placements.
• Lead the design, develop and implement data models for enterprise-level applications and systems • Create short-term tactical solutions to achieve long-term objectives and an overall data management roadmap • Propose and collaborate on plans for security, backup, disaster recovery, business continuity, and archiving • Oversee the development team by monitoring and reviewing the quality, performance, security, and scalability of solutions
• Design, implement, and maintain data pipelines and ETL processes supporting ingestion, transformation, and validation of mission data • Develop and optimize data models and schemas across relational and non-relational databases to support system integrations and analytics • Collaborate with system architects, integration developers, and data analysts to ensure data consistency, security, and integrity across cloud environments • Implement data migration and synchronization between legacy systems, applications, and modern cloud platforms • Utilize AWS services (Glue, Lambda, S3, RDS, Redshift, Kinesis) to build and sustain scalable and fault-tolerant data infrastructure • Support data validation and reconciliation, performing quality checks and developing reports to ensure accuracy • Integrate data from APIs, streaming sources, and file-based systems into centralized repositories or data lakes • Automate data workflows using infrastructure-as-code and CI/CD principles to ensure repeatability and efficiency • Monitor and troubleshoot data pipeline performance, ensuring adherence to SLAs and operational reliability • Implement data encryption, masking, and access controls in compliance with DoD cybersecurity policies and RMF requirements • Support development of dashboards and analytics products, enabling data-driven insights for mission stakeholders • Maintain documentation and metadata repositories, including data dictionaries, lineage, and technical specifications • Participate in Agile sprints, contributing to backlog refinement, testing, and cross-functional collaboration
• Design, build, and maintain **schemas and data models** • Optimize table layout, partitioning, indexing, and compression for high-volume data • Ensure fast, efficient querying for logs, requests, metrics, and performance traces • Maintain ingestion pipelines for billions of records • Build robust pipelines for: - API logs - Model inference logs - Error events - Usage & integration events - GPU & system metrics • Implement ETL/ELT workflows to transform raw data into analytics-ready structures • Ensure quality, reliability, and real-time availability of data sources • Build tooling to support large-scale **log analysis** • Enable deep investigation into latency, throughput, errors, and bottlenecks • Provide the raw data foundation for E2E inference-time monitoring • Help debug production issues using logs and traces • Work closely with DevOps, ML, and backend engineering • Integrate pipelines with monitoring tools (Prometheus, Grafana, Datadog, OpenTelemetry) • Automate ingestion and cleanup tasks • Build internal libraries or utilities to support monitoring and debugging workflows • Provide clean data interfaces for the Data Expert (dashboards, monitoring, analytics) • Support engineering teams by exposing the right logs and metrics • Contribute to debugging, RCA (root cause analysis), and performance optimization initiatives




