Job Closed
This listing is no longer active.
Logistical & physical assistance for non-emergency medical transport
Senior Ingestion Engineer
Location
United States
Posted
71 days ago
Salary
$5K - $8K / month
Seniority
Senior
Job Description
Senior Ingestion Engineer
Somewhere
Role Description We’re looking for a Senior Ingestion Engineer to build and scale high-volume, real-time data ingestion systems. You’ll work on collecting, processing, and optimizing large streams of data while ensuring performance, reliability, and cost-efficiency. This role is ideal for engineers who enjoy solving complex problems, working with real-time systems, and building scalable infrastructure. Key Responsibilities - Design and build real-time data ingestion pipelines - Handle high-throughput, low-latency data systems - Develop and maintain large-scale web scraping systems - Work with APIs, reverse engineering, and anti-bot solutions - Optimize systems for performance, reliability, and cost - Use AI tools to enhance development workflows - Collaborate with engineers, data experts, and analysts Qualifications - Strong experience with real-time/streaming data systems - Background in distributed systems and scalable infrastructure - Experience with web scraping, APIs, or data extraction at scale - Knowledge of performance optimization and cloud environments - Familiarity with AI-assisted development tools - Strong problem-solving and systems-thinking mindset Requirements - Experience in trading, betting, or financial data systems - Exposure to high-frequency or real-time data environments - Experience with adversarial scraping or anti-bot systems Benefits - Full-Time | Remote - Salary: $5,000 – $8,000/month (depending on experience) - Working hours: Monday to Friday can overlap US business hours
Job Requirements
- Strong experience with real-time/streaming data systems
- Background in distributed systems and scalable infrastructure
- Experience with web scraping, APIs, or data extraction at scale
- Knowledge of performance optimization and cloud environments
- Familiarity with AI-assisted development tools
- Strong problem-solving and systems-thinking mindset
- Experience in trading, betting, or financial data systems
- Exposure to high-frequency or real-time data environments
- Experience with adversarial scraping or anti-bot systems
Benefits
- Full-Time | Remote
- Salary: $5,000 – $8,000/month (depending on experience)
- Working hours: Monday to Friday can overlap US business hours
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
• Design, develop, and optimize scalable, high-performance, secure, and reliable data pipelines that address diverse business requirements • Identify opportunities to improve internal processes, implement automation to reduce manual tasks, and contribute to infrastructure redesign • Mentor and guide junior engineers, supporting their professional growth and promoting an inclusive work environment • Collaborate with cross-functional teams to ensure data quality and enable data-driven decision-making to enhance the functionality of our data systems • Work with project managers and product owners to help prioritize, estimate, and plan development tasks • Provide constructive feedback and share expertise with team members to foster mutual growth and learning • Continuously research and adopt new technologies, libraries, frameworks, and best practices to strengthen the data team’s capabilities • Demonstrate a commitment to accessibility and ensure your work considers and positively impacts diverse users
Azure Data Platform Lead
Codvo.aiBuilding Advance AI & Cloud Native Software Using The "Virtual Silicon Valley" Model. Let’s Talk AI, Cloud and Outcomes.
• Lead the design, implementation, and optimization of enterprise-scale Azure data platform solutions • Architect data ingestion pipelines from diverse sources including databases, APIs, files, and streaming systems • Design and optimize ETL/ELT processes using SQL, Python, Spark, and Azure native services • Establish data quality frameworks, monitoring, and alerting systems • Implement data governance frameworks, security protocols, and compliance standards
Snowflake Data Platform Lead
Codvo.aiBuilding Advance AI & Cloud Native Software Using The "Virtual Silicon Valley" Model. Let’s Talk AI, Cloud and Outcomes.
• Lead the design, implementation, and optimization of enterprise Snowflake data platform solutions • Drive cloud-native data architecture initiatives and establish scalable analytics capabilities. • Design and implement enterprise-scale Snowflake data platform architectures • Establish modern data lakehouse patterns using Snowflake's cloud data platform capabilities • Define data governance, security, and access control frameworks • Lead platform assessments, optimization initiatives, and strategic planning • Architect robust data ingestion pipelines using Snowpipe, external stages, and partner integrations • Design efficient ELT processes using Snowflake SQL, Snowpark, and Python/Scala • Implement data sharing capabilities, marketplace integrations, and cross-cloud connectivity • Establish monitoring, alerting, and cost management best practices • Design integrations with BI tools, data visualization platforms, and analytics applications • Enable advanced analytics and machine learning workflows using Snowpark ML • Implement real-time and batch data processing patterns • Lead data platform migrations and modernization projects
Data Engineer
CES Family of CompaniesThe CES Family of Companies is a collection of strong brands and businesses providing food equipment, supplies, service.
• Design and implement data ingestion pipelines using CDC/CT (Change Tracking) from SQL Server sources • Build and maintain medallion architecture (Bronze → Silver → Gold) data layers in Snowflake • Develop data transformation models using tools like dbt, AWS Glue, or Snowflake native features (stored procedures, tasks) • Implement SCD Type 1 and Type 2 patterns for historical data tracking • Design and implement Row-Level Security (RLS) for multi-tenant data access • Create and optimize Snowflake objects including tables, views, streams, tasks, and stored procedures • Design data models supporting complex reporting requirements for absence management, workforce analytics, and substitute tracking • Ensure Gold layer is optimized for BI tool consumption (Power BI, Tableau, or other reporting tools) • Establish data quality checks, monitoring, and alerting mechanisms • Document technical designs, data dictionaries, and lineage documentation • Mentor junior team members and conduct code reviews


