Job Closed
This listing is no longer active.
Data Engineer
Location
Worldwide
Posted
122 days ago
Salary
0
No structured requirement data.
Job Description
Data Engineer
Bullfinch Recruitment
This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more. Role Description Design, build, and manage advanced data systems that turn raw player data into actionable insights, powering personalized gaming experiences, fraud detection, and revenue optimization for our platform. - Develop batch and real-time data pipelines on our GCP platform - Develop APIs to share our data with other teams and consumers - Build CI/CD pipelines for automated deployments - Develop Terraform IAC for deploying our team's core infrastructure - Use Datastream to ingest CDC data to our data lake - Use Dataform and dbt to build a medallion data architecture - Optimize our BigQuery and ClickHouse data models - Build Airflow DAG pipelines for data imports and exports - Implement monitoring and alerting policies for data accuracy, consistency, and integrity across platforms - Uphold GDPR/CCPA compliance and data governance standards Qualifications - Good Bash, Git, SQL and Python - these are a must - Terraform IAC experience - Docker and K8s - Strong GCP experience (BigQuery, Dataform, Airflow, Datastream); API development and data modelling expertise - Real-time processing - Kafka, Pyspark, Flink - Proven ETL/CI-CD skills - Bachelor's in Computer Science, Data Science, Information Systems, or equivalent - Google Cloud certifications (Professional Data Engineer, Cloud Architect) a plus - Passion for gaming and collaborative mindset Benefits - Enjoy autonomy with cutting-edge GCP tech - Mentorship from a global team - Real impact on products - Flexible remote options - Professional development budgets - A culture celebrating diverse ideas Equal Opportunities We hire for skills, drive, and fresh perspectives—regardless of background, gender, age, race, ethnicity, disability, sexual orientation, religion, neurodiversity, or career journey. Diverse teams drive our success; bring your unique view to thrive here.
Job Requirements
- Good Bash, Git, SQL and Python - these are a must
- Terraform IAC experience
- Docker and K8s
- Strong GCP experience (BigQuery, Dataform, Airflow, Datastream); API development and data modelling expertise
- Real-time processing - Kafka, Pyspark, Flink
- Proven ETL/CI-CD skills
- Bachelor's in Computer Science, Data Science, Information Systems, or equivalent
- Google Cloud certifications (Professional Data Engineer, Cloud Architect) a plus
- Passion for gaming and collaborative mindset
Benefits
- Enjoy autonomy with cutting-edge GCP tech
- Mentorship from a global team
- Real impact on products
- Flexible remote options
- Professional development budgets
- A culture celebrating diverse ideas
- Equal Opportunities
- We hire for skills, drive, and fresh perspectives—regardless of background, gender, age, race, ethnicity, disability, sexual orientation, religion, neurodiversity, or career journey. Diverse teams drive our success; bring your unique view to thrive here.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Data Engineer
Object ComputingObject Computing, Inc. (OCI) is a modern consulting company that uses technology to create and accelerate business outcomes. Business leaders turn to OCI to design and build solutions that unlock transformative value, get to market faster, and do far more with less by leveraging today's leading-edge technologies in the areas of blockchain, machine learning, industrial IoT, cloud services, serverless computing, and more.
Object Computing, Inc. (OCI) OCI is seeking experienced Data Engineers to design, develop, and manage data infrastructure for internal and client projects within our AI/ML & Data Insights team. About OCI We provide a collaborative environment focused on innovation, leveraging open-source software and strategic partnerships with Amazon and Google to build transformative technology solutions. Job Responsibilities Design, build, and optimize large-scale data pipelines (Azure, AWS, GCP) Develop data ingestion and storage solutions. Implement scalable APIs and ensure system performance. Manage big data infrastructure and cloud deployments. Collaborate with developers, designers, and data scientists. Work in an Agile/DevOps environment. Core Competencies ETL data engineering (Databricks, SQL Server, Snowflake, BigQuery, Apache Spark). Proficiency in Go, Java, Python, or Scala. Proficiency in CI/CD pipelines and Infrastructure as Code (IaC) (Terraform, CDK, Ansible). Hands-on experience with event-driven architectures (Kafka, Pulsar). Strong knowledge of data warehousing, SQL/NoSQL databases, and cloud platforms. Experience with distributed computing, DevOps tools, and data governance. Familiarity with Delta Lake, Unity Catalog, Delta Sharing, and DLT. Preferred Qualifications
About Us DAS42 is a data consultancy that brings clarity and a modern point of view to managing, accessing, and using data to solve our client’s most urgent business needs. We see our clients and the complex data issues they face and apply customized strategies to reach their goals. Our deeply knowledgeable team can engage end-to-end across all layers of our client’s data ecosystem, giving them greater efficiency, scale, and flexibility to transform their organization for long-term success. Why should you work at DAS42? Our cultural pillars say it all: People, Impact, and Curiosity. We care about our people, the work we do makes an impact, and everyone at DAS42 is supported to further develop their skills and ask questions. Through our commitment to delivering best-in-class solutions and providing industry leading Total Rewards to our employees out team has built a company that we can be proud of. That is we’ve been named 2022 Snowflake Partner of the Year, one of BuiltIn’s 2023 and 2024 Best Places to Work . As a diverse team, we encourage people from all academic, social, and demographic backgrounds to explore career opportunities. Check out our page for more information about who we are and why our people love working here . About the Role DAS42 is seeking a versatile Lead Data Consultant who can flex between hands-on technical work and leading project teams. In this role, you will design and deliver scalable data solutions, including data models, ELT/ETL pipelines, cloud data platforms, and BI tools, while advising clients on how to maximize the value of their data. You’ll translate business needs into technical strategies, guide solution architecture, and support or lead project execution depending on team and client requirements. The ideal candidate is both a strong individual contributor and an emerging leader, comfortable mentoring others and driving high-quality outcomes. This is a client-facing role that requires excellent communication skills, technical expertise, and a consultative mindset. What You’ll Do Guide clients on optimizing their data environment to work most effectively and efficiently for them. Develop system engineering, integrations, and architectures based on client needs. Implement and provide advice on data warehouse solutions, ETL pipelines, and business intelligence reporting tools. Develop a data model around stated use cases to capture client’s KPIs and data transformations. Validation and testing of data models. Teach technical data modeling concepts to a variety of audiences, including developers, data architects, business users, and IT professionals. Manage technical teams of up to 4-6 people, delegating work to associates across concurrent engagements. Assign staff with appropriate skill sets in associate and junior consultants to projects in conjunction with the project manager Work within a project management framework to meet objectives, understand scope, and impact of your work across an organization. Work with the Sales and Marketing teams to develop Thought Leadership and support our sellers by talking to clients about DAS42’s capabilities. What We’re Looking For 5 to 8 years of work experience in a data analytics and/or data engineering role. Minimum of 1 year leading projects, either formally or informally. Able to manage internal employees (ideally having formal direct reports). A passion for exploring and solving different kinds of problems. A desire to learn and assimilate technical information quickly. Exposure to developer tools/workflow (e.g. git/github, SSH). Knowing how to get around a command line environment. Project management (eg. Basecamp, JIRA, ASANA). Experience with the AWS, Google Cloud ecosystem (BigQuery, Redshift). Experience with business visualization tools (e.g. Looker, Tableau, Microsoft PowerBI). Experience with data warehousing and using Snowflake. Experience optimizing database/query performance. Proficiency with a scripting language (e.g. Python, R, Perl, bash) and advanced SQL. Bachelor's or Master’s degree – in a quantitative field (i.e. Statistics or Operations Research) or technical field (i.e. Computer Science or Engineering) (preferred). Worked for a consulting/services organization (preferred). Worked with or for Media & Entertainment or Telecom companies (preferred). More about the position Job Type: Full Time, W-2 Anticipated Travel: Up to 15% of the time Location: USA, Remote Base Salary Range: $115-145k (offered salary depends on experience and location) Total Experience Equation We differentiate ourselves in the talent market by investing in a full suite of benefits and a culture that supports our employees' achievement of our core mission to help the world’s leading companies make better decisions, faster. The values of DAS42 drive the Total Experience Equation we offer for our team. We hope to motivate and engage our employees through a variety of offerings that satisfy those values and needs in a way unique to DAS42. A few of those benefits include: Unlimited Vacation Medical, Vision, and Dental Insurance Paid Family and Medical Leave Individual and Company Bonus Programs Paid Family and Medical Leave Regular, In-person Company Events Flexible Work Policy Remote Work Stipend 401(k) Matching Learning and Development Programs All new hires will be required to complete a background check, and employment at DAS42 is contingent upon successfully passing it. If an applicant is found to have misrepresented themselves, DAS42 reserves the right to withdraw the offer. DAS42 provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training. DAS42 uses E-Verify to confirm the employment eligibility of all newly hired employees. To learn more about E-Verify, including your rights and responsibilities, please contact the Department of Homeland Security at 888-897-7781 or visit www.dhs.gov/everify. Este empleador participa en E-Verify y proporcionará al gobierno federal la información de su Formulario I-9 para confirmar que usted está autorizado para trabajar en los EE.UU. Para más información, visite dhs.gov/e-verify.
Forward Deployed Engineer (Perm, USA, Remote + Travel) This is a full-time, permanent opportunity for candidates based in the United States and authorized to work without sponsorship , with a preference for those located on the East Coast . Please note that visa sponsorship is not available for this role. This position also requires frequent travel to client sites within the U.S. , with travel expenses covered by the company . About Nearform Nearform is an independent team of data & AI experts, engineers, and designers who build intelligent digital solutions and capability at pace. We create AI-enabled solutions that enhance digital experiences, empower developers, and deliver measurable results. In these ways, we partner with ambitious enterprises to deliver enduring impact. Our deep expertise in solving the world’s most complex digital problems, along with our collaborative, people-first approach, enables enterprises to build breakthrough products and modernise legacy systems by unleashing the power of AI. Today, our team of 500 experts in 20+ countries is trusted by leading enterprises including Lululemon, Puma, Sun Life, Starbucks, Travelex, Virgin Media 02, and Walmart. About the role As a Forward Deployed Engineer, you will help build, implement, and deploy agentic platforms within client environments. Your role will focus on building and deploying scalable AI-driven solutions, enabling organisations to operationalise LLM-powered agents across products, processes, and teams. You will work closely with client stakeholders, technical leaders, and delivery teams to build, and roll out agentic capabilities that integrate seamlessly with existing enterprise systems and frameworks. What we are looking for in this person: Significant experience delivering at a Senior Engineer level. Our Seniors typically have at least 8 years of commercial experience. Experience designing and building agentic platforms using Python and modern AI frameworks. Architect LLM orchestration using frameworks such as LangGraph, CrewAI, AutoGen, and related technologies. Implement multi-agent systems supporting tool use, workflow orchestration, memory, and decision-making. Design and deploy Retrieval-Augmented Generation (RAG) pipelines integrating enterprise data sources. Integrate agentic platforms with client systems, including APIs, data platforms, cloud services, and enterprise applications. The ability to configure Kubernetes and deploy workloads. Design deployment architectures across cloud, on-premise, and hybrid environments. Ability to collaborate efficiently in teams of technical and non-technical individuals. Comfort working in a dynamic environment with evolving objectives and direct iteration with users. Strong consulting experience to plan, execute, and deliver complex client engagements, solving real business problems. Nice to have: Hands-on experience working with Golang Hands-on experience in the Frontend working with React Deep understanding of Kubernetes Benefits & Perks: Annual Company Bonus - We all help Nearform to hit company goals so we all receive a share of the profits on an annual basis in line with company performance. Work Remotely and Flexibly - We have a genuine dedication to work/life balance. Our flexible working culture allows you to work around what matters - school run, no problem! Flexible Time Off Package - We offer a flexible annual leave policy plus public holidays. We also offer sick leave, marriage leave and many more. Remote Working Allowance - Every 2 years, you will have a budget of up to €1250 (equivalent in USD) to help you set up a comfortable and productive workspace in addition to your essential equipment provided by Nearform when you join. Training and Development Allowance - We understand the importance of continuously learning so we offer an allowance of up to €1000 (equivalent in USD) you can use to upskill yourself. Healthcare - It’s important to always take care of your health, so we offer additional private healthcare here at Nearform. If you wish to learn more about the plan offered feel free to reach out to our team. 401k - We offer a 401k plan and match up to 4%, with no minimum entry requirements and immediate vesting of employers’ contributions.
Staff Data Engineer
Blackbird.AIBlackbird.AI helps organizations detect and respond to disinformation and manipulation that causes reputational and financial harm. Powered by their exclusive AI-Driven Constellation Platform, Fortune 500s and governments can proactively manage new information risks that were previously undetectable. Blackbird.AI was founded by a team of experts from artificial intelligence, behavioral psychology and national security, with a mission to defend authenticity and fight narrative manipulation. Recognized by Forrester as a "Top Threat Intelligence Company", the Blackbird Risk Index™(BRI) is an industry benchmark in the reputation enhancement space.
Blackbird.AI helps organizations discover emergent threats and stay one step ahead of real-world harm through our AI-powered Narrative and Risk Intelligence Platform. Our commitment is to prioritize safety and security, providing the tools to identify potential risks and ensure a safer environment proactively. No matter the job or where it's located, we're all connected by a shared vision: To lead and enhance the landscape of risk intelligence. As a Staff Data Engineer, you will play a critical role in architecting and scaling our data platform and AI/ML processing infrastructure. You'll be a technical leader responsible for our entire data ecosystem—from ingestion pipelines that process diverse data sources to the lakehouse architecture that powers our narrative analysis capabilities. You'll architect systems that seamlessly support batch and streaming data patterns while building real time alerting on generated insights. You'll work at the intersection of data engineering, AI-powered data transformation, and platform engineering, making architectural decisions that will shape our ability to detect misinformation, disinformation, and narrative attacks at scale while managing costs effectively. A key aspect of this role involves building intelligent pipelines that use traditional AI and generative AI to cluster, enrich, classify, and extract insights from data as it flows through our system. As a Staff Data Engineer you will: Design and implement scalable data platform architecture on Databricks, supporting both batch and streaming ingestion Build robust, fault-tolerant data ingestion pipelines that integrate with multiple third-party APIs and data providers Design and implement AI-powered enrichment stages within pipelines—applying ML clustering, generative AI summarization, classification, and entity extraction to transform raw data into actionable intelligence Build analytical systems with full-text search capabilities using Elasticsearch for rapid querying and analysis of enriched data Work with AI/ML researchers to implement, integrate and scaling AI processing Expose data platform capabilities as APIs and other interfaces for downstream consumption by applications and services Optimize data lake and lakehouse architecture for performance, cost-efficiency, and scalability Design and implement data quality frameworks, monitoring, and alerting systems Design efficient architectures for calling external AI APIs and managing rate limits, costs, and reliability Architect solutions with cost-efficiency as a first-class concern, implementing monitoring and optimization strategies for compute and storage Make critical build-vs-buy decisions and establish architectural standards for the data organization Mentor engineers and elevate the team's technical capabilities through code reviews, design discussions, and knowledge sharing Requirements Preferred Qualifications: Experience designing both batch and streaming/near real-time data architectures Proficiency with Elasticsearch for building analytical systems with full-text search capabilities Hands-on experience with LLM APIs and understanding of rate limiting and cost optimization Experience with Agentic AI, context engineering, and evaluation Background in trust & safety, security, or content moderation domains Experience with data observability tools and building comprehensive monitoring systems Prior experience at a startup or fast-paced environment Apply agentic coding tools for day to day development Familiarity with Databricks' Lakeflow, Agent Bricks, and vector databases What’s in it for you: Blackbird.AI is embarking on an exciting growth journey with numerous opportunities for career development within the company. You will join a nurturing, inclusive, and experienced team. Join us as we soar to new heights! Values: At Blackbird.AI, our core values shape how we work and make decisions. Our values inspire us to be authentic and continue improving. We embrace a strong sense of responsibility to society, recognizing the vital role our services play in empowering governments, communities, and individuals to foster critical thinking and empowerment. We believe in integrating personal and professional lives with societal needs, emphasizing the importance of creating an environment that attracts top talent and provides substantial growth opportunities. We are motivated by the potential of science and technology to impact humanity positively. Benefits Competitive compensation package, 401(k), and equity - everyone has a stake in our growth! Comprehensive health benefits for you and your loved ones, including wellness days and monthly wellness reimbursements - an apple a day doesn't always keep the doctor away! Generous vacation policy, encouraging you to take the time you need - we trust you to strike the right work/life balance! A flexible work environment with opportunities to collaborate with your team in person - you can have it all! Inclusion and Impact - soar to new heights! Professional development stipend - never stop learning! Location & Work Eligibility: We are only able to hire candidates currently residing in the U.S. Unfortunately, we cannot offer visa sponsorship for this role. Applicants must be legally authorized to work in the U.S. without future sponsorship. Candidates applying for this position should meet the residency requirement and be able to provide proof of U.S. work authorization. Pay Transparency: [NEW YORK ONLY] For individuals assigned and/or hired to work in New York, Blackbird.AI is required by law to include a reasonable estimate of the compensation range for this role. This compensation range is specific to New York. It takes into account the wide range of factors that are considered in making compensation decisions, including, but not limited to, skill sets, experience and training, licensure and certifications, and other business and organizational needs. At Blackbird.AI, it is not typical for an individual to be hired at or near the top of the range for their role, and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current compensation range for this position is expected to be $160,000 - $190,000. This range may vary for positions outside of New York and as it has not been adjusted for the applicable geographic differential associated with the location where the position may be filled. Regardless of location, candidates can expect during the first few conversations with Blackbird.AI’s Talent Team and Hiring Managers to share any approved budget. Apply Today Equal Opportunity Employer



