Job Closed

This listing is no longer active.

Sunscrapers logo
Sunscrapers

Top Python Developers

Senior Data Engineer, LLM

Data EngineerData EngineerFull TimeRemoteSeniorTeam 11-50Since 2010H1B No SponsorCompany SiteLinkedIn

Location

Poland

Posted

55 days ago

Salary

0

Seniority

Senior

Job Description

Senior Data Engineer, LLM

Sunscrapers

• Developing PoCs using latest technologies, experimenting with third party integrations • Owning and evolving Next.js/React frontend with authenticated flows and secure session handling • Delivering production grade applications once PoCs are validated • Creating solutions that enable data scientists and business analysts to be self-sufficient as much as possible • Designing and implementing secure, scalable access patterns (OAuth2/OIDC, authorization boundaries) • Finding new ways how to leverage Gen AI applications and underlying vector and graph data storages • Contributing across the stack including FastAPI backend services and agent-driven workflows • Contributing data technology stacks including data warehouses and ETL pipelines • Building data flows for fetching, aggregation and data modeling using batch and streaming pipelines • Documenting design decisions before implementation

Job Requirements

  • At least 5+ years of professional experience in data-related or full-stack engineering role
  • Undergraduate or graduate degree in Computer Science, Engineering, Mathematics, or similar
  • Strong proficiency in Next.js / React for frontend development
  • Expertise in Python and SQL languages
  • Experience with data warehouses (Snowflake) and different database technologies (RDBMS, vector, graphs)
  • Proven experience building secure, scalable web applications
  • Expertise in AWS stack and services, proficiency in using Docker
  • Experience with infrastructure-as-code tools, like Terraform
  • Excellent command in spoken and written English, at least C1
  • Creative problem-solving skills and excellent technical documentation
  • Ability to work with both Windows and Unix-like operating systems
  • You will score extra points for:**
  • Experience with FastAPI or other Python web frameworks
  • Knowledge of OAuth2/OIDC flows, PKCE, token/session handling
  • Experience with integrating LLMs (OpenAI but also others, maybe open source)
  • Agent frameworks experience (OpenAI Agents, Agno, Strands) or MCP-style integrations
  • Understanding of LLMs fine tuning, embedding and vector semantic searching
  • Experience with Pinecone or Neo4j
  • Observability stacks experience (OpenTelemetry or similar)
  • Experience in building ETL processes and data pipelines with platforms like Airflow
  • AWS ECS, VPCs, and secure networking patterns
  • Proficiency in statistics and machine learning with Python libraries
  • Experience in working with repository manager, for example Jfrog Artifactory

Benefits

  • Working alongside a talented team of software engineers who are changing the image of Poland abroad
  • Culture of teamwork, professional development and knowledge sharing (https://www.youtube.com/user/sunscraperscom)
  • Flexible working hours and remote work possibility
  • Comfortable office in central Warsaw, equipped with all the necessary tools for conquering the universe (Macbook Pro/Dell, external screen, ergonomic chairs)

Related Categories

Related Job Pages

More Data Engineer Jobs

Enroute logo

AI Engineer + Data Engineer

Enroute

We deliver IT services and solutions provided by a team of passionate problem solving individuals highly skilled.

Data Engineer55 days ago
Full TimeRemoteTeam 51-200H1B Sponsor

We love technology, and we enjoy what we do. We are constantly driven by curiosity, innovation, and the desire to improve every day. We take ownership of our work, value collaboration, and foster a culture of trust and accountability. Our Enrouters embrace challenges, ask questions, learn quickly, and grow together. We pride ourselves on offering competitive compensation, excellent benefits, a great work environment, flexible schedules, and policies that promote a healthy work-life balance. We care about who you are both inside and outside the workplace, and we are committed to building a strong community of driven, responsible, respectful—and above all—happy individuals. We want you to genuinely enjoy working with us. We are seeking a data-driven Ai Engineer to join our team at a high-growth advertising technology company. This role focuses on scaling our reporting infrastructure for advertising performance and billing reconciliation, ensuring that financial and operational data is accurate, automated, and actionable. In this role, you will be responsible for developing robust data pipelines, ensuring data quality and reliability, and enabling efficient data consumption across the organization. You will collaborate closely with cross-functional teams including Product, Engineering, Analytics, and Business stakeholders to deliver high-impact data platforms. The ideal candidate is a proactive problem-solver with strong technical expertise, capable of working with large datasets, modern data architectures, and cloud-based environments. You thrive in fast-paced settings, navigate ambiguity with confidence, and are passionate about turning data into actionable value.

Mexico
Job Closed
Full TimeRemoteTeam 501-1,000Since 2003H1B No Sponsor

• Execute business-side data migration activities for Commercial and Procurement data objects (Direct and Indirect), in line with global, regional, and country-specific deployment requirements and timelines. • Plan and deliver data migration activities aligned with the Client’s rollout plan and key milestones. • Coordinate and perform data cleansing to ensure high data quality and compliance with defined standards. • Collect, validate, and complete data for manual or constructed data objects, ensuring accuracy and completeness. • Collaborate with IT and technical teams to define, validate, and maintain mappings between legacy systems and target solutions. • Create and maintain master data lists for Commercial and Procurement objects, as required. • Provide business insights and detailed input to support data extraction and transformation processes. • Ensure data readiness across the migration lifecycle, including quality checks, validation, and issue resolution. • Validate that data supports business processes (including Order to Cash) and meets stakeholder requirements. • Perform manual data loads into target systems where required, following governance and control procedures. • Execute data validation checks and provide results, insights, and approvals. • Support testing phases (SIT, UAT, mock loads), including defect identification, triage, and resolution. • Support cutover activities, including final data loads, reconciliation, and validation. • Work closely with the Client’s global data migration team and ensure alignment with delivery frameworks. • Collaborate with business stakeholders, SMEs, and technical teams across regions. • Identify and document business requirements and local market specifics impacting data migration. • Participate in project meetings, including workstream sessions, defect triage, and cutover planning.

Czechia
Creative Chaos logo

Data Engineer

Creative Chaos

Your innovation delivery partner.

Data Engineer55 days ago
Full TimeRemoteTeam 201-500Since 2000H1B No Sponsor

We are seeking a highly skilled Data Engineer with extensive experience in Azure Data Lake to contribute to our dynamic team at Creative Chaos. The ideal candidate will be responsible for architecting, developing, and optimizing data pipelines that will facilitate the efficient processing of large datasets. **Responsibilities:** - Designing and implementing robust data pipeline solutions within Azure Data Lake. - Integrating and transforming data from various sources to enable comprehensive analytics and reporting. - Ensuring data quality and integrity, implementing data governance practices. - Collaborating with cross-functional teams to understand data requirements and develop scalable solutions. - Monitoring and optimizing data processing workflows for performance and reliability. - Documenting processes and architecture to ensure maintainability and scalability. - Staying abreast of new Azure technologies and best practices for data engineering.

Pakistan
3form logo

Data Engineer

3form

A leading manufacturer of architectural resin, glass products, acoustic solutions, markerboards and light fixtures.

Data Engineer55 days ago
ContractRemoteTeam 201-500Since 2002H1B No Sponsor

• Design and implement robust data pipelines, build scalable data lakes. • Enable business insights through efficient data systems. • Collaborate with analysts and stakeholders to define data requirements and support business intelligence efforts. • Monitor and troubleshoot data pipelines to ensure smooth operation. • Stay updated on industry trends and best practices in data engineering.

Poland
PLN10.1K - PLN33.6K / month