Full Scale logo
Full Scale

Build software development teams quickly and affordably.

Senior Data Engineer

Data EngineerData EngineerFull TimeRemoteSeniorTeam 201-500Since 2018H1B No SponsorCompany SiteLinkedIn

Location

Philippines

Posted

21 days ago

Salary

0

Seniority

Senior

Bachelor Degree4 yrs expEnglishETLMS SQL ServerSQLSSIS

Job Description

Senior Data Engineer

Full Scale

• Assist with long-term strategic planning for modern data warehousing needs • Contribute to data modeling initiatives and the ongoing build out of the data warehouse • Design, build, and maintain data pipelines that ingest data from multiple disparate sources • Monitor, support, and analyze existing pipelines, identifying opportunities for performance and process improvements • Automate manual processes owned by the data team • Troubleshoot and remediate data ingestion, transformation, and reporting issues • Ensure the accuracy, reliability, and availability of data in the data warehouse • Collaborate with cross-functional teams to develop data-driven solutions aligned with business and technical needs • Create and deploy reports as needed to support operational and business requirements • Assist with cataloging and classifying existing data sets • Participate in peer reviews with a focus on continuous improvement and best practices • Respond to regulatory or business requests for data and reporting • Mentor team members and provide guidance on data engineering best practices • Support additional duties and responsibilities as assigned by management

Job Requirements

  • 4+ years of relevant data engineering experience
  • Strong expertise with Microsoft SQL Server
  • Hands-on experience designing, building, and supporting ETL pipelines
  • Experience with database design and data modeling
  • Experience supporting and troubleshooting SSIS packages
  • Experience consuming event-based data through APIs, queues, or similar integration methods
  • Experience working in an Agile software development environment
  • Strong analytical, problem-solving, and troubleshooting skills
  • Strong written, verbal, and visual communication skills
  • Ability to work effectively in a fast-paced, team-oriented environment
  • Flexibility and willingness to take on new responsibilities as business needs evolve

Benefits

  • Fully remote – work from anywhere in the Philippines
  • Collaborative, high-performing engineering culture

Related Categories

Related Job Pages

More Data Engineer Jobs

Training Qualifications UK logo

Freelance Data Management Apprenticeship Assessment Assessor

Training Qualifications UK

Training Qualifications UK, part of the AQA Group, is the fastest-growing Awarding Organisation in the UK and a market-leading Apprenticeship Assessment Organisation. We work with over 500 schools, colleges, universities, and training providers across the world to provide qualification certificates, endorsements, and apprenticeships to over 150,000 learners. Training Qualifications UK is entering its next phase of growth - and we’re investing in top talent to build what comes next. And what comes next is big. Multiple senior roles. Launched together. One shared future. This isn’t a backfill. It’s a build. We’re looking for exceptional people across qualification development, assessment development, people services and marketing & communications to help define what a market-leading organisation in vocational education and FE really looks like.

Data Engineer21 days ago

Role Description The role of a Freelance Apprenticeship Assessment Assessor is to provide independent, fair, reliable, and consistent assessment services to Training Qualifications UK customers working with Apprenticeship Standards. This role requires someone flexible in their approach to all tasks, with the independence to travel as and when the business requires. Also has exceptional assessment abilities coupled with the ability to act with integrity and impartiality. The sectors that fall within this role to be assessed are: - Data Technician Level 3 - Data Analyst Level 4 Key Responsibilities - Plan, deliver, and record assessment activity in line with apprenticeship standards and awarding organisation requirements. - Make objective, evidence-based assessment decisions that are valid, reliable, and consistent. - Ensure assessment practice complies with regulatory requirements, including those relating to independence and conflicts of interest. - Provide clear, constructive, and timely feedback to apprentices. - Maintain accurate, auditable, and compliant assessment records. Subject Matter Expertise (SME) - Contribute to the design and development of assessment materials, including: - Question banks - Examination papers - Mark schemes and grading criteria - Review and validate assessment content to ensure: - Technical accuracy - Occupational relevance - Alignment with current industry practice and standards - Act as a Subject Advisor where specified within apprenticeship standards. - Support continuous improvement through review of assessment performance data and feedback. Standardisation & Quality Assurance - Participate in and, where required, lead standardisation activities to ensure consistency and comparability of assessment decisions. - Support the induction, training, and calibration of assessors, including freelance or associate staff. - Guide the interpretation of standards and assessment requirements. - Contribute to internal quality assurance processes and continuous improvement activity. External Quality Assurance (EQA) Activity - Undertake EQA activity to assure the quality, consistency, and integrity of assessment decisions. - Sample assessment decisions and associated evidence in line with quality assurance strategy. - Monitor assessment practice and identify risks, trends, and areas for improvement. - Provide clear, evidence-based feedback and support corrective actions where required. - Contribute to maintaining standards across centres, assessors, and delivery models. Independence & Compliance - Identify, declare, and manage any conflicts of interest in line with organisational policy and regulatory requirements. - Ensure assessment and quality assurance decisions are made free from undue influence or personal interest. - Participate in mitigation measures (e.g. second marking, independent review, or standardisation) where required. - Maintain compliance with all relevant regulatory, organisational, and quality assurance requirements. Other Responsibilities - Maintain continuous professional development (CPD) in both occupational areas and assessment practice. - Keep up to date with changes in apprenticeship standards, regulatory requirements, and industry practice. - Support organisational quality, compliance, and continuous improvement objectives. - Produce accurate, appropriate and well-informed assessment feedback/written reports to validate assessment decisions using the correct and as required regulatory paperwork and appropriate systems. Quality Assurance & Compliance - Sample assessments using a risk-based approach, focusing on high-priority areas. - Ensure assessment judgements are fair, reliable, and aligned with assessment plans. - Support preparation for and response to EQA visits. - Escalate concerns relating to malpractice or non-compliance. Professional Standards & Development - Maintain current knowledge of apprenticeship standards, sector updates, and regulatory frameworks. - Demonstrate integrity, impartiality, and a commitment to CPD. - Share best practice examples and contribute to continuous improvement initiatives. - Be responsible for maintaining your own ongoing CPD relevant to assessment and internal quality assurance practices, the wider Apprenticeship landscape, and the industry for which you assess. Essential Standards - Data Technician Level 3 - Data Analyst Level 4 - Business Analyst Level (desirable) Essential Skills / Experience / Qualifications - Functional Skills Level 2 (English and maths). - Qualification at least Level 4 gained in the last 4 years/ or significant experience. - Proven assessment experience, including sampling and feedback. - Understanding of safeguarding, duty of care, EDI, and regulatory frameworks. - Excellent written/verbal communication and report-writing skills. - Confident in stakeholder engagement and presenting professional judgement. - Strong organisational skills, with the ability to work independently and to deadlines. - Commitment to ongoing CPD. Desirable Skills / Experience / Qualifications - Have or working towards Assessor qualification (D32/D33, A1, TAQA, or equivalent). - Quality Assurer (D34, IQA Award, EQA Award). - Relevant qualifications such as the International Diploma in Business Analysis or Certified Business Analysis Professional Qualification. Key Characteristics - Solution-focused with a “can do” approach. - Professional, approachable, and collaborative. - Passionate about education and learner outcomes. - Adaptable and willing to travel. *We are an equal opportunities employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. Should you require any additional support during the recruitment process due to a disability, please contact us so we can assist you.

United Kingdom
£250 / day
Swish Analytics logo

Data Engineer

Swish Analytics

Intelligent U.S. Sports Betting Solutions

Data Engineer21 days ago
Full TimeRemoteTeam 11-50Since 2014H1B Sponsor

Title: Data Engineer Location: United Kingdom United Kingdom · Remote Engineering · Database Marketing/Analytics/Business Intelligence · Product Engineering £70,000 - £100,000 / year Job Description: Swish Analytics is a sports analytics, betting and fantasy startup building the next generation of predictive sports analytics data products. We believe that oddsmaking is a challenge rooted in engineering, mathematics, and sports betting expertise; not intuition. We're looking for team-oriented individuals with an authentic passion for accurate and predictive real-time data who can execute in a fast-paced, creative, and continually-evolving environment without sacrificing technical excellence. Our challenges are unique, so we hope you are comfortable in uncharted territory and passionate about building systems to support products across a variety of industries and consumer/enterprise clients. Job Description The Swish Analytics team is seeking Data Engineers based in Europe to have a direct impact on the infrastructure and delivery of our core consumer and enterprise data offerings as well as helping support our coverage of non-US sports. We’re a team passionate about accurate predictions and real-time data, and hope you find satisfaction in building new products with the latest and greatest technologies. This is a remote position. Duties - Support production systems and help triage issues during live sporting events - Architect low-latency, real-time analytics systems including raw data collection, feature development and endpoint production - Build new sports betting data products and predictions offerings - Integrate large and complex real-time datasets into new consumer and enterprise products - Develop production-level predictive analytics into enterprise-grade APIs - Contribute to the design and implementation of new, fully-automated sports data delivery frameworks Requirements - BS/BA degree in Mathematics, Computer Science, or related STEM field - Minimum of 2+ years of demonstrated experience writing production level code (Python) - Proficiency in Python and SQL (preferably MySQL) Demonstrated experience with Airflow - Demonstrated experience with Kubernetes - Experience building end-to-end ETL pipelines - Experience utilizing REST APIs - Experience with version control (git), continuous integration and deployment, shell scripting, and cloud-computing infrastructures (AWS) - Experience with web scraping and cleaning unstructured data - Knowledge of data science and machine learning concepts - A strong interest for sports and sports betting, with an emphasis on Tennis. An understanding of US-based sports including the NFL, NBA, MLB, NHL, College Football, College Basketball, and the ability use your knowledge of the sport to inform your work with complex datasets Swish Analytics is an Equal Opportunity Employer. All candidates who meet the qualifications will be considered without regard to race, color, religion, sex, national origin, age, disability, sexual orientation, pregnancy status, genetic, military, veteran status, marital status, or any other characteristic protected by law. The position responsibilities are not limited to the responsibilities outlined above and are subject to change. At the employer’s discretion, this position may require successful completion of background and reference checks.

United Kingdom
GBP 70K - GBP 100K / year
Pear Tree. logo

Senior Data Engineer

Pear Tree.

Hire smarter, hire globally — scale your business while saving up to 80% on local costs. www.pear-tree.com

Data Engineer21 days ago
Full TimeRemoteTeam 1-10H1B No Sponsor

• Design and deliver modern data platforms using tools like Snowflake, Microsoft Fabric, Azure, Fivetran, Coalesce, dbt, and Power BI • Lead projects end-to-end - from architecture through to client handover • Champion data governance practices that make platforms trustworthy and scalable • Support clients through the change that comes with adopting new ways of working with data • Help build internal standards and frameworks that shape how the whole team works • Lift capability across the team - by doing good work and being someone others learn from

Philippines
$3K - $5K / month
ClickHouse logo

Senior Data Engineer

ClickHouse

ClickHouse is an open-source, column-oriented OLAP database management system.

Data Engineer21 days ago
Full TimeRemoteTeam 51-200Since 2016H1B Sponsor

Role Description At ClickHouse, we believe in making product decisions grounded in data, not gut feelings. To support that, we've built a comprehensive internal data warehouse. It powers analytics, forecasting, and decision-making across every team in the company. Our stack centers on ClickHouse as the core storage and processing engine, complemented by dbt, Airflow, S3, AWS, Superset, and GitHub Actions. We ingest data from 30+ distinct external sources, process over 2.5 PB of data, and deliver most data marts to business consumers with a 1-hour end-to-end latency - a standard that demands highly optimized, rock-solid transformation pipelines. We're looking for a Senior Data Engineer to help evolve the DWH platform, push its technical boundaries, and deliver reliable, high-performance data models to business users across the organization. Key Responsibilities - DWH Platform Development: - Design and develop reusable Airflow components - operators, connectors, and hooks - along with custom integrations tailored to our data architecture. - Build reusable dbt macros and abstractions: incremental strategies, ETL building blocks, and generic data quality tests, all optimized for ClickHouse-specific behavior and our data patterns. - Develop DataOps tooling - CI pipelines, data migration frameworks, and security controls - with a strong focus on reliability, self-service usability, and scale. - Team contributions: - Conduct thorough code reviews for team members and other team contributors. - Actively participate in technical and architectural design discussions. - Drive technical leadership in specific areas of our stack. - Continuously improve the team's development environment, with a focus on automation - including AI-assisted workflows. - Contribute to platform stability through proactive troubleshooting and timely incident resolution. - Data modeling: - Develop, refactor, and optimize business data models in line with our modeling standards and ClickHouse best practices. - Mentor and support contributors through code reviews and technical guidance. - Lead the design and implementation of the most technically demanding data marts - particularly those involving high data velocity, large volumes, or complex business logic. Qualifications - Exceptional SQL skills - this is non-negotiable. - Strong hands-on experience with Airflow, dbt, and Python. - Proven track record building and optimizing large-scale, high-throughput data pipelines. - Solid understanding of data warehousing fundamentals: ETL/ELT, dimensional modeling, and data quality. - Bachelor's degree in Computer Science or a related field. - Comfortable thriving in a fast-paced startup environment — exciting and dynamic, but sometimes wonderfully chaotic. Preferred - Hands-on experience with ClickHouse - a significant advantage. - Familiarity with AWS or other cloud platforms. - Experience with CI/CD development, especially using GitHub Actions. Compensation - The typical starting salary for this role in the US is $84,000 — $143,000 USD. - The typical starting salary for this role in US Premium Markets is $115,000 — $170,000 USD. - For roles based in the United States, the typical starting salary range for this position is listed above. In certain locations, such as the San Francisco Bay Area and the New York City Metro Area, a premium market range may apply, as listed. - These salary ranges reflect what we reasonably and in good faith believe to be the minimum and maximum pay for this role at the time of posting. - The actual compensation may be higher or lower than the amounts listed, and the ranges may be subject to future adjustments. - An individual’s placement within the range will depend on various factors, including (but not limited to) education, qualifications, certifications, experience, skills, location, performance, and the needs of the business or organization. - If you have any questions or comments about compensation as a candidate, please get in touch with us at paytransparency@clickhouse.com. Benefits - Flexible work environment - ClickHouse is a globally distributed company and remote-friendly. We currently operate in over 20 countries. - Healthcare - Employer contributions towards your healthcare. - Equity in the company - Every new team member who joins our company receives stock options. - Time off - Flexible time off in the US, generous entitlement in other countries. - A $500 Home office setup if you’re a remote employee. - Global Gatherings – We believe in the power of in-person connection and offer opportunities to engage with colleagues at company-wide offsites. - Culture - We All Shape It. As part of a rapidly scaling start up, you will be instrumental in shaping our culture.

Worldwide
$115K - $170K / year