One platform to find, assess, and act on every opportunity.
Data Sourcing Engineer
Location
Worldwide
Posted
7 days ago
Salary
0
Seniority
Mid Level
Job Description
Data Sourcing Engineer
Gain
Role Description You will be joining our Data & Automation Services team, a unit that sits at the intersection of data at scale and manual workflows requiring domain knowledge. The role spans two complementary tracks: - Conferences, where you will own the scraping pipeline and the run-rate of upcoming conference coverage. - Cross-vertical automation and data work for the wider business, ranging from ad hoc data extraction to one-off projects. For this, you will: - Maintain an active run-rate of upcoming conferences and continuously grow conference coverage on the platform. - Perform end-to-end delivery of one-off projects and recurring automation workflows. - Investigate and identify potential trade fairs and assess the value of scraping their exhibitor lists as well as researching additional data points. - Set up and run web scrapers using tools like Octoparse and Firecrawl to extract exhibitor lists and relevant information for projects. - Regularly update and maintain the content management system to ensure the information remains up-to-date and accurate. - Report and communicate problems and come up with solutions that will be integrated into a worldwide feature. - Communicate with internal stakeholders in a guided manner to define project requirements for cross-vertical work. - Support ad hoc data extraction and reporting requests from the wider business, working from a read-only dataset (e.g. monthly reporting, data completeness and accuracy reports). - Contribute to one-off AI-driven data gathering projects (e.g. extracting HQ locations for investors, advisors and lenders, or pulling financial information from annual reports). - Support internal tech-forward initiatives, such as Slack and Notion integrations that streamline analyst workflows. As this is a newly-shaped team and process, there is ample opportunity for you to refine and improve how we work — and to grow alongside it! Qualifications - Experience – You have a finished University degree and have experience with Python, scraping and database management. - Education – You have consistently achieved excellent results from a leading university in a computer science, data science or related field. - Workplace enthusiasm – You showcase a strong interest in project management, database management and data management techniques and possess strong attention to detail. - Languages – You are fluent and articulate in English. Benefits - High-growth fintech scale-up with an international footprint. - Competitive compensation package. - Unmatched learning and career preparation opportunities for private equity, investment banking or consulting. - Clear development path supported by lots of coaching and a feedback-driven approach. - Flexibility to work remotely and leeway around exam periods or deadlines. - Fun working atmosphere with company-wide outings and events. - Culture of trust, ownership and standard of excellence.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Data Engineer
SharkNinjaSharkNInja is a global leader in the housewares and small appliances industry, providing innovative vacuum cleaners via the company’s Shark brand and serving
About Us SharkNinja is a global product design and technology company, with a diversified portfolio of 5-star rated lifestyle solutions that positively impact people's lives in homes around the world. Powered by two trusted, global brands, Shark and Ninja, the company has a proven track record of bringing disruptive innovation to market and developing one consumer product after another has allowed SharkNinja to enter multiple product categories, driving significant growth and market share gains. Headquartered in Needham, Massachusetts with more than 4,100 associates, the company's products are sold at key retailers, online and offline, and through distributors around the world. Data Engineer About the Role SharkNinja is seeking a Data Engineer/Architect to play a critical role in evolving our data infrastructure and analytics capabilities. This position offers a blend of hands-on engineering and strategic architecture work, focusing on improving our existing AWS-based data platform while supporting our growing IoT initiatives. You'll work at the intersection of product innovation and data engineering, helping transform raw IoT sensor data, and customer insights into actionable intelligence that drives product development and business decisions. Key Responsibilities Architecture & Design - Design and evolve data architecture for our IoT platform, ensuring scalability, reliability, and performance - Define data modeling standards and best practices for data warehousing - Evaluate and recommend improvements to our existing AWS data stack - Create architectural documentation and data flow diagrams for cross-functional teams - Partner with product, engineering, and business intelligence teams to translate requirements into scalable data solutions - Establish data governance frameworks and data quality standards Hands-On Engineering - Build and optimize ETL/ELT pipelines for batch processing - Develop data ingestion pipelines from IoT devices for real-time and near-real-time data - Design and implement data models to support analytics and reporting use cases - Create and maintain data transformations, ensuring data accuracy and consistency - Optimize query performance for analytics workloads - Implement data orchestration and scheduling workflows - Write code following engineering best practices - Monitor and troubleshoot data pipeline failures and performance issues Required Qualifications - 2+ years of experience in data engineering, with some experience in a design or architect-level role - Strong hands-on experience with AWS data services: Glue, Kinesis, Redshift, S3, and Athena - Senior-level SQL skills and experience with data warehousing concepts (star schema, dimensional modeling, etc.) - Proven experience building and maintaining ETL/ELT pipelines at scale - Strong programming skills for data processing and automation - Experience with batch processing workflows and scheduling tools - Solid understanding of medallion and other data architecture patterns, data modeling, and database design - Experience working with analytics and reporting requirements - Strong problem-solving skills and ability to debug complex data issues - Excellent communication skills with ability to explain technical concepts to non-technical stakeholders - Bachelor's degree in computer science, engineering, or related field (or equivalent experience) Preferred Qualifications - Experience with IoT data pipelines and sensor data processing - Familiarity with streaming data architectures and real-time analytics - Experience with infrastructure as code (CDK, CloudFormation) - Knowledge of data quality frameworks and testing tools - Experience with data lifecycles and data lineage - Experience with DataOps practices and CI/CD for data pipelines - Exposure to BI tools (Tableau, Looker, QuickSight, PowerBI, etc.) - Experience in retail, consumer products, or hardware/IoT domains - AWS certifications (Solutions Architect, Data Analytics) Technical Skills Required: - AWS: Glue, Kinesis, Redshift, S3, Athena - Languages: Python, SQL - Data Warehousing: dimensional modeling, query optimization, performance tuning - ETL/ELT: pipeline design, data transformation, orchestration - Data Modeling: relational and analytical data models Nice to Have: - Workflow orchestration: Airflow, Step Functions, MWAA - Data formats: Parquet, Avro, JSON - Version control: Git - Monitoring: CloudWatch, data quality tools - Lakehouse architectures: Delta Lake, Iceberg What You'll Work On - Architecting data flows from IoT devices through our AWS infrastructure - Building robust data pipelines to process device telemetry, usage patterns, and performance metrics - Designing analytics-ready data models to support product teams in understanding how customers use our robot vacuums - Enabling real-time and batch analytics to drive product improvements and customer experience - Designing and building dashboards to visualize IoT metrics, product performance, and customer usage insights Salary and Other Compensation: The annual salary range for this position is displayed below. Factors which may affect starting pay within this range may include geography/market, skills, education, experience and other qualifications of the successful candidate. The Company offers the following benefits for this position, subject to applicable eligibility requirements: medical insurance, dental insurance, vision insurance, flexible spending accounts, health savings accounts (HSA) with company contribution, 401(k) retirement plan with matching, employee stock purchase program, life insurance, AD&D, short-term disability insurance, long-term disability insurance, generous paid time off, company holidays, parental leave, identity theft protection, pet insurance, pre-paid legal insurance, back-up child and eldercare days, product discounts, referral bonus program, and more. Pay Range $115,000-$130,000 USD Our Culture At SharkNinja, we don't just raise the bar-we push past it every single day. Our Outrageously Extraordinary mindset drives us to tackle the impossible, push boundaries, and deliver results that others only dream of. If you thrive on breaking out of your swim lane, you'll be right at home. What We Offer We offer competitive health insurance, retirement plans, paid time off, employee stock purchase options, wellness programs, SharkNinja product discounts, and more. We empower your personal and professional growth with high impact Learning Programs featuring bold voices redefining what's possible. When you join, you're not just part of a company-you're part of an outrageously extraordinary community. Together, we won't just launch products-we'll disrupt entire markets. At SharkNinja, Diversity, Equity, and Inclusion are vital to our global success. Valuing each unique voice and blending all of our diverse skills strengthens SharkNinja's innovation every day. We support ALL associates in bringing their authentic selves to work, making an impact, and having the opportunity for career acceleration. With help from our leadership, associates, and our community, we aim to have equity be a key component of the SharkNinja DNA. Learn more about us: Life At SharkNinja Outrageously Extraordinary SharkNinja Candidate Privacy Notice - For candidates based in all regions, please refer to this Candidate Privacy Notice. - For candidates based in China, please refer to this Candidate Privacy Notice. - For candidates based in Vietnam, please refer to this Candidate Privacy Notice. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, disability, or any other class protected by legislation, and local law. SharkNinja will consider reasonable accommodations consistent with legislation, and local law. If you require a reasonable accommodation to participate in the job application or interview process, please contact SharkNinja People & Culture at accommodations@sharkninja.com
• Architect, optimize, and supervise the daily ingestion pipelines that process calendar data for 14+ million listings. • Tune and scale our AWS RDS PostgreSQL and Aurora databases to handle extreme high-throughput read/write operations and multi-TB storage. • Optimize background job orchestration to ensure timely and efficient data processing. • Design and build robust ETL processes to integrate new, complex data sources into our ecosystem. • Collaborate with application engineers to make diverse versions and aggregations of our data easily accessible to the core application. • Apply DevOps best practices to maintain and improve our AWS infrastructure, CI/CD pipelines, and infrastructure-as-code. • Build comprehensive monitoring, alerting, and observability tooling to catch data bottlenecks before they impact the business.
Data Entry Specialist - Payment Reconciliation
Remote VANote: Due to the high volume of applications we receive, we regret that we are unable to provide individual feedback to all candidates. If you do not hear back from us within 4 weeks of your application, please assume that you have not been successful on this occasion. We genuinely appreciate your interest and wish you the best in your job search.
Role Description We are seeking detail-oriented and highly accurate CR-trained Data Entry Specialists to handle payment reconciliation within CentralReach. The ideal candidate has experience working with ABA billing processes, payment posting, and EOB/ERA verification. - Perform payment reconciliation manually or automatically within CentralReach. - Locate and verify corresponding EOBs/ERAs through clearinghouses or payer portals. - Match payments accurately with billing entries and patient accounts. - Enter payments, denial codes, adjustments, and patient responsibility information with precision. - Review records for discrepancies and ensure all billing data is accurate and complete. - Maintain organized and up-to-date financial documentation. - Follow company standards for accuracy, compliance, and confidentiality. Qualifications - Experience using CentralReach (CR) is required. - Background in medical billing, ABA billing, or payment reconciliation preferred. - Strong understanding of EOBs, ERAs, denial codes, and insurance payment posting. - Exceptional attention to detail and commitment to accuracy. - Strong data entry and organizational skills. Requirements - Purely work-from-home. - Night Shift (EST). - Weekly pay.
Data Entry Specialist
Remote VANote: Due to the high volume of applications we receive, we regret that we are unable to provide individual feedback to all candidates. If you do not hear back from us within 4 weeks of your application, please assume that you have not been successful on this occasion. We genuinely appreciate your interest and wish you the best in your job search.
Role Description We are seeking detail-oriented and highly accurate CR-trained Data Entry Specialists to handle payment reconciliation within CentralReach. The ideal candidate has experience working with ABA billing processes, payment posting, and EOB/ERA verification. - Perform payment reconciliation manually or automatically within CentralReach. - Locate and verify corresponding EOBs/ERAs through clearinghouses or payer portals. - Match payments accurately with billing entries and patient accounts. - Enter payments, denial codes, adjustments, and patient responsibility information with precision. - Review records for discrepancies and ensure all billing data is accurate and complete. - Maintain organized and up-to-date financial documentation. - Follow company standards for accuracy, compliance, and confidentiality. Qualifications - Experience using CentralReach (CR) is required. - Background in medical billing, ABA billing, or payment reconciliation preferred. - Strong understanding of EOBs, ERAs, denial codes, and insurance payment posting. - Exceptional attention to detail and commitment to accuracy. - Strong data entry and organizational skills. Requirements - Purely work-from-home. - Night Shift (EST). - Weekly pay.

