Job Closed

This listing is no longer active.

Mindrift logo
Mindrift

Apply → Pass qualification(s) → Join a project → Complete tasks → Get paid. Project time expectations: Tasks are estimated to require around 10–20 hours per week during active phases, based on project requirements; This is an estimate, not a guaranteed workload, and applies only while the project is active. Note: Rates vary based on expertise, skills assessment, location, project needs, and other factors. Higher rates may be offered to highly specialized experts. Lower rates may apply during onboarding or non-core project phases. Payment details are shared per project.

Freelance Web Scraping Engineer (Vibe Coding)

Location

Alabama

Posted

88 days ago

Salary

0

Seniority

Mid Level

EnglishJavaScript

Job Description

Freelance Web Scraping Engineer (Vibe Coding)

Mindrift

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project (https://tendem.ai/) and drive specialized data scraping workflows within our hybrid AI + human system. In this role, as an AI Pilot – that’s how we refer to this role at Mindrift – you’ll collaborate with Tendem Agents that handle repetitive tasks, while you provide critical thinking, domain expertise, and quality control to deliver accurate and actionable results. This part-time remote opportunity is ideal for technical professionals with hands-on experience in web scraping, data extraction and processing. What we do The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe. About the Role This is a freelance role for a Tendem project. As a Vibe Code specialist, you'll handle data scraping tasks requiring technical precision for web extraction and processing, utilizing various tools such as our provided Apify and OpenRouter alongside your own resourceful approaches. Key Responsibilities - Own end-to-end data extraction workflows across complex websites, ensuring complete coverage, accuracy, and reliable delivery of structured datasets. - Leverage internal tools (Apify, OpenRouter) alongside custom workflows to accelerate data collection, validation, and task execution while meeting defined requirements. - Ensure reliable extraction from dynamic and interactive web sources, adapting approaches as needed to handle JavaScript-rendered content and changing site behavior. - Enforce data quality standards through validation checks, cross-source consistency controls, adherence to formatting specifications, and systematic verification prior to delivery. - Scale scraping operations for large datasets using efficient batching or parallelization, monitor failures, and maintain stability against minor site structure changes. Compensation On this project, contributors can earn up to $32 per hour equivalent, depending on their level and pace of contribution. Compensation varies across projects depending on scope, complexity, and required expertise. Please note that other projects on the platform may offer different earning levels based on their requirements. How to get started Simply apply to this post, qualify, and get the chance to contribute to projects that match your technical skills, on your own schedule. From coding and automation to fine-tuning AI outputs, you’ll play a key role in advancing AI capabilities and real-world applications.

Job Requirements

  • At least 1 year of relevant experience in data analysis, AI automation, data engineering, or software development is desirable.
  • Bachelor's or Master’s Degree in Engineering, Applied Mathematics, Computer Science, or related technical fields is a plus.
  • Python web scraping: Build reliable scraping scripts using BeautifulSoup, Selenium (or equivalents) for multi-level sites, dynamic JS content (infinite scroll, AJAX), and API endpoints via provided proxy.
  • Data extraction expertise: Navigate complex hierarchical structures (regions → companies → details), handling archived pages and varied HTML formats.
  • Data processing: Clean, normalize, and validate scraped data; deliver high-quality datasets in well-structured formats (CSV, JSON, Google Sheets) with clear, consistent presentation.
  • Hands-on experience with LLMs and AI frameworks to enhance automation and problem-solving.
  • Strong attention to detail and commitment to data accuracy.
  • Self-directed work ethic with ability to troubleshoot independently.
  • English proficiency: Upper-intermediate (B2) or above (required).

Benefits

  • Why this freelance opportunity might be a great fit for you?
  • Work fully remote on your own schedule with just a laptop and stable internet connection.
  • Gain hands-on experience in a unique hybrid environment where human expertise and AI agents collaborate seamlessly — a distinctive skill set in a rapidly growing field.
  • Participate in performance-based bonus programs that reward high-quality work and consistent delivery.

Related Categories

Related Job Pages

More Data Engineer Jobs

Mindrift logo

Freelance Web Scraping Engineer (Vibe Coding)

Mindrift

Apply → Pass qualification(s) → Join a project → Complete tasks → Get paid. Project time expectations: Tasks are estimated to require around 10–20 hours per week during active phases, based on project requirements; This is an estimate, not a guaranteed workload, and applies only while the project is active. Note: Rates vary based on expertise, skills assessment, location, project needs, and other factors. Higher rates may be offered to highly specialized experts. Lower rates may apply during onboarding or non-core project phases. Payment details are shared per project.

Data Engineer88 days ago

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project (https://tendem.ai/) and drive specialized data scraping workflows within our hybrid AI + human system. In this role, as an AI Pilot – that’s how we refer to this role at Mindrift – you’ll collaborate with Tendem Agents that handle repetitive tasks, while you provide critical thinking, domain expertise, and quality control to deliver accurate and actionable results. This part-time remote opportunity is ideal for technical professionals with hands-on experience in web scraping, data extraction and processing. What we do The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe. About the Role This is a freelance role for a Tendem project. As a Vibe Code specialist, you'll handle data scraping tasks requiring technical precision for web extraction and processing, utilizing various tools such as our provided Apify and OpenRouter alongside your own resourceful approaches. Key Responsibilities - Own end-to-end data extraction workflows across complex websites, ensuring complete coverage, accuracy, and reliable delivery of structured datasets. - Leverage internal tools (Apify, OpenRouter) alongside custom workflows to accelerate data collection, validation, and task execution while meeting defined requirements. - Ensure reliable extraction from dynamic and interactive web sources, adapting approaches as needed to handle JavaScript-rendered content and changing site behavior. - Enforce data quality standards through validation checks, cross-source consistency controls, adherence to formatting specifications, and systematic verification prior to delivery. - Scale scraping operations for large datasets using efficient batching or parallelization, monitor failures, and maintain stability against minor site structure changes. Compensation On this project, contributors can earn up to $32 per hour equivalent, depending on their level and pace of contribution. Compensation varies across projects depending on scope, complexity, and required expertise. Please note that other projects on the platform may offer different earning levels based on their requirements. How to get started Simply apply to this post, qualify, and get the chance to contribute to projects that match your technical skills, on your own schedule. From coding and automation to fine-tuning AI outputs, you’ll play a key role in advancing AI capabilities and real-world applications.

Arizona
Job Closed
Mindrift logo

Freelance Web Scraping Engineer (Vibe Coding)

Mindrift

Apply → Pass qualification(s) → Join a project → Complete tasks → Get paid. Project time expectations: Tasks are estimated to require around 10–20 hours per week during active phases, based on project requirements; This is an estimate, not a guaranteed workload, and applies only while the project is active. Note: Rates vary based on expertise, skills assessment, location, project needs, and other factors. Higher rates may be offered to highly specialized experts. Lower rates may apply during onboarding or non-core project phases. Payment details are shared per project.

Data Engineer88 days ago

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project (https://tendem.ai/) and drive specialized data scraping workflows within our hybrid AI + human system. In this role, as an AI Pilot – that’s how we refer to this role at Mindrift – you’ll collaborate with Tendem Agents that handle repetitive tasks, while you provide critical thinking, domain expertise, and quality control to deliver accurate and actionable results. This part-time remote opportunity is ideal for technical professionals with hands-on experience in web scraping, data extraction and processing. What we do The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe. About the Role This is a freelance role for a Tendem project. As a Vibe Code specialist, you'll handle data scraping tasks requiring technical precision for web extraction and processing, utilizing various tools such as our provided Apify and OpenRouter alongside your own resourceful approaches. Key Responsibilities - Own end-to-end data extraction workflows across complex websites, ensuring complete coverage, accuracy, and reliable delivery of structured datasets. - Leverage internal tools (Apify, OpenRouter) alongside custom workflows to accelerate data collection, validation, and task execution while meeting defined requirements. - Ensure reliable extraction from dynamic and interactive web sources, adapting approaches as needed to handle JavaScript-rendered content and changing site behavior. - Enforce data quality standards through validation checks, cross-source consistency controls, adherence to formatting specifications, and systematic verification prior to delivery. - Scale scraping operations for large datasets using efficient batching or parallelization, monitor failures, and maintain stability against minor site structure changes. Compensation On this project, contributors can earn up to $32 per hour equivalent, depending on their level and pace of contribution. Compensation varies across projects depending on scope, complexity, and required expertise. Please note that other projects on the platform may offer different earning levels based on their requirements. How to get started Simply apply to this post, qualify, and get the chance to contribute to projects that match your technical skills, on your own schedule. From coding and automation to fine-tuning AI outputs, you’ll play a key role in advancing AI capabilities and real-world applications.

United States
Job Closed
Radar logo

Senior / Staff Data Platform Engineer

Radar

Radar is the world's first Location OS: next-gen geofencing and maps infrastructure for developers and AI-enabled solutions for marketing, fraud, and operations teams, all in a single platform. Hundreds of enterprises, including DICK'S Sporting Goods, T-Mobile, Inspire Brands, and bet365, use Radar to engage their customers, protect their business, and optimize their operations across hundreds of millions of devices worldwide. Founded in 2016, Radar is headquartered in New York, NY. Radar has raised $85.5M from leading venture capital firms including Accel and Insight Partners.

Data Engineer88 days ago
OtherRemoteTeam 64Since 2016

About Radar Radar is the global leader in geolocation, with geofencing SDKs, maps APIs, and AI-enabled solutions for marketing, fraud, and operations teams. Why is Radar the best place to work? - We're trusted by some of the world's best companies, from high-growth startups to the Fortune 500. - We have incredible scale: We're processing over 1 billion API calls per day from hundreds of millions of devices. - We're well-resourced, and we've raised $85.5M from world-class investors, including Accel and Insight Partners. - We have a high-performance culture, with ambitious and entrepreneurial teammates in every role. - We recently moved into an amazing new office in Flatiron, Manhattan, NYC. - We were recently named a top 10 best place to work in NYC by Crain's. Despite our growth and scale, we're still just getting started. That's where you come in. About the role We're looking for a Data Platform Engineer to build out the next generation of our data platform . The ideal candidate has been a data platform engineer on a large system and is energized by deeply understanding customer pain points and opportunities related to our data platform. To date this has been a shared responsibility on our engineering team, but as we've grown to over 1 billion API calls per day (with lots of data exhaust into our data lake), we're hiring a Data Platform Engineering team to modernize and level up our data stack. This role can be either in our NYC HQ or remote in the US. How we work: Most of our engineering team are former technical co-founders or former Radar interns from schools like Waterloo and CMU. Most engineers at Radar fit one of two molds, technically: either Staff level expertise in one stack, or "Multi-Stack" at any level. We say "Multi-Stack" because "Full-Stack" has the connotation of "Frontend and Backend", but Radar Engineers might also work on Mobile or Data engineering. Not that you need to be an expert in all of those, but a desire to learn, jump around to different stacks, and get things done is the important part. We care a lot about shipping fast and talking to customers. We're committed to our product vision of full-stack location infrastructure, but we also know that customer feedback is a treasure map to gold. Even though Slack is the brain of our company, working together in-person in our NYC HQ is the fastest way for us to get things done. We meet on Mondays to plan out work for the week in small groups and use Linear for planning. All projects are run by an Engineering lead, an executive and a Go-to-Market lead. Engineers figure out what to build, talk to customers, talk to prospects, help close them, get them live and make them successful. One of our most important company values is "Walk a mile," as in walking a mile in the customer's shoes, but also as in literally walking a mile, getting up from your desk and developing a deep understanding of how location services behave in the real world. To us, a week is a long time, and we expect to ship big things every week. The stack: - Our data stack includes Kinesis, S3, Athena, Terraform, Airflow, Parquet, Metabase, Python, Redis, MongoDB, and Kubernetes. - Our primary languages are TypeScript, Rust, and Python. - Most engineers are in the on-call rotation. - We sponsor OpenStreetMaps, MapLibre, and OpenAddresses. How we use AI: - Engineers choose what AI tools they use, Claude being the most popular. - We're actively building Claude skills - for example we've taught it how to debug HorizonDB, our geospatial database. - All code changes are reviewed by an Engineer knowledgeable in that area. Claude and Copilot also review all PRs. - There is a range of how much engineers use AI. Most use it daily if not weekly. - We are excited about what AI can do, but we also recognize the risks and don't compromise our coding standards. The hiring process: After a call with our Technical Recruiter, you'll do several technical Zoom calls with members of our engineering team: code screen, coding round, and system design round. If those go well we'll invite you to our NYC HQ for a final round interview. You'll meet one of our co-founders, someone from outside engineering, and meet more people from Radar. We'll go into more depth about how we work to see if there is a match. What you’ll do: - Work on core Radar data infrastructure built with Kinesis, S3, Athena, Terraform, Airflow, Parquet, Metabase, Python, Redis, and Mongo (some of these need to be replaced - you'll help figure out what that looks like) - Improve our current data platform via incremental improvements and deploying next generation infra to level up our stack. - Talk to Radar customers and prospects, hear their feedback, incorporate it into your work and make them successful You should: - Have experience building data infrastructure - Besides experience with some of our current data stack, have experience with several of Snowflake, Clickhouse, Databricks, Dynamo and dbt or similar tools - Are interested in talking to customers or prospects and making them successful - Are deeply curious about how things work, and have the tenacity to sit with hard problems and power through them Bonus points if you: - Are a former technical co-founder - Have experience building end-to-end customer facing analytics, real-time streaming solutions, leveraging cold and hot storage to achieve product goals You’ll work with: - Tim Julien, CTO - Our customers and prospects - Our Customer Success, Sales Engineering, and Sales teams What we offer: - Competitive salary - Meaningful stock options in a fast-growing company - 401(k) plan with 4% match - New HQ in Flatiron, NYC - Top-notch equipment - Catered lunches - Unlimited PTO - Health, dental, and vision insurance with 100% coverage for employees - 12 weeks of paid parental leave - Commuter and fitness benefits Compensation: For candidates based in the United States, the base salary range for this full-time position is between $200,000 - $300,000/year with an opportunity for performance bonuses and incentives. In addition to cash compensation, Radar offers full-time employees stock option grants under its equity plan. This is a meaningful ownership stake in the company we provide to our employees as we build a category-defining company. Our salary ranges are determined by role, level, and location. The range displayed on this job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations. Your exact offer may vary based on market location, job-related skills, experience, and relevant education or training. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender, gender identity or expression, or veteran status. We are proud to be an equal opportunity workplace.

New York
$150K - $250K / year
TaskUs logo

Associate Data Engineer

TaskUs

Digital Customer Experience. Trust & Safety. AI Services.

Data Engineer88 days ago
Full TimeRemoteTeam 10,001+Since 2008H1B Sponsor

• Create new data pipelines, database architectures and ETL processes • Observe and suggest go-to methodology • Gather requirements, perform vendor and product evaluations, deliver solutions, training, and documentation • Handle design and development, tuning, deployment, and maintenance of information, advanced data analytics, and physical data persistence technologies • Establish analytic environments for structured, semi-structured and unstructured data • Implement business requirements and processes, build ETL configurations, create pipelines for Data Warehouse • Research new technologies and build proofs-of-concept • Build and maintain extract-transform-load (ETL) and/or extract-load-transform (ELT) processes for DW and Data Lake • Perform monitoring, tuning, and database performance analysis • Design and extend data marts, metadata, and data models • Ensure all data warehouse architecture codes are maintained in a version control system

Colombia
Job Closed