Job Closed

This listing is no longer active.

Cortex logo
Cortex

Cortex é a plataforma líder na América Latina em Go-to-Market Intelligence

Senior Data Engineer – Crawlers & Orchestration Specialist

EngineerEngineerFull TimeRemoteSeniorTeam 201-500Since 2003H1B SponsorCompany SiteLinkedIn

Location

Brazil

Posted

64 days ago

Salary

0

Seniority

Senior

Job Description

Senior Data Engineer – Crawlers & Orchestration Specialist

Cortex

• Develop and maintain high-performance, resilient crawlers/bots for large-scale data extraction. • Design and implement complex data pipelines using Databricks (Spark) for batch and streaming processing. • Ensure the health and reliability of data flows using advanced orchestration tools. • Manage and optimize resources within the AWS ecosystem to ensure scalability and cost efficiency. • Implement error-handling techniques, block-workarounds (proxies, captchas) and data quality validation for collected data.

Job Requirements

  • Deep proficiency in Python (focused on scraping libraries such as Scrapy, Playwright, Selenium, or Beautiful Soup).
  • Solid experience with Databricks and Apache Spark (PySpark).
  • Experience with services such as S3, Lambda, Glue, Athena, EC2, and EKS.
  • Advanced knowledge of orchestration tools such as Airflow, Dagster, or Prefect.
  • Experience with SQL and NoSQL databases, and an understanding of Data Lakehouses (Delta Lake).
  • Familiarity with Docker, Kubernetes, and CI/CD pipelines.

Benefits

  • Meal and food vouchers (Vale Refeição and Vale Alimentação).
  • Gympass/TotalPass.
  • Home-office allowance.
  • Health plan and Dental plan (dental optional).
  • Childcare assistance (up to the child’s 6th birthday).
  • Extended maternity, paternity, and adoptive leave (#todasasfamíliasimportam / #allfamiliesmatter).
  • Life insurance.
  • Birthday Day Off (one day off to take on your birthday or during your birthday month).
  • Family Day (one day off for parents to take between May and August and enjoy as they wish).
  • Mental Break (one full week off in December to rest and recharge).
  • Benefits according to current policy*

Related Categories

Related Job Pages

More Engineer Jobs

Full TimeRemoteTeam 1,001-5,000Since 2003H1B No Sponsor

The Process & Controls Engineer will support the design, optimization, and continuous improvement of production processes within the Proliant Dairy manufacturing sites. This role works cross functionally with operations, quality, maintenance, and corporate teams to increase throughput, reduce waste, improve product quality, reduce energy usage, and ensure regulatory compliance.JOB QUALIFICATIONS: Education and Experience Required: - Bachelor’s degree in Electrical Engineering, Food Engineering, Mechanical Engineering, or related discipline. - Minimum 2 years of experience in the food or beverage manufacturing environment, ideally dairy. - Strong understanding of unit operations: thermal processing, evaporation, drying, filtration, separation, pumping, CIP and sanitation. - Working knowledge of FDA/USDA regulations and food safety systems. - Proficiency in data analysis tools (Excel, Power BI, Minitab, or similar). - Familiarity with Allen-Bradley's ControlLogix 5000 programming software and/or Ignition. Preferred Experience: - Experience with Dairy processes, including evaporation, drying and membrane filtration (UF/RO/NF), or spray drying. - Lean/Six Sigma Green Belt or Black Belt certification. - Experience working in high-volume Dairy processing environments. - Familiarity with AutoCAD, or other process modeling tools. - Strong project management experience. This role may be fully remote when not traveling, with regular travel to company manufacturing sites (approximately 60%). Candidates located within driving distance of Melrose, MN or St Johns, MI are preferred. JOB DUTIES: Process Design and Optimization - Analyze, develop, and optimize unit operations such as evaporation, drying, filtration, membrane processing, and thermal treatment. - Conduct time, yield, and mass‑balance studies to identify inefficiencies and implement solutions. - Lead continuous improvement initiatives using Lean, Six Sigma, or similar methodologies. - Support capacity expansion projects by providing process calculations, equipment specifications, and line balancing. - Create, edit, and update Process Instrumentation Diagrams (P&IDs) in alignment with engineering and operational requirements. - Identify and implement process improvements that reduce energy consumption, improve thermal efficiency, and lower utility costs. Technical Leadership - Provide input and expertise for Dairy processing technologies, including equipment CIP, Process improvement via equipment optimization. - Collaborate with R&D to scale new products—from bench to pilot to full commercial scale. - Troubleshoot process deviations and performance bottlenecks. Data Performance and Analysis - Utilize statistical tools to track process KPIs such as yields, moisture, solids content, viscosity, and other key process metrics. - Interpret manufacturing data to make recommendations for efficiency improvement or quality enhancement. - Support implementation and refinement of MES/SCADA systems for process monitoring. Quality, Food, and Safety Compliance - Ensure all processes comply with HACCP, USDA, FDA, and SQF/BRC requirements. - Maintain documentation including process flow diagrams (PFDs), SOPs, and control plans. - Work with QA to resolve customer complaints, deviations, and audit findings. Project and Equipment Support - Assist with equipment evaluation, FAT/SAT testing, commissioning, and startup. - Manage small‑to‑medium capital projects, including scope, budget, timeline, and contractor coordination. JOB REQUIREMENTS: - Strong analytical and problem‑solving skills. - Ability to lead cross‑functional teams and influence without authority. - Excellent communication—both technical and operational. - Continuous improvement mindset with a focus on safety and quality. - Hands‑on, plant‑floor‑focused approach. - Ability to travel and work at company facilities for extended hours as needed. Expected travel at least 60%. - Ability to work independently with minimal supervision.

United States
Astreya logo

Lead AV Installation, Commissioning Engineer

Astreya

Astreya provides IT support services with a special focus on increasing productivity and employee satisfaction for its business clients. The company was founded in 2001 with a visi

Engineer64 days ago

• Working as Lead AV Engineer you will be a central part of a team delivering industry-leading audiovisual systems installations. • Onsite you will set the bar high, delivering your work to a meticulous standard. • Advising and closely coordinating with others, including the project manager, you will be part of the team delivering first-class installations in an economical and timely manner. • You will be responsible for managing a team of AV engineers onsite, assigning them tasks each day and reporting project progress to the project manager. • Provide end-to-end system lead engineering and commissioning and quality assurance on a wide range of integrated audiovisual and video conferencing technologies in both the corporate and public sectors. • Take ownership of the delivery of the AV systems integration and commissioning process, both on the projects you are assigned to and generally, analysing, documenting and implementing best practices for installation, commissioning and pre-commissioning work. • Install, commission and quality assure audio and audiovisual installations to an excellent standard. • Produce system configuration documentation and ensure fully operational audiovisual systems. • Perform quality assurance checks on installations and identify any issues that need resolving, and work in close collaboration with the AV integration team and the project manager to ensure they are resolved. • Responsible for fault finding and technical resolution during the commissioning phase, escalating to third parties where necessary. • Manage the installation team with onsite tasks and collaborate closely with the programmer, and in some cases the client, in order to establish and share the brief for the control systems. • Conduct off site testing and configuration. • Deliver system training to end users. • Perform maintenance visits, on-going technical support and provide advice and information to colleagues in the support team. • Review and update system schematics, cable schedules etc.; create O&M documentation and ‘as built’ versions of the technical documents for future internal reference. • The development of junior audiovisual engineers / trainee commissioning engineers. Feedback to systems design team regarding products and design, and any other lessons learned on a project.

California
$113.5K - $154.8K / year
CLEAResult logo

Energy Engineer I

CLEAResult

We change the way people use energy.™

Engineer64 days ago
Full TimeRemoteTeam 1,001-5,000Since 2003H1B Sponsor

• Supports the development and delivery of energy efficiency programs by providing engineering calculations, measurement and verification, and utility program technical design and assistance • Leads design and development of technical strategies, conducts analysis to inform and recommend energy savings, and develops plans and provides reporting that contributes to the success of client programs • Provides general project oversight, quality control/assurance, and continuously informs customers and project team of updates and necessary adjustments • Support energy assessments and field work directly with customers and contractors

Michigan
$65K - $75K / year
Job Closed
Global Payments Inc. logo

Core - GERM

Global Payments Inc.

Global Payments Inc. is an equal opportunity employer. Global Payments provides equal employment opportunities to all employees and applicants for employment without regard to race, color, religion, sex (including pregnancy), national origin, ancestry, age, marital status, sexual orientation, gender identity or expression, disability, veteran status, genetic information or any other basis protected by law. If you wish to request reasonable accommodations related to applying for employment or provide feedback about the accessibility of this website, please contact jobs@globalpayments.com.

Engineer64 days ago
Full TimeRemoteTeam 10,001+Since 2000H1B No Sponsor

Every day, Global Payments makes it possible for millions of people to move money between buyers and sellers using our payments solutions for credit, debit, prepaid and merchant services. Our worldwide team helps over 3 million companies, more than 1,300 financial institutions and over 600 million cardholders grow with confidence and achieve amazing results. We are driven by our passion for success and we are proud to deliver best-in-class payment technology and software solutions. Join our dynamic team and make your mark on the payments technology landscape of tomorrow. About Global Payments: Every day, Global Payments makes it possible for millions of people to move money between buyers and sellers through our innovative payment and software solutions. We’re a Fortune 500 company that combines cutting-edge technology with exceptional service to help businesses of every size grow and prosper. If you’re passionate about helping business owners thrive—and you love selling technology that transforms the way they run their operations—join our dynamic, growth-minded team. Together, we’ll shape the future of commerce. Job Summary: As an Outside Sales Executive, Payment Technology, you’ll be on the front lines helping small and mid-sized merchants modernize how they run their business through Genius®, our industry-leading Point of Sale and payment platform. You’ll manage the full sales cycle—from prospecting and lead generation to running demos, negotiating, and closing deals. You’ll work closely with your District Manager and sales leadership for coaching and support while driving your own success in a fast-paced, high-reward environment. This is a role for driven, tech-savvy sales professionals who want to make an impact—selling real solutions that help local businesses simplify operations, improve customer experience, and grow revenue. What You’ll Do: - Sell Genius® and other Global Payments solutions to small and mid-sized businesses across restaurant, retail, and service industries. - Develop and manage a consistent pipeline through field prospecting, digital outreach, and local networking. - Deliver consultative, value-based presentations both in-person and virtually to demonstrate how Genius® helps businesses streamline payments, improve operations, and increase customer loyalty. - Collaborate with your District Manager to identify new opportunities, set appointments, and close sales within a short cycle. - Maintain accurate pipeline and activity tracking in Atlas and Salesforce, including call notes, follow-ups, and client communications. - Upsell and cross-sell existing merchants on new features, software add-ons, and hardware upgrades. - Stay current on the fintech landscape, industry trends, and product updates to position yourself as a trusted technology advisor. What You Bring: - Proven success in B2B sales, preferably in SaaS, fintech, or merchant services. - Strong communication, presentation, and negotiation skills—comfortable selling both face-to-face and virtually. - High energy, self-motivated, and competitive—driven to exceed targets. - Professional presence and genuine ability to connect with business owners. - Familiarity with the restaurant or retail industries is a plus. - Valid driver’s license and ability to spend at least 75% of your time in the field. Minimum & Preferred Qualifications: - Must be 18 years or older. - High school diploma or GED required; college degree preferred. - Two or more years of relevant B2B sales experience. - Must live within the geographic area of the posting. Compensation: Annual On-Target Earnings (OTE): $100,000+ Base Salary: $40,000 Residual Income: Keep earning monthly from the accounts you build. Bonuses: Monthly and quarterly incentives for surpassing quota and achieving stretch goals. Annual Range: $100,000-$150,000 Your total compensation depends on your performance, skills, and territory—your success is in your hands. Benefits: Global Payments offers a comprehensive benefits package including medical, dental, and vision coverage, paid time off, retirement programs, charitable gift matching, and more. Learn more at Global Payments Benefits. Our Culture: We honor and celebrate the diversity of our team members and the communities we serve. Our commitment to inclusion, respect, and belonging drives everything we do. Diversity and EEO Statements: Global Payments is an organization that stands against racism, intolerance and injustice in all its forms — one that respects, honors and celebrates the diversity of our team members and the differences among us. Our commitment to fostering a company culture that values and respects Inclusion and Diversity is steadfast. Standing together as one company, we will continue to work to drive positive change for the communities in which we live and work and stamp out injustice. Global Payments Company provides equal employment opportunities to all employees and applicants for employment without regard to race, color, religion, sex (including pregnancy), national origin, ancestry, age, marital status, sexual orientation, gender identity or expression, disability, veteran status, genetic information or any other basis protected by law. Those applicants requiring reasonable accommodation to the application and/or interview process should notify a representative of the Human Resources Department. #JS1 #LI-remote Global Payments Inc. is an equal opportunity employer. Global Payments provides equal employment opportunities to all employees and applicants for employment without regard to race, color, religion, sex (including pregnancy), national origin, ancestry, age, marital status, sexual orientation, gender identity or expression, disability, veteran status, genetic information or any other basis protected by law. If you wish to request reasonable accommodations related to applying for employment or provide feedback about the accessibility of this website, please contact jobs@globalpay.com.

United States
$100K - $150K / year