Palta logo
Palta

Health & well-being tech company led by entrepreneurs on a mission to create a positive impact globally.

Senior Data Engineer

Data EngineerData EngineerFull TimeRemoteSeniorTeam 501-1,000Since 2016H1B No SponsorCompany SiteLinkedIn

Location

Georgia

Posted

2 days ago

Salary

0

Seniority

Senior

Bachelor Degree5 yrs expEnglishAWSCloudDistributed SystemsPythonSQLTerraform

Job Description

Senior Data Engineer

Palta

• Design, build, and maintain streaming pipelines. • Develop custom ingestion pipelines from third-party APIs, webhooks, and SDKs. • Migrate existing data ingestion pipelines from SaaS tools to our own infrastructure. • Deliver data to the raw layer of our Snowflake warehouse with schema consistency, idempotency, and resilience to malformed or late data. • Evolve the existing AWS streaming stack (Kinesis, SQS, Lambda, API Gateway), improving cost efficiency, observability, and resilience. • Maintain infrastructure as code (Terraform) for ingestion and processing resources. • Monitor pipelines, troubleshoot, and resolve incidents. • Contribute to our ongoing work on safe data access for AI agents and tooling. • Continuously improve ingestion architecture, tooling, and engineering practices.

Job Requirements

  • 5+ years of commercial Python experience in a backend or data engineering role.
  • Solid understanding of distributed systems architecture, including load balancing, sharding, and trade-offs between synchronous and asynchronous processing.
  • Hands-on experience with cloud services, preferably AWS (Lambda, API Gateway, containers in ECS/EKS).
  • Experience building streaming pipelines (Kinesis, SQS, or equivalents).
  • Experience with infrastructure as code (Terraform or equivalents).
  • Working knowledge of SQL: ability to read and write queries, including joins and window functions.
  • Commercial experience with real-world production data: ability to design systems that gracefully handle messy, duplicated, delayed, or malformed input.
  • Solid understanding of how data flows through production systems, including the ability to anticipate and prevent downstream issues.
  • Operational mindset: comfortable owning production systems and monitoring them.
  • Ability to make architectural decisions independently and review the work of teammates.

Benefits

  • Open-minded teams, a welcoming and inclusive company culture, plus the opportunity to make a real difference with a game-changing health tech product.
  • A competitive salary package based on your unique expertise, skillset, and impact on the product plus stock options.
  • In-office, remote and hybrid work opportunities.
  • The equipment whatever you need to be happy and productive.
  • A premium SIMPLE subscription.
  • 21 days annual leave, plus bank holidays (those observed where you live).
  • Flexible hours. We focus on your results, not how long you spend at your desk.

Related Categories

Related Job Pages

More Data Engineer Jobs

ContractRemoteTeam 11-50

Role Description Forest Data Technicians primarily assist with forest cruise photo processing - the organization and digitization of photosets taken by our cruisers from the field. The Forest Data Technician will work closely with the Quality Assurance Coordinator to process data and produce deliverables under supervision from the Data Manager. This position is ideal for those with a flexible schedule, part-time or full-time students, or those seeking a secondary income. - Must commit 5-20 hours per week. - Comfortable with fluctuating hours (some weeks 15+ hours, some weeks 0 hours). Qualifications - Hold a high school degree or higher, with an interest in the environment. - The ability to identify tree species within your region. - Competency in the use of computers and reliable high-speed internet. - Great written and oral communication skills and time management. - Can take directions and work independently. - Able to maintain a high level of professionalism and discretion with project deliverables. - Can work effectively with team members in different time zones. Requirements - Part time, hourly contractor role (5-20hrs/wk). - Remote (must live in desired region within the US). - Starting pay ranges between $15-$18 per hour. - Hours are seasonal and dependent on when we have cruisers in the field. - More work is available in summer and fall, with winter being typically very slow (sometimes no work during given weeks if no field data is collected). Benefits - Practical experience in the rapidly growing sector of carbon credits for ecosystem services. - Flexible hours and an open work environment. - Proven commitment to mentoring early-career employees. - Networking and long-term employment opportunities.

United States
$15 - $18 / hour

Data Warehouse Developer

Universities of Wisconsin

Universities of Wisconsin is a premier public higher education system headquartered in Madison, Wisconsin, serving more than 164,000 students across 13 campuses

Data Engineer3 days ago

• Assist in the design, build, testing, deployment, and production support of core data warehouse and analytics solutions • Perform initial data exploration steps such as profiling, understanding data quality, binning, pivoting, and summarizing • Consult with data SMEs to understand and address data quality issues • Support the design, build, test, and deployment of data warehouse solutions • Provide modeling analysis and develop data models according to specifications and standards • Support the data cleaning, integration, and transformation of data according to the defined target data model

Wisconsin
$70K / year

Data Architect

Peoplebank

Peoplebank provides comprehensive IT and digital recruitment services for both talent and clients, offering a range of contract staffing, permanent placements,

Data Engineer3 days ago

Lead architectural evolution of the data platform, optimize data lake architecture for performance and governance, and establish foundational data management capabilities to support advanced analytics and data science initiatives.

Australia
Forbes Advisor logo

Data Engineer – L2

Forbes Advisor

Money advice, news and reviews from a name you trust. Navigating your financial decisions starts here.

Data Engineer3 days ago
Full TimeRemoteTeam 201-500Since 1917H1B No Sponsor

• Build and maintain data ingestion pipelines from APIs and other data sources • Write efficient Python and SQL for data transformation and processing • Support ETL/ELT workflows, microservices and ensure timely data availability • Troubleshoot pipeline failures and assist in performance improvements • Assist in ingestion and modeling of data from Meta Ads and similar platforms • Help create datasets for campaign performance reporting and lead funnel tracking • Work with marketing and analytics teams to understand data requirements • Help translate business needs into data queries and datasets • Implement basic data validation checks • Monitor pipelines and resolve data issues • Maintain documentation for pipelines and datasets

India