Job Closed
This listing is no longer active.
Senior Data Engineer
Location
United States
Posted
78 days ago
Salary
$2 - $96 / hour
Seniority
Senior
Job Description
Senior Data Engineer
aKube Inc
Role Description - Design and build scalable data pipelines for large datasets - Develop batch and real-time data processing solutions - Work with Databricks, Snowflake, and Redshift for data platforms - Optimize SQL queries and improve data performance - Build and maintain workflows using Airflow or DBT - Ensure data quality, reliability, and governance - Partner with data scientists to deploy ML models - Collaborate with teams to translate business needs into data solutions Qualifications - 7+ years of data engineering experience - Strong experience with AWS data services - Hands-on coding in Python and SQL - Experience with distributed data systems and big data tools - Experience building enterprise-scale data platforms Requirements - Databricks - Snowflake - Redshift - AWS (S3, Glue, Lambda) - Advanced SQL (performance tuning) - Python - Airflow or DBT Benefits - Max rate is $96/hr on C2C or $89/hr on W2 - Remote work option - Duration: 12 months - Work authorization: GC, USC, All valid EADs except H1B, OPT, CPT Nice to Have - Monte Carlo (data observability) - Atlan (data catalog) - CI/CD (GitHub Actions or Jenkins) - Experience with ML or statistical modeling
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
• Design, develop, and deploy large scale data processing pipelines, both batch and streaming, using technologies such as Dataflow, Apache Beam, Spark, Akka, Pub/Sub. • Expertise with multiple data storage technologies such as Bigtable/HBase, BigQuery, Spanner, CloudSQL/Postgres. • Work with stakeholders to understand business problems, develop use-cases, and translate them into pragmatic and effective technical solutions. • Design and develop appropriate schema for data based on understanding of the domain problem. • Manage data lineage and ensure data security with appropriate tools and methodologies. • Collaborate with data scientists, architects, and other stakeholders to ensure alignment between technical and business strategy. • Continuously monitor, refine and report on the performance of data management systems. • Mentor junior data engineers, reviewing their outputs and directing their professional development.
• Be a data champion and seek to empower others to leverage the data to its full potential • Architect and own our data platform strategy, with a deep understanding of our complex data ecosystem • Lead the design and implementation of scalable data infrastructure that powers both internal and external products • Partner with Product to translate business requirements for data across the company into a technical roadmap and architecture for the platform • Create and maintain data engineering best practices and mentor teams in building robust, observable pipelines • Assemble large, complex data sets that meet functional / non-functional business requirements • Build the infrastructure required for optimal extraction, transformation, and loading of data from various data sources. • Work with Executive, Clinical, Data, and Design teams, to assist with data-related technical issues and support their data infrastructure needs • Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader
• Integración y modelamiento de datos • Diseñar e implementar pipelines de ingesta y transformación de nuevas fuentes de datos (batch y/o near real-time). • Integrar fuentes internas y externas al modelo de Customer 360, asegurando consistencia con los contextos definidos. • Modelar y estructurar datos para su uso en APIs y analytics . • Construcción y mantenimiento de subproductos analíticos basados en contextos (ej: segmentaciones, features, modelos). • Habilitar datasets listos para consumo por equipos de negocio, analytics y data science. • Colaborar en la definición de nuevos casos de uso basados en datos de cliente. • Implementar controles de calidad, validaciones y monitoreo de pipelines. • Asegurar trazabilidad, documentación y buenas prácticas de data governance. • Optimizar pipelines para performance, costo y escalabilidad. • Trabajar de forma cercana con equipos de negocio, analytics, backend y producto. • Participar en el diseño de nuevos contextos y definición de requerimientos de datos. • Contribuir a la mejora continua de la arquitectura y estándares del equipo.
Senior Data Pipeline Engineer
CrowdStrikeCrowdStrike has redefined security with the world’s most advanced cloud-native platform that protects and enables the people, processes and technologies that drive modern enterprise. Tested and proven, the world's largest organizations trust CrowdStrike to stop breaches with unparalleled protection against the most sophisticated cyberattacks. The CrowdStrike culture has been built upon our Core Values since the day we began. We are Fanatical About the Customer, Relentlessly Focused on Innovation and believe that our Limitless Passion drives Unlimited Potential for every CrowdStriker. As a purpose-built remote-first company, we believe cultivating a connected culture for every employee, no matter where they are in the world, is a key ingredient in building a high-performing, diverse team. We don’t have a mission statement. We’re on a mission—to stop breaches. Ready to join a mission that matters?
• Collaborate with a global team of data engineers, fostering coordination across time zones and driving operational excellence • Architect and oversee large-scale data ingestion and transformation pipelines using Airflow, DBT, Python, Kafka streaming, and Snowflake • Design and implement real-time and batch ingestion frameworks integrating data from various business systems and APIs • Manage data integration and transformation from enterprise systems such as Salesforce (SFDC), NetSuite, Workday, and other core business applications • Drive data quality, observability and reliability across pipelines through monitoring, alerting, and proactive issue resolution • Collaborate with data science and product teams to support AI assistance bot integration, AI/ML workflows, and product telemetry analytics • Ensure engineering excellence by aligning data practices with DevOps principles, CI/CD automation, and robust data governance standards • Oversee multiple projects simultaneously, managing priorities, and delivery timelines in a dynamic, high-velocity environment • Communicate effectively with business and technical stakeholders to align data engineering initiatives with strategic organizational goals



