Data Engineer
Location
United States
Posted
75 days ago
Salary
0
Seniority
Mid Level
Job Description
Data Engineer
New Iron
Role Description We need a highly technical Senior Data Engineer to build and optimize production ETL pipelines in a Databricks environment. Working within an agile Scrum team, you will take high-level table designs and SQL transformation sketches from the Data Modeling team and implement them into robust, production-grade systems using DBT. - Develop, deploy, and maintain robust data pipelines using DBT in a Databricks ecosystem. - Translate data models and preliminary SQL sketches into scalable production code. - Build and maintain DBT macros, libraries, and modular code. - Collaborate within a team-based Git workflow for version control and deployment. Qualifications - Deep, hands-on expertise with DBT and Databricks. - Advanced to expert-level SQL skills. - Strong experience with GitLab and modern team-based CI/CD development practices. - Strong foundational knowledge of Python. Requirements - Applicants must be authorized to work for any employer in the U.S. - Our client is unable to sponsor or take over sponsorship of an employment visa at this time. - Principals only.
Job Requirements
- Deep, hands-on expertise with DBT and Databricks.
- Advanced to expert-level SQL skills.
- Strong experience with GitLab and modern team-based CI/CD development practices.
- Strong foundational knowledge of Python.
- Applicants must be authorized to work for any employer in the U.S.
- Our client is unable to sponsor or take over sponsorship of an employment visa at this time.
- Principals only.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Senior Data Engineer
VeevaHeadquartered in Pleasanton, California, Veeva is a leading provider of cloud-based software and services for the life sciences industry. As an employer, Veeva
• Design and implement a scalable Lakehouse environment. Own the lifecycle of efficient storage, including schema evolution, partition transformation, and snapshot management. • Build and manage real-time and batch data ingestion pipelines using Kafka and Spark • Deploy, manage, and scale data workloads (such as Spark executors) using Kubernetes (EKS). • Develop complex ETL workflows. Optimize jobs for large-scale data processing focusing on memory management and shuffle optimization. • Manage and monitor end-to-end data lifecycles using orchestration tools • Write and tune high-performance queries against the Lakehouse. Implement optimization strategies, compaction, and data skipping to reduce latency and cloud costs
Microsoft Fabric Specialist / Data Warehouse Engineer
Apex CompaniesApex Companies is a nationally recognized environmental consulting and engineering firm committed to creating a safe, sustainable, and equitable future. Since its founding in 1988,
Are you highly motivated, hard-working, and seeking to join a growth-focused consulting & engineering firm? Are you looking for a company that will invest in your development and grow your professional skills? If so, consider a career with Apex! Powered by record sales, extraordinary client retention, strategic acquisitions, and an entrepreneurial spirit, Apex Companies is one of the fastest growing engineering and environmental consulting firms in the US. We were recently recognized by the Zweig Group as one of the fastest growing firms in the AEC industry. We take pride in providing our clients with exceptional service and have earned numerous awards for project excellence. We continue to grow, and we want you to grow with us. We are seeking a highly skilled Microsoft Fabric Specialist to join our data and analytics team. This role will focus on designing, implementing, and optimizing solutions within Microsoft Fabric, enabling seamless integration of data across the enterprise. You will play a key role in building scalable data pipelines, managing lakehouses, and leveraging Fabric’s unified analytics capabilities to deliver actionable insights. Your Responsibilities as a Microsoft Fabric Specialist / Data Warehouse Engineer: - Architect and implement Microsoft Fabric solutions for data integration, analytics, and governance. - Develop and maintain lakehouses, dataflows, and pipelines within Fabric. - Collaborate with business stakeholders to understand requirements and translate them into robust data models. - Optimize performance and ensure data security and compliance within the Fabric environment. - Stay current with Microsoft Fabric updates and best practices to drive innovation. What we're looking for: - Proven experience with Microsoft Fabric and related technologies (Data Factory, Synapse, Power BI). - Strongly preferred direct experience in the Civil or Environmental Engineering, or Construction industries - Direct experience required working with financial and accounting databases - Strong understanding of data architecture, ETL processes, and cloud-based analytics. - Proficiency in SQL, DAX, and data modeling. - Familiarity with Azure Data Services and governance frameworks. - Excellent problem-solving and communication skills. Preferred Skills - Experience with data lakehouse architecture and OneLake. - Knowledge of data security, compliance, and governance in cloud environments. - Background in business intelligence and data visualization. Why you'll love working for us: - Company-subsidized medical and dental. - Company-paid life, short, and long-term disability. - 401k match, tuition assistance, and more. - Cross-training and the ability to work on a variety of projects. - Performance-based bonuses or other incentives. - Working with the best and brightest in the industry. - 2,000+ employee national firm with 50+ locations across the US. Apex Job Title: Data Engineer 3 Req ID: 11274 Annual Expected Pay Range $80,000—$120,000 USD We believe in equality for all and celebrate the diversity and differences of our employees, customers, and communities. We do not discriminate based on gender, race or color, ethnicity or national origin, age, disability, religion, sexual orientation, gender identity or expression, veteran status, or any other applicable characteristics protected by law. Apex aims to make apexcos.com accessible to all users. If you have a disability or special need that requires accommodation to navigate our website or complete the application process, please contact Talent@apexcos.com or (301) 417-0200. Likewise, feel free to reach out to us if you would like to view or discuss Apex policy related to equal employment opportunity or have any related concerns. EO/AA/VEV/Disabled Employer TO ALL RECRUITMENT AGENCIES: Apex Companies does not accept unsolicited agency resumes. Please do not forward resumes for any of our job postings to our career’s sites, or to any employees of Apex Companies or affiliates. Apex Companies is not responsible for any fees related to unsolicited resumes.
Senior Technical Architect
o9 Solutions, Inc.The knowledge powered analytics, planning and learning platform for next-generation global enterprises.
Transforming the Future of Enterprise Planning At o9, our mission is to be the Most Value-Creating Platform for enterprises by transforming decision-making through our AI-first approach. By integrating siloed planning capabilities and capturing millions—even billions—in value leakage, we help businesses plan smarter and faster. This not only enhances operational efficiency but also reduces waste, leading to better outcomes for both businesses and the planet. Global leaders like Google, PepsiCo, Walmart, T-Mobile, AB InBev, and Starbucks trust o9 to optimize their supply chains. Senior Technical Architect needed by o9 Solutions, Inc. in Dallas TX [and various unanticipated locations throughout the U.S.; may work from home] to Work with Extract, Transform, and Load (ETL) and Informatica (ETL). Work on response and resolution of batch automation disruptions, in order to meet customer SLAs with accurate and on-time results. Work on validating, synthesizing, transforming customer data for planning, visibility, collaboration, and analytics using tools like SQL, SSIS, Excel, Hadoop, PySpark, Hive and SQLs. Review and analyze the data provided by the customer along with its technical/functional intent and interdependencies. Ensure smooth operations of cloud-based solution. Support continuous integration and continuous delivery processes. Collect, monitor and analyze systems performance data for improved performance. Create automated tasks with shell scripts including bash, PowerShell and python. Understand the data model including table structures, linkages, optimal designs, post-go-live for maintaining, debugging, and enhancing various planning use cases. Working on the technical design, data requirements gathering, making recommendations in case of inaccurate or missing data. Fine-tune performance at various levels, automate manual processes, establish checks and balances for sustained value delivery. Create and execute integration test-cases. Work on bugs/issues and track the progress of resolving issues using support tools. Work with creating and optimizing stored procedures. Work experience on planning applications like SAP, Oracle, e2open, Kinaxis, or JDA and provide Statistical Optimization. Understand Cloud platforms including GCP, AWS and AZURE. Work and deliver with minimal management oversight. Utilize SQL and leveraging ETL tools like Informatica for data transformation. Work with Python and Shell Scripting. Work on data automation through software tools using Python. Minimum Requirements: Requires a Bachelor’s degree, or foreign equivalent degree, in Computer Engineering, Information Technology or Computer Science and 5 years of progressive, post-baccalaureate experience in the job offered, or 5 years of progressive, post-baccalaureate experience in a related occupation working and delivering with minimal management oversight; utilizing SQL and leveraging ETL tools like Informatica for data transformation; working with Python and Shell Scripting; and working on data automation through software tools using Python. Apply at https://o9solutions.com/careers/ by selecting “Explore all jobs”, entering the requisition number, JR102281, selecting “Search”, opening the requisition, and clicking “Apply”. More about us… At o9, transparency and open communication are at the core of our culture. Collaboration thrives across all levels—hierarchy, distance, or function never limit innovation or teamwork. Beyond work, we encourage volunteering opportunities, social impact initiatives, and diverse cultural celebrations. With a $3.7 billion valuation and a global presence across Dallas, Amsterdam, Barcelona, Madrid, London, Paris, Tokyo, Seoul, and Munich, o9 is among the fastest-growing technology companies in the world. Through our aim10x vision, we are committed to AI-powered management, driving 10x improvements in enterprise decision-making. Our Enterprise Knowledge Graph enables businesses to anticipate risks, adapt to market shifts, and gain real-time visibility. By automating millions of decisions and reducing manual interventions by up to 90%, we empower enterprises to drive profitable growth, reduce inefficiencies, and create lasting value. o9 is an equal-opportunity employer that values diversity and inclusion. We welcome applicants from all backgrounds, ensuring a fair and unbiased hiring process. Join us as we continue our growth journey!
• Participarás en el diseño e implementación de arquitecturas de datos seguras, escalables y eficientes, utilizando tanto servicios de Google Cloud como soluciones Open Source. • Desarrollarás y optimizarás pipelines y transformaciones de datos en Python y SQL, trabajando con herramientas como BigQuery, Cloud Run o Dataflow. • Orquestarás procesos de datos mediante Cloud Scheduler, Google Cloud Workflows o Google Cloud Composer. • Formarás parte de proyectos de Machine Learning y analítica avanzada, automatizando la integración de datos procedentes de múltiples fuentes. • Contribuirás al mantenimiento y evolución de entornos Docker y Kubernetes, colaborando en la automatización de procesos de datos. • Participarás en proyectos innovadores y en el desarrollo de productos de datos con impacto real en negocio. • Colaborarás estrechamente con equipos de otras áreas para garantizar la usabilidad, eficiencia y calidad del dato.


