Solve for today, evolve for tomorrow.
Lead Consultant Data Engineer
Location
United States
Posted
2 days ago
Salary
$138K - $185K / year
Seniority
Lead
Job Description
Lead Consultant Data Engineer
Excella
Role Description Lead Data Engineers at Excella play a key role in designing and building modern data solutions, including data lakes and cleansed data repositories. They develop robust, scalable, and sustainable data pipelines using batch and streaming technologies. Senior Data Engineers collaborate with cross-functional teams, including Architects, Data Scientists, and DevOps, to ensure data availability, quality, and integration. - Develop and manage data processes to ensure availability and usability. - Create and automate data pipelines and platforms. - Write clean, efficient, and well-documented code to support data engineering solutions. - Monitor and ensure data quality through automated testing frameworks. - Collaborate with Architects, Product Owners, Data Scientists, and DevOps to design, build, and maintain scalable data solutions. - Research data acquisition sources and evaluate suitability. - Integrate data management solutions into client environments. - Identify and mitigate risks to data while ensuring data recovery plans. - Build and maintain data repositories, including data warehouses, data lakes, and operational data stores. Qualifications - 8+ years of professional experience in data engineering or related fields. - Proven ability to build robust, scalable data pipelines and production-grade ETL/ELT systems. - Strong proficiency in SQL, Python, and orchestration tools like Airflow and dbt. - 2+ years of hands-on experience with Databricks, including development, data processing, and pipeline optimization in a cloud-based environment. - Hands-on experience with big data technologies such as Spark, Kafka, and file formats like Parquet, Delta Lake, and Iceberg. - Deep experience with AWS cloud data platforms (e.g., AWS Glue, S3, Redshift, EMR, BigQuery, or Azure equivalents). - Solid understanding of data modeling, performance optimization, and designing secure, well-structured data stores. - Familiarity with data lake and analytical architecture patterns, including Star Schema, schema-on-read, and data quality frameworks. - Experience with CI/CD, Git, infrastructure-as-code (e.g., Terraform), and NoSQL databases. - Effective communicator with experience working in Agile environments (Scrum/Kanban) and collaborating across technical and non-technical teams. - Strong problem-solving skills, a growth mindset, and a passion for learning new technologies. - One or more of the following certifications: - AWS Certified Machine Learning - Specialty - Data Science Council of America (DASCA) Certifications - Databricks Certified Machine Learning Associate - Databricks Certified Developer for Apache Spark - Databricks Certified Data Engineer Associate - Databricks Certified Data Engineer Professional - AWS Certified Data Analytics - Specialty - Python or Scala Programming Certification - Ability to hold and maintain a DHS Public Trust (requires US Citizenship). Requirements This range represents the minimum and maximum base salary that Excella reasonably and in good faith expects to pay for this role. Actual compensation within the range will depend on factors such as skills, experience, training, certifications, and organizational needs. It is not typical for an individual to be hired at or near the top or bottom of the range. Your pay also includes the opportunity for an annual bonus in addition to the base salary. This variable pay opportunity is dependent upon the attainment of shared firmwide goals and objectives as determined by Excella’s Executive Team. Certain eligibility and pro-ration rules apply. Should your experience and knowledge qualify you for a different position or title within Excella, we may consider you for positions that better align with your qualifications. In that case, we will provide the range for those positions as well. Pay Range $138,000 — $185,000 USD Benefits - Top of industry medical, dental, and vision benefits with multiple options. - 8 weeks of Parental Leave. - Discounted pet insurance. - Care.com membership with 3 back-up emergency child or elder care days annually. - 15 days of paid vacation, 6 federal holidays, and 4 floating holidays starting day one. - TechEleX program providing multiple options for technology needs. - Annual Internet Reimbursement benefit of $25 per month. - 3 days of paid professional development every year. - Mindfulness and overall well-being support through wellness events and mental health coverage. Company Description Excella is a transformative technology firm that helps organizations unlock new possibilities. We believe the key to helping clients challenge the status quo and reach new heights lies in our talented people. That’s why we’re committed to developing talent and providing opportunities for career growth at every stage. Join our collaborative team dedicated to solving complex problems with sustainable solutions while building your future as a leader. Workplace locations look different for everyone. Excellians are a distributed workforce and whether you're working from your home office or a client site, we support a flexible work/life integration regardless of your location. Excella is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, color, religion, national origin, disability, protected veteran status, age, or any other characteristic protected by law. Excella is committed to providing access, equal opportunity, and reasonable accommodation for individuals with disabilities in employment, its services, programs, and activities. To request reasonable accommodation to participate in the job application or interview process, contact Recruiting@excella.com or 703-840-8600.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
• Collaborate with clients to understand their data needs • Design and implement data pipelines using Snowflake • Build and maintain ETL/ELT processes • Optimize data storage and retrieval • Work with cross-functional teams to deliver data solutions
• Design, develop, and maintain robust data transformation pipelines using dbt (Data Build Tool) to implement version-controlled, tested, and documented data models. • Architect, manage, and optimize enterprise-scale data warehouses within Snowflake, ensuring optimal storage, compute sizing, clustering, and data sharing strategies. • Build scalable ingestion pipelines to extract data from various enterprise source systems (such as ERPs like SAP or Oracle, CRM platforms, and operational databases) and load it into Snowflake. • Troubleshoot and fine-tune complex SQL queries, dbt models, and Snowflake warehouse utilization to improve execution speeds and manage costs efficiently. • Establish rigorous data quality checks, testing frameworks (using dbt test configurations), and data monitoring patterns to ensure enterprise data reliability and lineage accuracy. • Implement and maintain best practices for modern data stack workflows, utilizing Git and CI/CD pipelines (e.g., GitHub Actions, GitLab CI) for seamless deployment of data models.
• Apoiar o desenvolvimento e evolução de iniciativas de plataforma de dados no Google Cloud Platform (GCP) • Trabalhar com serviços de dados do GCP, contribuindo para atividades de engenharia de dados e apoiando práticas de governança de dados quando aplicável
• Design, develop, and maintain scalable, secure, and reliable data pipelines using Databricks, Spark, and cloud-native technologies. • Build and optimize metadata-driven ETL/ELT pipelines. • Integrate data from multiple internal and external systems into analytics-ready datasets. • Support AI/ML and advanced analytics initiatives through high-quality data assets. • Implement data quality controls, monitoring, and validation frameworks. • Troubleshoot data pipeline failures and resolve production issues. • Optimize data processing performance and ensure operational reliability. • Collaborate with Data Science, Analytics, Product, and Engineering teams. • Develop curated datasets for reporting and visualization platforms such as Tableau and Power BI. • Provide technical mentorship and contribute to engineering best practices.



