We deliver Growth Invention for the world's most ambitious companies.
Principal, Data Engineer
Location
United States
Posted
86 days ago
Salary
$105K - $160K / year
Seniority
Lead
Job Description
Principal, Data Engineer
DEPT®
Role Description We are looking for a well-rounded, flexible Data Engineer with an interest in translating business goals into concrete solutions. You’ve been part of more than one team, you’ve demonstrated initiative on most of your projects, and you can tell us in technical detail what you did to help. Ideally you’ve worked with at least one devops team, and in at least one flavor of agile. If you haven’t we won’t hold that against you. At DEPT®, we pride ourselves on our pragmatic, engineering approach to making data work for the business. Qualifications - Expertise across multiple technical and functional domains to identify and execute optimal technical solutions. - Ability to understand design decisions and articulate the tradeoffs made. - Aware of industry trends and how they affect our work, introducing new ideas into current workflows. - Offer advice and opinions for technical decisions affecting multiple clients/projects or the entire company. - Communicate context, recommendations, and rationale to relevant internal and/or external stakeholders. - Demonstrate the ability to question and ensure that work maximizes client value delivery. - Synthesize input from various team members to drive to a solution. Requirements - 7+ years of experience in several of the following: - Pipeline management tools like Airflow or Luigi, and/or enterprise ETL tools like Informatica, SSIS, or Datastage. - Scripting languages like Python, Ruby. - Compiled languages like Java, Scala, C++. - Database Management Systems like Databricks, BigQuery, Snowflake, PostgreSQL, mySQL, Oracle, MS SQL Server, Redshift, MongoDB. - Experience with Scala, Kafka, and MongoDB is a plus. - Experience working in cloud environments (AWS or GCP) is a plus. - Experience with Unix-based OSes is a plus. - 5+ years of discovery and assessment of a client’s portfolio, tools, and applications. - 3+ years of professional software and consulting experience. - Experience managing smaller project teams. - Experience with data governance, observability, and quality frameworks. - Ability to take a project from RFP/SOW/BRD to delivery: project management, requirements gathering, data architecture, workflow management, quality assurance, reporting and visualization, presentation. - Interest in mentoring junior colleagues on process, analysis, deliverables, client. Benefits - Healthcare, Dental, and Vision coverage. - 401k plan, plus matching. - PTO. - Paid Company Holidays. - Parental Leave. Company Description DEPT® is a Growth Invention company built to help the world’s most ambitious brands grow faster. Operating at the intersection of technology and marketing, our 4,000+ specialists deliver growth invention across Brand & Media, Experience, Commerce, CRM, and Technology & Data. We’re 50|50 tech and marketing, partner-led, and first to move. Clients include Google, Lufthansa, Coach, eBay, and OpenAI.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
• Data Collection: Collect data from various internal and external sources, following established procedures and proposing process improvements when necessary. • Data Preparation: Perform data cleaning, transformation, and integration tasks, ensuring data quality and consistency with minimal supervision. • Project Support: Collaborate with team members on development and maintenance of data pipelines, taking on larger responsibilities and leading small subprojects. • Process Documentation: Contribute significantly to documentation of data engineering processes, recording procedures and workflows and ensuring they stay up to date. • Exploratory Data Analysis: Conduct initial data analyses to identify patterns, trends, and business-relevant insights with greater autonomy. • Query Support: Execute more complex SQL queries and extract information from relational databases, providing technical support to the team. • Quality Monitoring: Proactively monitor data quality, identify and resolve issues or inconsistencies, and suggest improvements to quality control practices. • Continuous Learning: Participate in and contribute to training and development programs, as well as mentor junior team members. • Cross-functional Collaboration: Work effectively with other departments to ensure proper integration of data into solutions and systems, contributing specialized knowledge. • Meeting Deadlines: Manage your tasks and ensure they are completed within established deadlines, proactively communicating any challenges or obstacles to team leadership.
Visual Data Collector (Freelance)
RAY AISelection is rigorous. Standards are high. If that sounds right for you -> apply.
Project: Real-World Image Capture for AI Model Training Location: Remote / Field-Based Engagement Type: Freelance, On-Demand (Client-Driven Volume) Compensation: Pay-Per-Series About the Role We are looking for reliable, detail-oriented individuals to join our global network of Visual Data Collectors supporting AI model training. This role does not require professional photography experience. Instead, success in this position depends on your ability to follow detailed instructions precisely and capture authentic, real-world moments that reflect everyday life. Your contributions will help train AI systems to better understand lighting, perspective, depth, and environmental context using real, unedited imagery. How the Work Operates - On-Demand Projects: Work availability is based on client demand. Some periods may have higher volume than others. - Flexible Schedule: When projects are active, you work on your own schedule, provided deadlines are met. - Output-Based: Compensation is strictly tied to approved deliverables, not time spent. Scope of Work You will create photographic Series, each representing one real-world scenario. What is a Series? - One scenario captured through 5–6 required photos - Examples include: someone drinking coffee, fixing a light, walking in a park, or a family picnic - Images must look natural and unstaged Important Notes - Photos do not need to be artistic or complex - Accuracy, clarity, and realism are essential - All images must strictly follow provided technical and content guidelines Key Responsibilities - Capture authentic, believable real-life scenarios - Ensure correct focus, lighting, and environmental consistency - Organize and label images according to required metadata standards - Submit completed series via Google Drive - Obtain signed indemnity forms for all human subjects (template provided) - Avoid visible logos, brand names, or copyrighted materials Requirements - Equipment: Smartphone or digital camera capable of at least 7 MP images - Reliability: Ability to follow instructions exactly—near-correct data cannot be used - No Editing: Images must be raw; no filters, retouching, or AI tools permitted - Access: Ability to shoot in varied environments (home, streets, parks, cafés, etc.) - Compliance: Willingness to adhere strictly to ethical and legal data-collection standards Compensation & Payment Terms - Base Rate: $3.50 per approved Series (each Series = 5–6 photos of one scenario) - Pay-Per-Output: Payment is issued only for submissions that fully meet quality and guideline requirements - Efficiency Potential: Contributors who optimize their workflow may earn the equivalent of up to $28/hour based on approved output (not guaranteed) - Volume Incentives: Higher rates or bonuses may be offered to contributors who consistently submit 100+ approved series - No Fees: We do not charge applicants or contributors any fees at any stage Next Steps If you have: - A smartphone or camera - Access to everyday environments - Strong attention to detail - The ability to follow detailed instructions We encourage you to apply. Selected applicants will receive full documentation outlining file specifications, metadata requirements, and submission workflows.
Data Program Lead
Creative Information Technology, Inc.Creative Information Technology Inc (CITI) is an esteemed IT enterprise renowned for its exceptional customer service and innovation. We serve both government and commercial sectors, offering a range of solutions such as: Healthcare IT Human Services Identity Credentialing Cloud Computing Big Data Analytics With clients in the US and abroad, we hold key contract vehicles including: GSA IT Schedule 70 NIH CIO-SP3 GSA Alliant DHS-Eagle II Join us in driving growth and seizing new business opportunities. Preferred Qualification Prior experience working with public health agencies (e.g., CDC, NIH, or State Departments of Health) to modernize legacy data infrastructures.
Role Description - Select and manage a team of data modernization and informatics staff - Lead the team’s strategic planning and implementation process - Manage data infrastructure to improve data integration, enhance interoperability, assure effective data governance, and support the development of reporting and visualizations - Ensure modernization efforts achieve: - Improved timeliness and quality of data - Better coordination of data activities and systems - Reduction of data burden - Integration of emerging and open-source technologies where possible - Coordinate with experts across the agency to assess the agency data environment and identify improvements required for the development of an effective data warehouse and data integration strategy Qualifications - Ten (10) plus years professional experience in health or related data or systems management Requirements - Master’s degree in public health, health informatics, data science, or other related field (preferred) - Prior experience working with public health agencies (e.g., CDC, NIH, or State Departments of Health) to modernize legacy data infrastructures (preferred) Company Description Creative Information Technology Inc (CITI) is an esteemed IT enterprise renowned for its exceptional customer service and innovation. We serve both government and commercial sectors, offering a range of solutions such as Healthcare IT, Human Services, Identity Credentialing, Cloud Computing, and Big Data Analytics. With clients in the US and abroad, we hold key contract vehicles including GSA IT Schedule 70, NIH CIO-SP3, GSA Alliant, and DHS-Eagle II.
Data Engineer – Level III
AttainX, Inc.SBA Certified 8(a), EDWOSB/WOSB and CMMI L3, ISO 9001:2015 Certified QMS
• Architect, lead and optimize large-scale ETL/ELT pipelines using PySpark, Python, Spark SQL and Databricks to support advanced analytics, fraud detection and inter-agency data sharing. • Implement enterprise-grade monitoring, observability and data quality frameworks, including automated validation, anomaly detection and SLA-driven alerting. • Develop and tune review complex SQL for large datasets, distributed compute environments and mission-critical analytical workloads. • Build automated ingestion frameworks for APIs, flat files, RDBMS sources and streaming feeds, ensuring lineage, auditability and compliance with Department of Homeland Security (DHS) and federal data governance standards. • Design and govern data lakehouse architectures, including Delta Lake, medallion (bronze/silver/gold) patterns, schema evolution and performance optimization. • Lead exploratory data analysis to identify operational trends, anomalies and mission-impacting insights across large, federated datasets. • Build and maintain analytics products, dashboards and reporting solutions using Databricks SQL, Tableau, Power BI and SSRS. • Support machine learning and entity resolution initiatives through feature engineering, data preparation and scalable data services. • Translate ambiguous business problems into structured analytical frameworks, delivering executive-ready visualizations, technical briefs and data-driven recommendations. • Serve as a technical subject matter expert (SME) and engineering lead across multi-disciplinary teams including data scientists, program analysts, cybersecurity and IT operations. • Provide mentorship, code reviews and architectural guidance to engineering teams across multiple programs. • Lead requirements analysis, system design, integration and modernization efforts for enterprise systems supporting operations and high-security missions.



