This opportunity is available through a leading AI-driven work platform.
Data Infrastructure Evaluation Engineer
Location
United States
Posted
4 days ago
Salary
$90 / hour
Seniority
Mid Level
Job Description
Data Infrastructure Evaluation Engineer
24-MAG
Role Description We are sharing a specialised remote consulting opportunity for experienced data engineers with strong coding agent experience, practical data infrastructure judgment, and the ability to evaluate complex data engineering implementations across realistic technical scenarios. This role supports current and upcoming remote consulting opportunities focused on data engineering evaluation, coding-agent-assisted technical workflows, pipeline assessment, data platform review, and distributed data system analysis. Selected professionals may use tools such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or comparable coding agents to complete, review, and evaluate data engineering tasks involving ETL pipelines, data warehouses, analytics platforms, distributed systems, and large-scale data infrastructure. Key Responsibilities - Data Engineering Evaluation - Use modern coding agents to complete and evaluate complex data engineering tasks - Review generated implementations involving ETL pipelines, data warehouses, analytics platforms, and distributed data systems - Assess technical outputs for correctness, scalability, maintainability, reliability, and production-readiness - Apply professional data engineering judgment to realistic infrastructure and pipeline scenarios - Pipeline & Data Platform Review - Evaluate pipeline architecture, data transformation logic, ingestion workflows, orchestration patterns, and data quality checks - Review data warehouse and analytics platform implementations for performance, accuracy, structure, and maintainability - Identify bugs, edge cases, scalability issues, failure modes, and weak assumptions in data engineering outputs - Provide structured feedback on data flow, system design, reliability, and implementation quality - Coding Agent Output Assessment - Compare outputs from multiple coding agents and assess their strengths, weaknesses, accuracy, and practical usefulness - Identify where generated solutions succeed, where they fail, and where additional engineering judgment is required - Evaluate whether generated data infrastructure reflects real-world data engineering standards - Document technical review findings clearly for project teams and quality evaluation workflows - Technical Documentation & Feedback - Produce clear, structured evaluations of data engineering tasks and generated outputs - Explain reasoning around pipeline design, data modelling, warehouse architecture, distributed systems, scalability, and failure handling - Support technical assessment workflows by documenting accepted work, improvement areas, and practical engineering conclusions - Help ensure outputs reflect production-scale data engineering expectations Qualifications - 2+ years of professional data engineering experience - Hands-on experience building ETL pipelines, data warehouses, analytics platforms, distributed data systems, or large-scale data infrastructure - Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or comparable tools - Ability to evaluate generated data infrastructure and pipeline implementations for correctness, scalability, and reliability - Experience supporting large-scale data platforms is strongly preferred - Strong understanding of data modelling, data quality, orchestration, distributed processing, warehouse design, and pipeline maintainability - Clear written communication skills and comfort documenting technical reasoning in a remote, project-based environment Educational Background - A degree in Computer Science, Data Engineering, Software Engineering, Computer Engineering, Information Systems, Statistics, or a related technical field is helpful - Equivalent professional experience in data engineering, analytics engineering, distributed systems, or production data platforms is also highly relevant Nice to Have - Experience with Python, SQL, Spark, Airflow, dbt, Kafka, Flink, Snowflake, BigQuery, Redshift, Databricks, or comparable data tools - Familiarity with cloud data platforms, data lakehouse architecture, orchestration systems, batch processing, streaming pipelines, or data quality frameworks - Experience with CI/CD workflows, Docker, Kubernetes, Terraform, observability tooling, or infrastructure automation in data environments - Background in technical code review, data architecture review, pipeline performance evaluation, or large-scale analytics systems - Strong comfort working in sprint-based project environments with focused technical assessment windows Why This Opportunity - Remote consulting work aligned with data engineering, coding agent, and technical evaluation expertise - Opportunity to evaluate realistic data engineering workflows involving ETL pipelines, data warehouses, analytics platforms, and distributed data systems - Suitable for engineers who enjoy technical assessment, tool-assisted coding workflows, pipeline review, and practical data infrastructure problem-solving - Sprint-based project work that can align with focused availability and remote schedules Contract Details - Independent contractor engagement - Fully remote and flexible scheduling - Sprint-based, project-based availability - Some project work may run in focused 12–24 hour sprint windows depending on project requirements - Compensation may reach up to $90/hour, depending on project scope, experience, and accepted work structure - Some projects may use accepted-task compensation depending on the specific workflow - Payments are made weekly via Stripe or Wise based on services rendered - Projects may be extended, shortened, adjusted, or concluded based on project needs and performance - Candidates requiring H1-B or STEM OPT sponsorship support are not eligible at this time - Work must not involve sharing confidential or proprietary information from any employer, client, or institution About the Platform This opportunity is available through 24-MAG LLC. We connect experienced professionals with remote consulting opportunities across technical, evaluation, and project-based workstreams. By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy: https://www.24-mag.com/privacy-policy
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
• Lead the design, development, and optimization of modern data platforms that enable advanced analytics, machine learning initiatives, and data-driven decision-making. • Work closely with Data Scientists, Analysts, Product teams, and business stakeholders to transform complex data ecosystems into reliable, scalable, and secure platforms that generate meaningful business insights. • Design, build, and maintain large-scale data platforms and data architectures. • Lead the development of scalable and reliable ETL/ELT pipelines for batch and near real-time processing. • Architect cloud-native data solutions leveraging AWS, Azure, or GCP services. • Drive data modeling strategies using methodologies such as Star Schema, Snowflake Schema, and Data Vault. • Define and enforce data engineering best practices, coding standards, governance policies, and architectural guidelines. • Implement orchestration frameworks using tools such as Airflow, dbt, or similar technologies. • Optimize data pipelines for performance, scalability, reliability, and cost efficiency. • Collaborate with Data Scientists and Analytics teams to ensure high-quality, production-ready datasets. • Establish monitoring, observability, testing, and data quality frameworks. • Lead technical discussions and architectural decisions across multiple teams. • Conduct code reviews and mentor Data Engineers across different seniority levels. • Implement data security, privacy, and compliance standards aligned with industry best practices. • Support strategic initiatives involving analytics, machine learning, and marketing intelligence platforms.
Data Engineer, Databricks
ICFWe are not a typical consulting firm and our people are not typical consultants.
• Enable secure, scalable, and efficient data exchange between federal client and external data sharing partners using Databricks Delta Sharing. • Support the design and development of data pipelines and ETL routines in Azure Cloud environment for many source system types including RDBMS, API, and unstructured data using CDC, incremental, and batch loading techniques. • Conduct data profiling, transformation, and quality assurance on structured, semi-structured, and unstructured data. • Identify underlying issues and translate them into technical requirements. • Assist in building and optimizing data lakes, feature stores, and data warehouse structures to support analytics and machine learning. • Prepare, structure, and validate data for data science and MLOps workflows, ensuring it meets the quality and format requirements for modeling. • Help monitor and maintain the flow of data across BI dashboards, analytics environments, and machine learning pipelines. • Engage directly with clients and stakeholders to understand data needs and translate them into scalable solutions. • Collaborate with UX designers, business analysts, developers, and end users to define data and reporting requirements • Work with external data partners to determine their data product needs and work within the Databricks platform to enable rapid prototyping and extensible use cases • Meet with government employees at executive levels, platform stakeholders, and vendor partners. • Work within Agile teams to support iterative development, backlog grooming, and sprint-based delivery. • Provide mentorship to junior resources.
• Design, develop, and maintain scalable data pipelines using modern distributed data processing platforms and cloud environments. • Build and optimize ETL/ELT processes following industry best practices and cloud-native architectures. • Implement data models aligned with modern Data Lakehouse principles and data architecture frameworks. • Ensure data quality, consistency, and performance across ingestion, staging, and curated data layers. • Collaborate with data architects, analysts, and business stakeholders to understand complex healthcare data requirements. • Develop reusable data transformation logic and modular processing components for efficient, maintainable systems. • Support deployment processes following CI/CD and DevOps best practices. • Monitor and optimize data workflows for performance, scalability, and reliability in production environments. • Contribute to data governance, security, and compliance practices relevant to regulated healthcare environments.
Data Engineer
VetsEZVeterans EZ Info, commonly known as VetsEZ, is a top provider of information technology (IT) services for both commercial and government markets. The company is
• Design, develop, and maintain scalable data pipelines and ETL processes. • Build and optimize data solutions within Azure cloud environments, including Azure Synapse and Azure Data Factory. • Integrate data from multiple sources through APIs and other system integration methods. • Develop and support data analytics and reporting solutions using Power BI. • Ensure data quality, integrity, security, and performance across data platforms. • Collaborate with stakeholders to gather requirements and deliver data-driven solutions supporting healthcare and VA initiatives. • Manage and track development activities using Agile methodologies and tools such as Jira. • Take on additional tasks and responsibilities as needed to support team objectives and ensure the success of the project.
