Horizon Industries logo
Horizon Industries

Horizon Industries Limited was founded in 1996 and is based in Vienna, Virginia. Horizon is a dynamic, SBA-certified Small Disadvantaged Business (SDB) with professional and talented strategists, technologists, and consultants across diverse domains. Expertise in IT, analysis and evaluation, data analytics, business process management Acquisition and financial management, cost and risk assessments Independent Verification & Validation, program management, systems engineering and design Database management, logistical warehouse services, and administrative support Capabilities in financial, operational, and technology consulting Risk management services, strategic planning, leadership effectiveness Anti-fraud waste and abuse programs, financial and operational assessments Regulatory compliance, workflow automation, and audit readiness services Equal Employment Opportunity Horizon is an Equal Employment Opportunity employer. It is our policy to consider all applicants for employment without regard to sex, race, color, creed, religion, national origin, sexual orientation, marital status, age, disability, veteran status, alienage, ancestry, citizenship status, or any other factor prohibited by law. Horizon will not discharge or discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant, consistent with applicable law.

Databricks Data Engineer

Data EngineerData EngineerOtherRemoteMid LevelTeam 201-500

Location

United States

Posted

71 days ago

Salary

0

Seniority

Mid Level

Job Description

Databricks Data Engineer

Horizon Industries

Role Description We are seeking a Databricks Data Engineer for a full-time position supporting our various clients. We are committed to your growth and success in the IT software development industry. We are looking for a Databricks Data Engineer ready to assume leadership responsibilities in a supportive team environment focused on your success as a function of client success. - Build end-to-end implementation of multiple ETL/ELT pipelines, demonstrating efficient data transformation and ingest patterns to move raw data from data producers to an enterprise data ecosystem, with a focus on performance and reliability. - Assess and understand the ETL jobs, workflows, BI tools, and reports. - Address technical inquiries concerning customization, integration, enterprise architecture and general feature/functionality of data products. - Experience in crafting database/data warehouse solutions in the cloud (Preferably AWS, Azure, Alternatively GCP). - Key must-have skill sets – Python, SQL, Databricks, AWS Data Services. - Experience with message queuing, stream processing, and highly scalable ‘big data’ data stores. - Experience manipulating, processing, and extracting value from large, disconnected datasets. - Experience manipulating structured and unstructured data for analysis. - Experience with data modeling tools and processes. - Experience aggregating and transforming data from multiple datasets to create data products. - Support an Agile software development lifecycle. Qualifications - Ability to hold a position of public trust with the US government. - B.S. in Computer Science or equivalent. - 4+ years' experience in data engineering and big data. At least 2 years' of professional services experience interacting directly with clients. - Big data tools: Hadoop, Spark, Kafka, etc. - Relational SQL and NoSQL databases and experience working with relational databases. - AWS cloud services: EC2, S3, RDS, Glue, Step Functions, Lambda, EMR, DynamoDB, DocumentDB, Redshift, Aurora, Athena. - Data Platforms: Databricks. - Data streaming systems: Batch, Kafka, Storm, Spark-Streaming, etc. - Languages: Python, R, Scala, Go. - Ability to inspect existing data pipelines, discern their purpose and functionality, and re-implement them efficiently in Databricks. - Extensive knowledge of data warehousing concepts and hands-on experience deploying pipelines using Databricks. - Data modeling and database design skills and knowledge of version control. - Excellent verbal and written communication skills. - Experience architecting scalable and fault-tolerant data solutions across Azure, AWS, and Databricks. - Databricks Data Engineer Professional certification a plus. - Preference for candidates with Databricks Professional certifications. Requirements - Bachelor’s degree in a technical field such as software engineering, engineering, computer science, etc. Benefits - A comprehensive benefits package including healthcare (medical, dental, vision and disability). - A 401k program where you are 100% vested from day one with an employer match after 90 days. - An Educational Assistance program. - A Student Loan Repayment Program. - Gym Reimbursement Program. - Paid Time off. - Dynamics, passionate, multi-disciplinary team of creative minds to work with, and many more.

Job Requirements

  • Ability to hold a position of public trust with the US government.
  • B.S. in Computer Science or equivalent.
  • 4+ years' experience in data engineering and big data. At least 2 years' of professional services experience interacting directly with clients.
  • Big data tools: Hadoop, Spark, Kafka, etc.
  • Relational SQL and NoSQL databases and experience working with relational databases.
  • AWS cloud services: EC2, S3, RDS, Glue, Step Functions, Lambda, EMR, DynamoDB, DocumentDB, Redshift, Aurora, Athena.
  • Data Platforms: Databricks.
  • Data streaming systems: Batch, Kafka, Storm, Spark-Streaming, etc.
  • Languages: Python, R, Scala, Go.
  • Ability to inspect existing data pipelines, discern their purpose and functionality, and re-implement them efficiently in Databricks.
  • Extensive knowledge of data warehousing concepts and hands-on experience deploying pipelines using Databricks.
  • Data modeling and database design skills and knowledge of version control.
  • Excellent verbal and written communication skills.
  • Experience architecting scalable and fault-tolerant data solutions across Azure, AWS, and Databricks.
  • Databricks Data Engineer Professional certification a plus.
  • Preference for candidates with Databricks Professional certifications.
  • Bachelor’s degree in a technical field such as software engineering, engineering, computer science, etc.

Benefits

  • A comprehensive benefits package including healthcare (medical, dental, vision and disability).
  • A 401k program where you are 100% vested from day one with an employer match after 90 days.
  • An Educational Assistance program.
  • A Student Loan Repayment Program.
  • Gym Reimbursement Program.
  • Paid Time off.
  • Dynamics, passionate, multi-disciplinary team of creative minds to work with, and many more.

Related Categories

Related Job Pages

More Data Engineer Jobs

Jobgether logo

Data Engineering Instructor

Jobgether

We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team. We appreciate your interest and wish you the best! Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time. #LI-CL1 We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

Data Engineer71 days ago
OtherRemoteH1B No Sponsor

Role Description This position is posted by Jobgether on behalf of a partner company. We are currently looking for a Data Engineering Instructor - REMOTE. In this critical role, you will harness the power of technology to train and inspire individuals from diverse backgrounds to pursue rewarding careers in data engineering. The instructor will drive the curriculum forward by integrating modern tools and methodologies, ensuring students gain necessary skills such as Python, SQL, and Cloud Technologies. As a leader in the educational process, you will also be responsible for facilitating hands-on learning and mentoring students through their training journey. This remote position offers flexibility while contributing to meaningful community impact. Accountabilities - Deliver high-quality instruction in Data Engineering covering essential tools and technologies. - Manage and monitor student performance, providing individual feedback and support. - Facilitate hands-on labs, guiding students through practical coding exercises. - Leverage AI tools to enhance learning experiences and demonstrate technical concepts. - Support the curriculum by maintaining and updating lesson plans. - Handle administrative duties, including updating learning management systems. Qualifications - Bachelor’s Degree in Computer Science, Data Science, or related field, or equivalent experience. - Minimum 1 year of teaching or mentoring experience in a technical environment. - Proficiency in Google Gemini and other AI tools for instructional use. - Experience with Unix/Linux command line and basic shell scripting. - Knowledge of version control using Git and GitHub. - Strong Python programming skills, including libraries like NumPy and Pandas. - Familiarity with relational databases and SQL programming. - Experience with Big Data frameworks and ETL processes. - Proficiency in data visualization tools, specifically Tableau. - Experience using AWS services relevant to data analytics. Benefits - Competitive hourly compensation at $60/hour. - Opportunities for professional development and continuous learning. - Flexible remote work environment. - Be part of a mission-driven organization focused on community impact. - Access to comprehensive healthcare benefits. - 401K match to support your financial future. - Join a collaborative and supportive team culture.

United States
$60 / hour
Job Closed
Blend360 logo

Data Engineer

Blend360

Optimizing business performance through people, data, tech & analytics

Data Engineer71 days ago
Full TimeRemoteTeam 501-1,000H1B Sponsor

• Design and build production-grade data pipelines in Databricks using Spark/PySpark and SQL. • Develop and maintain an Analytics ID stitching pipeline using deterministic and probabilistic matching techniques across multiple customer data sources. • Build and manage modular data marts (Identity, Behavior, Demographics) with independent refresh cadences. • Implement and maintain a scalable feature store supporting downstream analytics and data science use cases. • Own the end-to-end data lifecycle: ingestion, transformation, validation, deployment, monitoring, and optimization. • Develop data quality frameworks including schema drift detection, anomaly monitoring, match-rate validation, and automated deduplication audits. • Implement CI/CD processes for multi-environment promotion (dev/staging/prod) in Databricks environments. • Coordinate orchestration workflows and manage dependencies using Databricks Workflows or similar tools. • Collaborate closely with Data Architects and Client stakeholders to translate business rules into scalable technical solutions. • Produce comprehensive technical documentation including data contracts, lineage maps, architecture diagrams, and operational runbooks.

Uruguay
Job Closed
DocPlanner logo

Product Data Engineer

DocPlanner

At Docplanner Group, we’re on a mission to help people live longer, healthier lives. As the world’s largest healthcare platform, each month, we connect 24 million patients with 280k doctors across 13 countries. Our marketplaces, SaaS and AI tools simplify daily tasks and help doctors, clinics and hospitals work more efficiently. Real impact – We help doctors help patients. Your work truly makes a difference. At scale, yet agile – 3,000+ employees, but still fast, flexible, and hands-on. Shape the future, sustain growth – Make a difference now and build for long-term success.

Data Engineer72 days ago
Full TimeRemoteTeam 1,001-5,000Since 2012H1B No Sponsor

• Design, build, and maintain reliable end-to-end ETL pipelines orchestrated with Apache Airflow • Integrate data from multiple sources (internal operational databases, third-party APIs, SaaS tools) into the Google Cloud Data Warehouse (BigQuery) • Design and evolve data models, warehouse schemas, and transformations to support scalable analytics and KPIs • Ensure data quality, reliability, and observability through monitoring, validation, and alerting • Own the product data structure, mapping product features and behaviors to analytics-ready data models • Define and maintain meaningful KPIs in collaboration with Product and BI • Enable analytics for AI-powered product features, ensuring visibility on usage, performance, quality, and business impact • Partner with Product, BI, and other stakeholders to gather requirements and deliver dashboards and reports • Maintain clear and up-to-date documentation for data models, pipelines, and metrics • Act as the primary bridge between Backend Engineering and BI, owning the flow from data production to analytics consumption • Triage, analyze, and address BI requests related to data availability, correctness, performance, and modeling • Collaborate with Backend Engineers on data contracts, schema evolution, and performance optimization, without owning core backend services • Proactively identify and resolve data-related issues impacting BI and Product teams • Own first-level monitoring and support for data pipelines and Airflow DAGs, ensuring timely resolution of failures • Collaborate with BI and Backend teams to troubleshoot and resolve complex issues • Continuously improve the stability, performance, and maintainability of the data platform.

Spain
Job Closed
Jobgether logo

Senior Instructor, Data Engineering

Jobgether

We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team. We appreciate your interest and wish you the best! Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time. #LI-CL1 We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

Data Engineer72 days ago
OtherRemoteH1B No Sponsor

Role Description This position is posted by Jobgether on behalf of a partner company. We are currently looking for a Data Engineering Instructor - REMOTE. In this critical role, you will harness the power of technology to train and inspire individuals from diverse backgrounds to pursue rewarding careers in data engineering. The instructor will drive the curriculum forward by integrating modern tools and methodologies, ensuring students gain necessary skills such as Python, SQL, and Cloud Technologies. As a leader in the educational process, you will also be responsible for facilitating hands-on learning and mentoring students through their training journey. This remote position offers flexibility while contributing to meaningful community impact. Accountabilities - Deliver high-quality instruction in Data Engineering covering essential tools and technologies. - Manage and monitor student performance, providing individual feedback and support. - Facilitate hands-on labs, guiding students through practical coding exercises. - Leverage AI tools to enhance learning experiences and demonstrate technical concepts. - Support the curriculum by maintaining and updating lesson plans. - Handle administrative duties, including updating learning management systems. Qualifications - Bachelor’s Degree in Computer Science, Data Science, or related field, or equivalent experience. - Minimum 1 year of teaching or mentoring experience in a technical environment. - Proficiency in Google Gemini and other AI tools for instructional use. - Experience with Unix/Linux command line and basic shell scripting. - Knowledge of version control using Git and GitHub. - Strong Python programming skills, including libraries like NumPy and Pandas. - Familiarity with relational databases and SQL programming. - Experience with Big Data frameworks and ETL processes. - Proficiency in data visualization tools, specifically Tableau. - Experience using AWS services relevant to data analytics. Benefits - Competitive hourly compensation at $60/hour. - Opportunities for professional development and continuous learning. - Flexible remote work environment. - Be part of a mission-driven organization focused on community impact. - Access to comprehensive healthcare benefits. - 401K match to support your financial future. - Join a collaborative and supportive team culture.

United States
$60 / hour
Job Closed