Horizon Industries logo
Horizon Industries

Horizon Industries Limited was founded in 1996 and is based in Vienna, Virginia. Horizon is a dynamic, SBA-certified Small Disadvantaged Business (SDB) with professional and talented strategists, technologists, and consultants across diverse domains. Expertise in IT, analysis and evaluation, data analytics, business process management Acquisition and financial management, cost and risk assessments Independent Verification & Validation, program management, systems engineering and design Database management, logistical warehouse services, and administrative support Capabilities in financial, operational, and technology consulting Risk management services, strategic planning, leadership effectiveness Anti-fraud waste and abuse programs, financial and operational assessments Regulatory compliance, workflow automation, and audit readiness services Equal Employment Opportunity Horizon is an Equal Employment Opportunity employer. It is our policy to consider all applicants for employment without regard to sex, race, color, creed, religion, national origin, sexual orientation, marital status, age, disability, veteran status, alienage, ancestry, citizenship status, or any other factor prohibited by law. Horizon will not discharge or discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant, consistent with applicable law.

Databricks Data Engineer

Data EngineerData EngineerFull TimeRemoteMid LevelTeam 201-500

Location

United States

Posted

3 days ago

Salary

0

Seniority

Mid Level

Job Description

Databricks Data Engineer

Horizon Industries

Role Description We are seeking a Databricks Data Engineer for a full-time position supporting our various clients. We are committed to your growth and success in the IT software development industry. We are looking for a Databricks Data Engineer ready to assume leadership responsibilities in a supportive team environment focused on your success as a function of client success. - Build end-to-end implementation of multiple ETL/ELT pipelines, demonstrating efficient data transformation and ingest patterns to move raw data from data producers to an enterprise data ecosystem, with a focus on performance and reliability. - Assess and understand the ETL jobs, workflows, BI tools, and reports. - Address technical inquiries concerning customization, integration, enterprise architecture and general feature/functionality of data products. - Experience in crafting database/data warehouse solutions in the cloud (Preferably AWS, Azure, Alternatively GCP). - Key must-have skill sets: Python, SQL, Databricks, AWS Data Services. - Experience with message queuing, stream processing, and highly scalable ‘big data’ data stores. - Experience manipulating, processing, and extracting value from large, disconnected datasets. - Experience manipulating structured and unstructured data for analysis. - Experience with data modeling tools and processes. - Experience aggregating and transforming data from multiple datasets to create data products. - Support an Agile software development lifecycle. Qualifications - Ability to hold a position of public trust with the US government. - B.S. in Computer Science or equivalent. - 4+ years' experience in data engineering and big data. At least 2 years' of professional services experience interacting directly with clients. - Big data tools: Hadoop, Spark, Kafka, etc. - Relational SQL and NoSQL databases and experience working with relational databases. - AWS cloud services: EC2, S3, RDS, Glue, Step Functions, Lambda, EMR, DynamoDB, DocumentDB, Redshift, Aurora, Athena. - Data Platforms: Databricks. - Data streaming systems: Batch, Kafka, Storm, Spark-Streaming, etc. - Languages: Python, R, Scala, Go. - Ability to inspect existing data pipelines, discern their purpose and functionality, and re-implement them efficiently in Databricks. - Extensive knowledge of data warehousing concepts and hands-on experience deploying pipelines using Databricks. - Data modeling and database design skills and knowledge of version control. - Excellent verbal and written communication skills. - Experience architecting scalable and fault-tolerant data solutions across Azure, AWS, and Databricks. - Databricks Data Engineer Professional certification a plus. - Preference for candidates with Databricks Professional certifications. Requirements - Bachelor’s degree in a technical field such as software engineering, engineering, computer science, etc. Benefits - A comprehensive benefits package including healthcare (medical, dental, vision and disability). - A 401k program where you are 100% vested from day one with an employer match after 90 days. - An Educational Assistance program. - A Student Loan Repayment Program. - Gym Reimbursement Program. - Paid Time off. - Dynamics, passionate, multi-disciplinary team of creative minds to work with, and many more.

Related Categories

Related Job Pages

More Data Engineer Jobs

Alkami Technology logo

Senior Data Engineer

Alkami Technology

Alkami is the digital sales and service platform provider for financial institutions in the US.

Data Engineer3 days ago
Full TimeRemoteTeam 501-1,000Since 2009H1B No Sponsor

• Participate in the entire data pipeline lifecycle, focusing on building data lakes, data warehouses and related processes • Lead code and design reviews with junior and peer developers • Write clean code to develop data pipelines and necessary infrastructure as code • Collaborate with cross functional teams to understand requirements and effectively design appropriate solutions • Monitor and troubleshoot performance, scalability, and security issues, making improvements as needed • Participate in the evaluation of new technologies and tools that can improve performance of our system • Participate in data governance process • Contribute to the design and documentation of our data lake platform • Proficient in test automation solutions for data and ability to optimize performance • Gather technical and design requirements • Communicate effectively with technical and non-technical team members to ensure alignment and successful execution of projects. • Participate in cross-functional initiatives, promoting a culture of data-driven decision-making and continuous improvement • Participate in an on call rotation

United States
$120K - $150K / year
NinjaTrader logo

Sr. Data Engineer

NinjaTrader

Better Futures Start Now. Grow your FinTech career at NinjaTrader or start your futures trading journey with us.

Data Engineer3 days ago
Full TimeRemoteTeam 201-500Since 2003H1B No Sponsor

Disclaimer: Please be advised that the most accurate and up-to-date information about our open roles—including job descriptions, compensation, and benefits—can only be guaranteed on our official job board. For the latest listings and details, please visit: https://job-boards.greenhouse.io/ninjatrader. JOIN US ON OUR MISSION TO BECOME THE #1 RETAIL TRADING PLATFORM IN THE WORLD Welcome to the dynamic world of NinjaTrader! As an industry-leading trading platform and futures broker, we're empowering traders to take control of their financial destiny. How do we do it? We provide cutting-edge products and services that enhance the trading journey. Whether a seasoned pro or just starting out, NinjaTrader equips traders with award-winning software and brokerage services to navigate the world's leading financial markets with confidence. Our growth story is nothing short of exhilarating. Since 2003, NinjaTrader has been dedicated to understanding and supporting traders on their journey toward trading triumph. Through those efforts, our user base has grown to over 2 million users and we have become the number one rated futures brokerage worldwide. But we're not stopping there. We're constantly evolving, pushing boundaries, and modernizing the futures industry. Our commitment to innovation means users will always have access to dynamic tools, real-time support, and a community of like-minded traders. So, why work at NinjaTrader? Here, you're not just part of a team; you're part of a movement. We empower employees to reach new heights in their careers by providing a dynamic culture focused on social connection, professional development, and employee recognition initiatives. Sounds too good to be true? Take it from our employees. Join us as we redefine what's possible in trading, advocate for our customers, and continue our journey toward becoming the world's top retail-focused trading platform in the world. What you'll do: Your data-driven mindset and ability to work with large-scale data systems enable NinjaTrader to serve customers better, identify new opportunities, and improve processes. As an accomplished data engineer joining the Data & Analytics team, this is a terrific opportunity to become part of a fast-growing, revolutionary fintech company shaping the future of retail futures trading. At NinjaTrader, you'll play a key role in designing and operationalizing the modern data platform that powers our analytics, trading tools, and AI initiatives. This role is remote-friendly and reports to the Manager, Data & Analytics Engineering. As a Sr. Data Engineer, your primary responsibility is to stay one step ahead of your fellow team members by providing the platform, tools, and infrastructure they need to deliver deployable solutions to real-world business problems. This goes beyond maintaining pipelines—it's about delivering best-in-class data architecture, scalable workflows, and real-time solutions that power trading, product development, and machine learning. In this role you will: - Design, build, and maintain robust data pipelines and data lake architecture for both batch and real-time streaming use cases, including high-volume, low-latency data processing - Improve observability, alerting, and SLOs across data systems so pipelines are easier to monitor and issues are caught early - Optimize ETL/ELT workflows for performance, scalability, and fault tolerance - Develop dbt workflows to onboard Evaluation Partners and create end-of-day reporting for partner analysis - Build and support event-driven architectures and scalable platform components - Contribute to the orchestration and automation of workflows - Integrate complex financial APIs and third-party data sources into internal systems - Collaborate with analytics, product, and ML engineers to develop and deploy reliable data products - Work on feature pipelines and model-ready data to support ML engineers - Promote high standards in code quality, testing, and platform reliability - Participate in Agile ceremonies and foster a collaborative, growth-oriented team culture What you'll need: - Bachelor's degree in Computer Science, Engineering, or a related field - 5+ years of experience in data engineering, platform engineering, or backend development - Strong skills in SQL and Python for building and testing data solutions - Hands-on experience with GCP and GCP data products (BigQuery, Cloud SQL, Cloud Storage, etc.) - Experience with AWS cloud services (S3, Glue, Athena, Kinesis) in addition to GCP; bonus for EMR - Experience with CI/CD pipelines, infrastructure-as-code, and version-controlled deployment workflows (e.g., Terraform, GitOps) - Hands-on dbt experience building and maintaining dbt projects (models, tests, macros, documentation, CI) - Proficiency with workflow orchestration tools (e.g., Airflow, Prefect) - Knowledge of data lake architecture, including file formats (Parquet, Avro) and open table formats (Apache Iceberg) - Familiarity with event-driven and service-oriented architecture - A track record of building automated, well-tested, and observable data systems - Comfortable working both independently and collaboratively in a fast-paced Agile environment Bonus points for: - Hands-on Kubernetes experience, especially around data workloads and containerized pipelines - Experience with streaming technologies (e.g., Kafka, Spark Streaming, Flink) and comfort working with high-volume, low-latency data flows - Experience with change data capture tools (e.g., Debezium, Kafka Connect) and real-time data integration patterns - Experience with BI tools like Looker Studio or QuickSight - Experience with observability and monitoring tooling (e.g., Datadog, Grafana, Prometheus) - Background in fintech, trading, or derivatives Compensation: The salary range for this role will be $100,000.00 - $150,000.00 USD. In addition, this position will also receive an annual target bonus of 10%. Bonus pay at NinjaTrader is based on individual performance (50%) as well as company/team performance (50%). Salary and bonus earnings are only two components of the total compensation package offered by NinjaTrader. NinjaTrader offers a 401K plan through ADP under which the company will match up to 3.5% of employee contributions. Annual paid time off allowance accrues at a rate of 18 days per year (some positions may qualify for more) plus seven paid holidays. Location: This role is based in Chicago, IL. There may be remote flexibility for exceptional candidates in the following states: California, Colorado, Florida, Georgia, Illinois, Indiana, Minnesota, Missouri, Montana, New Jersey, New York, North Carolina, Ohio, Oregon, Pennsylvania, South Carolina, Texas, Utah, Vermont, Virginia, Washington, Washington DC, Wisconsin. Hybrid: For Chicago-based employees, we follow a hybrid work schedule: In-office Tuesday through Thursday, with remote work on Mondays and Fridays. In addition to these weekly remote days, we offer: - 20 additional flex remote days annually - 5 Company Wide Office-Optional weeks tied to major holidays Our Core Benefits Include: - Generous PTO - 7 Paid Holidays Annually + 5 Conditional Holidays Annually - 1 Service Day Annually - 401k with 3.5% Company Match - Paid Parental Bonding Leave - Health, Vision, Dental Coverage - Life and Disability Insurance Covered 100% by NinjaTrader We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender, gender identity or expression, or veteran status. We are proud to be an equal opportunity workplace.

Illinois
$100K - $150K / year
Mayo Clinic logo

Principal Data Engineer - AI Program

Mayo Clinic

Headquartered in Rochester, Minnesota, Mayo Clinic is a nonprofit medical institution ranked first in more specialties than all other hospitals in America. The

Data Engineer3 days ago

Role Description The Senior Data Engineer - AI Program develops and deploys data pipelines, integrations and transformations to support analytics and machine learning applications and solutions as part of an assigned product team using various open-source programming languages and vended software to meet the desired design functionality for products and programs. - Maintain an understanding of the organization's current solutions, coding languages, and tools. - Apply independent judgment regularly. - Provide consultative services to departments/divisions and leadership committees. - Demonstrated experience designing, building, and operating large-scale healthcare data platforms and data ecosystems. - Manage the movement, transformation, and optimization of structured and unstructured clinical, operational, and research data across on-premises and cloud environments. - Partner with product owners, clinical stakeholders, and AI/ML experts to identify and retrieve data. - Conduct exploratory analysis, pipeline, and transform data to support the creation of agentic systems and the build of state-of-the-art multi-modal foundation models. - Provide technical leadership in architecting scalable, cost-efficient data solutions. - Optimize data movement and storage strategies. - Ensure secure, compliant access to healthcare data assets across hybrid and multi-cloud environments. This is a full-time remote position within the United States. Mayo Clinic will not sponsor or transfer visas for this position including F1 OPT STEM. Qualifications - Experience in data engineering and analytics. - Proficiency in open-source programming languages. - Knowledge of healthcare data platforms. - Experience with cloud environments. Requirements - Ability to work independently and collaboratively. - Strong problem-solving skills. - Excellent communication skills. Benefits - Medical: Multiple plan options. - Dental: Delta Dental or reimbursement account for flexible coverage. - Vision: Affordable plan with national network. - Pre-Tax Savings: HSA and FSAs for eligible expenses. - Retirement: Competitive retirement package to secure your future. Company Description Mayo Clinic is top-ranked in more specialties than any other care provider according to U.S. News & World Report. As we work together to put the needs of the patient first, we are also dedicated to our employees, investing in competitive compensation and comprehensive benefit plans to take care of you and your family, now and in the future. With continuing education and advancement opportunities at every turn, you can build a long, successful career with Mayo Clinic. - Employees are located at three major campuses: Phoenix/Scottsdale, Arizona; Jacksonville, Florida; Rochester, Minnesota. - Mayo Clinic Health System campuses throughout Midwestern communities and international locations. - Each location is a special place where employees thrive in both their work and personal lives.

United States
$155.5K - $225.5K / year
Full TimeRemoteTeam 10,001+H1B Sponsor

• Define and maintain the enterprise data platform blueprint, including ingestion, storage, processing, serving, governance, and security. • Design, model, and simulate complex business processes using BPMS tools and workflow frameworks. • Establish and govern architectural standards, including data contracts, service-level objectives, access controls, and privacy-by-design principles. • Develop enterprise and domain reference architectures to support scalability, interoperability, and reuse. • Design and modernize systems into cloud-compatible or cloud-native architectures, including migration strategies. • Lead architecture reviews for complex or high-risk initiatives, evaluate trade-offs, and mitigate technical and compliance risks. • Develop process architecture artifacts, including workflow diagrams, functional maps, and cross-functional process models. • Recommend and implement best practices for process orchestration, workflow design, and system integration. • Align data and process architecture with enterprise architecture, security, IAM, networking, and FinOps practices. • Evaluate build-versus-buy decisions, serve as a subject matter expert in BPMS tools and process design patterns, collaborate with stakeholders to test and refine workflows, mentor technical professionals, provide strategic architecture recommendations, support CI/CD, DevOps, and automation practices, ensure solutions meet evolving security requirements and industry standards, and perform other duties as assigned.

United States
$138K - $200.1K / year