Job Closed

This listing is no longer active.

Senior Big Data Engineer

Data EngineerData EngineerOtherRemoteSeniorTeam 1-10H1B No SponsorCompany SiteLinkedIn

Location

Washington

Posted

131 days ago

Salary

$100K - $110K / year

Seniority

Senior

Job Description

Senior Big Data Engineer

BPCS, Comprehensive marketing solutions, ltd.

• Design, develop, test, and deploy features across distributed data platforms. • Maintain and enhance data pipelines running on big data and cloud data technologies. • Perform security-related engineering work, including fixing code vulnerabilities, updating secrets and identities, and ensuring secure endpoints. • Implement governance and compliance updates, including data partitioning, access controls, and physical access restrictions. • Write, modify, debug, and troubleshoot production code and services. • Follow standard engineering lifecycle practices, including CI/CD, monitoring, and deployment workflows. • Execute tasks independently with minimal oversight and deliver high-priority items on aggressive timelines. • Collaborate with engineers to ramp up quickly and take ownership of execution work. • Operate within secure environments and follow all access, security, and compliance requirements.

Job Requirements

  • Minimum 5 years of experience working with large-scale big data platforms and distributed systems.
  • Strong experience with cloud data technologies such as Cosmos (MapReducer), Spark, HDI, and ADLS Gen2.
  • Minimum 5 years of hands-on experience with SQL and at least one high-level programming language (C#, Scala, Java, or Python).
  • Minimum 5 years of experience with CI/CD pipelines, debugging, monitoring, and engineering lifecycle practices.
  • Proven ability to troubleshoot complex production issues and deliver reliable solutions.
  • Experience working in high-reliability data engineering environments.
  • Ability to work independently in a high-execution, fast-paced environment.
  • Experience following security, governance, and compliance standards in production systems.

Benefits

  • Medical, dental, and vision coverage
  • Flexible Spending Account
  • 401k program
  • Competitive PTO offerings
  • Parental Leave
  • Opportunities for professional growth and development

Related Categories

Related Job Pages

More Data Engineer Jobs

InductiveHealth Informatics logo

Data Engineer

InductiveHealth Informatics

Stop disease through technology.

Data Engineer131 days ago
OtherRemoteTeam 51-200H1B No Sponsor

• Lead the continued transition of legacy SAS-based ETL processes to SQL Server, completing remaining migrations and validating results through parallel processing and data reconciliation. • Translate undocumented or minimally documented legacy ETL logic into maintainable, fault tolerant SQL Server and SSIS workflows. • Improve and standardize incremental data processing patterns, reducing reliance on full data refreshes and destructive reload processes. • Own the reliability and performance of ETL pipelines by identifying and resolving bottlenecks, particularly in high-volume and performance-sensitive workflows. • Investigate and correct data flow issues that prevent records from consistently reaching downstream systems across environments. • Support production data operations by partnering with product, engineering, and support teams to triage and resolve data-related issues and support tickets. • Participate in regular operational check-ins and serve as a primary escalation point for ETL and data pipeline concerns. • Document ETL logic, dependencies, and operational processes to reduce institutional knowledge risk and improve long-term maintainability. • Introduce improved logging, monitoring, automation, and repeatability across data integration workflows. • Collaborate with engineering peers and domain experts to establish clearer ownership and standards for ETL and data pipeline practices.

United States
Job Closed
OZ logo

Azure Databricks Data Engineer

OZ

A leading consulting company whose Intelligent Automation expertise accelerates the way you do business.

Data Engineer131 days ago
Full TimeRemoteTeam 201-500H1B Sponsor

• Design and implement end-to-end data solutions on the Azure platform, including data ingestion, data processing, data storage, and data visualization. • Develop and maintain data pipelines using Azure Data Factory, Azure Databricks, Azure Data Lake Storage, and other relevant tools and technologies. • Collaborate with data architects and data scientists to understand data requirements and design scalable and optimized data models and schemas. • Implement data integration solutions to extract, transform, and load (ETL) data from various sources into Azure data platforms. • Ensure the reliability, availability, and performance of data solutions by monitoring and optimizing data pipelines and storage systems. • Troubleshoot and resolve data-related issues, including data quality, performance, and security concerns. • Collaborate with cross-functional teams to gather business requirements and translate them into technical solutions. • Stay updated with the latest trends and advancements in Azure data technologies and provide recommendations for adopting new tools and techniques. • Perform data profiling, data validation, and data cleansing activities to ensure data accuracy and consistency. • Document technical specifications, data flows, and processes for reference and knowledge sharing.

Argentina
Job Closed
AGGRANDIZE logo

Senior Data Architect – Databricks

AGGRANDIZE

Increase the power of your business

Data Engineer131 days ago
Full TimeRemoteTeam 51-200Since 2015H1B No Sponsor

• Design and implement scalable, modern data architectures (Lakehouse, Delta Lake, Medallion) • Collaborate with business and technology teams to align solutions with strategic objectives • Lead data modernization and decentralization initiatives with a Data Mesh approach • Ensure governance, security and compliance (LGPD, IAM, RBAC) • Participate actively in strategic data planning, aligning solutions with corporate goals • Support the definition of data roadmaps and contribute to long-term architectural decisions • Conduct regular alignments with technical and business stakeholders to ensure adherence to organizational needs

Brazil
Job Closed
EUROPEAN DYNAMICS logo

Semantic Data Engineer

EUROPEAN DYNAMICS

"​{ engineer; innovate; excite; }"​

Data Engineer131 days ago
Full TimeRemoteTeam 501-1,000Since 1998H1B No Sponsor

• Analyse and maintain RDF/TTL data models and vocabularies; • Develop, optimise, and maintain SPARQL queries; • Support data ingestion, transformation, and validation workflows; • Ensure consistency and correctness of semantic data across the platform; • Collaborate with backend engineers to integrate semantic logic into application flows; • Assist in documenting semantic models, assumptions, and constraints; • Participate in troubleshooting data quality and reasoning issues.

Italy
Job Closed