Senior Data Engineer

Data EngineerData EngineerFull TimeRemoteSeniorTeam 51-200Since 2012H1B SponsorCompany SiteLinkedIn

Location

Maryland

Posted

6 days ago

Salary

$131.1K - $173.3K / year

Seniority

Senior

Bachelor Degree10 yrs expEnglishAWSETLJenkinsPythonSQL

Job Description

Senior Data Engineer

Index Analytics LLC

• Collaborate closely with stakeholders, cross‑functional and internal technical teams to gather requirements, document business rules and develop thorough understanding of the business context and objectives • Collaborate to design secure, scalable, and cost‑optimized data solutions • Design, build, and maintain scalable, reliable ETL/ELT data pipelines using AWS, Snowflake and Snowflake tools • Develop and optimize data models, both conceptual and physical, to support analytics, reporting, dashboards and operational consumption • Implement data quality, validation, and monitoring frameworks to ensure accuracy and reliability • Ensure data workflows are modular, testable, and properly version‑controlled • Operationalize pipelines with monitoring, alerting, and automated recovery mechanisms • Conduct advanced data analysis using languages such as Python and SQL • Develop documentation to include data models, data dictionaries, and data usage guides • Improve end-to-end performance of data workflows • Build and maintain CI/CD pipelines using Jenkins to support automated testing, deployments, and continuous integration • Meet schedule deadlines and commitments with a high-level of quality of deliverables • Collaborate with a team of cross-functional resources in an Agile delivery environment to deliver iterative value

Job Requirements

  • US citizen or lived in the US for 3 of the last 5 years
  • Must be able to obtain a U.S. Federal government client badge and pass a government background investigation
  • Bachelor's degree or equivalent with ten (10) or more years of experience as Data System Architect, Engineer or similar role
  • Hands-on experience using Snowflake tools, SQL and Python is required
  • Strong proficiency in Snowflake, AWS services as well as with GitHub for source control, branching strategy and reviews
  • Knowledge of data integration patterns, data warehousing, and modern data architecture
  • Strong analytical and communication skills, including the ability to analyze data, create meaningful insights, and present information clearly to stakeholders
  • Experience with object‑oriented programming and building with software engineering principles
  • DevOps exposure, including CI/CD tools like Jenkins
  • Understanding of Data Lake concepts
  • Knowledge of Agile framework, Scrum methodologies and tools used to support them
  • Strong written and verbal communication skills are required, ability to collaborate, present, and report to stakeholders on findings
  • Prior experience with government agencies and fraud detection systems is a plus

Benefits

  • Health and retirement benefits
  • Discretionary bonuses
  • Reimbursement for professional development opportunities

Related Categories

Related Job Pages

More Data Engineer Jobs

itel logo

Data Engineer III

itel

The Source for Certainty

Data Engineer6 days ago
Full TimeRemoteTeam 201-500H1B No Sponsor

• Lead the design, development, and implementation of scalable data pipelines and infrastructure using Azure Databricks, Azure Data Factory, SQL Server, Salesforce integrations, and related technologies • Develop and maintain both OLTP and dimensional data models based on business requirements, applying Kimball and Inmon methodologies as appropriate • Optimize data storage and retrieval performance across SQL Server and cloud data platforms • Integrate data from Salesforce and other SaaS applications via APIs and extraction workflows • Implement and maintain batch and real-time data processing architectures • Participate in code and architecture reviews to ensure adherence to data engineering standards and best practices • Analyze and troubleshoot data pipeline and performance issues, providing timely and effective solutions • Contribute to the continuous improvement of data engineering practices, tools, and processes • Stay current with emerging trends in cloud data platforms and identify opportunities for innovation • Champion comprehensive documentation of data architecture, lineage, and modeling decisions • Facilitate knowledge sharing and mentorship across the team; engage cross-functionally to align on architectural vision • Drive adoption of best practices including data governance, quality, security, and compliance standards • Lead initiatives to reduce technical debt and improve pipeline performance and cost efficiency.

United States
Full TimeRemoteTeam 201-500Since 1982H1B No Sponsor

• Execute development engineering design activities, system performance modeling, and related CAD design activities by coordinating with discipline-specific (electrical, civil, structural) design teams • Review and oversee the delivery of preliminary designs (0–30%) and feasibility studies • Maintain professional understanding of all applicable codes, standards, and construction practices • Act as a liaison between design teams and relevant internal and external stakeholders • Work cross-functionally across departments to identify and align team members across disciplines to ensure project work is completed and submitted in a timely manner • Maintain strong and responsive company-client relationships, particularly for communication related to specific assignments and meeting topics • Ensure adherence to company and client QA/QC standards • Assist in the development, implementation, and enforcement of departmental Standard Best Practices (SBPs) • Support the development, maintenance, and improvement of development-phase performance analysis tools • Work with proposal teams and subject matter experts (SMEs) to establish proposal pricing • Provide engineering and technical support to members of the Business Development & Project Services teams • Provide pre-sales technical support to customers and NEI outside sales teams • Support business development through Seller-Doer activities, including marketing support and proposal preparation as needed • Attend conferences, training workshops, seminars, and continuing education activities as appropriate to maintain quality of work and support professional advancement • Maintain high ethical and professional standards • Attend required safety training and adhere to all safety rules and guidelines • Perform other responsibilities as assigned

Colorado
$80K - $120K / year
Resilinc logo

Senior Data Engineer

Resilinc

Strengthening the supply chains that power our lives.

Data Engineer6 days ago
Full TimeRemoteTeam 201-500Since 2010H1B Sponsor

• Partner directly with enterprise customers and business stakeholders to understand data challenges, define requirements, and deliver scalable solutions. • Own technical delivery for customer engagements from discovery and solution design through implementation and adoption. • Help customers maximize the value of Resilinc’s data and analytics capabilities through effective solution design and execution. • Present technical architectures, implementation plans, and business outcomes to both technical and executive audiences. • Design, build, and maintain scalable batch and real-time data pipelines and data products using Databricks, ClickHouse, Python, and distributed data processing frameworks. • Architect modern cloud-native data platforms leveraging Databricks, Delta Lake, Azure Data Services, and distributed processing technologies. • Develop robust ETL/ELT frameworks, data models, and data quality monitoring processes. • Optimize data storage, query performance, scalability, reliability, and cost efficiency across large-scale datasets. • Build and maintain data products that enable analytics, reporting, operational workflows, and AI/ML applications. • Collaborate closely with Product, Engineering, Solutions Consulting, and Customer Success teams to deliver customer outcomes. • Drive best practices in data governance, security, observability, reliability, and operational excellence. • Contribute to architecture decisions, technical design reviews, and platform evolution. • Mentor junior engineers and contribute to engineering best practices.

India
Ciklum logo

Senior Data Engineer

Ciklum

Experiences of Tomorrow, Engineered Together!

Data Engineer6 days ago
Full TimeRemoteTeam 1,001-5,000Since 2002H1B No Sponsor

Role Description Ciklum is looking for a Senior Data Engineer to join our team full-time in Pakistan. As a Senior Data Engineer, become a part of a cross-functional development team engineering experiences of tomorrow. Ciklum is developing the web solution - TAX platform built to enhance and unify the process of providing Tax and Financial Services. The team is developing an innovative automation platform for our client, a globally-operating, complex system that enhances and unifies the process of collecting, processing, and providing Tax and Financial services. The client's employees and external users actively use the platform daily, and the team continues to add new features that automate business flows. Responsibilities - Designing, developing, and deploying Power BI solutions, providing advanced data analytics, and creating dashboards and reports that deliver key insights to the business. - Data models design and implementation. - Optimize reports and dashboards for better performance by improving query speed and ensuring efficient data model design. - Contributes design, code, configurations, manage data ingestion, closed to real-time processing, batch processing, ETL across multiple data storages. - Responsible for performance tuning of complicated SQL and DAX queries. - Identify gaps and improve the platform’s quality, robustness, maintainability, and speed. - Cross-train other team members on technologies being developed, while also continuously learning new technologies from other team members. - Contribute in the Unit’s activities and community building, participate in conferences, and provide excellence in exercise and best practices. Qualifications - 3+ years of experience in developing BI solutions with Power BI. - Proficient in Power BI Desktop and Power BI Service, including report and dashboard creation, data transformations, and DAX formulas. - Strong expertise in DAX (Data Analysis Expressions) for complex calculations. - Experience with Power Query for data transformations and ETL processes. - Solid understanding of data modeling principles and best practices. - 3+ years of experience coding in SQL (Azure SQL DB or MSSQL preferable), solid CS fundamentals including data structure and algorithm design. - 2+ years contributing to production deployments of large backend data processing and analysis systems. - Experience in data integration and ETL processes. - Proficient with Azure Data Services (Azure Data Factory, Azure Synapse Analytics, etc.). - Strong problem-solving and analytical skills, with a keen attention to detail. - Excellent communication skills, both written and verbal, with the ability to present complex data in a clear and concise manner. - Experience in working with cross-functional teams and collaborating with stakeholders at various levels of the organization. - Knowledge of professional software engineering best practices for the full software development life cycle. - Knowledge of Data Warehousing, design, implementation, and optimization. - Knowledge of Data Quality testing, automation, and results visualization. - Knowledge of the development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations. - Experience participating in an Agile software development team, e.g. SCRUM. - Experience designing, documenting, and defending designs for key components in large distributed computing systems. - A consistent track record of delivering exceptionally high-quality software on large, complex, cross-functional projects. - Demonstrated ability to learn new technologies quickly and independently. - Ability to handle multiple competing priorities in a fast-paced environment. Requirements - Desirable: Experience with Power BI Embedded. - Experience with Power BI REST or JS APIs. - Power BI Premium Capacity Management. - Experience in backend development and deployment. - Experience in CI/CD configuration. - Experience with Azure DevOps for CI/CD. - Experience with Tabular Editor, DAX Studio, SQL Profiler. - Experience with Powershell. - Experience with Swagger, Postman. Benefits - Care: your mental and physical health is our priority. We offer a competitive benefits package that includes comprehensive medical coverage, life insurance, gym membership, fuel, internet and mobile allowances, and provident fund. - Tailored education path: boost your skills and knowledge with our regular internal events (meetups, conferences, workshops), Udemy license, language courses, and company-paid certifications. - Growth environment: share your experience and level up your expertise with a community of skilled professionals, locally and globally. - Flexibility: Own your schedule – you decide when to start your working day. - Opportunities: we value our specialists and always find the best options for them. Our Internal Mobility Program helps change a project if needed to help you grow, excel professionally, and fulfill your potential. - Global impact: work on large-scale projects that redefine industries with international and fast-growing clients. - Welcoming environment: feel empowered with a friendly team, open-door policy, informal atmosphere within the company, and regular team-building events.

Pakistan