Job Closed
This listing is no longer active.
Soluciones de Contacto Telefónico para Negocios
Senior Data Engineer
Location
United States
Posted
77 days ago
Salary
0
Seniority
Senior
Job Description
Senior Data Engineer
Layer7.mx
• As a Senior Data Engineer, you will be the ideal person to support the Engineering area; your primary responsibility will be the scalable maintenance and creation of solutions for the data infrastructure. • Inspect, clean, transform, and model information, which is fundamental for decision-making. • Support the design of data processing components on Layer7 infrastructure that meet the specific needs of the company and its clients and suppliers. • Design, implement, and maintain data pipelines to integrate different sources. • Actively collaborate with data analysts, engineers, and cross-functional teams to understand and translate data requirements and propose tailored solutions. • Build metrics and implement observability tools to track and measure data pipeline performance for early incident detection. • Support the data governance process, maintaining data privacy criteria and the security regulations established by Layer7. • Document architectures, data flows, and process automation.
Job Requirements
- Degree in Systems Engineering or a related field.
- 10 years of experience in Business Intelligence.
- 7 years of experience in Software Engineering.
- 5 years of experience programming in Python.
- 5 years of experience with AWS, MySQL, and ETL.
- 3 years of experience with Rust (optional).
- 10 years of experience with Linux.
- Experience creating dashboards and reports.
- Advanced SQL skills and experience with relational and multidimensional databases.
- Knowledge of Docker and Kubernetes.
- Experience designing batch and streaming data pipelines.
- Experience handling and processing large volumes of data.
- Strong organizational and project management skills.
- Excellent problem-solving, communication, and organizational skills.
- Demonstrated ability to work independently and as part of a team.
- Excellent interpersonal skills.
- Critical thinking.
Benefits
- 100% remote position
- Competitive salary
- Extensive learning opportunities in dynamic environments
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Data Engineer
Roqad | Zeotap DataThe identity graph for the post-cookie internet. Connect universal IDs, first-party data and device signals with Roqad.
• You'll work across the full lifecycle of data engineering - from designing elegant solutions to deploying them in production • Building and maintaining data pipelines of varying complexity - from straightforward transformations to advanced probabilistic algorithms that drive our data science capabilities • Designing thoughtful solutions for new challenges, with emphasis on clean architecture and maintainability • Writing automated tests because we believe quality is built in, not bolted on • Fixing bugs and improving existing systems - our codebase evolves constantly • Exploring data when problems require investigation and analysis • Contributing to backend services and internal tools that support our data infrastructure • Deploying your work - you own it from concept to production
• Architect, scale, and maintain the backbone of our data ecosystem. • Transform massive volumes of raw signals into actionable intelligence. • Bridge the gap between high-level data strategy and hands-on technical excellence. • Lead the design, implementation, and optimization of distributed data architectures to support massive Batch & Streaming pipelines. • Ensure scalability, security, and performance of the infrastructure, maintaining high system availability (99.9%+) for analytics platforms. • Optimize storage solutions to balance high-speed processing with cost-efficiency. • Collaborate with software engineers and data scientists to seamlessly integrate AI-driven models into production data workflows. • Lead and mentor a team of 2 data engineers, fostering a culture of continuous improvement and technical excellence. • Set high standards for code quality, documentation, and rigorous peer reviews. • Oversee project execution, delegate responsibilities, and act as the technical point of escalation for complex data-related roadblocks. • Implement robust monitoring, alerting, and automated testing (Data Quality) to ensure the integrity of the data team's output. • Ensure data security and GDPR compliance across all international jurisdictions and workflows. • Identify opportunities to leverage new technologies or improve existing workflows to optimize data processing.
Senior Data Engineer
DeltekDeltek is a leading provider of information solutions and enterprise software. Founded in 1983 by father-and-son team Donald and Kenneth deLaski, Deltek serves
Role Description As a Sr Data Engineer, you will design and implement robust data architectures for enterprise platforms, including data lakes, warehouses, and lakehouse solutions. You will build scalable data pipelines, ensure data quality and reliability, and drive modernization initiatives. Collaborating closely with data science and analytics teams, you will deliver advanced data solutions while supporting compliance and governance requirements. This role offers opportunities to mentor junior engineers, evaluate emerging technologies, and contribute to technical excellence across the organization. Key Responsibilities - Design and implement data architecture for enterprise data platforms (data lakes, warehouses, lakehouse architectures). - Build scalable data pipelines using modern ETL/ELT frameworks (e.g., Airflow, DBT); ensure data quality, reliability, and performance. - Implement Change Data Capture (CDC) and real-time streaming solutions using technologies such as Kafka and Spark Streaming. - Optimize data infrastructure for performance and cost, including partitioning, compression, and caching strategies. - Establish data governance practices: data lineage, quality monitoring, schema management, and access controls. - Lead technical initiatives for data platform modernization; evaluate and adopt new technologies and tools. - Mentor junior data engineers, conduct code reviews, and establish best practices. - Collaborate with data science and analytics teams to deliver data solutions for advanced analytics. - Support compliance requirements for data security, privacy, and regulatory needs (e.g., GDPR, SOC2). Qualifications - 5+ years of data engineering experience building large-scale data platforms on cloud infrastructure. - Extensive experience with cloud data platforms: AWS (Redshift, Glue, EMR, S3), Azure (Synapse, Data Factory, ADLS), or GCP (BigQuery, Dataflow, GCS). - Expertise in SQL; proficiency in Python or Scala; experience with Spark for distributed data processing. - Hands-on experience with data pipeline orchestration tools (Airflow, DBT, Luigi, or similar). - Experience with streaming platforms (Kafka, Kinesis, Pub/Sub) and event-driven architectures. - Deep knowledge of relational databases (PostgreSQL, Oracle, SQL Server) and NoSQL databases (MongoDB, Cassandra, DynamoDB). - Strong skills in dimensional modeling, data normalization, and schema design. - Experience with Infrastructure as Code tools (Terraform, CloudFormation, or similar). - Bachelor’s degree in Computer Science, Engineering, or related field. - This position requires US Citizenship. Preferred Qualifications - Master’s degree in Computer Science, Engineering, or related field. - Experience with data compliance requirements (FedRAMP, ITAR, HIPAA). - Experience with lakehouse platforms (Databricks, Delta Lake). - Experience with CDC tools (GoldenGate, Debezium). - Oracle Cloud experience. Benefits - Healthcare benefits. - 401(k) plan and company match. - Paid vacation time and holidays. - Well-living programs. - Short-term and long-term disability coverage. - Basic life insurance. - Tuition reimbursement.
Data Quality Assurance and Analysis Manager
State of WashingtonFounded in 1889, the State of Washington was the 42nd American territory to be admitted to the United States. Located in the Pacific Northwest, Washington is situated south of the
Title: Data Quality Assurance and Analysis Manager (Data Science & Informatics 2) Location: Olympia United States Salary $7,817.00 - $10,514.00 Monthly Location Thurston County – Olympia, WA Job Type Full Time - Permanent Remote Employment Flexible/Hybrid Job Number 2026-CRAB-001 Department County Road Administration Board Job Description: Schedule: 8am - 5pm, Mon.- Fri, with overnight travel and variable hours occasionally. Flexible schedule and work from home options are available following Agency policy. About Us: The mission of the Washington State County Road Administration Board (CRAB) is to ensure the success and accountability of all Washington county road departments. The transportation systems owned, operated, and maintained by the state's 39 counties include almost 40,000 miles of roads, 3,300 bridges, and four ferry systems. The annual county road department budget exceeds $1.2 billion per year, funded by local property taxes, a share of the state motor vehicle fuel tax, federal and state grants, and other sources. What you'll be doing: In this position, you will utilize your expertise in data collection, cleaning, validation, research methods, statistical models, and business as you lead data projects and serves as a technical lead informing program and agency leadership. You will serve as the primary bridge between the agency's IT division (which includes GIS) and the engineering and operations division by providing expert data and analytic support through design, execution, and oversight of data products as well as quantitative and mixed methods analyses of structured and unstructured data. You will provide customer-centric data design, predictive analytics, program evaluation (implementation, operations, and impact studies), reporting, visualization, and analytic data oversight integral to effective stewardship and equitable delivery of these programs. You will be responsible for data and evaluation products and services, along with leading requirements development and documentation of analytic data tables/products and automation algorithms. In addition, you will be supporting other workstreams and technical system implementation projects, enabling data-informed decision-making, evaluation of strategic goals and performance, assessment of program usage, effective use of administrative data, and incorporation of data needs and best practices into system development. Some of what you'll enjoy doing includes: - Independently extract, integrate, and clean data from large program databases (along with other data sources) generating complex queries to extract and manage data for use in data products, analytical research, evaluation, and program operations. - Respond to frequent requests for customized datasets to include everything from working with the requestor on functional requirements, performing complex data management and statistical calculations, optimizing for efficient data processing, performing validations, ensuring alignment with privacy guidelines, and determining the best approach for data transfer. - Design and construct data tables and automation functions, building complex analytical files from diverse sources. - Develop approaches to link across multiple programs' data, including probabilistic matching where direct matches aren't feasible. - Consult with Product and IT partners on data processes and infrastructure (e.g., information systems, administrative data lake/warehouse, applications/tools, reporting systems) and database object structures/tables. - Make recommendations on program production database design to ensure maximum usability of administrative data for data products and evaluation analytics. - Use statistical programming languages to develop functions and reproducible automation scripts and workflows to facilitate efficient use of data, support reporting, operations, actuarial, and program evaluation colleagues in their work. - Lead and contribute to analytic data documentation (e.g., data dictionaries). - Maintain clear documentation to ensure reproducibility and transparency of reporting processes, database objects, calculated fields, customized data sets, and program data. - Lead and develop quantitative program reports and dashboards for program and agency leadership, legislative staff and government officials, and the public, using database tools, statistical languages (e.g., SQL, R), and visualization software (e.g., Power BI). - Communicate about analytic research projects and results in plan or technical language, according to the intended audience. - Write reports that include a clear description of the approach, analysis, related context, and interpretation of the findings. - Define requirements and analytic logic models, analyze data, develop performance metrics, and conduct program evaluation for cross-functional and external partner initiatives. - Provide data-informed recommendations on data and program challenges and develop innovative approaches to solve analytics challenges that do not have readily apparent solutions. - Participate in division and agency portfolio projects, including advising on implementation of new technology system functionality to help ensure usability of resulting data. - Lead project teams in creating and carrying out data and evaluation plans by conducting data collection, management, and analysis to provide data products summarizing trends and evaluation outcomes in accordance with project objectives. REQUIRED: Qualifying candidates will meet one of the following criteria options: Option 1: Six (6) years of experience in data analysis related position/s such as data scientist, statistician, or business intelligence analyst. - This may include any combination of education/experience Option 2: Bachelor's degree in Data Science, Informatics, Statistics, Engineering, Economics, Accounting, Computer Science, Business Administration, or Mathematics AND two (2) years of experience in data analysis related position/s such as data scientist, statistician, or business intelligence analyst. Option 3: Master's degree in Data Science, Informatics, Statistics, Engineering, Economics, Accounting, Computer Science, Business Administration, or Mathematics. Required Experience Qualifications Include: - Experience designing or supporting relational databases and enterprise reporting systems. - Advanced proficiency in SQL and relational database management systems such as Microsoft SQL Server. - Experience applying data modeling principles and translating business requirements into technical specifications. - Experience designing dashboards and automated reporting solutions using enterprise business intelligence tools (e.g., Power BI, Tableau, SAP). - Proficiency in Python, R, or comparable programming languages to support analytical system design. - Experience implementing, testing, validating, and deploying reporting and database solutions in production environments. - Experience developing automated data workflows and repeatable analytical processes. - Ability to prepare technical documentation and communicate technical information to varied audiences. - Demonstrated ability to establish and maintain effective working relationships across departments. - Proficiency in Microsoft Office applications sufficient to support documentation and presentation of system information. - Experience evaluating existing data or reporting systems and recommending or implementing improvements. - Experience improving legacy processes through redesign, automation, or integration. - Ability to analyze complex system requirements and develop sustainable technical solutions. - Experience implementing measures to improve data quality and reliability. Desired Qualifications: - Experience designing data warehousing or integrated data environments. - Familiarity with enterprise data architecture principles. - Experience with GIS platforms such as ESRI products. - Experience designing systems in public sector or multi-agency environments. - Experience developing data pipelines and analytics solutions using Databricks, including work with Spark, Delta Lake, or MLflow. - Experience integrating analytics workflows with the Microsoft Power Platform, particularly Power Automate and SharePoint, to support business process automation and data governance. - Experience supporting enterprise system rollouts, vendor coordination, or procurement processes. - Experience delivering user training related to system functionality and reporting tools. - Experience implementing or optimizing analytics solutions within a Databricks lakehouse architecture. - Experience building automated business workflows using Power Automate and integrating data assets with SharePoint or other Microsoft 365 tools. - Experience supporting system upgrades, migrations, or platform transitions. - Familiarity with data governance, information security, and cloud or hybrid data environments. - Experience modernizing systems within public sector or multi-agency settings. Please provide the following documents in order to be considered; failure to do so may result in you not being considered for the position: - A letter of interest, describing how you meet the qualifications for this position as outlined in the job posting; - A current resume, detailing experience, and education; and - A current list of at least three (3) professional references with current contact information (attached or available to provide at the time of interview) NOTE: By submitting these materials, you are indicating that all information is true and correct. The state may verify information. Any untruthful or misleading information is cause for removal from the applicant pool or dismissal if employed. A resume will not substitute for completing the "duties summary" section or supplemental questions of the application. Please do not "refer to resume" for detail, or your application may be disqualified. Opportunity for All: CRAB celebrates our differences and we are committed to a workplace that supports equal opportunity employment and inclusion regardless of race, creed, color, national origin, citizenship or immigration status, marital status, families with children (including pregnancy, childbirth, or related medical conditions), sex, sexual orientation, gender identity diversity, age, status as a protected veteran, honorably discharged veteran or military status, status as an individual with the presence of any sensory, mental, or physical disability or the use of a trained dog guide or service animal by a person with disabilities or other applicable legally protected characteristics. We will also consider qualified applicants with criminal histories, consistent with applicable federal, state and local laws. You are welcome to include the name and pronoun you would like to be referred to in your materials and we will honor this as you interact with our organization. Contact Information:




