Job Closed
This listing is no longer active.
Creating optimal customer experiences through digital transformation.
Senior Data Engineer
Location
Michigan
Posted
113 days ago
Salary
0
Seniority
Senior
Job Description
Senior Data Engineer
OneMagnify
• Work as part of a GCP implementation team from concept to operations • Provide deep technical subject matter expertise for successful deployment of Data Platform automation • Provide technical guidance, mentorship, and code-level support to the development team • Drive effective and efficient delivery, focusing on speed, identifying risks, implementing mitigation/contingency plans and test/compare competing solutions • Design and build production data engineering solutions to deliver our pipeline patterns using GCP Services • Ensure data quality, maintain profiles of data products, monitor system performance
Job Requirements
- Experience in data engineering pipelines
- Experience in data warehouse systems
- Experience with ETL principles
- Experience with complex SQL queries
- GCP experience working in Big Data deployments leveraging BigQuery, Google Cloud Storage, Dataflow, Dataproc, Cloud Run
- Familiarity with Python, VS Code, GitHub, Tekton, and Terraform
- Experience with DAGs with Astronomer and Apache Airflow
- GCP Certification Preferred - Professional Data Engineer or Associate Cloud Engineer
- Experience in Qlik Sense, Looker, and Power BI preferred but not required
- Understands data architecture and design independent of the technology
- Experience working with Agile and Lean methodologies
- Experience with Test-Driven Development
- Problem solving and communication skills and management of multiple stakeholders
- Ability to provide analytic and creative solutions to business problems by deep-dives into data
Benefits
- medical
- dental
- 401(k)
- paid holidays
- vacations
- more
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
• Develop, maintain and evolve data pipelines for ingestion, transformation and delivery of large-scale data, covering both batch and streaming processing • Design, optimize and maintain ETL/ELT processes using Apache Spark and Delta Lake, ensuring data performance, quality and reliability • Integrate data solutions with AWS services such as AWS Glue, Amazon DynamoDB, Amazon Athena, AWS Lambda and Amazon SQS • Monitor pipeline execution and health using Amazon CloudWatch, proactively identifying and resolving failures • Automate data infrastructure using AWS CloudFormation to ensure standardization, scalability and version control • Apply the Medallion architecture pattern (Bronze, Silver and Gold) for organization, governance and evolution of analytical data
Senior Data Engineer – Real-Time & Distributed Systems, GCP
InnodataInnodata, with over 35 years of expertise, is a trusted leader in data solutions and AI innovation. The company specializes in training and deploying generative
• Design, build, and optimize scalable data pipelines for batch and real-time processing • Develop and maintain event-driven architectures for high-throughput systems • Ensure data reliability, performance, and low-latency processing across distributed environments • Collaborate with data scientists and application teams to enable analytics and AI use cases • Implement best practices in performance tuning, monitoring, and cost optimization
• Design and develop our Teamified AI data architecture & API using Python (Django Framework) and other relevant python libraries • Manage our RDBMs [SQL], NoSQL [MongoDb] and Vector [Pinecone] databases and conduct proper data governance & research • Collaborate with our leadership, product experts and software architect to integrate AI solutions into our Teamified Platform • Optimize AI augmentation models, context builders and prompt builders for performance, scalability, and efficiency. • Conduct research and stay up-to-date on the latest advancements in AI and data engineering.
Data Migration Analyst
Mark43Mark43 is a trusted leader in public safety technology, providing innovative solutions to help law enforcement and public safety agencies save time, ensure comp
• Lead pre-migration discovery sessions with public safety agencies. • Guide agencies through completion of migration questionnaires and data documentation. • Serve as the primary migration point of contact for agency stakeholders. • Clearly explain differences between legacy systems and Mark43 data structures and functionality. • Bridge gaps between how data existed historically and how it will function within Mark43. • Partner closely with the Mark43 Data Migration Engineering team to translate agency requirements into technical migration deliverables. • When applicable, collaborate with third-party migration contractors to support accurate data mapping, transformation, and execution. • Ensure alignment between customer expectations and technical implementation. • Support project planning and track migration milestones alongside project Program Managers. • Identify data risks, inconsistencies, and timeline concerns early in the process. • Facilitate structured migration validation rounds with agencies. • Track validation feedback and drive issue resolution in coordination with engineers and contractors. • Participate in user acceptance testing and quality assurance efforts. • Contribute to improving migration questionnaires, documentation, and validation workflows. • Support scalable and repeatable migration processes within Professional Services.



