Provider of SaaS Technology Platforms
Data Engineer – Azure
Location
New Zealand
Posted
135 days ago
Salary
0
Seniority
Senior
Job Description
Data Engineer – Azure
ICM Asia Pacific
• Deliver data solution architecture for clients (data lakes, cloud data warehouses, data enhancement via machine learning APIs) • Be part of a team on larger scale deployment and deployments • Lead in the development and implementations of the company’s data engineering solutions on Azure • Undertake hands-on development for client projects • Provide guidance and demonstrate best practices when delivering solutions • Understand and utilise modern data platforms (cloud or on-premises) • Create and design compelling architectural blueprints to deliver value to our clients • Implement data engineering and machine learning solutions on the Azure technology stack • Identify and propose development and architectural improvements to existing systems • Participate in planning meetings as required
Job Requirements
- At least 4 years of professional experience in a consulting environment on a cloud Platform with a focus on Azure
- Ideally you should at least have one valid and active Azure certification
- Hands on and experience building Data Analytics solutions on Azure (e.g. ADLS Gen2, Synapse Analytics, SQL Database, CosmosDB, Azure Data Factory, Azure Functions, Azure Logic Apps, Event Hubs, Databricks, PowerBi, Azure DevOps)
- Experience in Spark (Scala/Python/Java) and Kafka
- Experience architecting and building Data Lakes on Azure (ADLS Gen2)
- Experience building data models in a CDW (Synapse) based on Start Schemas, Wide Tables (or OBT)
- Experience working with AI/ML as a service
- Knowledge in MDM, Metadata Management, Data Quality, Data Lineage tools and more generally in Data Governance
- End to End Data Engineering and Lifecycle (including non-functional requirements and operations) management
- Regulatory and Compliance work in Data Management
- End to End Solution Design skills - Prototyping, Usability testing and data visualization literacy.
- Experience with SQL and NoSQL modern data stores.
- Knowledge in both SQL and Python
- Experienced in use of industry-leading CI/CD platforms such as Git, Azure DevOps
Benefits
- Competitive remuneration package
- Casual Friday morning tea and early evening nibbles and drinks are on us
- You choose your weapon: either a MacBook Pro or a Windows workstation
- Your mobile subscription is on us
- A central office in the heart of Ponsonby and Grey Lynn
- If you’ve got a dog, bring it to the office!
- Access to Azure certification trainings and exams
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
• Become a trusted advisor working together with our clients • Work independently as part of a small team to solve complex data engineering use-cases across a variety of industries • Design and develop the analytical layer, building cloud data warehouses, data lakes, ETL/ELT pipelines, and orchestration jobs • Work with modern tools such as Snowflake, Databricks, Fivetran, and dbt and credentialize your skills with certifications • Write code in SQL, Python, and Spark, and use software engineering best-practices such as Git and CI/CD • Support the deployment of data science and ML projects into production
Lead Data Engineer – School of Medicine Information Technology
Emory UniversityLocated in Atlanta, Georgia, Emory University is one of the world’s leading research universities. A top-ranked, private institution dedicated to serving huma
• Works as a positive team member of a project that may consist of Business Analysts, Project Managers, Information Architects, Data Analysts, and/or Database Administrators to deliver quality applications and components within scope, on time, within budget, and ensures compliance. • Manages workload effectively and report status of tasks in a timely manner. • Is able to guide stakeholders on solutions and support structure. • Ensures proper governance of prioritizing work from partners. • Forms tactical strategies to support multiple clients. • Leads and proactively identifies emerging technologies; develops proof-of-concepts, and promotes the usage of these emerging technologies. • Leads small to medium size technical teams, and mentors other analysts on regulation adherence. • Follows standard operational procedures and HIPAA regulations. • Develops strategies for managing complex data sets through maintaining data standards and metadata. • Applies biomedical informatics technical standards, methodologies, and principles to research-specific program needs, objectives, and outcomes. • Develops reporting infrastructure to meet multiple client needs. • Generates standard templates for architecture documentation related to current and proposed informatic solutions. • Performs other related duties as required.
Data Engineer – Intermediate
Mama MoneyAn innovative, rapidly growing tech company and the world’s first Social Business Money Transfer Operator.
• Work closely with Product and Development teams to help deliver components of the data roadmap • Gain a strong understanding of the organisation’s data needs and contribute to building accessible, reliable data solutions • Develop an interest across key business areas such as customer acquisition, conversion, retention, commercial performance, and user experience • Build, refine, and deliver data backlog items in collaboration with the Agile development team • Design, build, and maintain data pipelines, integrations, and transformations to support business reporting and analytics • Support data analysis, dashboard development, and self-service analytics by providing clean, well-structured datasets • Implement data management best practices to ensure data quality, consistency, and reliability • Apply techniques for accurate and complete data collection and validation • Follow secure and efficient procedures for data handling, storage, and processing • Assist colleagues with data access, extracts, and reporting as required • Monitor data systems and pipelines to identify issues, performance bottlenecks, and opportunities for improvement • Troubleshoot data-related issues and support routine maintenance and enhancements • Help ensure data platforms and databases are protected from data loss and security risks • Analyse data trends and provide well-structured datasets to support informed decision-making
• Architect end-to-end solutions to gather product telemetry, including offline data collection. • Evolve and maintain our telemetry stack with a strong focus on cost efficiency and scalability. • Define and implement best practices for product telemetry tracking, including standards, tests, and data plans, with a focus on quality and consistency. • Own and manage our data stacks, ensuring they scale with product and organizational needs. • Build and maintain data pipelines that connect business metrics with product metrics to empower product teams. • Support engineering teams by investigating data consistency issues and debugging complex SQL queries. • Share knowledge and mentor engineers on data architecture, tooling, and best practices. • Collaborate closely with the Director of Engineering to establish the data roadmap and translate stakeholder needs into clear action items.




