ICM Asia Pacific logo
ICM Asia Pacific

Provider of SaaS Technology Platforms

Data Engineer – Azure

Data EngineerData EngineerFull TimeRemoteSeniorTeam 11-50H1B No SponsorCompany SiteLinkedIn

Location

New Zealand

Posted

135 days ago

Salary

0

Seniority

Senior

Bachelor Degree4 yrs expExperience acceptedEnglishAzureJavaApache KafkaNoSQLPythonScalaApache SparkSQL

Job Description

Data Engineer – Azure

ICM Asia Pacific

• Deliver data solution architecture for clients (data lakes, cloud data warehouses, data enhancement via machine learning APIs) • Be part of a team on larger scale deployment and deployments • Lead in the development and implementations of the company’s data engineering solutions on Azure • Undertake hands-on development for client projects • Provide guidance and demonstrate best practices when delivering solutions • Understand and utilise modern data platforms (cloud or on-premises) • Create and design compelling architectural blueprints to deliver value to our clients • Implement data engineering and machine learning solutions on the Azure technology stack • Identify and propose development and architectural improvements to existing systems • Participate in planning meetings as required

Job Requirements

  • At least 4 years of professional experience in a consulting environment on a cloud Platform with a focus on Azure
  • Ideally you should at least have one valid and active Azure certification
  • Hands on and experience building Data Analytics solutions on Azure (e.g. ADLS Gen2, Synapse Analytics, SQL Database, CosmosDB, Azure Data Factory, Azure Functions, Azure Logic Apps, Event Hubs, Databricks, PowerBi, Azure DevOps)
  • Experience in Spark (Scala/Python/Java) and Kafka
  • Experience architecting and building Data Lakes on Azure (ADLS Gen2)
  • Experience building data models in a CDW (Synapse) based on Start Schemas, Wide Tables (or OBT)
  • Experience working with AI/ML as a service
  • Knowledge in MDM, Metadata Management, Data Quality, Data Lineage tools and more generally in Data Governance
  • End to End Data Engineering and Lifecycle (including non-functional requirements and operations) management
  • Regulatory and Compliance work in Data Management
  • End to End Solution Design skills - Prototyping, Usability testing and data visualization literacy.
  • Experience with SQL and NoSQL modern data stores.
  • Knowledge in both SQL and Python
  • Experienced in use of industry-leading CI/CD platforms such as Git, Azure DevOps

Benefits

  • Competitive remuneration package
  • Casual Friday morning tea and early evening nibbles and drinks are on us
  • You choose your weapon: either a MacBook Pro or a Windows workstation
  • Your mobile subscription is on us
  • A central office in the heart of Ponsonby and Grey Lynn
  • If you’ve got a dog, bring it to the office!
  • Access to Azure certification trainings and exams

Related Categories

Related Job Pages

More Data Engineer Jobs

Full TimeRemoteTeam 51-200H1B Sponsor

• Become a trusted advisor working together with our clients • Work independently as part of a small team to solve complex data engineering use-cases across a variety of industries • Design and develop the analytical layer, building cloud data warehouses, data lakes, ETL/ELT pipelines, and orchestration jobs • Work with modern tools such as Snowflake, Databricks, Fivetran, and dbt and credentialize your skills with certifications • Write code in SQL, Python, and Spark, and use software engineering best-practices such as Git and CI/CD • Support the deployment of data science and ML projects into production

Colombia
Emory University logo

Lead Data Engineer – School of Medicine Information Technology

Emory University

Located in Atlanta, Georgia, Emory University is one of the world’s leading research universities. A top-ranked, private institution dedicated to serving huma

Data Engineer135 days ago

• Works as a positive team member of a project that may consist of Business Analysts, Project Managers, Information Architects, Data Analysts, and/or Database Administrators to deliver quality applications and components within scope, on time, within budget, and ensures compliance. • Manages workload effectively and report status of tasks in a timely manner. • Is able to guide stakeholders on solutions and support structure. • Ensures proper governance of prioritizing work from partners. • Forms tactical strategies to support multiple clients. • Leads and proactively identifies emerging technologies; develops proof-of-concepts, and promotes the usage of these emerging technologies. • Leads small to medium size technical teams, and mentors other analysts on regulation adherence. • Follows standard operational procedures and HIPAA regulations. • Develops strategies for managing complex data sets through maintaining data standards and metadata. • Applies biomedical informatics technical standards, methodologies, and principles to research-specific program needs, objectives, and outcomes. • Develops reporting infrastructure to meet multiple client needs. • Generates standard templates for architecture documentation related to current and proposed informatic solutions. • Performs other related duties as required.

United States
Job Closed
Mama Money logo

Data Engineer – Intermediate

Mama Money

An innovative, rapidly growing tech company and the world’s first Social Business Money Transfer Operator.

Data Engineer135 days ago
Full TimeRemoteTeam 51-200H1B No Sponsor

• Work closely with Product and Development teams to help deliver components of the data roadmap • Gain a strong understanding of the organisation’s data needs and contribute to building accessible, reliable data solutions • Develop an interest across key business areas such as customer acquisition, conversion, retention, commercial performance, and user experience • Build, refine, and deliver data backlog items in collaboration with the Agile development team • Design, build, and maintain data pipelines, integrations, and transformations to support business reporting and analytics • Support data analysis, dashboard development, and self-service analytics by providing clean, well-structured datasets • Implement data management best practices to ensure data quality, consistency, and reliability • Apply techniques for accurate and complete data collection and validation • Follow secure and efficient procedures for data handling, storage, and processing • Assist colleagues with data access, extracts, and reporting as required • Monitor data systems and pipelines to identify issues, performance bottlenecks, and opportunities for improvement • Troubleshoot data-related issues and support routine maintenance and enhancements • Help ensure data platforms and databases are protected from data loss and security risks • Analyse data trends and provide well-structured datasets to support informed decision-making

South Africa
Job Closed
Full TimeRemoteTeam 51-200Since 2016H1B Sponsor

• Architect end-to-end solutions to gather product telemetry, including offline data collection. • Evolve and maintain our telemetry stack with a strong focus on cost efficiency and scalability. • Define and implement best practices for product telemetry tracking, including standards, tests, and data plans, with a focus on quality and consistency. • Own and manage our data stacks, ensuring they scale with product and organizational needs. • Build and maintain data pipelines that connect business metrics with product metrics to empower product teams. • Support engineering teams by investigating data consistency issues and debugging complex SQL queries. • Share knowledge and mentor engineers on data architecture, tooling, and best practices. • Collaborate closely with the Director of Engineering to establish the data roadmap and translate stakeholder needs into clear action items.

Germany
Job Closed