Bitwave logo
Bitwave

Bitwave is the #1 enterprise accounting platform for crypto

Data Engineer

Data EngineerData EngineerFull TimeRemoteSeniorTeam 11-50H1B No SponsorCompany SiteLinkedIn

Location

United States

Posted

1 day ago

Salary

0

Seniority

Senior

Job Description

Data Engineer

Bitwave

• Use Google Big Query and GCP Suite or similar big data tools to deliver on datawarehouse and reporting requirements • Use with Databricks and similar ETL tools to perform data extract and transformation of high volume (10’s of millions) of records • Architect, Design, and Build pipelines to move large amounts of data from variety of sources (postgres DBs, REST APIs, Databricks etc) • Improve existing data warehouse architecture to enable robust user facing and internal reporting • Handle large amounts of data and complex integration processes • Build reusable code and libraries for future use • Expertise with Firestore a plus

Job Requirements

  • 5+ year’s experience in programming primarily around JavaScript, SQL, Python
  • Experience in Web3, dapps is a plus
  • Proficient understanding of client-side scripting and JavaScript frameworks, including jQuery
  • Expertise in ETL tools, data extraction, storage and transformation
  • Expertise in writing and consuming web services
  • Strong experience working in Agile environment and understanding of SCRUM process, CI / CD, GCP
  • Strong written and verbal communication skills
  • Bachelor’s degree in Computer Science or related discipline
  • Interest in digital assets, decentralized finance, and cryptocurrencies
  • Be passionate about software quality, writing your own tests, and more

Related Categories

Related Job Pages

More Data Engineer Jobs

MUTT DATA logo

Senior Data Engineer – DBT

MUTT DATA

We are Data Nerds. Astronomer & Amazon Consulting Partners.

Data Engineer1 day ago
Full TimeRemoteTeam 51-200H1B No Sponsor

• Partner with cross-functional teams to define BI and analytics requirements • Innovate with new tools to improve Muttdata's infrastructure and processes. • Design dimensional data models and build scalable data pipelines • Develop data models to feed dashboards for teams across the org, as well as client-facing analytics • Develop tools for the team and assist in tech migrations and model design. • Build scalable, high-performance data architectures. • Focus on code quality—review, document, test, and integrate CI/CD.

Argentina
Simple Technology Solutions logo

Senior Data Engineer

Simple Technology Solutions

8(a) HUBZone IT consultancy w/ advanced partnerships w/ Amazon Web Services, Microsoft Azure & Google Cloud Platform

Data Engineer1 day ago
Full TimeRemoteTeam 51-200H1B No Sponsor

• design, build, and maintain well-architected ETL pipelines • work at enterprise scale and process terabytes of financial data • ensure data is timely, accurate, and stored within contractually required timelines • build and maintain ingestion pipelines using AWS Glue • process and ingest large-volume XML filings • store curated zone data in Apache Iceberg tables • prevent duplicate data loads across target destinations • integrate the agency's ETL Common Library into Glue jobs • ensure all ETL jobs populate ETL Load Reports in real-time • implement technical data quality standards • develop and maintain the semantic layer • deploy ETL resources using CloudFormation templates • create and maintain documentation suite for each dataset • support operationalization of statistical outputs and derived data products

United States
Simple Technology Solutions logo

Mid-Level Data Engineer

Simple Technology Solutions

8(a) HUBZone IT consultancy w/ advanced partnerships w/ Amazon Web Services, Microsoft Azure & Google Cloud Platform

Data Engineer1 day ago
Full TimeRemoteTeam 51-200H1B No Sponsor

• Develop new ETL pipelines and data ingestion processes alongside senior engineers using AWS Glue (Spark-based, PySpark), MWAA (Airflow), Lambda, and SNS • Integrate the agency's ETL Common Library into Glue jobs for standardized orchestration, error handling, metadata recording, and SNS notifications for all success and error job events • Ingest structured and semi-structured datasets (CSV, XML, JSON, Avro, pipe-delimited) into S3 landing, raw, and curated zones using Apache Iceberg tables • Configure static ETL metadata in the centralized PostgreSQL metadata store; ensure dynamic metadata records job status and timestamps for all key execution steps • Monitor assigned production jobs and participate in operations support rotations • Ensure ETL Load Reports are populated in real-time and ETL Gap Reports are updated on a weekly basis • Build and maintain materialized views and semantic layer objects in Trino and Athena to ensure optimized query performance and consistent business logic • Produce and maintain required documentation for each assigned dataset: Business Requirements, ETL Design Documents, Data Models, Data Dictionaries, Mapping Documents, Deployment Documents, O&M Guides, and ETL Test Plans • Write unit and integration tests achieving the 90% minimum code coverage threshold; complete security scans at least once per sprint • Deploy ETL resources using CloudFormation templates through the agency CICD pipeline • Support transition of ETL jobs from other agency teams and disaster recovery exercises

United States
Vitru Educação logo

Professor/Author | Content Curation and Validation - POWER QUERY AND ETL (M LANGUAGE) - EdTech | Vitru

Vitru Educação

A Vitru Educação é a maior instituição privada de ensino EAD do Brasil e referência nacional do ensino presencial e Medicina. Juntas, Vitru, Unicesumar e Uniasselvi se dedicam ao desenvolvimento individual e coletivo, priorizando o aprendizado e fazendo do conhecimento um estilo de vida.

Data Engineer1 day ago

Role Description A Vitru Educação está em busca de professor(a)-autor(a) para atuar na revisão técnica, validação acadêmica e curadoria conceitual da disciplina POWER QUERY E ETL (M LANGUAGE), do curso Power BI e Data Visualization Avançada (Storytelling e DAX), na modalidade pós-graduação EAD. SOBRE A ATIVIDADE: - Curadoria e validação de conteúdo - Revisão técnica de 3 temas (20 a 30 laudas cada) - Análise de atualidade conceitual, linguagem e adequação ao público - Conferência e eventual complementação de referências - Realização de ajustes diretamente no material (não apenas sugestões) - Atividades avaliativas e complementares - Validação de 3 questões de autoestudo por tema - Revisão e validação de 15 questões objetivas por tema - Validação de materiais complementares (1 estudo de caso + 10 questões) - Validação de roteiros e gravação de 3 videoaulas (10 a 15 minutos cada) EMENTA DA DISCIPLINA: - Conectores de dados - Transformação e limpeza de dados com Power Query - Linguagem M - Parâmetros e funções personalizadas Qualifications - Pós-graduação lato ou stricto sensu – Especialização, Mestrado ou Doutorado na área da disciplina* - Familiaridade com Google Docs e/ou Word - Organização, gestão de prazos e clareza na escrita - Experiência prévia na produção de livros ou materiais educacionais será considerada um diferencial - Power BI e Data Visualization Avançada (Storytelling e DAX) Benefits - Atividade 100% home office - Acompanhamento especializado durante todas as etapas - Publicações com registro de ISBN - Desenvolvimento de competências autorais digitais - Visibilidade nacional e reconhecimento acadêmico Company Description A Vitru valoriza e apoia a diversidade em todas as suas formas. Todas as candidaturas são bem-vindas.

Brazil