Bitwave is the #1 enterprise accounting platform for crypto
Data Engineer
Location
United States
Posted
1 day ago
Salary
0
Seniority
Senior
Job Description
Data Engineer
Bitwave
• Use Google Big Query and GCP Suite or similar big data tools to deliver on datawarehouse and reporting requirements • Use with Databricks and similar ETL tools to perform data extract and transformation of high volume (10’s of millions) of records • Architect, Design, and Build pipelines to move large amounts of data from variety of sources (postgres DBs, REST APIs, Databricks etc) • Improve existing data warehouse architecture to enable robust user facing and internal reporting • Handle large amounts of data and complex integration processes • Build reusable code and libraries for future use • Expertise with Firestore a plus
Job Requirements
- 5+ year’s experience in programming primarily around JavaScript, SQL, Python
- Experience in Web3, dapps is a plus
- Proficient understanding of client-side scripting and JavaScript frameworks, including jQuery
- Expertise in ETL tools, data extraction, storage and transformation
- Expertise in writing and consuming web services
- Strong experience working in Agile environment and understanding of SCRUM process, CI / CD, GCP
- Strong written and verbal communication skills
- Bachelor’s degree in Computer Science or related discipline
- Interest in digital assets, decentralized finance, and cryptocurrencies
- Be passionate about software quality, writing your own tests, and more
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
• Partner with cross-functional teams to define BI and analytics requirements • Innovate with new tools to improve Muttdata's infrastructure and processes. • Design dimensional data models and build scalable data pipelines • Develop data models to feed dashboards for teams across the org, as well as client-facing analytics • Develop tools for the team and assist in tech migrations and model design. • Build scalable, high-performance data architectures. • Focus on code quality—review, document, test, and integrate CI/CD.
Senior Data Engineer
Simple Technology Solutions8(a) HUBZone IT consultancy w/ advanced partnerships w/ Amazon Web Services, Microsoft Azure & Google Cloud Platform
• design, build, and maintain well-architected ETL pipelines • work at enterprise scale and process terabytes of financial data • ensure data is timely, accurate, and stored within contractually required timelines • build and maintain ingestion pipelines using AWS Glue • process and ingest large-volume XML filings • store curated zone data in Apache Iceberg tables • prevent duplicate data loads across target destinations • integrate the agency's ETL Common Library into Glue jobs • ensure all ETL jobs populate ETL Load Reports in real-time • implement technical data quality standards • develop and maintain the semantic layer • deploy ETL resources using CloudFormation templates • create and maintain documentation suite for each dataset • support operationalization of statistical outputs and derived data products
Mid-Level Data Engineer
Simple Technology Solutions8(a) HUBZone IT consultancy w/ advanced partnerships w/ Amazon Web Services, Microsoft Azure & Google Cloud Platform
• Develop new ETL pipelines and data ingestion processes alongside senior engineers using AWS Glue (Spark-based, PySpark), MWAA (Airflow), Lambda, and SNS • Integrate the agency's ETL Common Library into Glue jobs for standardized orchestration, error handling, metadata recording, and SNS notifications for all success and error job events • Ingest structured and semi-structured datasets (CSV, XML, JSON, Avro, pipe-delimited) into S3 landing, raw, and curated zones using Apache Iceberg tables • Configure static ETL metadata in the centralized PostgreSQL metadata store; ensure dynamic metadata records job status and timestamps for all key execution steps • Monitor assigned production jobs and participate in operations support rotations • Ensure ETL Load Reports are populated in real-time and ETL Gap Reports are updated on a weekly basis • Build and maintain materialized views and semantic layer objects in Trino and Athena to ensure optimized query performance and consistent business logic • Produce and maintain required documentation for each assigned dataset: Business Requirements, ETL Design Documents, Data Models, Data Dictionaries, Mapping Documents, Deployment Documents, O&M Guides, and ETL Test Plans • Write unit and integration tests achieving the 90% minimum code coverage threshold; complete security scans at least once per sprint • Deploy ETL resources using CloudFormation templates through the agency CICD pipeline • Support transition of ETL jobs from other agency teams and disaster recovery exercises
Professor/Author | Content Curation and Validation - POWER QUERY AND ETL (M LANGUAGE) - EdTech | Vitru
Vitru EducaçãoA Vitru Educação é a maior instituição privada de ensino EAD do Brasil e referência nacional do ensino presencial e Medicina. Juntas, Vitru, Unicesumar e Uniasselvi se dedicam ao desenvolvimento individual e coletivo, priorizando o aprendizado e fazendo do conhecimento um estilo de vida.
Role Description A Vitru Educação está em busca de professor(a)-autor(a) para atuar na revisão técnica, validação acadêmica e curadoria conceitual da disciplina POWER QUERY E ETL (M LANGUAGE), do curso Power BI e Data Visualization Avançada (Storytelling e DAX), na modalidade pós-graduação EAD. SOBRE A ATIVIDADE: - Curadoria e validação de conteúdo - Revisão técnica de 3 temas (20 a 30 laudas cada) - Análise de atualidade conceitual, linguagem e adequação ao público - Conferência e eventual complementação de referências - Realização de ajustes diretamente no material (não apenas sugestões) - Atividades avaliativas e complementares - Validação de 3 questões de autoestudo por tema - Revisão e validação de 15 questões objetivas por tema - Validação de materiais complementares (1 estudo de caso + 10 questões) - Validação de roteiros e gravação de 3 videoaulas (10 a 15 minutos cada) EMENTA DA DISCIPLINA: - Conectores de dados - Transformação e limpeza de dados com Power Query - Linguagem M - Parâmetros e funções personalizadas Qualifications - Pós-graduação lato ou stricto sensu – Especialização, Mestrado ou Doutorado na área da disciplina* - Familiaridade com Google Docs e/ou Word - Organização, gestão de prazos e clareza na escrita - Experiência prévia na produção de livros ou materiais educacionais será considerada um diferencial - Power BI e Data Visualization Avançada (Storytelling e DAX) Benefits - Atividade 100% home office - Acompanhamento especializado durante todas as etapas - Publicações com registro de ISBN - Desenvolvimento de competências autorais digitais - Visibilidade nacional e reconhecimento acadêmico Company Description A Vitru valoriza e apoia a diversidade em todas as suas formas. Todas as candidaturas são bem-vindas.


