Job Closed
This listing is no longer active.
Bright Vision Technologies is a forward-thinking software development company dedicated to building innovative solutions that help businesses automate and optimize their operations. We leverage cutting-edge technologies to create scalable, secure, and user-friendly applications. We recognize that our people are our strength. We are an equal opportunity employer and place a high value on diversity and inclusion. We do not discriminate on the basis of any protected attribute. We make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Bright Vision Technologies is an Equal Opportunity Employer, including Disability/Veterans.
Hadoop Developer
Location
United States
Posted
3 days ago
Salary
$100K - $150K / year
Seniority
Mid Level
Job Description
Hadoop Developer
Bright Vision Technologies
Role Description We are seeking an experienced Hadoop Developer to design, build, and operate large-scale data processing pipelines and analytics platforms on Hadoop and related big-data ecosystems. In this role you will be responsible for ingesting, transforming, and analyzing massive volumes of structured and unstructured data to support enterprise analytics, machine learning, and reporting workloads. The ideal candidate will combine deep technical expertise across the Hadoop ecosystem with strong software engineering fundamentals and a clear understanding of how to deliver reliable, performant, and cost-effective data platforms in production environments. Key Responsibilities - Design, develop, and operate end-to-end big-data pipelines on Hadoop, ingesting data from a diverse mix of relational, file-based, streaming, and API-driven sources. - Build robust ETL/ELT workflows using Apache Spark, Hive, Pig, and Sqoop, with strong attention to data quality, idempotency, error handling, and recoverability. - Develop high-throughput streaming data pipelines using Kafka, Spark Streaming, or Flink, and integrate them with downstream analytical and operational systems. - Optimize Spark and MapReduce jobs through careful tuning of partitioning, memory, serialization, and skew handling to meet demanding SLAs at minimal cost. - Design and maintain data models and storage layouts on HDFS, Hive, HBase, and modern lakehouse formats (Parquet, ORC, Delta, Iceberg, Hudi) to balance flexibility and performance. - Implement data governance, lineage, and quality controls in collaboration with data governance and security teams. - Build robust monitoring, alerting, and logging strategies for big-data pipelines, including job-level SLAs and proactive failure detection. - Partner with data scientists and analysts to deliver curated, reliable, and well-documented datasets that accelerate their work. - Automate pipeline orchestration using Airflow, Oozie, or similar workflow engines, with clean dependency management and clear ownership boundaries. - Continuously evaluate and adopt new technologies in the big-data and cloud ecosystem (EMR, Databricks, Snowflake, BigQuery) where they offer meaningful improvements. - Lead performance reviews and architecture audits of existing pipelines, proposing concrete refactoring and optimization initiatives. - Document data architectures, schemas, pipeline behaviors, and operational runbooks in a way that makes the platform supportable as the team scales. - Mentor junior engineers and contribute to the team’s engineering standards and best practices. Qualifications - Bachelor’s degree in Computer Science, Engineering, or a related technical discipline. - Five or more years of professional experience designing and operating big-data pipelines on Hadoop. - Strong hands-on expertise with Apache Spark (Scala, Python, or Java) in production environments. - Solid experience with Hive, HDFS, Sqoop, HBase, and the broader Hadoop ecosystem. - Hands-on experience with streaming data platforms such as Kafka, Spark Streaming, or Flink. - Strong SQL skills and experience working with both relational and NoSQL data stores. - Experience with workflow orchestration tools such as Airflow or Oozie. - Solid understanding of distributed systems concepts, including partitioning, replication, and fault tolerance. - Strong scripting skills in Python or Shell. - Excellent troubleshooting, debugging, and documentation skills. Preferred Qualifications - Experience operating Hadoop on cloud platforms such as AWS EMR, Azure HDInsight, or Databricks. - Familiarity with modern lakehouse formats (Delta, Iceberg, Hudi). - Exposure to data governance tooling such as Apache Atlas or Collibra. - Experience with Kubernetes-based data platforms (Spark-on-K8s, Trino). - Hands-on experience with CI/CD and infrastructure-as-code in data engineering workflows. How to Apply For immediate consideration, please send your resume to [email protected] or contact us at (908) 650-6699. Learn more about Bright Vision Technologies at www.bvteck.com .
Related Guides
Related Job Pages
More Software Engineer Jobs
• Design, develop, and maintain Amazon Connect contact flows, IVR solutions, and call routing strategies. • Configure routing profiles, queues, callbacks, emergency messaging, and business hours/holiday routing within Amazon Connect. • Develop AWS Lambda functions and integrate Amazon Connect with DynamoDB, S3, CloudWatch, and other AWS services. • Build and support integrations with CRM platforms, third-party applications, APIs, and backend systems. • Implement conversational AI and chatbot solutions using Google Dialogflow CX or similar platforms. • Troubleshoot and resolve issues related to Amazon Connect, AWS services, and contact center operations. • Support CI/CD processes and infrastructure automation using tools such as Terraform and CloudFormation. • Collaborate with business stakeholders, operations teams, and technical teams to deliver scalable and reliable contact center solutions.
Senior Software Engineer
AppmaxO time da Appmax é feito por pessoas que encantam os parceiros e valorizam a entrega de resultados. Trabalham lado a lado para ampliar o potencial dos negócios digitais e desta forma, maximizam o seu desenvolvimento profissional. Em um ambiente inovador e colaborativo, impulsionado pelos nossos valores e atitudes, estamos revolucionando o mercado digital por meio da nossa plataforma de pagamentos online.
Role Description O time de Engenharia de Software da Appmax é o responsável por implementar através da tecnologia e inovação, as demandas priorizadas pelo time de produto, desenvolvendo e sustentando as soluções que maximizam os resultados dos nossos parceiros. - Desenvolver e evoluir serviços backend de alta performance, disponibilidade e escalabilidade; - Participar da definição arquitetural das soluções, contribuindo para decisões técnicas de médio e longo prazo; - Desenvolver código limpo, testável, seguro e de fácil manutenção, seguindo boas práticas de engenharia de software; - Atuar na evolução contínua da plataforma, identificando oportunidades de melhoria em performance, confiabilidade e escalabilidade; - Construir e manter integrações entre sistemas, APIs e serviços internos e externos; - Trabalhar com arquiteturas assíncronas, mensageria e processamento distribuído quando necessário; - Garantir a qualidade das entregas através de testes automatizados, observabilidade e monitoramento das aplicações; - Apoiar tecnicamente o time através de code reviews, compartilhamento de conhecimento e discussões arquiteturais; - Colaborar com times multidisciplinares para transformar necessidades de negócio em soluções técnicas robustas; - Participar da sustentação e evolução dos sistemas em produção, contribuindo para a estabilidade e eficiência operacional da plataforma; Qualifications - Experiência sólida no desenvolvimento de aplicações backend utilizando preferencialmente Go; - Experiência na construção e manutenção de APIs REST e/ou arquiteturas orientadas a eventos; - Experiência com testes automatizados, testes de integração e estratégias de qualidade de software; - Vivência com comunicação assíncrona, mensageria e filas (RabbitMQ, Kafka ou similares); - Experiência com otimização de performance, profiling e análise de gargalos em aplicações backend; - Conhecimento em bancos de dados relacionais e não relacionais, incluindo modelagem e otimização de consultas; - Experiência com Docker e ambientes containerizados; - Vivência com processos de CI/CD e entrega contínua; - Conhecimento sólido de arquitetura de software, design patterns e princípios de sistemas distribuídos; - Experiência com monitoramento, observabilidade, logs, métricas e tracing; - Domínio de boas práticas de desenvolvimento como SOLID, Clean Code, Clean Architecture, DRY, KISS e YAGNI; - Experiência atuando com autonomia técnica e participação ativa em decisões arquiteturais; Requirements - Experiência com Kubernetes; - Experiência com arquiteturas de microserviços; - Vivência com plataformas de alta escala e alta volumetria de transações; - Conhecimento em Event-Driven Architecture (EDA); - Experiência com observabilidade utilizando ferramentas como Prometheus, Grafana, OpenTelemetry ou similares; - Conhecimento em cloud computing (AWS, GCP ou Azure); - Experiência com PHP; - Experiência em ambientes orientados a produto; - Vivência em metodologias ágeis como Scrum ou Kanban; - Experiência atuando como referência técnica ou liderando iniciativas de engenharia. Benefits - 💻 Todos os equipamentos e recursos necessários para realizar o trabalho em modelo presencial, híbrido ou remoto; - 🌎 Ajuda de custo para despesas para quem atua no formato híbrido ou remoto; - 🍟 Flexfood, assim você não precisa escolher entre VR ou VA; - 🏥 Plano de Saúde e Odontológico; - 🏋️♀️ Wellhub; - 💊 Avus; - 🧠 Starbem; - 🩹 Convênio farmácia; - 🚌 Vale transporte; - ❤️🩹 Seguro de vida; - 📚 Upmaxter para auxiliar nos seus estudos; - 🚀 Um ambiente que favorece e incentiva o desenvolvimento e o alto desempenho com checkpoints mensais de performance, práticas de 1:1, rotinas de feedbacks contínuos, acompanhamento do PDI e muito mais...
Lead Forward Deployed Engineering
ParloaParloa, founded in 2018 by Malte Kosub and Stefan Ostwald, has rapidly evolved into a global leader in AI-powered customer service solutions, specializing in co
• Lead and develop a team of Forward Deployed Engineers (FDEs) • Own capacity planning and staffing across projects • Drive engineering delivery management — dependencies, risk management, stakeholder alignment • Implement time tracking and delivery visibility • Provide technical leadership and escalation support • Create scalable field engineering practices • Translate recurring customer needs into productization proposals • Collaborate with customer teams to deliver outcomes
• Manage a growing team of FDEs working across strategic enterprise accounts • Own what makes a world-class FDE engagement, and stay close enough to the work to escalate, coach, and course-correct in real-time • Serve as the primary point of contact for customers, owning both project delivery and the day-to-day relationship • Identify and scope new opportunities • Build our partner FDE track — training and enabling GSI and consulting partners

