Job Closed
This listing is no longer active.
Spark Engineer
Location
United States
Posted
79 days ago
Salary
0
Seniority
Mid Level
Job Description
Spark Engineer
Bright Vision Technologies
Role - Spark Engineer Bright Vision Technologies is a forward-thinking software development company dedicated to building innovative solutions that help businesses automate and optimize their operations. We leverage cutting-edge distributed data processing technologies to build scalable, high-performance analytics platforms. As we continue to grow, we’re looking for a skilled Spark Engineer to join our dynamic team and contribute to our mission of transforming business processes through technology. This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential. We are looking for OPT/CPT/H4 EAD/TN/E3 or any other Non-immigrant visa people who are looking for an H1B sponsorship for the year 2027 quota. Company: Bright Vision Technologies ( www.bvteck.com ) Job Title: Spark Engineer Job Location: Bridgewater, New Jersey - 08807 Onsite/Hybrid: Remote FULL-TIME ROLE WITH BRIGHT VISION Job Description: Environment: Apache Spark, PySpark, Spark SQL, Scala / Python, Hadoop ecosystem (HDFS, YARN), Kafka, DataFrames & Datasets, ETL pipelines, SQL, NoSQL databases, Cloud Platforms (AWS EMR / Azure Databricks), Performance tuning, Linux, CI/CD pipelines, Git, Agile methodologies BUT STRICTLY NO C2C/1099/3RD PARTY COMPANIES. ALL OUR ROLES ARE W2 AND NO 3RD PARTY BROKERING PLEASE. For every role, a coding test is required, so apply only if you are confident and technically strong. We prefer at least 3 to 5 years real time experience. If you are a Spark Engineer with the above skills and are looking for an H-1 B sponsorship this year, please send your resume immediately to Sairaj@bvteck.com. Best Regards Sairaj Sales Manager Bright Vision Technologies Email: Sairaj@bvteck.com (O): (908) 505-3454 | ext 1011 Address: #991 Route 22 West, Suite 200, Bridgewater, New Jersey - 08807 we are committed to providing equal employment opportunities and fostering an inclusive work environment. We encourage applications from all qualified individuals regardless of race, ethnicity, religion, gender identity, sexual orientation, age, disability, or any other protected status. If you require accommodations during the recruitment process, please let us know. Position offered by “No Fee agency.” Equal Employment Opportunity (EEO) Statement Bright Vision Technologies (BV Teck) is committed to equal employment opportunity (EEO) for all employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other protected status as defined by applicable federal, state, or local laws. This commitment extends to all aspects of employment, including recruitment, hiring, training, compensation, promotion, transfer, leaves of absence, termination, layoffs, and recall. BV Teck expressly prohibits any form of workplace harassment or discrimination. Any improper interference with employees' ability to perform their job duties may result in disciplinary action up to and including termination of employment. Equal Employment Opportunity (EEO) Statement Bright Vision Technologies (BV Teck) is committed to equal employment opportunity (EEO) for all employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other protected status as defined by applicable federal, state, or local laws. This commitment extends to all aspects of employment, including recruitment, hiring, training, compensation, promotion, transfer, leaves of absence, termination, layoffs, and recall. BV Teck expressly prohibits any form of workplace harassment or discrimination. Any improper interference with employees' ability to perform their job duties may result in disciplinary action up to and including termination of employment.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
• Design and implement data pipelines that integrate Warehouse Management Systems (WMS) into an existing enterprise data platform • Extend and maintain a Data Vault 2.0 architecture (Raw Vault, Business Vault, and Information Mart layers) • Develop data transformations using dbt within a Databricks Lakehouse environment • Build persistent staging and ingestion pipelines to address operational system data retention limitations • Integrate data from multiple operational and reference sources to enable consolidated cross-system reporting • Contribute to the creation of scalable Information Marts that support high-frequency analytical reporting • Follow and enhance existing automation frameworks and development standards used in the platform • Collaborate with data architects, engineers, and business stakeholders to ensure solutions are robust, scalable, and future-ready • Contribute to designing architectures that can evolve from batch ingestion to real-time data processing
Data Solutions Analyst
Liberty MutualLiberty Mutual is a leading global insurance corporation and one of the largest casualty and property insurance companies in the nation. In the past, Liberty Mutual Insurance has o
Role Description Provides, builds, and maintains prototype data solutions to meet the needs of the enterprise. Helps ensure those solutions can be scaled appropriately. Under technical direction, works within limits and authority on assignments of moderate technical complexity and coordination. Possesses demonstrated technical knowledge and skills, including product and industry, reflective of successful progression through various job family levels. May provide guidance and assistance to lower level associates and other functional areas. - Under technical direction, prototypes/develops data solutions of moderate complexity to meet the needs of the organization and business customers. - Code proof of concepts utilizing a working knowledge of multiple coding languages, leveraging reusable code modules. - May provide assistance to lower level team members. - Participate in the design and development of data solutions that enable effective self-service data consumption, and can describe their value to the customer. - Has an understanding of Agile techniques. - Can set expectations for deliverables of moderate complexity. - Participate in the maintenance of proof of concepts and prototype data solutions, and participates in any assessment of their viability and scalability, with partnership from IT. - Working with IT, assist in building robust systems focusing on long term and ongoing maintenance and support. - Ensure data solutions include deliverables required to achieve high quality data. - Has an understanding of Business Intelligence tools, including visualization and user experience techniques. - Apply a working knowledge of the principles of metadata, lineage, business definitions, compliance, and data security to project work. - Have a basic ability to understand new technologies as needed to progress initiatives. This is a remote position. For candidates who reside within 50 miles of a hub office, will be required to go in office 2 days per week. Please note this policy is subject to change. Qualifications - Strong written and oral communication skills required. - Bachelor's degree in Computer Science, Computer Engineering, or related discipline preferred. - Master's in same or related disciplines strongly preferred. - 2 to 4 years experience in coding for data management, data warehousing, or other data environments, including, but not limited to, working in NoSQL implementation, ETL, Java, scripting languages (Python, Perl, Shell), and the Hadoop stack. Benefits - Comprehensive benefits. - Workplace flexibility. - Professional development opportunities. - Opportunities provided through Employee Resource Groups. Company Description At Liberty Mutual, our goal is to create a workplace where everyone feels valued, supported, and can thrive. We build an environment that welcomes a wide range of perspectives and experiences, with inclusion embedded in every aspect of our culture and reflected in everyday interactions. Each employee plays a role in creating our inclusive culture, which supports every individual to do their best work. Together, we cultivate a community where everyone can make a meaningful impact for our business, our customers, and the communities we serve. We value your hard work, integrity and commitment to make things better, and we put people first by offering you benefits that support your life and well-being. To learn more about our benefit offerings please visit: https://LMI.co/Benefits Liberty Mutual is an equal opportunity employer. We will not tolerate discrimination on the basis of race, color, national origin, sex, sexual orientation, gender identity, religion, age, disability, veteran's status, pregnancy, genetic information or on any basis prohibited by federal, state or local law.
• Diseñar, desarrollar y optimizar pipelines de datos batch y streaming. • Modernizar y mejorar los procesos ETL existentes, implementando cargas incrementales y flujos escalables. • Modelar datos siguiendo la Arquitectura Medallion (Bronze/Silver/Gold). • Gestionar datos en el ecosistema Databricks Lakehouse: Unity Catalog, Delta Lake y estándares del entorno. • Asegurar calidad, gobernanza y consistencia de los datos dentro de los dominios asignados. • Documentar procesos y preparar una transferencia fluida al equipo interno del cliente. • Colaborar con el Product Owner y otros stakeholders para traducir requisitos funcionales en soluciones técnicas. • Participar en revisiones de código y seguir buenas prácticas de desarrollo, CI/CD y versionado.
• Diseñar, desarrollar y optimizar pipelines de datos batch y streaming. • Modernizar y mejorar los procesos ETL existentes, implementando cargas incrementales y flujos escalables. • Modelar datos siguiendo la Arquitectura Medallion (Bronze/Silver/Gold). • Gestionar datos en el ecosistema Databricks Lakehouse: Unity Catalog, Delta Lake y estándares del entorno. • Asegurar calidad, gobernanza y consistencia de los datos dentro de los dominios asignados. • Documentar procesos y preparar una transferencia fluida al equipo interno del cliente. • Colaborar con el Product Owner y otros stakeholders para traducir requisitos funcionales en soluciones técnicas. • Participar en revisiones de código y seguir buenas prácticas de desarrollo, CI/CD y versionado.



