Job Closed

This listing is no longer active.

Big Data Developer / Engineer

Location

United States

Posted

93 days ago

Salary

0

Job Description

Big Data Developer / Engineer

Bright Vision Technologies

Bright Vision Technologies is a forward-thinking software development company dedicated to building innovative solutions that help businesses automate and optimize their operations. We leverage cutting-edge big data technologies to design scalable, reliable, and high-performance data platforms. As we continue to grow, we’re looking for a skilled Big Data Developer / Engineer to join our dynamic team and contribute to our mission of transforming business processes through technology. This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential. We are looking for OPT/CPT/H4 EAD/TN/E3 or any other Non-immigrant visa people who are looking for an H1B sponsorship for the year 2027 quota. Company: Bright Vision Technologies ( www.bvteck.com ) Job Title: Big Data Developer / Engineer Job Location: Bridgewater, New Jersey - 08807 Onsite/Hybrid: Remote Job Description: Environment: Apache Hadoop, Spark, PySpark, Scala, Kafka, HDFS, Hive, HBase, Airflow, Data Warehousing, ETL pipelines, SQL, NoSQL databases, Cloud Platforms (AWS / Azure / GCP), Big Data services (EMR, Dataproc), Docker, Linux, CI/CD pipelines, Git, Agile methodologies BUT STRICTLY NO C2C/1099/3RD PARTY COMPANIES. ALL OUR ROLES ARE W2 AND NO 3RD PARTY BROKERING PLEASE. For every role, a coding test is required, so apply only if you are confident and technically strong. We prefer at least 3 to 5 years real time experience. If you are a Big Data Developer / Engineer with the above skills and are looking for an H1B sponsorship this year, please send your resume immediately to venkat.r@bvteck.com. we are committed to providing equal employment opportunities and fostering an inclusive work environment. We encourage applications from all qualified individuals regardless of race, ethnicity, religion, gender identity, sexual orientation, age, disability, or any other protected status. If you require accommodations during the recruitment process, please let us know. Position offered by “No Fee agency.”Equal Employment Opportunity (EEO) Statement Bright Vision Technologies (BV Teck) is committed to equal employment opportunity (EEO) for all employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other protected status as defined by applicable federal, state, or local laws. This commitment extends to all aspects of employment, including recruitment, hiring, training, compensation, promotion, transfer, leaves of absence, termination, layoffs, and recall. BV Teck expressly prohibits any form of workplace harassment or discrimination. Any improper interference with employees' ability to perform their job duties may result in disciplinary action up to and including termination of employment.

Related Categories

Related Job Pages

More Data Engineer Jobs

Fulton Bank logo

IT Data Quality Senior Engineer

Fulton Bank

Fulton Bank is a financial services company interested in hiring organized, reliable, and detail-oriented professionals "who are passionate about collaboration, customer service, a

Data Engineer93 days ago

Value Proposition Our values define us and our culture inspires us to change lives for the better. Our employees are the heart and soul of our company, and every success we experience begins with them. Together we are committed to making a positive impact in our local communities. We champion a culture of continuous learning, work-life integration, and inclusion. We promote a digitally enabled work environment to continuously enhance the experience of our employees and customers. Overview This is a full-time career opportunity that can be remote within the Fulton Bank footprint as follows: DC, DE, MD, NJ, PA, VA. Must have the ability to be onsite once per month at our East Petersburg, PA location. The Data Quality Senior Engineer is a highly qualified individual contributor in the data quality space with dedicated focus on data quality, controls, validations, subject matter expertise between the business and IT, general data-related lights on activities and assurance for overall standards and compliance for optimum quality related to project work. Incumbents are responsible for the quality of the work as it relates to the architecture, development, and visualization for data related responsibilities. This role drives improvement and accountability for data quality processes and optimization. Responsibilities - Leverage technology to automate and optimize validations, profile data, implement business rules, visualize results, and work with data stewards in all applications/lines of business to address any data quality issues. Uphold Data Quality Standards to ensure compliance and best business practices across the corporation. - Provide a high level of subject matter expertise between the business and IT to ensure the data requirements are accurate and specific, as well as ensure the output meets the acceptance criteria. - Design, build, and implement robust validations, adequate controls using point-to-point testing, and source to target mapping to ensure high quality results for all data implementations and projects. Troubleshoot, analyze, trace, and identify root causes of quality issues which involves dissecting Stored Procedures, STTM documents and source data. Provide suggestions to architecture/ query / stored procedure changes where applicable. - Monitor controls and aid in remediation as required. - Oversee and review the data quality related work of lower-level engineers or team members, acting as an escalation point or coaching peers when appropriate. Additional Responsibilities - Supports data governance (DG) initiatives including profiling of Critical Data Elements (CDEs) and other DG responsibilities as required. Qualifications Education High School Diploma or equivalent. Specialty: IT, Data, Information Systems. (Required) Master's Degree or the equivalent experience. Specialty: business, management, IT, Data, Information Systems. (Preferred) Required Experience - 5 or more years data quality, validations, controls, testing, source to target mapping, project management. - 3 or more years banking/line of business experience - 2 or more years SQL Server and SSIS experience Preferred Experience - 1 or more years of Python experience Certifications Data Governance Certification (Dataversity, ICCP, CDMP, or others). (Preferred) Knowledge, Skills, and Abilities - Technical Acumen (Python, SQL, SAS, and/or other technical tools) (Required) - Great communication to bridge the gap between the business and IT (Required) Other Duties as Assigned by Manager This role may perform other job duties as assigned by the manager. Each employee of the Organization, regardless of position, is accountable for reading, understanding and acting on the contents of all Company-assigned and/or job related Compliance Programs, regulations and policies and procedures, as well as ensure that all Compliance Training assignments are completed by established due dates. This includes but is not limited to, understanding and identifying compliance risks impacting their department(s), ensuring compliance with applicable laws or regulations, and escalating compliance risks to the appropriate level of management. Pay Transparency To provide greater transparency to candidates, we share base salary ranges on all job postings regardless of state. We set standard salary ranges for our roles based on the position, function, and responsibilities, as benchmarked against similarly sized companies in our industry. Specific compensation offered will be determined based on a combination of factors including the candidate’s knowledge, skills, depth of work experience, and relevant licenses/credentials. The salary range may vary based on geographic location. The salary range for this position is $88,500.00 - $147,600.00 annually. Additional Compensation Components This job is eligible to receive equity in the form of restricted stock units. This job is eligible to participate in a short-term incentive compensation plan subject to individual and company performance. Benefits Additionally, as part of our Total Rewards program, Fulton Bank offers a comprehensive benefits package to those who qualify. This includes medical plans with prescription drug coverage; flexible spending account or health savings account depending on the medical plan chosen; dental and vision insurance; life insurance; 401(k) program with employer match and Employee Stock Purchase Plan; paid time off programs including holiday pay and paid volunteer time; disability insurance coverage and maternity and parental leave; adoption assistance; educational assistance and a robust wellness program with financial incentives. To learn more about your potential eligibility for these programs, please visit Benefits & Wellness | Fulton Bank. EEO Statement Fulton Bank (“Fulton”) is an equal opportunity employer and is committed to providing equal employment opportunity for all qualified persons. Fulton will recruit, hire, train and promote persons in all job titles, and ensure that all other personnel actions are administered, without regard to race, color, religion, creed, sexual orientation, national origin, citizenship, gender, gender identity, age, genetic information, marital status, disability, covered veteran status, or any other legally protected status. Sponsorship Statement As a condition of employment, individuals must be authorized to work in the United States without sponsorship for a work visa by Fulton Bank currently or in the future.

United States
$88.5K - $147K / year
Job Closed
OtherRemoteTeam 10,001+Since 2017H1B Sponsor

• Provide hands-on technical direction, architectural oversight, and implementation leadership for the design, development, and operation of the data warehouse environment • Lead the design, implementation, and maintenance of the Medicaid Enterprise Data Warehouse architecture (data models, ETL/ELT pipelines, metadata, and BI layers) • Define and enforce data architecture standards, integration patterns, and performance optimization strategies • Oversee the development and optimization of ETL/ELT processes to extract, transform, and load data from MMIS, MCOs, and other Medicaid source systems • Implement and enforce data governance, lineage tracking, and metadata management standards • Monitor system performance and troubleshoot complex data or processing issues • Serve as the primary technical point of contact for MEDW development and support teams

United States
$110K - $140K / year
OtherRemoteTeam 1,001-5,000Since 1946H1B Sponsor

AIR is currently seeking a Medicaid Data Programmer. This role is ideal for a programmer with deep experience working with Medicaid administrative data, including eligibility, enrollment, claims, and managed care encounter data. The Medicaid Data Programmer II will contribute to applied health services research and policy analysis by transforming complex administrative datasets into high-quality analytic files and research-ready outputs. The ideal candidate will participate in all aspects of project work, including data ingestion, data quality assessment, analytic file development, statistical analysis, and documentation. This position emphasizes Medicaid data expertise, data engineering, and analytic rigor over reliance on any single programming language. The Medicaid Data Programmer will report to AIR's Healthcare Innovations Team, which supports high-quality implementation and produces rigorous evidence on the effectiveness of new approaches to care and payment—translating findings into actionable insights for policymakers, payers, providers, and patients. This position has the flexibility to work remotely within the United States (U.S.) or from one of AIR’s U.S. office locations. This does not include U.S. territories. About AIR: Founded in 1946 and headquartered in Arlington, Virginia, the American Institutes for Research (AIR) is a nonpartisan, not-for-profit organization that conducts behavioral and social science research and delivers technical assistance to address some of the most pressing challenges in the United States and globally. We generate evidence and apply data-driven solutions that expand opportunities and improve lives for all. Responsibilities: - Work with large-scale Medicaid administrative datasets, including eligibility, enrollment, claims, encounters, and provider files. - Extract, clean, recode, merge, and de-duplicate complex administrative data from multiple sources. - Convert and integrate data across analytic environments and formats (e.g., STATA, R, Python, SQL-based systems, mainframe extracts, or cloud-based platforms). - Perform data quality checks, logic checks, and validation analyses to ensure accuracy and completeness of analytic datasets. - Handle missing data, conduct outlier analyses, and construct derived variables and analytic measures. - Develop research-ready datasets to support health policy analysis, program evaluation, and reporting. - Produce tables, figures, and customized analytic outputs for internal and external stakeholders. - Contribute to statistical analyses under the direction of senior researchers. - Write and maintain clear documentation for data processing steps, analytic decisions, and code changes. - Troubleshoot and revise existing code and workflows to improve performance, reproducibility, and accuracy. - Provide technical guidance or informal mentoring to junior programming staff, as appropriate. - Contribute to technical sections of reports and proposals. - Perform other related duties as assigned. Qualifications: Education, Knowledge, and Experience - Undergraduate degree in Statistics, Epidemiology, Economics, Health Informatics, Computer Science, or a related field. - At least 3 years of experience working directly with Medicaid administrative data, including claims and/or encounter data. - Strong hands-on experience using one or more programming or analytic languages (e.g., SQL, R, Python, STATA, or similar) to manage and analyze large datasets. - Demonstrated experience producing analytic datasets, summary tables, and figures for research or policy projects. - Familiarity with Medicaid data structures, coding systems (e.g., ICD, CPT, HCPCS, NDC), and enrollment or eligibility concepts. - Experience working with CMS Medicaid and Medicare Research Identifiable Files (RIF) and/or secure data environments (such as the CMS Virtual Research Data Center) preferred, but not required. - Experience supporting proposal development or technical write-ups preferred, but not required. Skills - Strong data management and data processing skills. - Excellent attention to detail and commitment to data accuracy and documentation. - Strong organizational and time-management skills. - Ability to clearly communicate technical concepts to non-technical audiences. - Strong interpersonal skills and ability to collaborate effectively in a multidisciplinary team environment. - Ability to learn new tools, data structures, and analytic approaches quickly. - Experience applying data programming skills in a health policy or health services research context preferred. Disclosures: Applicants must be currently authorized to work in the U.S. on a full-time basis. Employment-based visa sponsorship (including H-1B sponsorship) is not available for this position. Depending on project work, qualified candidates may need to meet certain residency requirements. American Institutes for Research is an equal employment opportunity/affirmative action employer. All qualified applicants will receive consideration for employment without discrimination on the basis of age, race, color, religion, sex, gender, gender identity/expression, sexual orientation, national origin, protected veteran status, or disability. AIR adheres to strict child safeguarding principles. All selected candidates will be expected to adhere to these standards and principles and will therefore undergo reference and background checks. AIR maintains a drug-free work environment. ACCESSIBILITY NOTICE: If you need a reasonable accommodation for any part of the employment process due to a physical or mental disability, please send an email to Taliba Boone at tboone@air.orgor call 202.403.5000. Fraudulent Job Scams Warning & Disclaimer: AIR is aware of individuals falsely presenting themselves as AIR representatives. Fraudulent job scams seek to extract sensitive information or money from victims. To protect yourself, please be aware that AIR recruitment will only email you from an “@air.org” domain. Please take extra caution while examining the email address, for example jdoe@air.org is correct and jdoe@aircareers.org is not a legitimate AIR email address. If you are unsure of the legitimacy of a communication you have received, please reach out torecruitment@air.org. If you see a job scam, or lose money to one, report it to the Federal Trade Commission (FTC) atReportFraud.ftc.gov. You can also report it to your state attorney general. Find out more about how to avoid scams atftc.gov/scams. #LI-AS1 #LI-REMOTE AIR’s Total Rewards Program, is designed to reward our staff competitively and motivate them to achieve our critical mission. This position offers the anticipated annual salary as listed. Salary offers are made based on internal equity within the institution and external equity with competitive markets. Please note this is the annual salary range for candidates that are based in the United States. Anticipated Annual Salary Range $12,500—$166,800 USD

United States
Data Engineer93 days ago
OtherRemoteTeam 201-500Since 2003H1B No Sponsor

Role: Senior Data Engineer Remote Work *Must be a US Citizen & have a USA Passport Primary Responsibilities: - Design, develop, and maintain scalable data pipelines using Python, PySpark, and other modern programming languages to support both batch and streaming workloads - Build and optimize data processing frameworks on cloud platforms such as Databricks or Snowflake, ensuring performance, reliability, and cost efficiency - Design and implement robust data models, including transactional (OLTP) and dimensional (OLAP) schemas, to support analytics, reporting, and application integration - Develop high quality SQL code including complex queries, stored procedures, and views, with a focus on performance tuning and efficient data access patterns - Create and manage workflow orchestration using Apache Airflow or similar tools, ensuring reliable scheduling, dependency management, and monitoring - Implement and enforce data governance and metadata standards through tools such as Microsoft Purview, including data lineage, classification, cataloging, and security policies - Build automated data quality and validation frameworks to ensure accuracy, completeness, and reliability of production datasets - Collaborate with cross functional teams including data architects, analysts, scientists, and business stakeholders to understand requirements and deliver scalable, well designed data solutions - Lead technical design sessions and code reviews, promoting engineering best practices, reusability, and maintainability - Support cloud infrastructure and DevOps practices, including CI/CD pipelines, version control, testing automation, and environment management - Monitor and troubleshoot production data pipelines, proactively addressing issues, performance bottlenecks, and system failures - Contribute to the evolution of the enterprise data platform, recommending tools, frameworks, and architectures to improve scalability and efficiency You’ll be rewarded and recognized for your performance in an environment that will challenge you and give you clear direction on what it takes to succeed in your role as well as provide development for other roles you may be interested in. Required Qualifications: - 7+ years of experience in data engineering, software engineering, or similar disciplines - Hands-on experience with Databricks or Snowflake - Experience with orchestration tools such as Apache Airflow - Experience working with cloud ecosystems (Azure preferred; AWS/GCP acceptable) - Advanced SQL skills and experience with OLTP and OLAP data modeling - Solid understanding of modern data warehousing, data lake, and ELT/ETL design patterns - Familiarity with data governance tools, especially Microsoft Purview - Solid programming expertise in Python, PySpark, or similar languages - If you are offered this position, you will be required to provide extensive personal information to obtain and maintain a suitability or determination of eligibility for a Confidential/Secret or Top Secret security clearance as a condition of your employment - United States Citizenship Preferred Qualifications: - Healthcare industry experience, including claims, clinical, FHIR, HL7, or provider data - Experience with containerization (Docker, Kubernetes) for data workloads - Experience supporting machine learning workflows or analytical data science pipelines - Knowledge of distributed computing concepts and performance tuning This is a remote position.

United States
$55 - $60 / hour