This page tracks remote data engineer openings that are location-eligible for Virginia.
Open jobs
3,233
Hiring companies this week
9
Salary sample
$17 - $125,000
Jobs added last hour
0
3233 Jobs
1926 Companies
Role Description The ideal candidate for this role is well-organized, analytical, and interested in developing expertise within enterprise systems and data management through SAP Global. While prior experience with SAP and data entry tasks are beneficial, they are not required – we are committed to training motivated and qualified candidates who demonstrate strong attention to detail and an eagerness to learn new systems and skill sets. - This position aligns with a structured three to five-year engagement with a confidential client with opportunities for additional work, scope, and duration beyond the initial phase. - Accurately identify, enter, update, and maintain data within the SAP system as dictated by the client. - Verify and review data for accuracy, completeness, and consistency. - Assist with data validation and maintenance. - Identify potential errors and misaligned data quickly and report those issues to the appropriate personnel. This is a remote position. Qualifications - Strong attention to detail and organization skills. Benefits - Health insurance - Signing bonus - Dental insurance - Flexible schedule Company Description
EAB - Education Advisory Board is "making education smarter" by helping clients achieve their institutional goals. A best-practice research, technology, and ser
Principal Data Engineer Location: Glen Allen (Richmond), Virginia Work Arrangement: Hybrid (Telework permitted 2 days per week) Employment Type: Full-time Salary: $119,101–$140,000 USD annually Job Description: THIS NOTICE IS BEING PROVIDED AS A RESULT OF THE FILING OF AN APPLICATION FOR PERMANENT ALIEN LABOR CERTIFICATION. ANY PERSON MAY COMMENT OR PROVIDE DOCUMENTARY EVIDENCE BEARING ON THIS APPLICATION TO OFFICE LISTED BELOW: U.S. Department of Labor Employment and Training Administration Office of Foreign Labor Certification 200 Constitution Avenue NW, Room N-5311 Washington, DC 20210 TITLE: Principal Data Engineer EMPLOYER: EAB Global, Inc. LOCATION: 11011 W Broad St., Glen Allen, VA 23060 (Telework permitted two days a week) DUTIES: Develop and deploy data integration and configuration procedures between client IT systems and EAB technology. Conceptualize, develop and deploy data extraction procedures working collaboratively with new product alpha clients. Develop recommendations for internal leadership around preferred data integration methodologies. Ensure barriers to timely completion of Data Integration Services projects are anticipated and overcome. Encapsulate findings through new product integration exercises for the overall benefit of EAB data integration effort. REQUIREMENTS: Bachelor's degree or equivalent in Computer Science, Information Technology, or a related field and 7 years of experience in data extraction pipelines (mapping, transformation, loading), including 5 years of client facing software implementation. Prior experience must include: SQL; Agile, Scrum, Kanban, Waterfall and hybrid delivery; Data extraction with Oracle and Microsoft SQL Server; Risk & issue management with RAID logs; Change control and impact analysis; Jira, Confluence, or Azure DevOps; MS Project or Smartsheet; SharePoint; Miro or Lucidchart; Teams or Slack; Managing multiple clients, projects, and stakeholders simultaneously; Serving as a project owner including managing communication progress to stakeholders, risk identification and mitigation, and facilitating problem solving; Creating status reports, roadmaps, and dashboards; and Coordinating UAT, release planning, and post-deployment support within formal SDLC or governance. TRAVEL: None SALARY: $119,101 to $140,000 per year BENEFITS: Health/Dental/Vision ins., 401(K), PTO, Life/Disability Ins. & more. TO APPLY: Send your resume to recruiting@EAB.com and include reference number #216.
Role Description As a Language Engineer at xMentium, you'll be at the forefront of how enterprises curate, structure, and operationalize their most important content. You'll play a pivotal role in bridging the gap between subject matter experts and technology, designing and implementing extraction schemas, configuring AI-powered workflows, and delivering structured data that powers analytics, agents, and enterprise decision-making across a wide range of industries and use cases. This role sits at the intersection of domain expertise, AI, and applied engineering. You will work directly with customers and prospects (running demos, leading working sessions, and configuring solutions) as well as spend time building, refining, and validating the capabilities that make xTract work. Your contributions will directly impact customer success and company growth, ensuring our solutions remain at the cutting edge. Responsibilities - Implement and configure xMentium's AI-powered platform to extract structured data at scale from unstructured documents across industries such as media and entertainment, oil and gas, manufacturing, real estate, and more. - Partner with customers to define extraction schemas, taxonomies, and business rules that turn their document repositories into clean, queryable, machine-readable data. - Collaborate with software developers, customers, and product managers to define requirements, scope, and design of new platform capabilities. - Analyze customer processes and workflows to identify high-value opportunities for AI-driven automation and structured data extraction. - Support sales efforts with software demos and working sessions tailored to the customer's domain and data. - Lead testing, validation, and quality assurance (including human-in-the-loop review of extraction outputs) to ensure reliability and customer trust. - Provide training and support to users, facilitating adoption and offering technical assistance as needed. - Stay current on advancements in AI, LLMs, VLMs, OCR, and enterprise data platforms to continuously improve our offerings. - Gather user feedback and recommend enhancements to functionality, extraction quality, and user experience. - Assist with the management of customer implementations from inception through ongoing operation. Qualifications - Demonstrable history of customer-centric service and delivery. - Enterprise contracting, operations, or domain-expert experience in at least one or more of our target verticals: media and entertainment, oil and gas, manufacturing, real estate, or enterprise AI transformation. - Working familiarity with AI tools and functionality; specifically, a solid understanding of how LLMs work, their strengths and limitations, and how to prompt and evaluate them effectively. - Strong analytical and problem-solving abilities with keen attention to detail, especially when working with schemas, taxonomies, and structured data. - Demonstrable project management skills with the ability to manage multiple projects and customers simultaneously. - Strong verbal and written communication skills, with the ability to explain technical concepts to non-technical users and executives. - Willingness to learn and adapt to new technologies as the AI and enterprise data landscape evolves. - A collaborative team player with a drive for results and a passion for innovation. - Bachelor's degree. Plusses - Programming experience (Python, SQL, or similar). - Hands-on experience with AI and machine learning, particularly applied to enterprise document workflows. - Familiarity with Microsoft Fabric, Purview, Power BI, SharePoint, or similar enterprise data platforms. - Familiarity with agentic AI workflows and grounding techniques for LLM-based assistants and Copilots. - Juris Doctorate or equivalent domain credential. Benefits - Health Care Plan (Medical, Dental & Vision) - Retirement Plan (401k, IRA) - Paid Time Off (Vacation, Sick & Public Holidays) - Work From Home - Stock Option Plan
Bloomerang helps nonprofits deliver a better giving experience so they can raise more funds and create lasting change.
• Design and ship production pipelines on Databricks, using a medallion architecture grounded in Data Vault 2.0 modeling patterns. • Build and harden the curated and presentation layers—driving donor lifetime value, retention, lapse risk, and campaign ROI. • Resolve identity across products to compute values on one trustworthy record. • Move toward near-real-time data and partner with architects on Change Data Capture. • Extend existing tracing and AI lifecycle tooling into ETL. • Partner with AI and product engineers to ensure data is properly shaped for applications. • Use AI tools in daily development tasks. • Raise the bar on engineering standards, addressing testing, idempotency, documentation, and security.
Role Description Gritter Francona is looking for a Data Modeler to provide technical expertise in the design, development, implementation, and maintenance of enterprise data models supporting the Veterans Health Administration (VHA) Veterans Family Member Program (VFMP) Modernization Portfolio. This role is responsible for designing logical and physical data models that enable modernization initiatives, improve operational efficiency, and ensure the integrity, accessibility, and security of enterprise data. The Data Modeler works closely with business stakeholders, architects, application developers, Electronic Data Interchange (EDI) specialists, and Integrated Project Teams (IPTs) to develop scalable data solutions that support VFMP's modernization objectives. The role ensures that data architecture supports high-volume business operations, system interoperability, and long-term maintainability while enabling accurate reporting, performance measurement, and informed decision-making. - Design, develop, and maintain conceptual, logical, and physical data models that support the VFMP Modernization Portfolio. - Produce comprehensive database design documentation, including entity relationship diagrams, data models, data dictionaries, metadata definitions, and data flow diagrams. - Analyze business requirements and translate them into scalable, efficient, and maintainable database designs. - Evaluate and configure database technologies to align user requirements with system capabilities, performance objectives, and operational needs. - Determine appropriate database structures, file organization, indexing strategies, partitioning methods, and storage optimization techniques. - Define and implement database security, data integrity, and access control procedures consistent with VHA and Federal information security requirements. - Plan, coordinate, and support the migration and conversion of legacy databases into modernized environments while preserving data quality and integrity. - Collaborate with application development, systems engineering, and EDI teams to ensure data models support provider, eligibility, claims, and related transaction processing. - Support modernization initiatives that improve efficiency across high-volume business operations, including: - Beneficiary enrollment - Claims adjudication - Appeals processing - Benefits coordination - Care coordination - Pharmacy support - Nurse review - Processing of non-standard customer requests - Ensure data models enable modernization objectives by supporting: - Inventory management within established Key Performance Indicators (KPIs) - Processing timeliness as operational volumes increase - High levels of data accuracy and integrity - Enterprise performance measurement and reporting - User-friendly and maintainable solutions for VFMP and VHA - Collaborate with Integrated Project Teams (IPTs), business analysts, solution architects, database administrators, and vendors to ensure consistent enterprise data architecture. - Identify opportunities to improve data quality, reduce redundancy, standardize data definitions, and enhance enterprise data governance. - Support testing, validation, and quality assurance activities to ensure data models function as intended within enterprise applications. - Document data standards, modeling conventions, database architecture, and migration procedures to support long-term system maintenance. Qualifications - Bachelor's degree - Must have practical field experience in the last year, with a minimum of four (4) years federal healthcare work experience. - Experience in data modeling methodologies, including conceptual, logical, and physical data modeling. - Previous experience with VHA or other Federal healthcare information systems and modernization initiatives. Benefits - Health Care Plan (Medical, Dental & Vision) - Retirement Plan (401k, IRA) - Life Insurance (Basic, Voluntary & AD&D) - Paid Time Off (Vacation, Sick & Public Holidays) - Short Term & Long Term Disability - Training & Development
Bright Vision Technologies is a forward-thinking software development company dedicated to building innovative solutions that help businesses automate and optimize their operations. We leverage cutting-edge technologies to create scalable, secure, and user-friendly applications.
Role Description We are seeking an experienced SAP Data Engineer to design, build, and optimize HANA-native data models and analytical objects supporting S/4HANA, BW/4HANA, and standalone HANA platforms. In this role you will translate complex business and analytics requirements into performant HANA models, and you will be the go-to expert for diagnosing and resolving HANA performance issues across the SAP landscape. The ideal candidate will combine deep expertise in HANA-native modeling — including calculation views, CDS views, AMDPs, and SQLScript — with strong performance-tuning skills and a clear understanding of HANA internals. Key Responsibilities - Design and develop performant calculation views, CDS views, AMDPs, and SQLScript procedures for analytical and transactional workloads. - Translate business and analytics requirements into well-structured HANA data models that balance flexibility, performance, and maintainability. - Optimize complex queries, joins, and aggregations through careful use of partitioning, pruning, and parallelization features of HANA. - Lead HANA performance reviews and audits, using tools such as HANA Studio Plan Visualizer, ST04, ST05, and DBACOCKPIT to identify bottlenecks. - Implement appropriate security models for HANA, including analytic privileges, roles, and row-level security. - Design and operate HANA replication scenarios using SLT, smart data integration, and smart data access. - Support data tiering using HANA Native Storage Extension and dynamic tiering where appropriate. - Build and maintain HANA-native applications and procedures consumed by Fiori, BW, and BTP services. - Lead capacity planning and sizing for HANA systems, taking into account both current and projected workloads. - Collaborate closely with Basis, ABAP, and analytics teams to ensure HANA models are integrated cleanly with the broader landscape. - Maintain comprehensive, current technical documentation — including architecture diagrams, design decisions, configuration references, runbooks, and operational procedures — so that the system remains supportable, auditable, and easy to onboard new engineers onto over time. - Mentor junior developers on HANA-native development and performance best practices. Qualifications - Bachelor’s degree in Computer Science, Engineering, or a related technical discipline. - Five or more years of SAP HANA development experience. - Strong hands-on expertise with calculation views, CDS views, AMDPs, and SQLScript. - Solid understanding of HANA architecture, including in-memory storage, columnar processing, and parallel execution. - Hands-on experience with HANA performance tuning tools and methodologies. - Experience with HANA replication tools (SLT, SDI, SDA). - Working knowledge of HANA security models, including analytic privileges and roles. - Familiarity with S/4HANA embedded analytics or BW/4HANA modeling. - Strong SQL skills. - Excellent troubleshooting, communication, and documentation skills. Preferred Qualifications - SAP-certified HANA modeling or development credentials. - Experience with HANA Native Storage Extension or dynamic tiering. - Exposure to HANA Cloud and SAP Datasphere. - Familiarity with BTP-based analytics tooling such as SAC. - Hands-on experience with large-scale HANA migrations and upgrades. How to Apply Would you like to know more about this opportunity? For immediate consideration, please send your resume to [email protected] or contact us at (908)676-4399. Learn more about Bright Vision Technologies at www.bvteck.com . Equal Employment Opportunity (EEO) Statement Bright Vision Technologies (BV Teck) is committed to equal employment opportunity (EEO) for all employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other protected status as defined by applicable federal, state, or local laws. This commitment extends to all aspects of employment, including recruitment, hiring, training, compensation, promotion, transfer, leaves of absence, termination, layoffs, and recall. BV Teck expressly prohibits any form of workplace harassment or discrimination. Any improper interference with employees' ability to perform their job duties may result in disciplinary action up to and including termination of employment.
Role Description The Sr. ETL Developer provides technical leadership and hands-on expertise with respect to the analysis, design, development, and support of Golden 1’s Informatica ETL implementation. This is a senior position responsible for assisting the ETL Architect with implementation methodologies including standards, design patterns, and best practices for enterprise data warehouse development. The Sr. ETL Developer will assist in leading other ETL developers, ensuring an efficient, high-performance implementation that fully supports the business’ data needs. - Helps create standards, design patterns, and best practices for ETL development in an enterprise data warehouse environment. - Installs, configures, and administrates Informatica PowerCenter and IDQ. Informatica Web Services Hub experience also desired. - Responsible for workflow and mapping analysis, design, development, testing, and configuration. - Functions as both an expert and lead technical resource on ETL projects throughout the project lifecycle. - Provides support for enterprise data warehouse ETL jobs and processes. - Diagnoses and remedies technical problems to ensure platform uptime and application service levels are met. - Supports, maintains, and monitors the health of the platform and associated processes. - Writes high-quality processes utilizing structured development techniques to support process components and development. - Utilizes an agile-based approach to implementing data services and solutions. - Recommends improvements to ETL processes to enhance data delivery, data quality, and overall processing efficiency. - Partners with quality assurance testing teams to identify errors and confirm business specifications have been achieved. - Able to organize and lead code releases using native Informatica PowerCenter capabilities. - Develops support guides and run books for operational support purposes. - Collects information to analyze and evaluate existing or proposed application designs. - Maintains system and programming guidelines by adhering to the software development lifecycle; develops and maintains artifacts related to standards and architecture. - Assists with the definition and implementation of processes, policies, standards, and procedures to assure compliance with corporate and regulatory policies. - Effective oral and written communication skills required to train, direct, and evaluate staff, diagnose, correct, and resolve system problems. - Maintains a thorough understanding of state and federal laws and regulations related to credit union compliance including bank secrecy and anti-money laundering laws appropriate to the position. Qualifications - Bachelor’s degree in Computer Science, Management Information Systems, or comparable discipline or equivalent work experience. - Minimum of five years’ experience designing, developing, and supporting enterprise data warehouse ETL implementations. - Experience with Cloud implementations is essential. - Highly experienced working with Kimball-based data warehouse implementations. - Strong understanding of all aspects of dimensional modeling as it pertains to ETL design and development. - Must have prior experience designing loads for daily and monthly snapshot facts, accumulating snapshot facts, factless facts, type 1, 2, 3, and other hybrid dimension types as well as 3NF and other modeling techniques. - Strong understanding of enterprise architecture, security, management, and monitoring. - Strong understanding of data management best practices and concepts including data quality, reference data, metadata, and data lineage. - Strong SQL skills expected. - Data Integration experience necessary. - This is a master developer role. Requirements - Availability for emergency and on-call duty 24 hours a day, 7 days a week, as needed. - Occasional travel may be required. - Lift and carry communications equipment and computer hardware weighing up to fifty pounds. - Must possess sufficient manual dexterity to skillfully operate applicable computer hardware, a variety of hand tools, and standard office equipment. - May work additional hours to accomplish tasks. Physical Requirements - Prolonged sitting throughout the workday with occasional mobility required. - Corrected vision in the normal range required to configure, test, and troubleshoot network server hardware and data. - Hearing within normal range. A device to enhance hearing will be provided if needed. Licenses/Certifications - Possession of a valid California Driver’s License is required.
Appfire is a computer software company that has been recognized as a “global authority” on Atlassian products and software. As an employer, the company aims
Role Description Data is the fuel behind Appfire's global footprint. We’ve grown fast, and now our focus has shifted toward building the most mature, high-performing data platform in our industry. We are looking for a Senior Data Engineer to take ownership of our core infrastructure, champion engineering excellence, and help shape the future of our data ecosystem. Leveraging your expert Python, SQL, and cloud infrastructure skills, you will develop pragmatic architectures that ensure stability and performance across the organization. As a key member of our central data insights team, you will evolve our custom data lake ("firelake" built on AWS and Snowflake). To accelerate our platform optimization efforts, you will ruthlessly eliminate technical debt, resolve edge cases, and introduce modern, AI-driven development practices. This isn't just about maintaining pipelines; it's about architecting a highly secure, resilient, and scalable foundation that empowers company-wide decision-making. If you love solving complex data puzzles, driving overarching data strategy, and seeing the direct impact of your work across an entire organization, let's talk. Qualifications - 5+ years in a data or software engineering role with a deep understanding of the full data lifecycle, modern data warehousing, and agile software development best practices. - 5+ years of experience autonomously building scalable data products, pipelines, and solutions that support company-wide systems and overarching business goals. - Exceptional personal organization and multitasking skills, with the ability to work with minimal supervision while driving 3-5 concurrent cross-departmental projects. - 5+ years of advanced SQL optimization and complex ETL/ELT pipeline development, with extensive, hands-on experience in Snowflake. - 5+ years of advanced Python programming. - 5+ years of experience designing and maintaining AWS cloud environments. Strong, hands-on proficiency with Terraform and Docker is required. - Deep operational experience with Airflow for orchestration, dbt (3+ years) for transformation, and familiarity with managing Fivetran pipelines. - Proven ability to design pragmatic, cost-effective architectures from scratch that prioritize security, scalability, and high performance without over-engineering. - Incredibly strong troubleshooting skills with a ruthless dedication to reducing technical debt, optimizing CI/CD pipelines, and enforcing strict version control and testing standards. - Solid understanding of modern data governance principles, including automated data classification, PII masking, and row/column-level access controls. - Strong written and verbal skills, with a proven ability to translate and simplify complex technical architectures to both engineering peers and non-technical business stakeholders. - A team-oriented mindset with a passion for coaching and providing constructive feedback to junior team members. Requirements - Own the complete solution development lifecycle, from driving initial requirements to building Proof of Concepts (POCs) and Minimum Viable Products (MVPs), and continuously iterating to improve and scale production solutions. - Work closely with internal and external partners to stand up and optimize robust data delivery solutions. Build, manage, and scale complex data pipelines (ETL and reverse ETL) utilizing expert-level Python and Airflow. - Develop standard integration patterns as well as custom data pipelines that interface with atypical APIs to efficiently extend our data delivery capabilities. - Architect and maintain highly efficient, cost-effective scalable data solutions and cloud infrastructure from scratch. - Be the key driver in the evolution of our custom data lake ("firelake" built on AWS/Snowflake), serving as the ultimate subject matter expert on our tech stack and data infrastructure. - Manage Fivetran and custom pipeline operations, proactively handle schema drift, and implement rigorous data quality checks to ensure we have ingested a true and accurate representation of all source systems. - Spearhead AI adoption in our daily engineering workflows to automate Pull Requests, enforce new "definition of done" standards, and accelerate CI/CD, test coverage, and release management. - Drive the integration of AI capabilities directly into our data solutions by interfacing with LLMs and developing intelligent assistants and agents to solve complex business problems. - Stay on the forefront of the rapidly evolving data landscape and drive proof-of-concepts for new tools to ensure we leverage best-in-class technologies to scale quickly. - Implement advanced PII management by leveraging automated data classification techniques, applying masking policies, and enforcing sophisticated row-level and column-level security practices. - Develop and deploy robust monitoring solutions and governance strategies to ensure accurate, secure data is available on time and to the correct audience. - Autonomously lead 3-5 concurrent cross-departmental data projects, driving everything from requirements gathering and UAT to production deployment. - Partner seamlessly with business, analytics, and engineering teams, translating complex technical architectures into relatable concepts to influence stakeholders and align goals. - Champion best practices, systematically reduce technical debt, write clear documentation, and provide both technical and soft-skill mentorship to junior team members. Benefits - Work in a product-first SaaS B2B environment focused on building and scaling solutions for large enterprise customers. - Deliver meaningful, high-impact work that directly influences product direction and customer success. - Every Appfire team member is eligible for company equity, fostering a true sense of ownership and connection to our growth. - Employees receive 25 days of paid time off per year. After 5 years of employment, employees receive 30 days per year. - Appfire provides comprehensive coverage through Empire Health, including medical, dental, and vision insurance. Additional protection includes life insurance, critical illness coverage, accidental death and dismemberment, and long-term disability insurance. - To promote health and well-being, Appfire offers a yearly sport allowance of CAD 600, which can be used to cover the cost of various fitness or outdoor activities from gym memberships to sports equipment. - Every employee receives 3 fully paid days each year to participate in Appfire Town, our Corporate Social Responsibility (CSR) program supporting local communities.
Tieto Tech Consulting (MentorMate from 2001 to 2026) provides design-led, data-centric, and AI-powered digital engineering & consulting services to enterprises worldwide.
Role Description We are looking for a Data Engineer/ Data Modeler to support the design and implementation of a modern Azure-based data platform. The ideal candidate combines strong hands-on data engineering skills with the ability to work closely with business stakeholders, structure unclear requirements, and translate them into scalable data models. The role is especially suitable for someone with experience in: - Azure Synapse - Azure Data Factory - Python/ PySpark - SQL - SAP source systems - Data warehousing - Power BI reporting enablement Key Responsibilities - Analyze and clarify business requirements from scattered or incomplete documentation - Work directly with business departments to align requirements, data definitions, and reporting needs - Translate business requirements into conceptual, logical, and physical data models - Design and implement data models for: - Silver layer: normalized / 3NF model - Gold layer: dimensional / star schema model - Build and maintain medallion architecture in Azure Synapse, including silver and gold tables - Develop data transformations and pipelines using Azure Synapse, Azure Data Factory, SQL, Python/ PySpark - Integrate data mainly from SAP source systems - Support data cataloging, governance, and lineage through Microsoft Purview - Use Azure DevOps for repository management, CI/CD, and project tracking - Enable reporting and analytics through well-structured datasets for Power BI Qualifications - Strong experience with Azure cloud data platforms - Hands-on experience with: - Azure Synapse - Azure Data Factory - Python/ PySpark - SQL - Data Lake/ Lakehouse architectures - Solid understanding of data modeling: - 3NF / normalized models - Star schema/ dimensional modeling - Data warehouse design - Experience working with SAP source systems - Ability to translate business requirements into technical data models - Experience with Git-based development and CI/CD, ideally in Azure DevOps - Good understanding of reporting needs, ideally with Power BI - Strong communication skills and ability to work with both business and technical stakeholders Requirements - A significant advantage would be: - Experience with Microsoft Purview - Experience in enterprise reporting, forecasting, or analytics platforms - Background in SAP-heavy enterprise environments - Experience with agile delivery and tools such as Jira/ Azure DevOps - Microsoft data engineering certification is a plus Benefits - Diversity, equity and inclusion - Sustainability Additional Information At Tieto, we believe in the power of diversity, equity, and inclusion. We encourage applicants of all backgrounds, genders (m/f/d), and walks of life to join our team, as we believe that this fosters an inspiring workplace and fuels innovation. Our commitment to openness, trust, and diversity is at the heart of our mission to create digital futures that benefit businesses, societies, and humanity. Stay alert to recruitment scams: - Tieto only communicates via @tieto.com email addresses. - We never ask candidates to pay fees or share financial details during recruitment. - If you receive a suspicious message claiming to be from Tieto, don't respond — verify it via our official careers site. - For more information visit Important Advisory Regarding Recruitment Fraud | Tieto Blog Remote Type Remote Job Area Application and Product Development Business Unit Tech Consulting
Bright Vision Technologies is a forward-thinking software development company dedicated to building innovative solutions that help businesses automate and optimize their operations. We leverage cutting-edge technologies to create scalable, secure, and user-friendly applications.
Role Description We are seeking an experienced Big Data Engineer to design, build, and operate large-scale data processing pipelines and analytics platforms on Hadoop and related big-data ecosystems. In this role you will be responsible for ingesting, transforming, and analyzing massive volumes of structured and unstructured data to support enterprise analytics, machine learning, and reporting workloads. The ideal candidate will combine deep technical expertise across the Hadoop ecosystem with strong software engineering fundamentals and a clear understanding of how to deliver reliable, performant, and cost-effective data platforms in production environments. Key Responsibilities - Design, develop, and operate end-to-end big-data pipelines on Hadoop, ingesting data from a diverse mix of relational, file-based, streaming, and API-driven sources. - Build robust ETL/ELT workflows using Apache Spark, Hive, Pig, and Sqoop, with strong attention to data quality, idempotency, error handling, and recoverability. - Develop high-throughput streaming data pipelines using Kafka, Spark Streaming, or Flink, and integrate them with downstream analytical and operational systems. - Optimize Spark and MapReduce jobs through careful tuning of partitioning, memory, serialization, and skew handling to meet demanding SLAs at minimal cost. - Design and maintain data models and storage layouts on HDFS, Hive, HBase, and modern lakehouse formats (Parquet, ORC, Delta, Iceberg, Hudi) to balance flexibility and performance. - Implement data governance, lineage, and quality controls in collaboration with data governance and security teams. - Build robust monitoring, alerting, and logging strategies for big-data pipelines, including job-level SLAs and proactive failure detection. - Partner with data scientists and analysts to deliver curated, reliable, and well-documented datasets that accelerate their work. - Automate pipeline orchestration using Airflow, Oozie, or similar workflow engines, with clean dependency management and clear ownership boundaries. - Continuously evaluate and adopt new technologies in the big-data and cloud ecosystem (EMR, Databricks, Snowflake, BigQuery) where they offer meaningful improvements. - Lead performance reviews and architecture audits of existing pipelines, proposing concrete refactoring and optimization initiatives. - Document data architectures, schemas, pipeline behaviors, and operational runbooks in a way that makes the platform supportable as the team scales. - Mentor junior engineers and contribute to the team’s engineering standards and best practices. Qualifications - Bachelor’s degree in Computer Science, Engineering, or a related technical discipline. - Five or more years of professional experience designing and operating big-data pipelines on Hadoop. - Strong hands-on expertise with Apache Spark (Scala, Python, or Java) in production environments. - Solid experience with Hive, HDFS, Sqoop, HBase, and the broader Hadoop ecosystem. - Hands-on experience with streaming data platforms such as Kafka, Spark Streaming, or Flink. - Strong SQL skills and experience working with both relational and NoSQL data stores. - Experience with workflow orchestration tools such as Airflow or Oozie. - Solid understanding of distributed systems concepts, including partitioning, replication, and fault tolerance. - Strong scripting skills in Python or Shell. - Excellent troubleshooting, debugging, and documentation skills. Preferred Qualifications - Experience operating Hadoop on cloud platforms such as AWS EMR, Azure HDInsight, or Databricks. - Familiarity with modern lakehouse formats (Delta, Iceberg, Hudi). - Exposure to data governance tooling such as Apache Atlas or Collibra. - Experience with Kubernetes-based data platforms (Spark-on-K8s, Trino). - Hands-on experience with CI/CD and infrastructure-as-code in data engineering workflows. How to Apply Would you like to know more about this opportunity? For immediate consideration, please send your resume to [email protected] Equal Employment Opportunity (EEO) Statement Bright Vision Technologies (BV Teck) is committed to equal employment opportunity (EEO) for all employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other protected status as defined by applicable federal, state, or local laws. This commitment extends to all aspects of employment, including recruitment, hiring, training, compensation, promotion, transfer, leaves of absence, termination, layoffs, and recall. BV Teck expressly prohibits any form of workplace harassment or discrimination. Any improper interference with employees' ability to perform their job duties may result in disciplinary action up to and including termination of employment.
3,223more opportunities are still waiting for you.Log in now and take your next shot before someone else does.
SQL, Python, ETL, SAP, Observability/Monitoring, CI/CD
