Codvo.ai logo
Codvo.ai

Building Advance AI & Cloud Native Software Using The "Virtual Silicon Valley" Model. Let’s Talk AI, Cloud and Outcomes.

Data Engineer Lead, OT Data, Oil & Gas

Data EngineerData EngineerFull TimeRemoteSeniorTeam 51-200Since 2019H1B No SponsorCompany SiteLinkedIn

Location

India

Posted

95 days ago

Salary

0

Seniority

Senior

Job Description

Data Engineer Lead, OT Data, Oil & Gas

Codvo.ai

• Architect & Build Data Pipelines: Design, construct, install, test, and maintain highly scalable data management systems and ETL/ELT pipelines. • Integrate Diverse Data Sources: Develop processes to ingest and integrate high-volume, high-velocity data from SCADA systems, historians, DCS, PLC, and IoT sensors. • Cloud Data Platform Development: Implement and manage data solutions on Microsoft Azure, leveraging services like Azure IoT Hub. • Data Modelling & Warehousing: Design and implement data models optimized for time-series data from industrial assets. • Enable Advanced AI: Build the data infrastructure to support AI/ML models for predictive maintenance and anomaly detection. • Champion Master Data Management (MDM): Create a single source of truth for critical data domains. • Ensure Data Quality & Governance: Implement data quality checks and monitoring to ensure accuracy and consistency. • Embrace Industry Standards: Implement industry-specific standards for interoperability across sectors. • Collaborate & Innovate: Work with cross-functional teams to understand data needs and deliver effective solutions. • Automate & Optimize: Identify automation opportunities to improve data delivery and scalability. • Security First: Maintain security best practices to protect sensitive data assets.

Job Requirements

  • 6+ years of experience in data engineering
  • Bachelor's in engineering, Information Systems, or a related quantitative field
  • Experience within oil and gas industry is highly preferred
  • Demonstrable experience building and operationalizing large-scale data pipelines and applications
  • Expert-level proficiency in SQL and Python for data manipulation and pipeline development
  • Hands-on experience with distributed computing frameworks like Apache Spark (PySpark)
  • Deep experience with Microsoft Azure (Azure Data Lake Storage, Azure Data Factory, Azure Databricks, Azure Synapse)
  • Proven experience with modern data platforms Databricks Delta Lake
  • Understanding of machine learning lifecycles and the data requirements for training and deploying AI/ML models
  • Experience with workflow orchestration tools like Airflow, Dagster, or Azure Data Factory
  • Strong understanding of both relational and NoSQL databases
  • Proficiency with Git and CI/CD best practices

Benefits

  • Flexible remote work arrangements

Related Categories

Related Job Pages

More Data Engineer Jobs

Full TimeRemoteTeam 10,001+H1B Sponsor

• Lead the design, development, and enhancement of ETL pipelines and backend data workflows using Python and SQL • Design and optimize large-scale data processing solutions on AWS using services such as Glue, EMR, Lambda, and S3 • Lead the implementation and improvement of CI/CD pipelines to automate build, test, and deployment for data and application code • Collaborate with architects, product owners, and business partners to refine requirements and translate them into scalable, secure data solutions that follow approved architecture patterns • Write high quality, maintainable, and well-tested code, and set a strong example for coding and design practices • Investigate and resolve complex technical issues, data quality problems, and performance bottlenecks across environments • Participate in and often lead code reviews, helping to maintain high standards for code quality, testing, and documentation • Mentor junior and mid-level engineers through pairing, feedback, and knowledge sharing • Contribute to the evolution of data and application architecture, development processes, and engineering best practices • Collaborate with cross-functional teams to debug, improve, and support data products and services in production • Continuously learn and adopt modern technologies, tools, and development practices relevant to data engineering and cloud platforms.

India
Job Closed
Catalist logo

Data Operations Engineer

Catalist

Ellucian powers innovation for higher education, partnering with approximately 3,000 customers across 50 countries, serving more than 21 million students. Ellucian's AI-powered platform drives efficiency, personalized experiences, and strengthened engagement for all students, faculty and staff.

Data Engineer96 days ago
OtherRemoteTeam 51-200H1B No Sponsor

For over 19 years, Catalist has been a leader in civic data and data science innovation. Our mission is to provide progressive organizations with the data, software, and services needed to better identify, understand, and communicate with the people they need to engage and mobilize. Our clients include the largest, most influential organizations in the U.S. active in civic engagement, advocacy, and political campaigns. Catalist is home to a dedicated, creative team of technologists, data scientists, and campaign experts committed to using our talents and technology to nurture a vibrant and growing progressive community. As a Data Operations Engineer, you will have a leading role in providing data sets and solutions in a timely and efficient manner for use by a wide array of Catalist clients and partners. The position will also be responsible for conducting research into election administration, political trends, and new data sets to help meet the needs of Catalist and our clients. The ideal candidate will be a highly motivated individual with a strong attention to detail, a desire to learn new skills, and an interest in progressive politics. Catalist values creativity and problem-solving. Our work is on the cutting edge of data-driven politics, and your support will help Democratic candidates and progressive organizations conduct successful advocacy and electoral campaigns. This position reports to the Director of Data Acquisition. While Data Operations Engineers work with the Client Services, Analytics, and Tech teams, they are a part of the growing Data team that supports all underlying work at Catalist. This position is included in our CWA bargaining unit. Principle Duties & Responsibilities - Research, collect, and work with data from various sources, such as voter file, absentee/early vote, geographic, and aggregate level data in a timely and efficient manner - Fulfill various administrative tasks such as preparing required forms, letters, and check requests, as well as working with Catalist’s legal counsel to ensure compliance with federal, state, and local regulations - Build and foster relationships with points of contact at various data sources to stay informed about data changes as well as monitor information on elections and regulations - Track ongoing and future internal operations, including but not limited to, acquisition calendars, budgeting documents, and data element listings - Execute and help develop the process that sees all data acquired by Catalist is both handled and stored in a secure manner, in keeping with best practices - Respond to all correspondence in alignment with company values and objectives while handling confidential information with the utmost maturity, discretion, and diplomacy - Utilize programming languages as well as other internal resources to process data sets as well as answer questions internally and externally about data and data processing - Plan, manage, and execute special projects as directed by the Director of Data Acquisition Requirements - One to two years of some previous administrative work - Background check required Preferred Skills & Abilities - Experience with political campaigns or progressive organizations - Excellent organizational and time management skills, including ability to multitask - Effective problem solving and troubleshooting abilities in a fast-paced environment - Able to focus on details and make productive suggestions on ways to improve processes - Willingness to be creative and personable, work with internal teams, and articulate ideas clearly in both written and oral communication - Capacity to become an internal subject matter expert on various datasets and support other Catalist departments/teams on usage of those datasets - Ability and willingness to learn new skills quickly Benefits Medical, Dental, Vision, Prescription Drug Catalist offers Medical, Dental, Vision, and Prescription Drug coverage for eligible staff and their eligible dependents. Catalist’s Medical plan is a comprehensive PPO program including Prescription Drug coverage with 85% of the premium paid by Catalist. We also offer an HDHP plan with HSA eligibility. Dental and Vision coverage is provided at no cost to employees. Group Term Life Insurance and Long-Term & Short-Term Disability Coverage Group Term Life Insurance and Long-Term and Short-Term Disability coverage is available for eligible staff. These benefits are provided at no cost to Catalist employees. 401(k) Safe Harbor Plan A 401(k) Safe Harbor Plan is available to eligible staff with a 3% contribution from Catalist from the date of hire. Employees may contribute pre-tax or post-tax from their salary up to the legal limits set forth by the IRS. Medical and Dependent Care Flexible Spending Accounts (FSAs) Catalist offers an FSA Program that gives eligible staff the ability to pay out-of-pocket medical/dental/vision/child care expenses from pre-tax earnings. Transit Benefits Catalist also makes available a Transit benefit FSA program to eligible employees using pre-tax contributions with a company match. Professional Development and Remote Work Expenses Eligible employees may be reimbursed up to $750 each year for professional development / education and $500 for remote work expenses. Student Loan PayDown or SaveUp Catalist offers a Student Loan PayDown and College SaveUp benefit for eligible staff. Vacation, Personal Leave, Sick Leave Benefits Catalist offers generous vacation benefits to all eligible staff. Eligible employees also receive: - 15 Paid Holidays (16 in Presidential Inauguration years) - Personal Days - Sick Leave - Parental Leave Hybrid Office/Remote Work Certain positions at Catalist are eligible for Office/Remote Hybrid or full Remote status.

District Of Columbia
$56K - $63K / year
Job Closed
RISE - Internet Service Provider in the Philippines logo

Data Engineer

RISE - Internet Service Provider in the Philippines

At RISE we are on a mission to accelerate internet in the Philippines.

Data Engineer96 days ago
Full TimeRemoteTeam 51-200H1B No Sponsor

• Analyze and develop solutions to information needs in our business • Design, develop, deploy, and test new information and data processing applications in accordance to our quality standards • Perform preventive maintenance, identify and execute improvements, and refactor existing code base, including our legacy applications • Monitor, respond, and resolve incidents in production • Develop and maintain the infrastructure that host our applications in production • Support our internal staff and stakeholders’ inquiries and issues with the applications in use • Investigate and create proofs of concepts, such as in using external services, APIs, programming libraries, and data source systems • Contribute in the development of user guides and knowledge base of applications in use

Philippines
OtherRemoteTeam 5,001-10,000Since 1972H1B No Sponsor

• designing, building, and maintaining dimensional data models that support our analytics, AI, and business intelligence initiatives • working closely with stakeholders to ensure data is accessible, reliable, and optimized for performance • creating and maintaining logical, physical, and conceptual data models in Google Big Query using Dataform • collaborating with stakeholders to understand business needs and deliver data products in support of those needs • developing and managing data dictionaries, metadata, and data lineage • refining and updating models for performance, scalability, and cost efficiencies • ensuring data quality, integrity, and security across all data platforms

United States
$61.7K - $110.3K / year
Job Closed