Job Closed

This listing is no longer active.

Illumination Works LLC logo
Illumination Works LLC

At Illumination Works, we know data, and we should, we’ve been doing it since we started in 2006! We specialize in everything data from big data to data science, data engineering, software engineering, and cloud design. We are a trusted technology partner in user-centered digital transformation—delivering impactful business results to clients. We partner with customers to solve their unique technology and data challenges and stay on top of modern technologies and advancements leveraging our Innovation Lab. Illumination Works is committed to hiring and retaining the best workforce. We hire the best talent for our customer’s needs. We make our hiring decisions without regard to race, color, religion, sexual orientation, gender identity or national origin, age, veteran status, disability, or any other protected class. Acceptable candidates must successfully pass a drug test and background screen.

Data Engineer / Architect

Location

United States

Posted

95 days ago

Salary

0

Seniority

Mid Level

Job Description

Data Engineer / Architect

Illumination Works LLC

This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more. Role Description The key responsibilities of the Data Engineer/Architect include: - Work closely with data scientists to ingest, integrate, and prepare database structures needed for advanced analytics and visualization. - Construct robust and complex database designs for structured and unstructured data. - Ensure high performance and efficiency for production applications. - Collaborate with data science and software developer teammates to understand and implement data requirements. We value passion, curiosity, and perseverance with an ability to communicate ideas and results to diverse audiences. We look for people who thrive in collaborative and independent assignments, have the aptitude to learn new data quickly, and who are willing to mentor junior team members. Key responsibilities and skills for this position include: - Strong experience with complex data modeling, schema design, and database architecture. - Advanced proficiency in SQL and Python. - Expertise in building data ingestion and transformation pipelines. - Experience integrating multiple data source types. - Proficiency with PostgreSQL or comparable relational database systems. - Expertise in optimizing code/query performance and data workflows. - Familiarity with structured and unstructured data. - Experience writing multithreaded or multiprocessing applications. - Understanding of cloud architecture and data platform best practices (AWS preferred). - Experience working in collaborative development environments using Git. - Understanding of containerization (Docker). - Knowledge of CI/CD for data pipelines. - Strong problem-solving and analytical skills. - Excellent written and verbal communication skills. Qualifications - Minimum Education: Bachelor’s or Master’s degree in Computer Science, Mathematics, or comparable academic discipline. - Minimum Experience Requirements: Seven (7) years of experience required. - Must have or be willing to obtain Secret Clearance (this requires US Citizenship). Requirements - Acceptable candidates must successfully pass a drug test and background screen. Benefits - Market competitive salary. - Generous PTO package. - Comprehensive medical, dental, vision, and life insurance plans. - 401K. - Short/long-term disability insurance. - A fun and engaging culture. - Training opportunities to keep you up to speed on the latest technologies.

Job Requirements

  • Minimum Education: Bachelor’s or Master’s degree in Computer Science, Mathematics, or comparable academic discipline.
  • Minimum Experience Requirements: Seven (7) years of experience required.
  • Must have or be willing to obtain Secret Clearance (this requires US Citizenship).
  • Acceptable candidates must successfully pass a drug test and background screen.

Benefits

  • Market competitive salary.
  • Generous PTO package.
  • Comprehensive medical, dental, vision, and life insurance plans.
  • 401K.
  • Short/long-term disability insurance.
  • A fun and engaging culture.
  • Training opportunities to keep you up to speed on the latest technologies.

Related Categories

Related Job Pages

More Data Engineer Jobs

Consumer Direct Care Network logo

Integrations Team Manager

Consumer Direct Care Network

Consumer Direct Care Network is a healthcare services company committed to “advancing the philosophy of self-direction" through community-based and in-home se

Data Engineer95 days ago

This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more. Role Description Lead the IT Data Team ensuring that customer issues are addressed within established SLA time-frames. Manage IT Data Team to deliver accurate, timely, and secure data. Monitor IT Data Team operations and manage workflows, assignment, and management of tickets through closure. Manage individual performance ensuring sustained quality via metrics and measurables. Promote cohesiveness in the office environment. Support day-to-day operations. Job Duties - Principal resource for collaboration with stakeholders regarding the delivery of services - Communicate effectively and be a focal point for the IT Data Team for communications - Lead assigned initiatives, coordination, and implementation of data projects - Demonstrate dependability - Demonstrate effective problem solving and decision-making skills - Manage enterprise data management, data warehouse, support, monitoring, and other data initiatives - Manage special projects including, but not limited to: - Data schema deployments, data movement, fixes, and conversions - Database Infrastructure and cloud-based designs, improvements, and implementations - Monitoring and management of data flows between Infrastructures - Work with internal teams to develop data requirements & processing methods and solutions - Documentation of systems and solutions - Maintain necessary skills and knowledge to coordinate workflow - Provide direction and mentoring to a team of Data Analysts and Engineers - Participate in, and assign professional development and training activities - Prioritize and multitask effectively - Recruit, hire, train, and supervise employees - Evaluate employee job performance through goal setting and performance appraisals - Provide technical mentoring and coaching of IT Data Team members - Other duties as assigned Qualifications - Bachelor’s degree in business, computer science, or management information systems - Five years of experience, or equivalent combination of education and experience - Must have experience working with Microsoft tools and technologies to develop custom software solutions - Demonstrated experience in two or more of the following (preferred platform noted in parentheses): - Design, development and implementation of enterprise data warehouse solution (MSFT Fabric) - Application development platforms - Database platforms (Microsoft Azure and SQL Server) - Minimum 5 years of senior level experience in IT, with management experience preferred - Be able to successfully pass a background screening - Ability to work flexible and/or extended hours, if needed, to meet the job requirements - If working remotely, employee must provide their own reliable internet Benefits - A rewarding career helping others - Fun and engaging work environment built on team unity - Job satisfaction knowing you make a difference in the work you do and lives we serve - Professional training to help advance your skills for career development - Based on your position and employment status, you may be eligible for: - Medical, Dental, and Vision Insurance - Vacation accrued at 3.07 hours per pay period to use when accrued - Two Paid Floating Holidays - Nine Paid Federal Holidays - Paid Safe Sick Time accrued at 1 hour per 30 worked to use when accrued - Instant Earnings Option - 401(k) Retirement plan & discretionary company match - Company-Paid Life Insurance - Supplemental Life, Accident, Critical Illness, and Hospital benefits - Short and Long-Term Disability - Paid Parental Leave - Flexible Spending Account - Employee Assistance Program - Pet Insurance

United States
$100K - $110K / year
Job Closed
OtherRemoteTeam 1,001-5,000

Join Us in this Amazing Opportunity The Team You’ll Join We are a mission driven community-based organization that serves member health with excellence and dignity, respecting the value and needs of each person. If you are ready to advance your career while making a difference, we encourage you to review and apply today and help us build healthier communities for all. More About the Opportunity We are hoping you will join us as a Data Operations Engineer & Analyst (Data Warehouse Programmer/Analyst) and help shape the future of healthcare where you’ll be an integral part of our Enterprise Data and Systems Integrations team, helping to strive for excellence while we serve our member health with dignity, respecting the value and needs of each of our members through collaboration with our providers, community partners and local stakeholders. This position has been approved to be Full Telework. - If telework is approved, you are required to work within the State of California only and if Partial Telework, also come in to the Main Office in Orange, CA, at least two (2) days per week minimum. The Data Warehouse Programmer/Analyst will be responsible for designing, building, and operating large-scale enterprise cloud data platforms while driving the evolution of our data governance framework. You will ensure the delivery of reliable, scalable and high-quality data pipelines that power analytics, reporting and data science initiatives. You will collaborate with CalOptima Health leadership and cross-functional teams, including data stewards, warehousing, analytics and security, to strengthen data platform operations and advance governance goals, policies and best practices. Also, you will enable informed health care decision-making, reduce regulatory risk and improve organizational performance through strengthening data accountability and operational consistency. Together, we are building a stronger, more equitable health system. Your Contributions To the Team: - 90% - Technical Responsibilities - Participates in a mission driven culture of high-quality performance, with a member focus on customer service, consistency, dignity and accountability. - Assists the team in carrying out department responsibilities and collaborates with others to support short and long-term goals/priorities for the department. - Designs, supports and maintains scalable, modular ETL/ELT pipelines (e.g., SSIS, PySpark) for ingestion, transformation and delivery, embedding governance controls for data quality, lineage and compliance. - Partners with the Data Warehouse team to co-develop solutions on the modern data platform (e.g., Snowflake, Databricks, Microsoft Fabric), embedding data quality, lineage and compliance requirements into engineering workflows. - Modernizes legacy SQL-based transformations into parameterized, config-driven pipelines for reusability and scalability. - Designs and maintains data pipelines for historical tracking, snapshots, handling slowly changing datasets and leveraging modern data platforms and frameworks. - Contributes to continuous integration/continuous delivery (CI/CD) automation for data workflows, including version control (e.g., GitHub), orchestration frameworks, and automated testing. - Develops and maintains automation scripts to streamline data governance processes and operational tasks. - Monitors and troubleshoots data workflows, resolving issues related to data movement, transformation, and system performance. - Stays informed on emerging data technologies, tools and best practices, and proactively recommends enhancements to data engineering processes and platform capabilities. - Supports end-to-end pipeline operations, including orchestration, monitoring, alerting and service level agreement (SLA) management using appropriate tools (e.g., Airflow). - Implements data quality checks and anomaly detection as part of engineering workflows to ensure trust in analytical datasets. - Partners with data engineers to optimize jobs, SQL queries and data platform workloads for performance and cost efficiency. - Drives governance of the enterprise data platform to ensure consistent ingestion, naming conventions, schema management, and enrichment of data assets for reliable analytics. - Partners with cybersecurity to implement robust data protection standards and maintain regulatory compliance (e.g., Health Insurance Portability and Accountability Act (HIPAA)) to reduce risk exposure. - Tracks and reports governance maturity through key performance indicators (KPIs) and dashboards; contributes to policy development and council initiatives. - Maintains clear documentation of data flows, definitions and validation processes to ensure transparency and traceability. - Creates process maps and diagrams to support stewardship and communicate effectively with both technical and business stakeholders. - Queries and analyzes large-scale health care datasets and business logic (e.g., claims, pharmacy, patient data) using SQL and other tools. - Provides employee engagement sessions to strengthen data literacy and reinforce governance principles, practices, roles, and accountability expectations. - Manages multiple projects simultaneously, ensuring timely delivery and alignment with stakeholder expectations. - 10% - Other - Completes other projects and duties as assigned. Do You Have What the Role Requires? - Bachelor’s degree in computer science, health informatics, data analytics or a related field PLUS 5 years of professional experience in data management, data governance or enterprise information management required; an equivalent combination of education and experience sufficient to successfully perform the essential duties of the position such as those listed above may also be qualifying. - 4 years of hands-on experience working with health care data, including administrative and clinical datasets, and familiarity with HIPAA compliance required. You’ll Stand Out More If You Possess the Following: - Master’s degree in computer science, health informatics, data analytics or a related field. - Experience with at least one other programming language (e.g., Python, Scala) for automation and analysis. - Experience designing and implementing data pipelines in cloud environments, including orchestration frameworks (e.g., Apache Airflow, Azure Data Factory). - Experience with CI/CD tools and practices (e.g., GitHub, Azure DevOps) for data workflows. - In-depth experience with SQL Server Integration Services (SSIS) for complex ETL development and optimization. - Hands-on experience with cloud data platforms and big data architectures, including Snowflake, Databricks or Microsoft Fabric on Azure. - Experience in regulated industries (e.g., government). - Relevant certifications. What the Regulatory Agencies Need You to Possess? - n/a Your Knowledge & Abilities to Bring to this Role: - Develop rapport and establish and maintain effective working relationships with CalOptima Health's leadership and staff and external contacts at all levels and with diverse backgrounds. - Work independently and exercise sound judgment. - Communicate clearly and concisely, both orally and in writing. - Work a flexible schedule; available to participate in evening and weekend events. - Organize, be analytical, problem-solve and possess project management skills. - Work in a fast-paced environment and in an efficient manner. - Manage multiple projects and identify opportunities for internal and external collaboration. - Motivate and lead multi-program teams and external committees/coalitions. - Utilize computer and appropriate software (e.g., Microsoft Office: Word, Outlook, Excel, PowerPoint) and job specific applications/systems to produce correspondence, charts, spreadsheets, and/or other information applicable to the position assignment. Your Physical Requirements (With or Without Accommodations): - Ability to visually read information from computer screens, forms and other printed materials and information. - Ability to speak (enunciate) clearly in conversation and general communication. - Hearing ability for verbal communication/conversation/responses via telephone, telephone systems, and face-to-face interactions. - Manual dexterity for typing, writing, standing and reaching, flexibility, body movement for bending, crouching, walking, kneeling and prolonged sitting. - Lifting and moving objects, patients and/or equipment 10 to 25 pounds Ways We Are Here For You - You’ll enjoy competitive compensation for this role. - Our current hiring range is: Pay Grade: 314 - $99,902 - $159,843 ($48.03 - $76.8476). - The final salary offered will be based on education, job-related knowledge and experience, skills relevant to the role and internal equity among other factors. - This position is approved for Full Telework (**If the position is Telework, it is eligible in California only**) - A comprehensive benefits package - CalPERS pension program and additional retirement packages. - Additional benefits and perks including: - A generous PTO program - A quality work life balance - Various wellness programs - Tuition Reimbursement - Professional development opportunities - Career development opportunities - Flexible scheduling - And the satisfaction of knowing your work directly impacts and improves healthcare access for thousands of individuals and families. Our Work Environment: If located at the 500, 505 Building or a remote work location: - Work is typically indoors and sedentary and is subject to schedule changes and/or variable work hours, with travel as needed. - There are no harmful environmental conditions present for this job. - The noise level in this work environment is usually moderate. If located at PACE: - Work is typically indoors in a clinical setting serving the frail and elderly. - There may be harmful or hazardous environmental conditions present for this job. - The noise level in this work environment is usually moderate to loud. If located in the Community: - Work is typically indoors and sedentary and is subject to schedule changes and/or variable work hours, with travel as needed. - Employee will occasionally work outdoors in varied temperatures. - There may be harmful or hazardous environmental conditions present for this job. - The noise level in this work environment is usually moderate to loud. Why Join Us? We believe that diverse perspectives drive innovation. Each employee brings a unique perspective to the overall team and we value everyone's input and we are committed to creating an inclusive environment where you and every team member can thrive while making a meaningful impacts on our community members. Our team reflects and represents the communities we serve, and we welcome candidates from all backgrounds who share our commitment to accessible, quality healthcare. What's Your Next Step? All Applications will be accepted on a continuous basis until a sufficient number of qualified applications have been received. Do NOT miss out. If you want to join our team, the deadline for the first review of applications is March 2, 2026 at 9:00 PM (PST). We are encouraging you to apply early. If you apply after the first review date, your application is not guaranteed to be considered for this recruitment. This recruitment may close at any time without notice after the first review date. Our Commitment to You Your application and resume will be reviewed by a dedicated recruiter to this position. If your experience matches what we need, we will reach out to you to discuss the next steps. The selection process may include, but is not limited to, a skills assessment, phone screen and interview. If you make it through the steps above and are selected for this exciting role, you will be required to undergo a reference and a background check (to include a conviction record) and if applicable also pass a drug screening and/or a post-offer pre-employment medical examination (for specific positions) If you are an Internal CalOptima Health applicant, please apply through the internal portal on InfoNet. We will make sure to keep you updated through each step of the process on your candidate portal. Please make sure to watch for updates on your candidate portal and you emails which will be sent to the email address you listed on your application. Please check your email, including your SPAM folder, regularly throughout the recruitment process. CalOptima Health is committed to attracting, hiring, and retaining a diverse staff, where we will honor your unique experiences, identity, and perspectives. Our organization strives to create and maintain a workplace environment that is inclusive, equitable and welcoming so we can truly be Better Together. CalOptima Health is an equal opportunity employer and makes all employment decisions on the basis of merit. CalOptima Health wants to have qualified employees in every job position. CalOptima Health prohibits unlawful discrimination against any employee, or applicant for employment, based on race, religion/religious creed, color, national origin, ancestry, mental or physical disability, medical condition, genetic information, marital status, sex, sex stereotype, gender, gender identity, gender expression, transitioning status, age, sexual orientation, immigration status, military status as a disabled veteran, or veteran of the Vietnam era, or any other consideration made unlawful by federal, state, or local laws. CalOptima Health also prohibits unlawful discrimination based on the perception that anyone has any of those characteristics or is associated with a person who has, or is perceived as having, any of those characteristics. If you are a qualified individual with a disability or a disabled veteran, you may request a reasonable accommodation at (714) 246-8400 if you are unable or limited in your ability to access job openings or apply for a job on this site as a result of your disability.

United States
$99.9K - $159K / year
Job Closed
OtherRemoteTeam 11-50

Reports to: Head of ML Data Infrastructure Department: AI Engineering Platform FLSA Category: Exempt Position Type: Full-Time, Mid-Senior Level Travel Requirement: 0-10%, Quarterly for meetings Office Location: Remote, US Based JOB SUMMARY We are seeking an experienced Principal/Senior Software Engineer, Data/ML Platform to define and lead the technical vision for our large-scale data and machine learning infrastructure. You will architect and build the systems that enable our teams to deliver intelligent, data-driven, and agentic AI products. This is a hands-on leadership role combining deep technical expertise with strategic impact across the organization. Essential Functions & Key Responsibilities: - Define and implement the data architecture and software systems that underpin our ML and - AI platforms. - Lead design and development of scalable data pipelines, APIs, and services enabling Data-as-a-Service for ML use cases. - Architect real-time and batch data serving frameworks for training, inference, and feedback - loops. - Drive engineering excellence and platform scalability across distributed environments. - Collaborate with AI Platform leadership, MLOps, and backend teams to shape long-term technical strategy. - Mentor and guide senior engineers, establishing standards for design, testing, and deployment. - Evaluate emerging technologies and tools to strengthen the platform’s reliability and - performance. - Champion best practices in software architecture, data quality, and performance optimization Qualifications & Experience Requirements: - Bachelor’s in Computer Science, Engineering, or related field (Master’s preferred). - 7+ years of experience in software engineering, or ML/Data platform development. - Expertise is preferred in Python, Java, and/or PySpark for distributed data and service - development. - Proven experience architecting cloud-native data and ML systems (preferably GCP + - Databricks). - Deep understanding of system design, data modeling, and distributed computing. - Demonstrated leadership in scaling large, data-intensive systems and mentoring engineering - teams. - Excellent communication, technical leadership, and stakeholder management skills. - Strong system design and architecture skills. - Excellent debugging and troubleshooting abilities. - Expertise with automated testing. - Ability to thrive in a highly dynamic, fast-paced environment. Why This Role Matters? You will define the data foundation of our Agentic-AI platform, transforming raw information into a trusted, scalable data service that directly fuels brand growth solutions in MarTech and AdTech. Your work ensures our Application & ML engineers can build inference-as-a-service products faster, cheaper, and with higher accuracy. PHYSICAL REQUIREMENTS/WORKING CONDITIONS: Standing/Walking/Mobility: Must have mobility to attend meetings remotely and in person. Climbing/Stooping/Kneeling: 0% - 10% of the time. Lifting/Pulling/Pushing: 0% - 10% of the time. Fingering/Grasping/Feeling: Must be able to write, type and use a telephone system 100% of the time. Sitting: Sitting for prolonged and extended periods of time. This job description reflects management’s assignment of essential functions; it does not prescribe or restrict the tasks that may be assigned. Management may revise duties as necessary without updating this job description. For more information about the company, please visit our website: https://clarvos.com/ Clarvos is an Equal Opportunity Employer and does not discriminate against any employee or applicant for employment because of race, color, sex, age, national origin, religion, sexual orientation, gender identity, status as veteran, disability or any other federal, state or local protected class. Clarvos complies with federal and state disability laws and makes reasonable accommodation for applicants and employees with disabilities. If you require reasonable accommodation in completing the application, interviewing, completing any pre-employment testing, or otherwise participating in the employee selection process, please direct your inquiries to hrsupport@Clarvos.com.

United States

Troveo is the largest licensable video library for AI model training. We partner with thousands of content licensors—ranging from top-tier studios and production houses to leading YouTube creators—to supply video content to the world’s foremost research labs. Our mission is to rapidly deliver massive volumes of video content, to exact specifications, fueling next-generation generative and world-understanding AI models. Data Engineering is central to our success. Each week, we process petabytes of video data—quickly, cost-effectively, and with uncompromising quality. As a data engineer at Troveo, you’ll focus on: - Lowering costs and reducing turnaround times for processing content. - Enhancing and transforming video data for our customers, to make it easier to discover and more valuable. We are seeking a Principal or Senior Data Engineer with demonstrated expertise in Python and large-scale data management. Practical experience with AWS services (S3, EC2, etc.), search, and large databases is essential. Familiarity with video data is a plus, but not required. Responsibilities - Data Pipeline Development: Design, build, and maintain scalable, efficient data pipelines in Python. - AWS Ecosystem: Leverage services like S3 for data storage (including multiple tiers of storage) and EC2 for compute (currently running clusters of 50k G instances), retrieval, and processing in production environments. - Big Data Handling: Develop and optimize systems to handle petabyte-scale datasets with a focus on performance, reliability, and cost-effectiveness. - Metadata Generation: Leveraging self-hosted open source LLMs and managed APIs to generate reliable metadata to power discovery and enhance the value of the content we deliver. - Discovery: Building from the ground up search capabilities leveraging visual, semantic and taxonomic data to deliver the right content to our customers. - Monitoring & Reliability: Implement robust monitoring, alerting, and logging to ensure smooth data flow and quickly troubleshoot issues. - Collaboration: Work cross-functionally with data scientists, software engineers, and product teams to understand data needs and deliver optimized solutions. - Video Processing (Preferred): If applicable, process and manage video data for analytics, quality control, and other use cases. Required Qualifications - Python Proficiency: Strong coding skills in Python (including familiarity with libraries for data manipulation and analysis). - AWS Expertise: Hands-on experience using core AWS services (S3, EC2, possibly Lambda, EMR, or ECS). - Big Data Skills: Demonstrated ability to work with large-scale datasets (petabyte-level), ensuring high performance and scalability. - Database & Storage: Familiarity with large Postgres databases. - Automation & Scripting: Comfortable building CI/CD pipelines and automating repetitive tasks. Nice to Have - Video Processing: Experience handling or transforming video data (e.g., transcoding, extracting metadata, compiling FFMPEG). - Machine Learning Pipelines: Familiarity with ML and Computer Vision workflows or frameworks (OpenCV, TensorFlow, PyTorch, etc.). - Security Best Practices: Understanding of AWS IAM, encryption, and SOC II compliance standards. What We Offer - An opportunity to work with massive data sets and cutting-edge technologies in the cloud serving the biggest companies in tech building the next generation of AI models - A collaborative environment with a talented, diverse team of engineers and data experts. - Competitive compensation and benefits with room for career growth and professional development. - This job is remote/work from home with the option of meeting up from time to time if you are located in the SF Bay Area.

United States