Data Engineer – SME
Location
United States
Posted
3 days ago
Salary
0
Seniority
Lead
Job Description
Data Engineer – SME
Bart & Associates, Inc.
• Lead and provide expert support for data collection, data validation, data visualization, and analytics initiatives • Apply disciplined methodologies for the planning, analysis, design, and development of information systems on an enterprise-wide basis or across a business sector • Develop analytical techniques and methodologies to solve complex business and technical problems • Perform strategic systems planning, business information planning, and business analysis • Organize and analyze large volumes of structured and unstructured data sets using data analytical tools • Locate, access, merge, clean, and standardize data from multiple sources, and develop derived metrics • Create and implement data collection and analysis tools using programming languages such as Python, Databricks, SQL, Scala, R, and Java • Design, script, debug, and analyze data engineering solutions • Implement and create machine learning-based tools and processes • Apply distributed and parallel processing technologies (e.g., Spark) to handle big data analytics tasks involving large data volumes • Perform SQL Server data imports from CSV and TXT files • Leverage Excel and Google Suite for data analysis, reporting, and collaboration • Utilize supporting tools and platforms such as Pentaho (data import/transformation), Azure Data Studio, GitHub, and Smartsheet as needed • Document task requirements, work completed, processes, and technical details thoroughly • Communicate effectively with stakeholders across technical and business teams • Operate independently as a subject matter expert in a fast-paced, entrepreneurial environment
Job Requirements
- Bachelor’s or master’s degree in computer science Computer Science, Data Science, Engineering, or a related field.
- This position requires a minimum of seven (7) years experience, of which at least three (3) years must be specialized.
- Knowledge in organizing and analyzing large amounts of structured and unstructured data sets using data analytical tools, to include experience locating, accessing, merging, cleaning, and standardizing data, and developing derived metrics.
- Strong proficiency in creating and implementing data collection and analysis tools while utilizing programming languages and environments, including Python, Databricks, SQL, Scala, R, and Java.
- Knowledge of design, scripting, debugging, and analysis.
- Experience in the implementation and creation of machine learning-based tools or processes.
- Knowledge in distributed & parallel processing (e.g., Spark) and the computational power required to handle most big data analytics tasks that can process large volumes of data.
- Good facility with SQL Server data import from CSV files and TXT files
- Strong skills with Excel and Google Suite
- Familiarity with the following software packages and platforms are helpful: Pentaho for data import and transformation, Azure Data Studio, GitHub, and Smartsheet.
- Strong documentation and communication skills Documenting details of task requirements, work completed, etc.
- Security Clearance Eligible to obtain a Public Trust Clearance.
Benefits
- B&A is proud to offer three robust individual and family medical plans to full time employees, including a Health Savings Account (HSA) option as well as two tiers of dental coverage, vision, life & AD&D, disability, accident, hospital indemnity, and critical illness insurance.
- In addition to these benefits, B&A employees enjoy paid time off, B&A sponsored trainings and certifications, pet insurance benefits, commuter transit benefits and a free subscription to a virtual exercise platform (NEOU).
- B&A’s 401(k) plan is available to all employees and includes a company matching contribution.
- B&A has launched several programs to focus on employee engagement, wellness, and assistance. These include: The B&A Cares program: 30/60/90-day wellness check ins, personal development, financial management, and stress management seminars, and more A formal mentorship program Job shadowing and cross training opportunities Brand Ambassador program Employee Assistance Program (EAP) - Access to various support resources to include counseling, legal guidance, financial planning, and more Monthly teambuilding events B&A Annual Wellness Challenges: #StepWithB&A, #WalkDuringLunchWithB&A, #VolunteeringWithB&A, #ExerciseDuringLunchWithB&A, and more
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Data Engineer II
MediavineMediavine is a leading programmatic ad tech partner helping independent publishers build sustainable businesses
Role Description The Data & Analytics team consists of data analysts, data engineers, and analytics engineers working to build the most effective platform and tools to help uncover opportunities and make decisions with data here at Mediavine. A Data Engineer at Mediavine will help build and maintain our data infrastructure, including: - Building scalable data pipelines - Managing transformation processes - Ensuring data quality and security at all steps - Writing and maintaining code in Python and SQL - Developing on AWS - Selecting and using third-party tools like Rundeck, Metabase, and others Essential Responsibilities include: - Create data pipelines that make data available for analytic and application use cases - Develop self-healing, resilient processes - Create meaningful data quality notifications - Lead projects from a technical standpoint, creating project Technical Design Documents - Support data analysts and analytics engineers - Participate in code reviews - Build or implement tooling around data quality, governance, and lineage - Provide next-level support for data issues - Work with data analysts and analytics engineers to standardize transformation logic - Enable analytics engineers and data analysts by providing data modeling guidance Qualifications - 3+ years of experience in a data engineering role - Strong Python skills (understands tradeoffs, optimization, etc.) - Strong SQL skills (CTEs, window functions, optimization) - Experience working in cloud environments (AWS preferred, GCS, Azure) - Experience managing complex dbt environments with hundreds or more flows - Understanding of how to best structure data for analytics - Familiarity with calling APIs to retrieve data - Experience working with DevOps to deploy, scale, and monitor data infrastructure - Scheduler experience either traditional or DAG based - Experience using LM-powered tools for code generation, documentation, and architectural diagramming - Comfortable working with multi-TB cloud data warehouses (Snowflake preferred) - Experience with other DBMS systems (Postgres in particular) - Ability to travel up to approx 15% Requirements - Experience with web analysis such as creating data structures that support product funnels, user behavior, and decision path analysis - Understanding of Snowflake external stages, file formats, and snowpipe - Experience managing the semantic layer in either dbt or Snowflake - Experience with orchestration tools across different technologies and stacks - Knowledge of Ad Tech, Google Ad Manager - The ability to make your teammates laugh - Familiarity with event tracking systems (Snowplow, etc.) - Experience with one or more major BI tools (Omni, Sigma, Metabase, etc.) Benefits - 100% remote - Comprehensive benefits including Medical, Dental, Vision, Disability, and Life Insurance - 401(k) with company matching - Generous PTO - Wellness initiatives and employer-sponsored mental health resources - Professional development opportunities - Inclusive, collaborative, and entrepreneurial company culture
BI, Big Data, Data Warehouse Instructor – Google BigQuery
Flowon - Gamification LabThe commotion power of games directed to solve problems.
• Deliver live, remote classes and mentor students, answering questions and providing feedback on assignments and projects. • Analyze and contrast architectures of transactional systems and decision-support systems, optimizing the flow of information for corporate analytics. • Develop Business Intelligence projects, identifying key convergences and divergences with Big Data initiatives to create scalable data strategies. • Manage the full lifecycle of Business Intelligence projects, from data ingestion to strategic visualization. • Design and operationalize Data Warehouses on Google BigQuery, applying storage and processing techniques to generate high-performance insights.
Senior Data Engineer
AvengaA global IT engineering and consulting company specializing in custom software development.
• Technical analysis and documentation of complex data flows and system architectures in a payments processing environment • Creation and maintenance of data mappings between source and target systems in distributed Big Data environments • Close collaboration with business and IT departments for requirements gathering and implementation • Development and optimization of data pipelines using Spark-Scala and SQL on Google Cloud Platform • Modelling and implementation of Dataform transformations and integration into existing cloud architectures • Management and monitoring of batch processes via automation tools (UC4) • Independent execution of testing and quality assurance activities • Preparation of status reports and presentation of results to stakeholders • Active participation in agile team ceremonies and Scrum processes
Title: Electronic Data Interchange Coordinator Location: Concord United States Job Description: Northeast Delta Dental in Concord, NH is seeking to hire a full-time, remote, Electronic Data Interchange (EDI) Coordinator who will provide accurate, secure, and expedited enrollment for employer groups and Third-Party Administrators (TPAs). Our EDI Coordinator position earns a competitive salary at $24.00 - $25.00/hour depending on experience. We provide fantastic benefits including health, life, dental, vision, short-term disability (STD), long-term disability (LTD), paid time off (PTO), paid holidays, a 401(k) plan, an independent retirement advisor, an employee assistance program, a tuition reimbursement program, and more! If this sounds like the right opportunity for you, apply today! ABOUT NORTHEAST DELTA DENTAL: Northeast Delta Dental - a nonprofit member of Delta Dental Plans Association (DDPA) - is the region's most trusted name in dental insurance for companies, individuals, and families throughout Maine, New Hampshire, and Vermont. A DAY IN THE LIFE OF AN EDI COORDINATOR: - Promotes accurate electronic file feeds by educating and training employer groups and TPAs about file formatting and requirements. - Implements electronic group enrollments by receiving and entering eligibility records into the custom enterprise system. Updates current records as needed. - Reviews enrollment data for accuracy by comparing and analyzing error reports and performing audits. Collaborates with TPAs and employer groups to reconcile discrepancies and update records. - Improves claims adjudication by performing scenario testing, researching errors, and updating enrollment data in the custom enterprise system. - Provides excellent customer service to employer groups by processing electronic eligibility files accurately and in a timely fashion; answering calls, and responding to email inquiries. - Provides training, guidance, and information on electronic enrollment by maintaining and enhancing knowledge about the process and rules around setting up and receiving 834 transactions, electronic enrollment files, the subscriber benefit administration tool, and eligibility modules in the custom enterprise system. - Maintains accurate process and procedure reference guides by documenting, reviewing, and updating department manuals, training materials, and related documentation. THE EXPERTISE AND SKILLS YOU WILL BRING: - Associates Degree in Business, Computer Science, or related field, plus at least two years of progressively responsible eligibility or enrollment experience or an equivalent combination of training, education, and/or experience. - Must be proficient in the use of the Microsoft Office suite. Experience with online enrollment tools, electronic enrollment file formats, and the Health Insurance Marketplace preferred. - Must be authorized to work for any employer in the United States without sponsorship now and in the future. WORK SCHEDULE: The typical work schedule for this position is Monday - Friday, 8:00 a.m. - 4:00 p.m. All candidates must be authorized to work for any employer in the United States without sponsorship now and in the future. Northeast Delta Dental is proud to be an equal opportunity employer. IF YOU ARE READY TO JOIN OUR TEAM ~ APPLY TODAY! Location: 03301



