Job Closed
This listing is no longer active.
Data Engineer
Location
Brazil
Posted
79 days ago
Salary
0
Seniority
Junior
Job Description
Data Engineer
YouGov
• Design, develop, and maintain robust, scalable data pipelines using Python and Airflow. • Collaborate with Analytics Engineers and other team members to deliver clean, well-modeled data to downstream users. • Implement monitoring, logging, and alerting to ensure data pipeline reliability and performance. • Ensure data quality and integrity through validation frameworks and testing. • Optimize performance and cost-efficiency of cloud-based data systems. • Contribute to architectural decisions around data storage, workflow orchestration, and infrastructure as code. • Document data pipelines and processes
Job Requirements
- Bachelor’s degree in computer science or related field
- Proven years of experience in a Data Engineering or Software Engineering role
- Very good knowledge of Python and experience with SQL
- Experience with Kubernetes and containerization
- Experience with Airflow or similar process orchestration tool
- Familiarity with modern data file formats (Parquet, ORC, JSON)
- Experience with data architecture, modelling, and pipelines in an enterprise data warehouse ( Snowflake, Redshift, BigQuery )
- Experience with AWS products (S3, Lambda, Athena)
- Ability to work both independently and in a team-oriented environment
- Strong analytical skills with a critical thinking attitude.
Benefits
- Health insurance
- Retirement plans
- Paid time off
- Flexible work arrangements
- Professional development
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Senior Software Development Engineer (Big Data)
ZillowReimagining real estate to make it easier than ever to move from one home to the next.
This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more. Role Description As a Senior Software Engineer (Big Data) on the Iron Chef team, you will design, build, and support data pipelines and data products that power machine learning (ML), AI-driven workflows, and analytics for Zillow Partner Agents. You will collaborate closely with product managers, engineers, data scientists, and analysts to create high-quality datasets and data products that surface the right customer opportunities at the right time. This is a high-impact role where you will improve data quality, reliability, and automation across our data engineering stack and contribute to the development and deployment of AI-driven systems used across Zillow. You Will Get To: - Collaborate with product managers, engineers, data scientists, and analysts to build, transform, and derive value from high-quality datasets that power machine learning, AI-driven workflows, and advanced analytics. - Design, build, and support scalable data pipelines and data products that serve ML, AI, and analytical use cases for Zillow Partner Agents. - Build self-service tools and platforms that address challenges for both data producers and data consumers, including integration and orchestration of AI-driven processes. - Contribute to shared infrastructure and tooling that enable reliable, scalable, and observable AI-powered systems. - Evaluate and drive adoption of new data and AI technologies that advance the team’s automation and AI capabilities. - Mentor, coach, and lead junior team members to help them grow into strong big data engineers. This role has been categorized as a Remote position. “Remote” employees do not have a permanent corporate office workplace and, instead, work from a physical location of their choice, which must be identified to the Company. U.S. employees may live in any of the 50 United States, with limited exceptions. In addition to a competitive base salary and benefits, this position is also eligible for equity awards based on factors such as experience, performance and location. Qualifications - 5+ years of software development experience with high proficiency in Python, Java, Scala, or a similar programming language. - Strong knowledge of SQL, data structures, and algorithms, and experience building highly scalable and reliable data pipelines using technologies such as Spark, Hive, Trino/Presto, Airflow, Kafka, or Flink. - Experience with containerization and orchestration technologies, for example Docker and/or Kubernetes. - Familiarity with analytical and BI tools such as Tableau, Superset, or Mode Analytics, and experience working directly with customers or stakeholders to understand and capture requirements. - You care deeply about building high-quality tools, APIs, and platforms, and you use creativity and feedback to continuously improve them. - Nice to have: experience with data modeling and DevOps practices for running and supporting production systems. - Nice to have: experience with AI/ML systems, AI agents or workflows, or automation of data-driven processes. Company Description At Zillow, we’re reimagining how people move—through the real estate market and through their careers. As the most-visited real estate platform in the U.S., we help customers navigate buying, selling, financing and renting with greater ease and confidence. Whether you're working in tech, sales, operations, or design, you’ll be part of a company that's reshaping an industry and helping more people make home a reality. Zillow is honored to be recognized among the best workplaces in the country. Zillow was named one of FORTUNE 100 Best Companies to Work For® in 2025, and included on the PEOPLE Companies That Care® 2025 list, reflecting our commitment to creating an innovative, inclusive, and engaging culture where employees are empowered to grow. No matter where you sit in the organization, your work will help drive innovation, support our customers, and move the industry—and your career—forward, together. Zillow Group is an equal opportunity employer committed to fostering an inclusive, innovative environment with the best employees. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. If you have a disability or special need that requires accommodation, please contact your recruiter directly. Qualified applicants with arrest or conviction records will be considered for employment in accordance with applicable state and local law. Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company’s reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more. Role Description As a BI Developer, you will be responsible for design, development and deployment of BI solutions that support HCP business and enable business to serve our clients efficiently. You will be collaborating with Conduent shared services teams and business teams during the product roadmap and design phases to ensure solutions align with the business and IT strategy. - Manage end to end implementation of Datawarehouse and ETL on premise/cloud. - Expert skills and ability to work and provide guidance to team on Database Design/Modelling. - In-depth skills to design, write and modify SSIS packages. - In-depth skills on SQL/TSQL (performance tuning and troubleshooting). - Advanced knowledge on SSAS to develop cube and tabular models with MDX/DAX Query Skills. - Advanced Skills in SSRS to Create reports, data and analysis based on business needs and available data elements. - Expert knowledge in developing parameterized, Chart, Graph, drill down reports using SSRS. - Intermediate Skills in Power BI with ability to create Dashboards for Data Analysis based on the business needs. - Setup TFS CI/CD for SQL Automation and Automation via scripting tools such as PowerShell (in addition to T-SQL). - Performance tuning of DB Objects, ETL and SSRS Reports. - Independently analyze, solve, and correct issues in real time, providing problem resolution end-to-end. Qualifications - Bachelor’s/Master’s degree in Computer Science / Computer Engineering or equivalent experience. - 5+ years’ experience with SQL Server database systems including complex warehouse design, experience with designing ETL extracts from various data sources. - 5+ years of SQL / TSQL development and fine-tuning experience. - 4+ years Microsoft BI Stack (SSRS, SSIS, SSAS), including development of reports (RDLs, complex stored procedures, subscriptions, ETL packages using SSIS & T-SQL queries). - Effectively prioritize and execute tasks in a high-pressure environment. - Must have experience of Agile development methodologies. - Excellent oral and written communication skills. Requirements - Pay Transparency Laws in some locations require disclosure of compensation and/or benefits-related information. For this position, actual salaries will vary and may be above or below the range based on various factors including but not limited to location, experience, and performance. - In addition to base pay, this position, based on business need, may be eligible for a bonus or incentive. - The estimated salary range for this role is $96,000 - $120,000. Benefits - Health insurance coverage. - Voluntary dental and vision programs. - Life and disability insurance. - Retirement savings plan. - Paid holidays. - Paid time off (PTO) or vacation and/or sick time.
This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more. Role Description CACI is seeking a Legacy System Export Developer with expertise in PeopleSoft HRMS and Oracle E-Business Suite (EBS) HCM to support a large-scale federal HCM modernization program. This enterprise-scale initiative will migrate federal civilian employee records from legacy HR systems to Oracle Fusion Cloud HCM across multiple federal agencies. In this role, you will be responsible for: - Extracting, validating, and transforming HR data from agency legacy PeopleSoft HRMS and Oracle EBS HCM systems. - Mapping legacy data schemas to Oracle Fusion HCM Data Loader (HDL) formats. - Ensuring extracted data meets EHRI standards and data quality thresholds required for successful migration. - Working directly with agency legacy system databases, developing SQL/PL-SQL extraction programs, SQR reports, PeopleSoft Application Engine processes, and EBS concurrent programs. This is a primarily remote position with up to 10% travel supporting agency-by-agency data migrations throughout the contract period. This position is at the T3 level, suited for a mid-career technical professional who applies solid working knowledge and established methods to independently perform a range of technical and functional tasks, resolving problems of moderate scope and complexity. Qualifications - Bachelor's degree in Computer Science, Information Technology, Database Administration, or related field. - 5+ years of experience in database development, data extraction, or database administration for enterprise HR systems. - 3+ years of hands-on experience with PeopleSoft HRMS (Application Designer, Application Engine, PeopleCode, SQR) and/or Oracle E-Business Suite HCM (concurrent programs, PL/SQL packages, HR module tables). - Strong SQL and PL/SQL development skills with experience writing complex extraction queries against large (100,000+ record) HR databases. - Experience with data mapping between legacy HR system schemas and target system data formats for system migration projects. - Knowledge of HR data domains including employee demographics, job history, position management, compensation, and benefits data structures. - Experience with data validation, data profiling, and data quality assessment methodologies. - Familiarity with Agile/SAFe development methodologies and iterative migration approaches with mock conversion cycles. - Must be able to obtain and maintain a Public Trust clearance (US Citizenship required). - Additional experience may substitute for degree. Requirements - Develop SQL and PL/SQL extraction programs to export employee data from PeopleSoft HRMS and Oracle EBS HCM databases including personal data, job history, compensation, benefits, position management, and organizational structures. - Analyze agency-specific legacy system configurations, custom fields, and data structures to create comprehensive data mapping documents from legacy schemas to Oracle Fusion HCM HDL file formats. - Build PeopleSoft Application Designer and Application Engine processes for automated, repeatable data extraction routines that support iterative mock migration cycles and final cutover extracts. - Develop EBS concurrent programs and data extraction packages for agencies running Oracle E-Business Suite HRMS, ensuring complete extraction of HR, payroll, and benefits data. - Create SQR reports and data validation queries to verify extraction completeness, data integrity, and compliance with EHRI data standards before handoff to the middleware/ETL team. - Design and execute data profiling analyses on legacy databases to identify data quality issues, orphaned records, incomplete fields, and agency-specific customizations requiring special handling. - Maintain legacy database environments (PeopleSoft and EBS) used for extraction development and testing, including schema refreshes, access management, and performance tuning for large-volume exports. - Collaborate with agency legacy system administrators to understand custom configurations, interfaces, and data dependencies that affect extraction scope and sequencing. - Develop data reconciliation procedures that compare legacy system record counts and key data elements against extraction outputs to ensure zero data loss during migration. - Document extraction procedures, data mapping specifications, and known data quality issues for each agency migration in accordance with SAFe Agile artifact standards. - Support cutover activities during agency go-live events, executing final extraction runs, validating outputs, and resolving extraction-related issues within tight cutover windows. - Apply established methods, standards, and practices to independently resolve issues. Benefits - Healthcare, wellness, financial, retirement, family support, continuing education, and time off benefits. - Competitive compensation and learning and development opportunities. - Flexible time off benefit. Company Description CACI values the unique contributions that every employee brings to our company and our customers - every day. You’ll be part of a high-performing group dedicated to our customer’s missions and driven by a higher purpose – to ensure the safety of our nation. At CACI, we place character and innovation at the center of everything we do.
Data Migration Developer
DysrupITWe partner with clients to build bespoke cloud technology teams that solve business challenges. Resources as a Service.
• Design, build, and execute data migrations into and across Microsoft Dataverse environments (required) • Perform document and data migrations from document management platforms, including SharePoint to SharePoint and other DMS solutions • Conduct source-to-target data mapping, transformation, and migration planning • Build and maintain ETL packages using SSIS or reputable third-party migration/ETL tools • Implement data cleansing activities, including: Data format standardisation and transformation • Validation and correction of inconsistent, incomplete, or inaccurate data • Perform data validation, reconciliation, and post-migration checks to ensure data integrity and completeness • Utilize Azure data migration tools, including Azure Data Factory and related services, to support scalable migration solutions • Execute dry runs, testing, and final migrations, resolving migration issues and data discrepancies • Ensure migrations are delivered with minimal business disruption, adhering to agreed timelines and quality standards • Produce migration documentation, runbooks, and validation reports as required




