This page tracks remote data engineer openings that are location-eligible for Minnesota.
Open jobs
2,388
Hiring companies this week
10
Salary sample
$22 - $135,000
Jobs added last hour
0
2388 Jobs
1479 Companies
Role Description We are looking for a Middle Data Engineer specialized in Azure Databricks to join our data platform team. The candidate will design and develop modern data pipelines and Lakehouse architectures, leveraging Azure Databricks, Spark, and Azure Data Factory, while integrating with existing SQL Server-based data warehouse environments, also evolving our data platform towards scalable, cloud-based data architectures, enabling advanced analytics and business intelligence. - Design, develop, and maintain data pipelines using Azure Databricks - Build and optimize data transformations using PySpark and SQL in Databricks - Implement and maintain Lakehouse architectures using Delta Lake - Develop ETL/ELT pipelines orchestrated through Azure Data Factory - Integrate data from multiple sources into the data platform and analytical layers - Design and maintain data models and data warehouse structures for analytics - Ensure data quality, scalability, and performance of large-scale data processing pipelines - Collaborate with BI teams to support Power BI and reporting platforms - Support and evolve existing SQL Server data platforms and ETL solutions (SSIS) when required - Contribute to the design of modern cloud-based data architectures Qualifications - 3+ years of experience in Data Engineering or Data Warehouse development - Strong experience with Azure Databricks - Experience developing data pipelines using PySpark and Spark SQL - Solid understanding of distributed data processing and big data concepts - Experience working with Delta Lake and Lakehouse architectures - Strong SQL skills and experience with SQL Server relational databases - Experience building data pipelines using Azure Data Factory - Experience handling large datasets and performance optimization Requirements - Experience with Spark optimization techniques (partitioning, caching, cluster tuning) - Experience with structured streaming in Databricks - Knowledge of CI/CD pipelines for data platforms (Azure Devops) - Familiarity with Power BI - Experience in migrating from traditional ETL process to cloud architectures Benefits - Culture of Relentless Performance: join an unstoppable technology development team with a 99% project success rate and more than 30% year-over-year revenue growth. - Competitive Pay and Benefits: enjoy a comprehensive compensation and benefits package, including health insurance, and a relocation program. - Work From Anywhere Culture: make the most of the flexibility that comes with remote work. - Growth Mindset: reap the benefits of a range of professional development opportunities, including certification programs, mentorship and talent investment programs, internal mobility and internship opportunities. - Global Impact: collaborate on impactful projects for top global clients and shape the future of industries. - Welcoming Multicultural Environment: be a part of a dynamic, global team and thrive in an inclusive and supportive work environment with open communication and regular team-building company social events. - Social Sustainability Values: join our sustainable business practices focused on five pillars, including IT education, community empowerment, fair operating practices, environmental sustainability, and gender equality.
One-stop-shop for entrepreneurs to start & grow their business in Australia, Hong Kong, Singapore and the UK.
Role Description We are looking for a skilled and passionate Data Engineer to join our growing Data Platform team. Mission: - Design, build, and maintain robust data pipelines on Databricks and AWS infrastructure that power analytics and reporting capabilities across the organization. Key responsibilities: - Design and implement scalable ETL/ELT pipelines using both batch and streaming patterns. - Build and maintain ingestion workflows from diverse sources (databases, APIs, event streams). - Implement Change Data Capture (CDC), full-load, and incremental ingestion strategies. - Develop and manage data workflows using Apache Airflow for orchestration. - Configure and manage data ingestion connectors using Airbyte. - Work with Databricks to build and optimize data engineering workloads on the Lakehouse platform. - Write and optimize complex SQL queries. - Solid hands-on experience on dbt with Databricks, build modular, testable dbt models for data transformation. - Develop and maintain data models in staging, intermediate, and mart layers following data warehousing best practices. - Working knowledge of AWS services like S3, Lambda, EC2, IAM, etc. - Containerize data services and applications using Docker & EKS. - Ensure data quality, observability, and reliability across the data platform. - Document pipelines, models, and data dictionaries to maintain platform knowledge. Qualifications - 3+ years of professional experience in data engineering. - Strong understanding of data platform architecture: Lakehouse, Data Warehouse, Data Lake patterns. - Hands-on experience with ETL/ELT design patterns including batch processing and stream processing. - Familiarity with ingestion patterns: full load, incremental, CDC, event-driven. - 5+ years of hands-on experience as a Database Administrator in production environments. - Strong understanding of database internals — storage engines, transactions, isolation levels, locking, MVCC, query planners. - Proven experience supporting mission-critical OLTP workloads with high availability requirements. - Solid scripting skills in Bash and/or Python for automation. Requirements - Experience building data pipelines on Databricks (Delta Live Tables, Jobs, Notebooks). - Proficiency with PySpark or Spark SQL for large-scale data processing. - Familiarity with Delta Lake concepts: ACID transactions, time travel, schema evolution. - Proficiency with Apache Airflow — authoring, scheduling, and monitoring DAGs. - Experience with Airbyte for managing source-to-destination data connectors. - Hands-on experience administering MongoDB (self-managed and/or Atlas). - Replica set configuration, sharding, indexing strategies, and aggregation pipeline tuning. - Backup, restore, and disaster recovery using mongodump/mongorestore or Ops Manager. - Strong SQL skills — query optimization, window functions, CTEs, and complex joins. - Experience with dbt (data build tool) for transformation, testing, and documentation. - Practical experience with AWS services (S3, Lambda, IAM, CloudWatch, etc). Benefits - Humility and kindness: A culture of not taking ourselves too seriously and being able to laugh. - Flexibility: Work from home and the option to work fully remote from anywhere in the world for 1 month each year. - Financial benefits: Competitive market salaries, generous paid time off, and access to a flexi benefits scheme. - Personal growth: Responsibility and autonomy with a range of internal and external training programs. Company Description Sleek launched in 2017 and now has around 15,000 customers across our offices in Singapore, Hong Kong, Australia, and the UK. We have around 500 staff with an intact startup mindset. We have recently raised Series B financing off the back of >70% compound annual growth in Revenue over the last 5 years. Sleek has been recognised by The Financial Times, The Straits Times, Forbes, and LinkedIn as one of the fastest-growing companies in Asia. Backed by world-class investors, we are on track to be one of the few cash flow positive, tech-enabled unicorns based out of Asia Pacific.
• Translate business requirements into data requests, reports and dashboards. • Strong Database & modeling concepts with exposure to SQL & NoSQL Databases • Strong data architecture patterns & principles, ability to design secure & scalable data lakes, data warehouse, data hubs, and other event-driven architectures • Expertise in designing and writing ETL processes in Python / Java / Scala • Understanding of Hadoop framework - Exposure to PySpark, Spark, Storm, HDFS, Hive • Strong hands-on experience with either Databricks or Snowflake; experience with both is desirable. • Knowledge of Master Data management and related tools • Strong exposure to data security and privacy regulations (GDPR, HIPAA) and best practices • Skilled in ensuring data accuracy, consistency, and quality • Experience with the AWS/Azure/GCP data engineering services • Knowledge of AWS services viz., AWS S3, Redshift, Lambda, DynamoDB, EMR, Glue, Lakeformation, Athena, Quicksight, RDS, Kinesis, Managed Kafka, API Gateway, CloudWatch • And / OR • Knowledge of Azure services viz., ADF, Data Catalog, Databricks, Azure Synapse Analytics, ADLS Gen2, Azure Devops • Ability to implement data validation processes and establish data quality standards. • Experience in Linux • Proficiency in data visualization tools like Tableau, Power BI or similar to create meaningful insights
The world's leading Aircraft Maintenance Tracking Solutions provider.
• Design, develop, and maintain high-performance, scalable, high-volume, and efficient ETL/ELT pipelines to extract, transform, and load data from various sources such as Oracle. • Create and optimize data models and schemas to support various use cases (such as AI/ML solutions, benchmarking, customer data delivery) in Snowflake and Redshift. • Ensure data quality, integrity/completeness, and governance by implementing best practices for monitoring and validation. • Build automated monitoring and alerting mechanisms. • Collaborate with cross-functional teams to understand data requirements to support business objectives. • Stay up to date with emerging trends and technologies in data engineering.
Founded in 1967, Capgemini is revered as one of the world's leading consulting, technology, and outsourcing agencies. In 2016 alone, the company reported global revenues of €12.5
Title: Lead Data Engineer Location: Irving United States Job Description: Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of technology and build a more sustainable, more inclusive world. Location United States - Remote Your Role 10+ Years of Experience in Data Engineering• At least four years of experience designing and delivering data engineering solutions with Databricks - Ability to independently define and deploy an end to end data architecture that includes Databricks medallion architecture - Experience leading large teams of engineers and developers to deploy Databricks solutions - Expert level hands on development knowledge in PySpark/Python - Expert level hands on SQL development skills - Hands on cloud platform experience in two of the following cloud platforms: Azure, AWS, Google Cloud - Prior expertise deploying Delta Lake Solutions into production Required Skill and Expereince - Experience extracting value from large and complex sets of data from various sources and databases - Solid grasp of database engineering and design principles - Familiarity with CI/CD methods desired - Background working with orchestration tools, such as Airflow - Strong knowledge of Unity Catalog - Past or current experience with an ETL tools such as Infomatica, Talend, Matillion desired - Experienced in managing senior client stakeholders - Delta Sharing and Marketplace Expertise - Experience working with Databricks Apps - Working knowledge of Databricks Genie, AI/BI and Databricks Data Visualization Capabilities - Conceptual, Logical and The base compensation range for this role in the posted location is $90,000- $160,000 Capgemini provides compensation range information in accordance with applicable national, state, provincial, and local pay transparency laws. The base compensation range listed for this position reflects the minimum and maximum target compensation Capgemini, in good faith, believes it may pay for the role at the time of this posting. This range may be subject to change as permitted by law. The actual compensation offered to any candidate may fall outside of the posted range and will be determined based on multiple factors legally permitted in the applicable jurisdiction. These may include, but are not limited to: Geographic location, Education and qualifications, Certifications and licenses, Relevant experience and skills, Seniority and performance, Market and business consideration, Internal pay equity. It is not typical for candidates to be hired at or near the top of the posted compensation range. In addition to base salary, this role may be eligible for additional compensation such as variable incentives, bonuses, or commissions, depending on the position and applicable laws. Capgemini offers a comprehensive, non-negotiable benefits package to all regular, full-time employees. In the U.S. and Canada, available benefits are determined by local policy and eligibility and may include: - Paid time off based on employee grade (A-F), defined by policy: Vacation: 12-25 days, depending on grade, Company paid holidays, Personal Days, Sick Leave - Medical, dental, and vision coverage (or provincial healthcare coordination in Canada) - Retirement savings plans (e.g., 401(k) in the U.S., RRSP in Canada) - Life and disability insurance - Employee assistance programs - Other benefits as provided by local policy and eligibility Important Notice: Compensation (including bonuses, commissions, or other forms of incentive pay) is not considered earned, vested, or payable until it becomes due under the terms of applicable plans or agreements and is subject to Capgemini's discretion, consistent with applicable laws. The Company reserves the right to amend or withdraw compensation programs at any time, within the limits of applicable legislation. Disclaimers Capgemini is an Equal Opportunity Employer encouraging inclusion in the workplace. Capgemini also participates in the Partnership Accreditation in Indigenous Relations (PAIR) program which supports meaningful engagement with Indigenous communities across Canada by promoting fairness, accessibility, inclusion and respect. We value the rich cultural heritage and contributions of Indigenous Peoples and actively work to create a welcoming and respectful environment. All qualified applicants will receive consideration for employment without regard to race, national origin, gender identity/expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status or any other characteristic protected by law. This is a general description of the Duties, Responsibilities and Qualifications required for this position. Physical, mental, sensory or environmental demands may be referenced in an attempt to communicate the manner in which this position traditionally is performed. Whenever necessary to provide individuals with disabilities an equal employment opportunity, Capgemini will consider reasonable accommodations that might involve varying job requirements and/or changing the way this job is performed, provided that such accommodation does not pose an undue hardship. Capgemini is committed to providing reasonable accommodation during our recruitment process. If you need assistance or accommodation, please reach out to your recruiting contact. Please be aware that Capgemini may capture your image (video or screenshot) during the interview process and that image may be used for verification, including during the hiring and onboarding process. Click the following link for more information on your rights as an Applicant in the United States. http://www.capgemini.com/resources/equal-employment-opportunity-is-the-law Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market leading capabilities in AI, generative AI, cloud and data, combined with its deep industry expertise and partner ecosystem.
Based in LaCrosse, Wisconsin, the Gundersen Health System is a physician-led, nonprofit healthcare network with facilities in 19 counties throughout western Wisconsin, southeastern
Title: Clinical Data Registrar | 0.8 FTE Location: Wisconsin United States Job Description: time type Part time job requisition id JR-30815 Love + medicine is who we are, it's what we do, it's why people want to work here. If you’re looking for a job to love, apply today. Scheduled Weekly Hours: 32 At Emplify Health, we are committed to improving patient outcomes through data-driven insights and exceptional care. We are seeking a detail-oriented Clinical Data Registrar – Stroke Program to support our clinical teams by ensuring high-quality data collection, reporting, and analysis that supports stroke program excellence and compliance. The Clinical Data Registrar works independently on abstraction and reporting of stroke-related clinical data. Key Responsibilities Include: - Collect, abstract, and code clinical data for stroke registry programs in accordance with regulatory standards - Perform detailed medical record reviews to accurately capture patient data and outcomes - Maintain and manage databases, spreadsheets, and data collection tools - Compile, analyze, and present data through reports and visual presentations for leadership - Ensure data integrity, accuracy, and completeness through routine audits and validation - Submit required data to external registries and reporting agencies - Support quality improvement initiatives through data insights and reporting - Provide excellent customer service through clear, timely, and professional communication What's Available: - 0.8 FTE; 32 hours weekly - Schedule: Typically 4 days per week, 8 hour shift - between 7:00am-5:00pm - Location: Primarily remote role for residents in WI, MN, or IA only. There may be occasional need to work onsite in La Crosse, WI for team related needs. - Immigration sponsorship (e.g., H-1B) is not available for this position. - Starting pay of $22.40/hour + more based on relevant work experience What You'll Need: - Education: Bachelor's degree or equivalent years of experience and education - Experience: 2 years of relevant work experience - Strong knowledge of medical terminology and clinical documentation - Experience with data abstraction, clinical registries, or quality reporting programs (stroke experience preferred) - High attention to detail with a strong focus on accuracy and data integrity - Proficiency in Microsoft Excel and data tracking tools - Ability to analyze data and create meaningful reports and presentations - Strong organizational skills with the ability to manage multiple priorities - Excellent communication and collaboration skills In addition to the rewarding work, you'll receive: - A highly adaptable and mission-driven organization with a work environment that supports you personally and professionally and a work culture where you are valued and appreciated - Competitive Benefits: A comprehensive and generous benefits package (Medical, Dental, Life Ins, HSA/FSA) ensuring your comfort and well-being as a valuable team member - Substantial retirement contribution including a 401k match & annual discretionary base contribution - Work-Life Balance: Paid Time Off (PTO) combines vacation, sick, and personal days into one balance to allow you the flexibility to use your time off as you need - Professional Development: Support for your career growth through Professional Development Opportunities, our Tuition Investment Program, and our Career Development Center - Additional Employee Discounts and Perks Other benefits include a Wellness program with incentives, employer-paid life insurance and AD&D, optional short-term and long-term disability coverage, an employee assistance program, identity theft protection, pet insurance, Inspire & Celebrate colleague recognition and rewards program, a discount program, and more! If you are looking to be a part of a stable and growing mission-driven organization, this may be the right opportunity for you! PRACTICES AND PROMOTES BEHAVIOR CONSISTENT WITH THE MISSION, VISION AND VALUES: Mission: Together, we inspire your best life by relentlessly caring, learning and innovating. Vision: Leading with love, we courageously commit to a future of healthy people and thriving communities. Values: Belonging, Respect, Excellence, Accountability, Teamwork, Humility Emplify Health is comprised of two of the Midwest’s most respected healthcare systems, Bellin Health and Gundersen Health System. Once neighbors, we are now partners, united in our mission to provide exceptional care to our communities. As a not-for-profit, patient-centered healthcare network, we have headquarters in Green Bay and La Crosse, Wisconsin. Our extensive network includes 11 hospitals and more than 100 clinics, serving 67 cities and rural communities across Wisconsin, Iowa, Minnesota and Michigan’s Upper Peninsula. With over 4,500 dedicated nurses and providers, we are committed to delivering primary, specialty and emergency care, along with innovative medical education programs. Join us in making a meaningful difference in the lives of our patients and communities. We inspire your best life by relentlessly caring, learning and innovating. This is our purpose. Together with our values — belonging, respect, excellence, accountability, teamwork and humility — our pillars set our foundation and our future. Equal Opportunity Employer
Apex Systems, an IT staffing and workforce solutions firm, provides recruiting and staffing services to large and small companies alike. Founded in 1995 by thre
Title: Data Architect Employee Type: Contract Pay Range: $50 - $95 per hour Job#: 3033647 Job Description: Data Architect Location: Remote Employment Type: Contract Role Overview The Data Architect will ensure a high level of data quality across the enterprise through the creation and management of sound data management processes. This individual is responsible for establishing metadata and registries, standardizing data naming, establishing consistent data definitions and business rules, and monitoring overall data quality. The role serves as a senior subject matter expert for enterprise data acquisition and business intelligence plans. Experience with SQL, Qlik, Health Catalyst, Snowflake (preferred), and Epic is required. Key Responsibilities - Lead the architecture, design, and deployment of enterprise solutions spanning multiple technologies, and research and recommend appropriate tools and standards. - Ensure new systems adhere to established data management practices and policies, and lead data warehouse discussions on modeling and integration. - Create and implement the data management strategy, including enforcing data validation at the point of entry and performing regular data audits. - Identify and resolve data quality issues, determine root causes, and implement solutions while ensuring project management methods include deliverables for high-quality data. - Coordinate mass data-cleansing initiatives and apply continuous quality improvement practices. Required Qualifications Education: A High School Diploma is required. Experience: Seven years of experience in data warehouse/business intelligence and internet/client-server systems. This must include three years of RDBMS experience covering data types, change control, performance optimization, and full life-cycle software development. Technical Skills: A broad IT industry knowledge with depth in application development, servers, networks, and databases. Familiarity with various operating systems and data processing techniques. A working knowledge of diverse hardware and software environments is necessary, along with an understanding of architecting internet, client-server, integration, and communications platforms. Preferred Qualifications - A Bachelor's or Master's degree in computer science, business administration, healthcare administration, or a related technology field is preferred. Work Environment We are an equal opportunity employer and welcome applications from all qualified candidates regardless of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or veteran status. Apex uses a virtual recruiter as part of the application process. Click here for more details. Everforth Apex is a world-class IT services company that serves thousands of clients across the globe. When you join Everforth Apex, you become part of a team that values innovation, collaboration, and continuous learning. We offer quality career resources, training, certifications, development opportunities, and a comprehensive benefits package. Our commitment to excellence is reflected in many awards, including ClearlyRated's Best of Staffing® in Talent Satisfaction in the United States and Great Place to Work® in the United Kingdom and Mexico. Everforth Apex uses a virtual recruiter as part of the application process. Click here for more details. Everforth Apex Benefits Overview: Everforth Apex offers a range of supplemental benefits, including medical, dental, vision, life, disability, and other insurance plans that offer an optional layer of financial protection. We offer an ESPP (employee stock purchase program) and a 401K program which allows you to contribute typically within 30 days of starting, with a company match after 12 months of tenure. Everforth Apex also offers a HSA (Health Savings Account on the HDHP plan), a SupportLinc Employee Assistance Program (EAP) with up to 8 free counseling sessions, a corporate discount savings program and other discounts. In terms of professional development, Everforth Apex hosts an on-demand training program, provides access to certification prep and a library of technical and leadership courses/books/seminars once you have 6+ months of tenure, and certification discounts and other perks to associations that include CompTIA and IIBA. Everforth Apex has a dedicated customer service team for our Consultants that can address questions around benefits and other resources, as well as a certified Career Coach. You can access a full list of our benefits, programs, support teams and resources within our ‘Welcome Packet’ as well, which an Everforth Apex team member can provide.
At Cohere, our mission is to build machines that understand the world, and to make them safely accessible to all.
Role Description We are on a mission to build machines that understand the world and make them safely accessible to all. Data quality is foundational to this process. Machines (or Large Language Models to be exact) learn in similar ways to humans: by way of feedback. By labeling, ranking, auditing, prompting, red teaming, and correcting output, you will improve Large Language Model’s performance for iterations to come, thus having a lasting impact on Cohere’s tech. Cohere is looking for Data Annotation Specialists with backgrounds and skills in Trust & Safety, Content Moderation, AI model evaluation, or related fields. This role is best suited for candidates who bring: - Strong contextual judgment - Cultural and bias sensitivity - Experience applying nuanced guidelines to complex or ambiguous content Successful candidates will be highly detail-oriented, comfortable evaluating safety risks across different user intents and scenarios, and able to make consistent, well-reasoned decisions with a high degree of independence after onboarding. IMPORTANT CONTEXT ON THIS ROLE: In this position, you will be asked to engage with human-generated and model-generated tasks which will sometimes mean intentional exposure to explicit content. Your annotations on these explicit tasks will be used to prevent the Large Language Model from generating unintentional, adversarial, toxic, or unsafe outputs. The types of explicit content you may be exposed to may include but are not limited to those of a sexual, violent, or psychologically disturbing nature. Please Note: This is a part-time, remote, independent contractor position available within Canada or the United States. We seek candidates who are able to commit to 16 hours per week minimum at a 45 CAD/hour or 45 USD/hour contract rate, depending on your location, consisting of 30/hour base pay plus 15/hour hazard pay. This role is BYOD 💻 - Bring Your Own Device (laptop). 12 months contract with potential for extension. As a Data Annotation Specialist on safety task, you will: - Evaluate and improve model safety: - Label, rank, audit, and refine human- and model-generated text to improve safety, quality, and policy alignment, including content that may be sexual, violent, or psychologically disturbing. - Apply nuanced safety judgment: - Assess model outputs against detailed safety guidelines, rubrics, and style standards, making consistent decisions across ambiguous, sensitive, and context-dependent cases. - Create prompts and safety test cases: - Write realistic prompts, user scenarios, and adversarial examples that help evaluate model behavior across safety categories and uncover unsafe, evasive, over-refusing, or policy-inconsistent responses. - Support quality and calibration: - Identify annotation inconsistencies or unclear guidelines, and provide actionable feedback on recurring edge cases, model failures, and opportunities to improve data quality. - Work with precision and independence: - Complete annotation tasks with strong attention to detail, while being comfortable working independently in a globally distributed, asynchronous team environment. Qualifications - 1+ years of experience in Content Moderation, Trust and Safety, AI data annotation, LLM evaluation, or a related analytical role, with exposure to quality assurance, red teaming, and/or prompt engineering preferred. - Experience applying detailed guidelines to complex and sensitive content, with strong contextual and sociocultural judgment and the ability to recognize and manage personal bias. - Emotional resilience: Comfort working with content that contains unsafe, explicit, and/or toxic content, including content of a sexual, violent, or psychologically disturbing nature. - Excellent command of written English and the ability to clearly justify content evaluations, including why an output is safe, unsafe, high-quality or low-quality. Bonus points if you are fluent in another language! - Strong attention to detail and commitment to accuracy, with the ability to maintain consistency across high-volume and monotonous tasks. - Strong execution in a remote environment, including good time management, comfort using new tools, and the ability to work independently in a global, asynchronous team. Candidate Journey - Initial Screening - Once you have submitted your application our Talent Team will review your resume and writing samples. - Virtual Annotation Test - This assignment will test your written skill through various language-based tasks, such as a writing sample, interacting with a chat bot, and more. - Video Screen - If selected to move forward, you will have a short video call with a member of our Operations Team! Benefits - An open and inclusive culture and work environment - Work closely with a team on the cutting edge of AI research - Weekly lunch stipend, in-office lunches & snacks - Full health and dental benefits, including a separate budget to take care of your mental health - 100% Parental Leave top-up for up to 6 months - Personal enrichment benefits towards arts and culture, fitness and well-being, quality time, and workspace improvement - Remote-flexible, offices in Toronto, New York, San Francisco, London and Paris, as well as a co-working stipend - 6 weeks of vacation (30 working days!)
Atlassian is a publicly-traded computer software business specializing in collaboration, development, and issue-tracking software for teams. As an employer, Atlassian maintains a t
Role Description Atlassian is looking for a Principal Data Engineer to join our Data Engineering Team and play a tech lead & architect role to build world-class data solutions and applications that power crucial business decisions throughout the organization. We are looking for an open-minded, structured thinker who is passionate about building systems at scale. You will enable a world-class engineering practice, drive the approach with which we use data, develop backend systems and data models to serve the needs of insights and play an active role in building Atlassian's data-driven culture. - Own the technical evolution of the data engineering capabilities and be responsible for ensuring solutions are being delivered incrementally, meeting outcomes, and promptly escalating risks and issues. - Establish a deep understanding of how things work in data engineering, use this to direct and coordinate the technical aspects of work across data engineering, and systematically improve productivity across the teams. - Maintain a high bar for operational data quality and proactively address performance, scale, complexity and security considerations. - Drive complex decisions that can impact the work in data engineering. Set the technical direction and balance customer and business needs with long-term maintainability & scale. - Understand and define the problem space, and architect solutions. Coordinate a team of engineers towards implementing them, unblocking them along the way if necessary. - Lead a team of data engineers through mentoring and coaching, work closely with the engineering manager, and provide consistent feedback to help them manage and grow the team. - Work with close counterparts in other departments as part of a multi-functional team, and build this culture in your team. Qualifications - You have 12+ years of experience in a Data Engineer role as an individual contributor. - You have at least 2 years of experience as a tech lead for a Data Engineering team. - You are an engineer with a track record of driving and delivering large (multi-person or multi-team) and complex efforts. - You are a great communicator and maintain many of the essential cross-team and cross-functional relationships necessary for the team's success. - Experience with building streaming pipelines with a micro-services architecture for low-latency analytics. - Experience working with varied forms of data infrastructure, including relational databases (e.g. SQL), Spark, and column stores (e.g. Redshift). - Experience building scalable data pipelines using Spark using Airflow scheduler/executor framework or similar scheduling tools. - Experience working in a technical environment with the latest technologies like AWS data services (Redshift, Athena, EMR) or similar Apache projects (Spark, Flink, Hive, or Kafka). - Understanding of Data Engineering tools/frameworks and standards to improve the productivity and quality of output for Data Engineers across the team. - Industry experience working with large-scale, high-performance data processing systems (batch and streaming) with a "Streaming First" mindset to drive Atlassian's business growth and improve the product experience. Benefits - Atlassian offers a wide range of perks and benefits designed to support you, your family and to help you engage with your local community. - Our offerings include health and wellbeing resources, paid volunteer days, and so much more. Company Description At Atlassian, we're motivated by a common goal: to unleash the potential of every team. Our software products help teams all over the planet and our solutions are designed for all types of work. Team collaboration through our tools makes what may be impossible alone, possible together. We believe that the unique contributions of all Atlassians create our success. To ensure that our products and culture continue to incorporate everyone's perspectives and experience, we never discriminate based on race, religion, national origin, gender identity or expression, sexual orientation, age, or marital, veteran, or disability status. All your information will be kept confidential according to EEO guidelines. To provide you the best experience, we can support with accommodations or adjustments at any stage of the recruitment process. Simply inform our Recruitment team during your conversation with them. To learn more about our culture and hiring process, visit go.atlassian.com/crh.
Peraton Corporation, a national security company headquartered in Herndon, Virginia, supplies solutions for mission-critical programs and systems. Founded in 2017, Peraton's missio
Role Description We are looking for a highly experienced Senior Technical Lead for Data to lead engineering and architectural efforts supporting the design, development, and maintenance of large-scale enterprise data systems. The ideal candidate will have deep expertise in data systems architecture, cloud environments, and enterprise database products, with proven leadership managing high-availability mission-critical systems in federal environments. You will oversee engineering teams, manage risk, develop technical performance metrics, and ensure the stable, secure, and efficient operation of data systems integrated with Identity and Access Management (IAM) and cloud platforms. As the Senior Technical Lead for Data, you will serve as the authoritative technical voice for all data-related workstreams, translating complex business and mission requirements into scalable, secure, and compliant data architectures while directly mentoring and guiding a team of data engineers. Sitting at the intersection of data engineering, cloud architecture, data governance, and technical leadership, you will collaborate closely with IAM engineers, platform architects, data scientists, security teams, and program leadership to ensure the data platform is modern, resilient, and aligned with federal data governance mandates and Zero Trust principles. - Lead the design, development, evaluation, testing, and integration of organizational data systems infrastructure, including both hardware and software components. - Ensure all systems meet stability, integrity, and efficient operation requirements in accordance with approved specifications; verify systems are properly maintained and optimized once operational. - Provide technical support for acquisition documentation, milestone reviews, and key operational and test events throughout the program lifecycle. - Oversee the systems engineering team and all engineering activities supporting organizational data and information systems, including networked software and associated operating systems. - Execute and manage risk assessments, develop mitigation strategies, and plan cost, schedule, and execution plans for assigned projects. - Develop and review technical performance metrics to track and communicate system health, delivery progress, and operational readiness. - Plan, manage, and coordinate multiple concurrent tasks, each with strict deadlines across a large-scale, highly available system integrated with business-critical platforms. - Drive continuous improvements and optimizations to database systems, data encryption, storage, and retention strategies. - Collaborate with IAM engineers, platform architects, data scientists, security teams, and program leadership to ensure data solutions align with organizational goals, AWS GovCloud architecture, and IAM frameworks. - Support agile development teams by assessing how enhancements, defects, and other requests impact the architecture and performance of the application. - Demonstrate expert knowledge of recent technological advances in computer science and engineering to inform architectural decisions and modernization efforts. - Provide excellent written and verbal communication to stakeholders at all levels, including executive briefings, technical documentation, and team guidance. Qualifications - Minimum of 12 years with BS/BA or 16 years with a HS diploma/equivalent. - Minimum 10 years of experience in Information Technology supporting complex data systems. - 7+ years of experience working with IBM, Oracle, and cloud-based database products. - Training and certification (mandatory) in target ICAM database products preferred, especially Oracle and DB2. - Strong understanding of software development, enhancement, and maintenance lifecycles. - Demonstrated experience with the planning, management, leadership, and coordination of multiple concurrent tasks with strict deadlines for large-scale, highly available systems integrated with business-critical platforms. - Demonstrated expertise in data encryption, data storage, and retention policies in secure federal environments. - Proven ability to perform complex technical tasks in a highly secure environment. - Strong technical knowledge of IT systems, IAM, and AWS GovCloud services. - Experience with agile/scrum methodologies. - Expert knowledge of recent advances in computer science and engineering. - Must be able to obtain and maintain the required agency clearance. - Must be a US Citizen. Preferred Skills - Experience with federal IT programs, regulatory compliance, and federal acquisition documentation. - Familiarity with enterprise data governance and security frameworks (NIST, FISMA, FedRAMP). - Knowledge of cloud-native database and data warehousing technologies on AWS GovCloud. - Experience supporting ATO processes, System Security Plans (SSPs), and continuous monitoring activities. - Familiarity with Zero Trust Architecture principles and federal mandates (OMB M-22-09, EO 14028). Company Description Peraton is a next-generation national security company that drives missions of consequence spanning the globe and extending to the farthest reaches of the galaxy. As the world’s leading mission capability integrator and transformative enterprise IT provider, we deliver trusted, highly differentiated solutions and technologies to protect our nation and allies. Peraton operates at the critical nexus between traditional and nontraditional threats across all domains: land, sea, space, air, and cyberspace. The company serves as a valued partner to essential government agencies and supports every branch of the U.S. armed forces. Each day, our employees do the can’t be done by solving the most daunting challenges facing our customers. Target Salary Range $135,000 - $216,000. This represents the typical salary range for this position. Salary is determined by various factors, including but not limited to, the scope and responsibilities of the position, the individual’s experience, education, knowledge, skills, and competencies, as well as geographic location and business and contract considerations. Depending on the position, employees may be eligible for overtime, shift differential, and a discretionary bonus in addition to base pay. EEO EEO: Equal opportunity employer, including disability and protected veterans, or other characteristics protected by law.
2,378more opportunities are still waiting for you.Log in now and take your next shot before someone else does.
AWS, SQL, ETL, Data Engineering, Azure, PySpark
