Datamaxis is a WMBE corporation and committed to provide IT services to commercial and government organizations.
Senior Data Engineer, Databricks, PySpark
Location
India
Posted
76 days ago
Salary
0
Seniority
Senior
Job Description
Senior Data Engineer, Databricks, PySpark
DATAMAXIS, Inc
• Understands the full picture and helps operations with monitoring, dashboards etc. • Work with architect and tech lead on design. • Constantly keeps an eye on cost and performance of the system. • Work with BA on the integration requirements. • Ability to trouble shoot performance issue and other functional issues. • Attention to details and documents the key decisions made. • Ability to handle fast paced projects and willing to look into production issues. • Should be a quick/self learner and be able to adopt to new technologies. • Prompt response /communication needed.
Job Requirements
- Must be a team player.
- Must have at least 5 years of IT development experience.
- Must have strong analytical and problem-solving skills.
- Must have experience in designing solutions, performing code reviews, mentoring junior engineers.
- Must have strong SQL and backend experience, and working on data driven projects.
- Must have following experience: Python/PySpark SQL/ PL/SQL Databricks Java/C#
- Preferred to have following experience: Azure Kafka Node JS Azure Data Factory
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
• Lead paid acquisition engine by turning complex data into scalable, profitable results • Drive growth by efficiently allocating capital across paid channels • Optimize marketing dollars for scalable revenue • Manage end-to-end architecture of paid media efforts • Analyze complex datasets to identify growth opportunities • Design and measure A/B and CRO tests • Build and own reporting layer in BigQuery and Looker Studio • Deploy advanced bidding and geotargeting
• Design, develop, and maintain ELT/ETL processes and scripts for data integration and transformation • Create and maintain data mappings with business logic to support data processing and reporting • Work with data warehouse structures and support data integration into analytical environments • Analyze and optimize existing data processing workflows and pipelines • Collaborate with the development and business teams to understand and implement business logic in data processes • Create and maintain technical documentation and user instructions • Troubleshoot data-related issues and provide technical support • Support data preparation and transformation for reporting and analytics
Senior Data Engineer, Advertising Platform
OneTeamAnywhereProviding dedicated IT teams to clients anywhere around the globe
• Contribute to building and maintaining data pipelines and the data platform. • Manage data ingestion from various sources, optimizing for efficiency and reliability. • Collaborate with data analysts on complex data transformations, implementing orchestration tools and quality checks. • Oversee the operational aspects of the data platform, including performance tuning and capacity management. • Mentor and guide junior team members, promoting best practices in data engineering.
Data Engineer, Architect
RebaseFront-end software engineering at the service of the technology network.
• Looking for Data Engineers and Data Architects in Helsinki and other parts of Finland. • Work on various projects with hundreds of customers. • Collaborate with other vendors and teams. • Participate in a professional community supporting growth.




