Global data intelligence partner offering advanced web scraping & ethical proxies. 🌎 Worldwide IP locations since 2019
Platform Architect & Tech Lead
Location
Worldwide
Posted
5 days ago
Salary
0
Seniority
Lead
Job Description
Platform Architect & Tech Lead
Infatica.io
Role Description As the Platform Architect & Tech Lead, you will own the technical architecture of our Web Data Platform, guide engineering decisions, and lead a team responsible for browser automation, data collection infrastructure, and large-scale distributed services. You'll remain close to the code while spending a significant portion of your time on architecture, technical strategy, mentoring, and cross-functional collaboration. What You'll Do: - Own the technical architecture and long-term evolution of the Web Data Platform. - Define engineering standards, architectural principles, and technical roadmaps. - Lead a team of engineers through technical direction, mentoring, and regular feedback. - Design and build scalable distributed systems for public web data collection. - Drive the evolution of our browser automation platform and data extraction infrastructure. - Solve complex engineering challenges involving JavaScript-heavy websites, browser automation, networking, and anti-bot environments. - Improve scalability, resilience, observability, and operational excellence across the platform. - Review architecture, code, and technical designs to maintain high engineering quality. - Partner with Product, Infrastructure, and Platform teams to deliver reliable production systems. - Support hiring, onboarding, and the professional growth of the engineering team. - Help shape the engineering culture through technical excellence, collaboration, and continuous improvement. Qualifications - Several years of professional software engineering experience. - Experience as a Technical Lead, Staff Engineer, Engineering Lead, or Software Architect. - Proven experience designing and operating large-scale distributed systems. - Expert-level Python. - Deep understanding of asynchronous programming, concurrency, and high-performance backend systems. - Strong software architecture and system design skills. - Experience building production platforms that operate under significant scale and reliability requirements. - Strong understanding of HTTP, networking, browser internals, JavaScript rendering, cookies, sessions, caching, and modern web technologies. - Excellent debugging, troubleshooting, and performance optimization skills. - Strong communication and technical leadership abilities. - Upper-Intermediate English or higher. Preferred Experience - Browser automation platforms (Playwright, CDP, Chromium-based tooling). - Distributed crawling or web data collection platforms. - Reverse engineering of modern web applications and anti-bot systems. - High-load backend services processing millions of requests or pages per day. - Performance optimization of distributed systems. - Platform engineering and infrastructure automation. - Production incident management and operational excellence. - Mentoring engineers and driving technical excellence across teams. Leadership Expectations - Make sound architectural decisions under uncertainty. - Balance immediate business needs with long-term platform evolution. - Translate complex technical challenges into clear engineering plans. - Build alignment across teams through technical leadership. - Raise engineering quality through architecture reviews and code reviews. - Mentor engineers and help develop future technical leaders. - Take ownership of technical outcomes from design through production. - Foster a collaborative, high-performing engineering culture. - Own the architecture of one of the company's most strategic technology platforms. - Work on technically challenging distributed systems at production scale. - High level of technical autonomy and ownership. - Opportunity to influence engineering strategy and platform direction. Benefits - Remote-first environment with flexible working hours. - Competitive compensation. - Learning and professional development budget. - Support for conferences, certifications, and technical growth.
Related Guides
Related Categories
Related Job Pages
More Architect Jobs
Architect – Documentation-Focused Role
Pear Tree.Hire smarter, hire globally — scale your business while saving up to 80% on local costs. www.pear-tree.com
• Prepare, develop, and coordinate detailed architectural documentation throughout the Design Development, Tender, Construction Certificate, and Construction phases. • Produce high-quality working drawings, specifications, schedules, and documentation packages using Revit. • Ensure all documentation complies with the National Construction Code (NCC), Australian Standards, SEPPs, LEPs, and other relevant NSW planning regulations. • Coordinate architectural documentation with consultants and internal project teams to maintain consistency and technical accuracy. • Review and maintain documentation quality while resolving design coordination and technical issues throughout project delivery. • Support construction-stage documentation, RFIs, revisions, and project updates as required. • Manage multiple project deliverables while meeting deadlines and maintaining high attention to detail. • Communicate effectively with project stakeholders and contribute practical, solution-focused recommendations throughout each project phase.
Role Description We are looking for an experienced Senior Solution Architect with deep expertise in Databricks and modern data engineering technologies to lead the design, architecture, and implementation of scalable data platforms. The ideal candidate will work closely with customers to understand their business objectives, translate requirements into technical solutions, and deliver high-performance, cloud-based data platforms. As a trusted technical advisor, you will provide architectural guidance, mentor engineering teams, and ensure best practices in data engineering, data governance, and platform optimization. Qualifications - 10+ years of overall experience in Information Technology. - 6+ years of hands-on experience designing and implementing solutions using Databricks. - Proven experience in architecting enterprise-scale data platforms and analytics solutions. Requirements - Collaborate with customers, business stakeholders, and technical teams to gather requirements and design scalable data platform architectures. - Design and implement modern Data Lakehouse solutions using Databricks. - Develop and optimize scalable data ingestion, transformation, and processing pipelines using Apache Spark. - Define and implement data architecture following Medallion (Bronze, Silver, Gold) architecture principles. - Lead solution design discussions, technical workshops, and architecture reviews with customers. - Provide technical leadership and mentor development teams on Databricks best practices and modern data engineering techniques. - Optimize Spark workloads for performance, scalability, and cost efficiency. - Design secure, reliable, and highly available data solutions with appropriate governance and monitoring. - Work closely with cross-functional teams including Data Engineers, Data Scientists, DevOps, and Cloud Architects to deliver end-to-end solutions. - Identify opportunities for platform optimization, automation, and continuous improvement. - Support pre-sales activities by providing technical consulting, solution presentations, architecture diagrams, and effort estimations when required. Benefits - Strong hands-on expertise in Databricks. - Strong programming skills in Python and SQL. - Extensive experience with Apache Spark (PySpark/Spark SQL). - Solid understanding of Data Lake and Lakehouse architectures. - Experience implementing Medallion Architecture (Bronze, Silver, Gold layers). - Expertise in designing and maintaining scalable ETL/ELT pipelines. - Strong knowledge of data modeling, partitioning, optimization, and performance tuning. - Experience working with structured, semi-structured, and unstructured data. - Good understanding of data quality, governance, and security best practices. - Familiarity with CI/CD practices, version control (Git), and Agile methodologies. Preferred Skills - Experience with cloud platforms such as Microsoft Azure, AWS, or Google Cloud Platform. - Knowledge of Delta Lake, Unity Catalog, Delta Live Tables, Databricks Workflows, and MLflow. - Experience integrating Databricks with cloud-native data services and orchestration tools. - Understanding of streaming technologies and real-time data processing. - Experience with Infrastructure as Code (Terraform or similar) is a plus. - Databricks or cloud certifications are highly desirable. Soft Skills - Excellent customer-facing and stakeholder management skills. - Strong analytical and problem-solving abilities. - Excellent verbal and written communication skills. - Ability to lead technical discussions and influence architectural decisions. - Strong collaboration and mentoring capabilities. - Ability to manage multiple priorities in a fast-paced environment. What You'll Bring - A customer-first mindset with the ability to translate business requirements into scalable technical solutions. - Strong architectural thinking with expertise in modern data platforms. - Passion for building reliable, high-performance, and cost-effective data solutions. - Ability to work independently while collaborating effectively across distributed teams.
Architect / Documentation-Focused Role
D2BAn Australian home building company specializing in the construction of quality residential properties. The team focuses on delivering well-designed homes with efficient project management, accurate costing, and strong collaboration with suppliers and contractors.
Role Description We are seeking an experienced Architect to join our team and support the delivery of active New South Wales projects, with a primary focus on technical documentation and project delivery rather than concept design. The successful candidate will play a key role in producing and coordinating comprehensive documentation packages throughout the Design Development (DD), Tender, Construction Certificate (CC), and Construction phases. - This role is ideal for an architect with strong NSW multi-residential documentation experience, advanced Revit skills, and preference for technical delivery-focused work. - Experience in seniors living or residential aged care will be especially valuable. - Prepare, develop, and coordinate detailed architectural documentation throughout the Design Development, Tender, Construction Certificate, and Construction phases. - Produce high-quality working drawings, specifications, schedules, and documentation packages using Revit. - Ensure all documentation complies with the National Construction Code (NCC), Australian Standards, SEPPs, LEPs, and other relevant NSW planning regulations. - Coordinate architectural documentation with consultants and internal project teams to maintain consistency and technical accuracy. - Review and maintain documentation quality while resolving design coordination and technical issues throughout project delivery. - Support construction-stage documentation, RFIs, revisions, and project updates as required. - Manage multiple project deliverables while meeting deadlines and maintaining high attention to detail. - Communicate effectively with project stakeholders and contribute practical, solution-focused recommendations throughout each project phase. Qualifications - Bachelor's or Master's degree in Architecture or a related discipline. - Minimum of 5 years' experience delivering architectural projects, preferably within NSW multi-residential, mixed-use, or seniors living developments. - Proven experience preparing and coordinating technical documentation across DD, Tender, CC, and Construction stages. - Advanced proficiency in Autodesk Revit is essential. - Strong knowledge of the National Construction Code (NCC), Australian Standards, SEPPs, LEPs, and NSW planning regulations. - Experience producing coordinated working drawings, specifications, and schedules. - Excellent communication, coordination, organizational, and problem-solving skills. - Ability to work independently while collaborating effectively within multidisciplinary project teams. - Proficiency in Adobe Creative Suite is highly desirable. - Previous experience in seniors living or residential aged care projects is considered a strong advantage.
Big Data Architect
Bright Vision TechnologiesBright Vision Technologies is a forward-thinking software development company dedicated to building innovative solutions that help businesses automate and optimize their operations. We leverage cutting-edge technologies to create scalable, secure, and user-friendly applications.
Role Description We are seeking a Big Data Architect to define and lead the architecture of our enterprise data platform, spanning ingestion, storage, processing, governance, and consumption layers. The role drives the strategic direction of data infrastructure, sets standards for data modeling and lifecycle management, and partners with data engineering, analytics, ML, and business stakeholders to deliver a coherent, scalable data foundation. The ideal candidate combines deep technical mastery of modern data platforms with strong architectural judgment, and has led data-platform programs of meaningful scope and complexity. Key Responsibilities - Define the target-state architecture of the enterprise data platform, including ingestion, storage, processing, and consumption layers. - Establish standards for data modeling, schema evolution, partitioning, file formats, and storage organization. - Architect lakehouse, warehouse, and streaming patterns leveraging technologies such as Snowflake, Databricks, BigQuery, Redshift, Iceberg, Delta Lake, or Hudi. - Design end-to-end data pipelines that balance latency, cost, reliability, and maintainability across batch and streaming workloads. - Lead the integration of governance, lineage, and catalog tools such as Collibra, Alation, Atlan, Unity Catalog, or DataHub. - Define security architecture including row- and column-level controls, masking, encryption, and identity-aware access patterns. - Partner with ML, BI, and product teams to ensure platform capabilities align with downstream consumption needs. - Establish data contract and data product principles to drive ownership, quality, and decoupling between producers and consumers. - Lead architecture reviews and provide guidance on pipeline and warehouse design proposals across teams. - Drive cost optimization and capacity planning across the data platform estate. - Design disaster recovery, multi-region, and high-availability strategies for critical data assets. - Mentor data engineers and architects on platform standards and emerging best practices. - Produce architecture artifacts including context diagrams, decision records, and reference patterns. - Stay current with data platform research, vendor offerings, and open-source ecosystem developments. Qualifications - Bachelor’s or Master’s degree in Computer Science, Information Systems, or a related field. - Eight or more years of experience in data engineering, with significant time in architecture roles. - Deep expertise across at least two major data platforms such as Snowflake, Databricks, BigQuery, or Redshift. - Strong understanding of lakehouse architectures, modern table formats, and streaming systems. - Hands-on experience with Spark, Flink, or Kafka at production scale. - Strong data modeling expertise across dimensional, normalized, and data-vault patterns. - Experience implementing governance, lineage, and catalog capabilities. - Solid grasp of cloud platforms, networking, identity, and cost optimization. - Excellent communication, facilitation, and stakeholder management skills. - Track record of leading large data platform initiatives across teams. Preferred Qualifications - Experience with data mesh or data product architectures. - Familiarity with semantic layers such as dbt Semantic Layer, Cube, or LookML. - Exposure to regulated industries with strict data residency or audit requirements. - Cloud or platform certifications (Snowflake, Databricks, AWS, Azure, GCP). - Public talks or writing on data architecture. Requirements - 8+ years of experience. - 100% Remote (Continental United States). - Full-time, direct W2 with Bright Vision Technologies (no C2C, no 1099, no third-party). - No new H1B sponsorship available. H1B transfers welcomed for qualified candidates. - Technical coding assessment is mandatory. Benefits - Competitive base salary commensurate with experience. - Benefits included. How to Apply For immediate consideration, please send your resume to [email protected] or contact us at (908) 505-3545.

