Automation Engineer
Location
California
Posted
119 days ago
Salary
0
Seniority
Senior
Job Description
Automation Engineer
INV Technologies
• Create crawlers for each source URL by using Python modules [scrapy, selenium, requests, BeautifulSoup and splash] • Create and maintain scrapy pipelines and middlewares to manage the output from the crawlers. • Create crawlers for all types of websites irrespective of the technical roadblocks. • Manage the crawlers to overcome technical challenges like IP ban, geolocation ban, captcha and bot blocking services. • Write SQL queries to manage database operations using Python modules like sqlalchemy • Deploy the python scripts / crawlers to Linux based AWS servers
Job Requirements
- 3+ experience working on web development frameworks such as Flask/Django/FastAPI/Tornado/Pandas
- Strong hands-on experience in Python programming
- Good experience with scraping libraries such as Requests, BeautifulSoup, Selenium and Scrapy.
- Knowledge of building APIs and services using REST.
- Experience with any RDBMS and strong SQL knowledge.
- Clear with Object-oriented concepts.
- Excellent troubleshooting skills.
- Proficient understanding of code versioning tools like git.
- Basic understanding of front-end technologies, such as JavaScript, HTML5 and CSS3
- Understanding of fundamental design principles behind a scalable application.
Benefits
- Employees can work remotely
Related Guides
Related Categories
Related Job Pages
More QA Automation Engineer Jobs
UFT Automation Engineer
Insight International (UK) LtdWe"re on a mission to transform every organization to achieve more
• Work on UFT and Automation tools. • Define Test Scope and Strategy for a release. • Manage requirements based on testing change. • Develop business-based test scenarios. • Perform manual and automation testing on web and client applications.
Automation Developer
VerinextVerinext delivers transformative business technology, so customers are ready for everything that comes next.
• Take a lead role in identifying, designing, developing, testing, delivering, maintaining, and supporting automation solutions • Apply software development expertise in .NET with C#, Modern Angular, Python, SQL, Blazor, API Development/Integration, Microservices to create automation solutions • Collaborate with internal and external business and technology teams • Monitor deployed solutions for performance and troubleshoot issues • Manage multiple projects simultaneously to deliver both quick wins and long-term strategic automation solutions
• Will work with other Senior Automation Testers that will be using various technologies.
• Develop and execute a comprehensive API automation strategy aligned with the overall quality goals of the organization. • Identify and implement innovative testing approaches and technologies to enhance the efficiency and effectiveness of our QA processes. • Design, develop, and maintain robust and scalable API automation frameworks using RestAssured and BDD principles. • Write clean, well-documented, and maintainable automation scripts to validate API functionality, performance, and security. • Implement data-driven testing strategies to ensure comprehensive test coverage. • Integrate automation scripts into the CI/CD pipeline for continuous testing. • Collaborate closely with developers, product managers, and other stakeholders to understand requirements and ensure testability. • Participate in design and architecture reviews to provide feedback on testability and identify potential quality risks. • Communicate test results and quality metrics to stakeholders in a clear and concise manner. • Work with extended integration partner teams to define and execute exploratory and automated API tests. • Establish and enforce QA guidelines, best practices, and standards across the team. • Actively review code to ensure software quality and functional accuracy. • Handle operational issues with minimal oversight, troubleshooting and resolving problems quickly and effectively.
