Best Practices for Web Scraping
What exactly is web scraping?
Web scraping is the process of crawling various websites and extracting the necessary data using spiders. This data is processed and stored in a structured format using a data pipeline. Nowadays, net scraping is popular and has...
We are looking for an experienced MySQL database administrator who will be responsible for ensuring the performance, availability, and security of clusters of MySQL instances. You will also be responsible for orchestrating upgrades, backups, and provisioning of database instances. You will also work in tandem with the other teams, preparing documentations and specifications as required.
Responsiblities:-
• Provision MySQL instances, both in clustered and non-clustered configurations
• Ensure performance, security, and availability of databases
• Prepare documentations and specifications
• Handle common database procedures, such as upgrade, backup, recovery, migration, etc.
Skills:-
• Strong proficiency in MySQL database management
• Decent experience with recent versions of MySQL
• Understanding of MySQL’s underlying storage engines, such as InnoDB and MyISAM
• Experience with replication configuration in MySQL
Experience:-
2+ Years
Job Description:-
We are looking for a Guzzle Framework(PHP) Developer responsible for managing back-end services and the interchange of data between the server and the users. Your primary focus will be the development of all server-side logic, definition and maintenance of the central database, and ensuring high performance and responsiveness to requests from the front-end. You will also be responsible for integrating the front-end elements built by your co-workers into the application. Therefore, a basic understanding of front-end technologies is necessary as well.
Responsiblities:-
• Integration of user-facing elements developed by front-end developers
• Build efficient, testable, and reusable PHP modules
• Solve complex performance problems and architectural challenges
• Integration of data storage solutions
Skills:-
• Strong knowledge of PHP web frameworks
• Understanding the fully synchronous behavior of PHP
• Basic understanding of front-end technologies, such as JavaScript, HTML5, and CSS3s
• Knowledge of object oriented PHP programming
Experience:-
2+ Years
Job Description:-
We are looking for a Node.js Developer responsible for managing the interchange of data between the server and the users. Your primary focus will be the development of all server-side logic, definition and maintenance of the central database, and ensuring high performance and responsiveness to requests from the front-end. You will also be responsible for integrating the front-end elements built by your co-workers into the application. Therefore, a basic understanding of front-end technologies is necessary as well.
Responsiblities:-
• Integration of user-facing elements developed by front-end developers with server side logic
• Writing reusable, testable, and efficient code
• Design and implementation of low-latency, high-availability, and performant applications
• Implementation of security and data protection
Skills:-
• Strong proficiency with JavaScript
• Knowledge of Node.js and frameworks available for it
• Understanding the nature of asynchronous programming and its quirks and workarounds
• Good understanding of server-side templating languages
Experience:-
2+ Years
Senior Data QA Engineer
Job Description:-
QA is an important function within InstaDataWorks. The QA team works to ensure that the quality and usability of the data scraped by our web scrapers meets and exceeds the expectations of our enterprise clients. Due to growing business and the need for ever more sophisticated QA, we are looking for a talented QA Engineer with both automated and manual test experience to join our team. You will take automated, semi-automated, and manual approaches and apply them in the verification and validation of data quality. Although Python is our preferred language for automation; demonstrable experience of automating things in other languages (e.g. R, Java, C# etc.) is welcome. And while we are primarily interested in the quality assurance of data, your experience in testing applications, systems, UIs, APIs etc. will be brought to bear on the role.
Responsiblities:-
Understand customer web scraping and data requirements; translate these into test approaches that include exploratory manual/visual testing and any additional automated tests deemed appropriate. Provide input to our existing test automation frameworks from points of view of test coverage, performance, etc. Ensure that project requirements are testable; work with project managers and/or clients to clarify ambiguities before QA begins. Take ownership of the end-to-end QA process in newly-started projects. Work under minimal supervision and collaborate effectively with Head of QA, Project Managers, and Developers to realize your QA deliverables. Draw conclusions about data quality by producing basic descriptive statistics, summaries, and visualisations. Proactively suggest and take ownership of improvements to QA processes and methodologies by employing other technologies and tools, including but not limited to: browser add-ons, Excel add-ons, UI-based test automation tools etc.
Skills:-
B.E degree in Computer Science, Engineering or equivalent. Demonstrable programming knowledge and experience, minimum of 3 years (please provide code samples in your application, via a link to GitHub or other publicly-accessible service). Minimum 3 years in a Software Test, Software QA, or Software Development role, in Agile, fast-paced environment and projects. Solid grasp of web technologies and protocols (HTML, XPath, JSON, HTTP, CSS etc.); experience in developing tests against HTTP/REST APIs. Strong knowledge of software QA methodologies, tools, and processes. Ability to formulate basic to intermediate SQL queries; comfortable with at least one RDBMS and its utilities Excellent level of written and spoken English; confident communicator; able to communicate on both technical and non-technical levels with various stakeholders on all matters of QA
Experience:-
3 Year+
Python Developer
Job Description:-
Dynamic team player who is consistently motivated toward success and completion of projects with an ability to work independently and a quick learner who can swiftly adapt to new challenges. Strong experience in driving the complete QA cycle, right from the requirement analysis stage till production check out. Define and monitor quality assurance metrics for continuous quality & process improvement. Drive the Automation, Tools, Infra Strategy. Estimates efforts, identify risks, devises and meets project schedule. Communicates clearly and openly with internal and external stakeholders regarding progress, roadblocks and timelines.
Responsiblities:-
You are responsible for building scalable crawling platforms You will identify functional /non-functional issues and come up with creative resolutions. You are responsible for adhering to best practices and improve the quality of the systems continuously. Implement features and support Job Ingestion (Python, Scrapy Xpaths). Good to have experience working with web crawling systems (Scrapy / Beautiful soup). Collaborate on other technologies owned by the team.
Skills:-
Experience with the Python programming language Experience working with version control systems like Git and svn. Experience working in a short-cycle, agile, iterative development team. Experience with technologies like Web Scraping, HTML, CSS, JS, XPATH Experience with headless browsers like selenium, puppeteer or PhantomJS Should have worked in AGILE. Experience with pyhton libraries like Scrapy, BeautifulSoup and regex.
Experience:-
2 Years+
Business Dev
Job Description:-
Business Development Manager is responsible for helping InstaDataWorks obtain better brand recognition and financial growth. BD Managers coordinate with company executives and sales & marketing professionals to review current market trends in order to propose new business ideas that can improve revenue margins.
Responsiblities:-
• Develop new business via the established channels (telephone and help desk system) and mass communication such as email and social media to introduce the EstateMaster solutions and identify appropriate buyers within the target market.
• Follow up on leads and conduct research to identify potential prospects.
• Writing press releases, online content and company articles for our online channels.
• Assessing the results of marketing campaigns.
• Helping to drive leads and online traffic with web-based activities and programs.
• Build and cultivate prospect relationships by initiating communications and conducting follow-up communications in order to move opportunities through the sales funnel.
• Generate Leads thru Email Marketing and other social media channels.
• Address challenging situations and tight deadlines effortlessly. Finding solutions and maintaining a positive relationship with all internal teams is key.
• Work with Business Managers to help maintain reporting verification across all campaigns, ensuring they’re running and tracking accurately.
• Additional responsibilities may be delegated in order to assist meeting our goals and mission
Skills:-
• Bachelor’s Degree or MBA in Business, Communications or related field.
• 2-3 years telemarketing / online channel sales and/or inside sales experience is a plus.
• Excellent client service skills. • Excellent written and verbal communication skills.
• Proficient in MS Office products (Excel, Word, MS Outlook, MS PowerPoint).
• Experience with Salesforce or another CRM Software preferred.
Experience:-
2 Years+
Data QA Engineer
Job Description:-
QA is an important function within InstaDataWorks. The QA team works to ensure that the quality and usability of the data scraped by our web scrapers meets and exceeds the expectations of our enterprise clients. Due to growing business and the need for ever more sophisticated QA, we are looking for a talented QA Engineer with both automated and manual test experience to join our team. You will take automated, semi-automated, and manual approaches and apply them in the verification and validation of data quality. Although Python is our preferred language for automation; demonstrable experience of automating things in other languages (e.g. R, Java, C# etc.) is welcome. And while we are primarily interested in the quality assurance of data, your experience in testing applications, systems, UIs, APIs etc. will be brought to bear on the role.
Responsiblities:-
Understand customer web scraping and data requirements; translate these into test approaches that include exploratory manual/visual testing and any additional automated tests deemed appropriate. Provide input to our existing test automation frameworks from points of view of test coverage, performance, etc. Ensure that project requirements are testable; work with project managers and/or clients to clarify ambiguities before QA begins. Take ownership of the end-to-end QA process in newly-started projects. Work under minimal supervision and collaborate effectively with Head of QA, Project Managers, and Developers to realize your QA deliverables. Draw conclusions about data quality by producing basic descriptive statistics, summaries, and visualisations. Proactively suggest and take ownership of improvements to QA processes and methodologies by employing other technologies and tools, including but not limited to: browser add-ons, Excel add-ons, UI-based test automation tools etc.
Skills:-
B.E degree in Computer Science, Engineering or equivalent. Demonstrable programming knowledge and experience, minimum of 3 years (please provide code samples in your application, via a link to GitHub or other publicly-accessible service). Minimum 3 years in a Software Test, Software QA, or Software Development role, in Agile, fast-paced environment and projects. Solid grasp of web technologies and protocols (HTML, XPath, JSON, HTTP, CSS etc.); experience in developing tests against HTTP/REST APIs. Strong knowledge of software QA methodologies, tools, and processes. Ability to formulate basic to intermediate SQL queries; comfortable with at least one RDBMS and its utilities Excellent level of written and spoken English; confident communicator; able to communicate on both technical and non-technical levels with various stakeholders on all matters of QA
Experience:-
1 Year+
Business Analyst
Job Description:-
responsible for day-to-day execution on key strategic initiatives.
Responsiblities:-
Capture and document requirements in industry standard templates – which includes writing PRDs, user stories/acceptance criteria, as well as basic wireframing. • Partner and collaborate with the front-end, data science & data delivery teams. • Design wireframes, user flows or storyboards to establish user experiences that meet our needs to effectively collaborate with the technical teams. • Work with the technical project manager to plan feature development/roll-out and participate in Agile ceremonies such as daily standups, backlog grooming and sprint planning.
Skills:-
2+ years of product management experience.
• Ability to balance multiple priorities and meet predefined timelines.
• A high-level understanding of software engineering is expected. A computer science background is preferred.
• Experience working with or on data engineering/data science teams that build products for businesses to deliver data products or analytical services will be a big plus.
• Excellent oral/written communication and problem-solving skills.
Experience:-
2 Years+
Selenium Developer
Job Description:-
We are looking forward to hire Automation Test Engineer (Selenium and Python) whothrives on challenges and desires to make a real difference in the business world. The shortlisted candidate should have strong communication, interpersonal, analytical, and problem-solving skills. Should have an ability to effectively communicate complex technical designs within the team, and able to guide the team to achieve project goals.
Responsiblities:-
The candidate will be responsible to ensure that a product is completely stable before releasing itcommercially. This needs to be accomplished by working closely with the Development and Portfolio teams, early designof test plan, test cases and reporting results to the concerned team for the assigned software products.
Skills:-
You are required to have skills in the following areas: 2-4years of strong automation experience using Selenium withPython. Experience in understanding ofoverall Testing process and Agile methodologies Exceptional knowledge of OOPs concept and Python programminglanguage Exceptional knowledge on Python/Selenium frameworks like Page Object Model, BDD, Robot Jenkins. Exceptional knowledge in Data base testing like MySql , in Overall automation testing strategies and cloud technologieslike AWS, Azure Knowledge of Test Management tools like Jira, Rally HP ALM. Knowledge of automation Test plans andbuilding Smoke and Regression suites Ability to work in a fast-paced environment utilize sound judgment And ability tomanage multiple priorities with a sense of urgency and good communication skills Desirable Skills: Strong in Python scripting/coding skills Working knowledge on cloud testing in CI/CD pipeline. Exposure to gaming/device test automation is a plus.
Experience:-
2 Years+
INTERNATIONAL WOMEN'S DAY - WE CELEBRATE WITH HER!
