We’ve made a product
that will change your life
We are here to listen and deliver you an exellence marketing experience.
The web-crawler was designed to find products of your interest from a targeted site, and return to you the best offers in price and quality.
The table below, shows a quick example of what the web-crawler will return. The product description and review can be located within the demo section.
Get Started Now
Alpaca Sprint
Progression Graph
Main Goals:
- Extract data with the web-crawler, and place the data into a CSV file.
- Debug issues
- Setup Github page for the web-crawler.
Buffalo Sprint
Progression Graph
Main Goals:
- Find a way to link the review tables to the product table.
- Automating shell script.
Cheetah Sprint
Progression Graph
Main Goals:
- Creating a GUI for public use
- Tutorials
- License & Documentation
How the system works
Example Target: Walmart - 40 Products Per Category
The web-crawler contains multiple modules, that assist in extracting data from the product site. For developers, a web-crawler module is provided
upon download, and can be customized to extract product information from other desired locations. However, a connection is required to use the software.
In this flowchart, the destination site is Walmart: Home Health Care. Within their Home Health Care page, there are
multple categories that contain products used by senior citizens. By using the product-extract module, the web-crawler
extracts the targeted products': name, price, rating, link/url, product description, and a review. The data is then stored within
several CSV files, based upon the product label and category.
After being stored, the product-extract module will contact an apacahe server, and execute the software database module.
By using the CSV Database Module, the data stored within the CSV, is parsed and stored into a secure SQL database.
The flowchart, works in order by the numbers starting from 1.
