What's Web Mining?

Sometimes you might not be given enough data to conduct a thorough analysis. In such cases, it's necessary to do further research. This allows you to take more factors into account, identify more patterns, and reach unexpected conclusions. Analysts can enrich their data by supplementing it with data from the internet. First they track down resources that might be relevant, then they retrieve all the necessary data. This process is called web mining, ****or parsing.

Things an Analyst Needs to Know About the Internet. Browsers. HTML. HTTP

The internet is a network of computers exchanging data. It has rules for exchanging and representing information on the internet (taking into account the way computers display it). To make this happen, several things were invented:

  1. A language for creating documents: HTML
  2. Software applications for viewing such documents: browsers
  3. General rules for transferring documents: HTTP

Transfer Protocols

For the process of exchanging data to work, there need to be certain rules that govern how one computer sends data to another. Data exchange on the internet is based upon the "request-response" principle: a browser generates a request, then the server analyzes it and sends back a reply. The rules for formulating requests and responses are determined by what's known as a transfer protocol—in this case, HTTP.

The majority of websites today use a security-enhanced data transfer protocol called HTTPS. This protocol ensures that all communication between your browser and a website is encrypted.

When you access a website, your browser sends an HTTP request to the server. The server, in turn, formulates a reply: the HTML code for the relevant page. A request formed by a browser may include the following:

The reply may include: