Scraping & Crawling

김지영·2022년 6월 3일
0

[Scraping]

  • extracting and collecting data from a website for your personal use

Scraping Open Graph:

  • What is Open Graph?
    - an internet protocol that was originally created by Meta (previously known as Facebook) to standardize the use of metadata within a webpage to represent the content of a page (cited from freeCodeCamp).
    - It's the small card-thingy that appears when you share a link with your friends through (almost any type of) messengers/Twitter/Facebook.

Recommended Tool: cheerio

[Crawling]

  • Crawling is an act of repeating scraping.
  • vs. Scraping:
    - Web Crawling: usually captures generic information (ANY information -> index them)
    - Web Scraping: extracts SPECIFIC data set snippets

Recommended Tool: puppeteer

profile
아줌마

0개의 댓글