(of a program) systematically visit (a number of web pages) in order to create an index of data.
방문하여 데이터의 인덱스를 만들어준다.
"it's automated software robots crawl websites, grabbing copies of pages to index"