Wanted crawling

Joey Lee·2020년 6월 13일
0

Web-crawling

목록 보기
5/5
  1. Sub_category에 포함된 job_list 자료 추출

import time
import requests
import csv
from bs4 import BeautifulSoup
from selenium import webdriver

# sub_category 한 페이지별로 job_list 자료 추출 테스트

driver = webdriver.Chrome('./chromedriver')
driver.implicitly_wait(3)

url = 'https://www.wanted.co.kr/wdlist/518/872'
driver.get(url)

time.sleep(3)
# Scroll down to 40개 요소까지
driver.execute_script("window.scrollTo(0, 12000);")

time.sleep(3)
links = driver.find_elements_by_css_selector('#__next > div > div._1yHloYOs_bDD0E-s121Oaa > div._2y4sIVmvSrf6Iy63okz9Qh > div > ul > li > div > a')
headers = driver.find_elements_by_css_selector('#__next > div > div._1yHloYOs_bDD0E-s121Oaa > div._2y4sIVmvSrf6Iy63okz9Qh > div > ul > li > div > a > header')
dts = driver.find_elements_by_css_selector('#__next > div > div._1yHloYOs_bDD0E-s121Oaa > div._2y4sIVmvSrf6Iy63okz9Qh > div > ul > li > div > a > div > dl > dt')
profile
안녕하세요!

0개의 댓글