Programming/python37 [python] 데이터 스크랩 연습 오늘은 파이썬으로 데이터 스크랩을 해보았다. MAIN PAGE from players import extract_player_info keyword = "squad" players_info= extract_player_info(keyword) file = open(f"{keyword}.csv", "w", encoding="utf-8") file.write("Name, Position, Number, Link\n") for each in players_info: file.write(f"{each['name']},{each['position']},{each['number']},{each['link']}\n") file.close() # keyword = "squad" # player = extract_pla.. 2023. 3. 4. [Python, web scrapper] 데이터 수집 연습 MAIN PAGE from extractors.jobkr import extract_jobkr_jobs from extractors.wwr import extract_wwr_jobs keyword = input("what job are you searching for? ") # because these are list, because it returns a list, I can combine both of them jobkr = extract_jobkr_jobs(keyword) wwr = extract_wwr_jobs(keyword) jobs = jobkr + wwr # csv 파일 열기 시작 file = open(f"{keyword}.csv", "w", encoding="utf-8") # comma s.. 2023. 3. 3. [Python] Beautifulsoup 을 사용해서 웹사이트 정보 가져오는 연습 from requests import get from bs4 import BeautifulSoup base_url = "https://www.jobkorea.co.kr/Search/?stext=" search_term = "python" response = get(f"{base_url}+{search_term}") if response.status_code != 200: print("cant request") else: results = [] soup = BeautifulSoup(response.text, "html.parser") job_list = soup.find("div", class_="list-default") jobs = job_list.find("ul", class_="clear") # r.. 2023. 3. 2. [python] Day 23 # score_file = open("score.txt", "w", encoding="utf8") # print("math:20", file=score_file) # print("b:30", file=score_file) # score_file.close() # 반복문을 통해서 줄의 갯수를 알 수 있음 # score_file = open("score.txt", "r", encoding="utf8") # lines = score_file.readlines() # for line in lines: # print(line) # pickle import pickle profile_file = open("profile.pickle","wb") profile = {"name":"a", "age":"b", "loca.. 2023. 3. 1. 이전 1 ··· 6 7 8 9 10 다음