Skip to content

Instantly share code, notes, and snippets.

@Tomiwa-Ot
Last active June 1, 2021 20:31
Show Gist options
  • Select an option

  • Save Tomiwa-Ot/3fa6f50af5fdff677c8c17363f4c84b1 to your computer and use it in GitHub Desktop.

Select an option

Save Tomiwa-Ot/3fa6f50af5fdff677c8c17363f4c84b1 to your computer and use it in GitHub Desktop.
import hashlib
import requests
from bs4 import BeautifulSoup
text = ""
reqs = requests.get(url)
soup = BeautifulSoup(reqs.text, 'lxml')
for heading in soup.find_all("h3"):
print(heading.name + ' ' + heading.text.strip())
text = heading.text.strip()
text = hashlib.md5(text).hexdigest()
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment