Skip to content

Instantly share code, notes, and snippets.

@gotocva

gotocva/web-scraping-in-nodejs.js

Created January 8, 2024 06:48
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save gotocva/1139b5d05f1c8465fccf7eaaf24af01f to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save gotocva/1139b5d05f1c8465fccf7eaaf24af01f to your computer and use it in GitHub Desktop.
Download ZIP
Raw
web-scraping-in-nodejs.js
const axios = require('axios');
const https = require('https');
const cheerio = require('cheerio');
const agent = new https.Agent({
rejectUnauthorized: false
});
const init = async () => {
const response = await axios.get(`https://sivabharathy.in`, { httpsAgent: agent });
$ = cheerio.load(response.data);
$title = $('head title').text();
$desc = $('meta[name="description"]').attr('content'),
$kwd = $('meta[name="keywords"]').attr('content'),
$ogTitle = $('meta[property="og:title"]').attr('content'),
$ogImage = $('meta[property="og:image"]').attr('content'),
$ogkeywords = $('meta[property="og:keywords"]').attr('content'),
$images = $('img');
console.log($title);
console.log('description', $desc);
}
init();
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment