48 packages found

spidr_epg

Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
  1. crawler
  2. ruby
  3. scraper
  4. spider
  5. spider-links
  6. web
  7. web-crawler
  8. web-scraper
  9. web-scraping
  10. web-spider
13 Contributors
1.0.0published 12 years agoMIT

google-play-scraper

Google-Play-Scraper provides APIs to easily crawl the Google Play Store for Python without any external dependencies!
  1. crawler
  2. google-play
  3. hacktoberfest
  4. hacktoberfest2023
  5. python
  6. scraper
22 Contributors
1.2.7published 11 months agoMIT

spidr

Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
  1. crawler
  2. ruby
  3. scraper
  4. spider
  5. spider-links
  6. web
  7. web-crawler
  8. web-scraper
  9. web-scraping
  10. web-spider
13 Contributors
0.7.2published 3 months agoMIT

tanakai

Maintained fork of Kimurai, a modern web scraping framework written in Ruby and based on Capybara/Nokogiri
  1. chrome-headless
  2. crawler
  3. kimurai
  4. scraper
  5. scrapy
  6. webscraping
1.7.5published 2 months agoMIT

metascraper

A library to easily scrape metadata from an article on the web using Open Graph, JSON+LD, regular HTML metadata, and series of fallbacks.
  1. RDF
  2. article
  3. browser
  4. cheerio
  5. content
  6. expand
  7. extract
  8. facebook
  9. fallback
  10. fetch
  11. get
  12. graph
  13. html
  14. json-ld
  15. jsonld
  16. linked data
  17. meta
  18. metadata
  19. micro format
  20. microformat
  21. og
  22. open
  23. open graph
  24. opengraph
  25. page
  26. parse
  27. parser
  28. scrape
  29. scraper
  30. semantic
  31. semantic web
  32. server
  33. site
  34. summarize
  35. summary
  36. tag
  37. tags
  38. twitter
  39. unfluff
  40. unfurl
  41. url
  42. web
  43. website
39 Contributors
5.46.11published 3 weeks agoMIT

org.webjars.npm:cheerio

WebJar for cheerio
  1. cheerio
  2. dom
  3. hacktoberfest
  4. html
  5. htmlparser
  6. htmlparser2
  7. jquery
  8. parser
  9. scraper
  10. selector
152 Contributors
1.0.0-rc.12published 5 months agoMIT

scrapetube

Scrape youtube without the official youtube api and without selenium.
  1. youtube
  2. python
  3. channel
  4. videos
  5. search
  6. playlist
  7. list
  8. get
  9. scraper
  10. web-api
  11. youtube-api
  12. youtube-channel
  13. youtube-playlist
  14. youtube-search
5 Contributors
2.5.1published 2 years agoMIT

snscrape

A social networking service scraper
  1. python
  2. scraper
  3. social-media
  4. social-network
14 Contributors
0.7.0.20230622published 2 years agoGPL-3.0, GPL-3.0+

autoscraper

A Smart, Automatic, Fast and Lightweight Web Scraper for Python
  1. scraping
  2. -
  3. scraper
  4. ai
  5. artificial-intelligence
  6. automation
  7. crawler
  8. machine-learning
  9. python
  10. scrape
  11. web-scraping
  12. webautomation
  13. webscraping
7 Contributors
1.1.14published 3 years agoMIT

news-please

news-please is an open source easy-to-use news extractor that just works.
  1. news
  2. crawler
  3. scraper
  4. extractor
  5. information
  6. retrieval
  7. cc-news
  8. ccnews
  9. commoncrawl
  10. data-gathering
  11. elasticsearch
  12. extract-articles
  13. extract-information
  14. json
  15. news-archive
  16. news-articles
  17. news-crawler
  18. news-extractor
  19. news-scraper
  20. news-websites
  21. nlp
  22. python
  23. roberta
37 Contributors
1.6.14published 1 month agoApache-2.0
Showing 1 to 10 of 48 results