30 packages found

Minner

Scrapy, a fast high-level web crawling & scraping framework for Python.
  1. crawler
  2. crawling
  3. framework
  4. hacktoberfest
  5. python
  6. scraping
  7. web-scraping
  8. web-scraping-python
0.1.4published 4 months agoBSD-3-Clause

finvizfinance

Finviz Finance. Information downloader.
  1. crypto
  2. earnings-calls
  3. financial-analysis
  4. forex
  5. fundament
  6. fundamental-analysis
  7. inside-trader
  8. outer-ratings
  9. pandas
  10. pypi
  11. screener
  12. stock-charts
  13. stock-news
  14. technical-analysis
  15. web-scraping
9 Contributors
1.1.0published 6 months agoMIT

google-search-results

Scrape and search localized results from Google, Bing, Baidu, Yahoo, Yandex, Ebay, Homedepot, youtube at scale using SerpApi.com
  1. scrape
  2. serp
  3. api
  4. json
  5. search
  6. localized
  7. rank
  8. google
  9. bing
  10. baidu
  11. yandex
  12. yahoo
  13. ebay
  14. scale
  15. datamining
  16. training
  17. machine
  18. ml
  19. youtube
  20. naver
  21. walmart
  22. apple
  23. store
  24. app
  25. bing-image
  26. google-crawler
  27. google-images
  28. python
  29. scraping
  30. serp-api
  31. serpapi
  32. web-scraping
14 Contributors
2.4.2published 2 years agoMIT

bose

The Ultimate Web Scraping Framework
  1. crawler
  2. framework
  3. scraping
  4. crawling
  5. web-scraping
  6. web-scraping-python
  7. cloudflare-bypass
  8. anti-detection
  9. bot-detection
  10. automation
  11. webdriver
  12. browser
  13. anti-bot
  14. anti-detect
  15. anti-detect-browser
  16. antidetect-browser
  17. bypass-cloudflare
  18. cloudflare-scrape
  19. python-scraper
  20. python-web-scraper
  21. python-web-scraping
  22. scraping-framework
  23. scraping-python
  24. scraping-tool
  25. undetectable
  26. undetected
  27. undetected-chromedriver
  28. web-crawling
6 Contributors
2.0.22published 1 year agoMIT

faster-than-requests

Faster & simpler requests replacement for Python
  1. python3
  2. python4
  3. cpython
  4. speed
  5. cython
  6. c
  7. performance
  8. compiled
  9. native
  10. fast
  11. nim
  12. curl
  13. download-file
  14. faster-than-requests
  15. high-performance
  16. http-requests
  17. ndjson
  18. open-data
  19. python
  20. python-library
  21. python-requests
  22. requests-toolbelt
  23. requests3
  24. scrapy
  25. urllib
  26. urllib3
  27. web-scraper
  28. web-scraping
4 Contributors
21.03.03published 4 years agoMIT

pytest-seleniumbase

A complete web automation framework for end-to-end testing.
  1. anti-detection
  2. behave
  3. bot-detection
  4. cdp
  5. chromedriver
  6. cloudflare-bypass
  7. e2e-testing
  8. pytest
  9. pytest-plugin
  10. python
  11. python-scraper
  12. selenium
  13. selenium-python
  14. seleniumbase
  15. test-automation
  16. web-automation
  17. web-scraping
  18. web-scraping-python
  19. webdriver
  20. webkit
35 Contributors
4.36.5published 6 days agoMIT

douyin-tiktok-scraper

Douyin/TikTok async data scraper.
  1. TikTok
  2. Douyin
  3. 抖音
  4. Scraper
  5. Crawler
  6. API
  7. Download
  8. Video
  9. No
  10. Watermark
  11. Async
  12. douyin-api
  13. douyin-scraper
  14. douyin-tiktok-api
  15. douyin-tiktok-download
  16. fastapi
  17. no-watermark
  18. online-parsing
  19. python
  20. pywebio
  21. spider
  22. tiktok-api
  23. tiktok-scraper
  24. tiktok-signature
  25. web-scraping
9 Contributors
1.2.9published 2 years agoMIT

trafilatura

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML.
  1. corpus
  2. html2text
  3. news-crawler
  4. natural-language-processing
  5. scraper
  6. tei-xml
  7. text-extraction
  8. webscraping
  9. web-scraping
  10. article-extractor
  11. corpus-builder
  12. corpus-tools
  13. crawler
  14. html-to-markdown
  15. llm
  16. news-aggregator
  17. nlp
  18. rag
  19. readability
  20. rss-feed
  21. scraping
  22. tei
  23. text-cleaning
  24. text-mining
  25. text-preprocessing
45 Contributors
2.0.0published 4 months agoApache-2.0

web-poet

Zyte's Page Object pattern for web scraping
  1. hacktoberfest
  2. page-objects
  3. python
  4. web-scraping
9 Contributors
0.18.0published 2 months agoBSD-3-Clause

Aminer-Scrapy

A high-level Web Crawling and Web Scraping framework
  1. crawler
  2. crawling
  3. framework
  4. hacktoberfest
  5. python
  6. scraping
  7. web-scraping
  8. web-scraping-python
524 Contributors
2.11.1published 1 year agoBSD-3-Clause
Showing 1 to 10 of 30 results