20
I Use This!
Activity Not Available
Analyzed 12 months ago. based on code collected over 1 year ago.

Project Summary

Scrapy is a fast high-level scraping and web crawling framework, used to crawl websites and extract structured data from their pages. It can be used for a wide range of purposes, from data mining to monitoring and automated testing.

Tags

crawling extraction libxml2 python scraping screenscraper twisted webscraper webscraping xpath

Badges

BSD 3-clause "New" or "Revised" License
Permitted

Commercial Use

Modify

Distribute

Place Warranty

Forbidden

Hold Liable

Use Trademarks

Required

Include Copyright

Include License

These details are provided for information only. No information here is legal advice and should not be used as such.

Project Security

Vulnerabilities per Version ( last 10 releases )

Project Vulnerability Report

Security Confidence Index

Poor security track-record
Favorable security track-record

Vulnerability Exposure Index

Many reported vulnerabilities
Few reported vulnerabilities

Did You Know...

  • ...
    in 2016, 47% of companies did not have formal process in place to track OS code
  • ...
    search using multiple tags to find exactly what you need
  • ...
    nearly 1 in 3 companies have no process for identifying, tracking, or remediating known open source vulnerabilities
  • ...
    learn about Open Hub updates and features on the Open Hub blog
About Project Security

Languages

Languages?height=75&width=75
Python
99%
5 Other
1%

30 Day Summary

Jul 29 2019 — Aug 28 2019

12 Month Summary

Aug 28 2018 — Aug 28 2019
  • 470 Commits
    Up + 140 (42%) from previous 12 months
  • 54 Contributors
    Down -5 (8%) from previous 12 months

Ratings

7 users rate this project:
5.0
 
5.0/5.0
Click to add your rating
   Spinner
Review this Project!