Bug 136811 - New port: www/py-scrapy, a high level scraping and web crawling framework
Summary: New port: www/py-scrapy, a high level scraping and web crawling framework
Status: Closed FIXED
Alias: None
Product: Ports & Packages
Classification: Unclassified
Component: Individual Port(s) (show other bugs)
Version: Latest
Hardware: Any Any
: Normal Affects Only Me
Assignee: freebsd-ports-bugs (Nobody)
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2009-07-16 05:00 UTC by QingFeng
Modified: 2009-12-14 03:00 UTC (History)
0 users

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description QingFeng 2009-07-16 05:00:05 UTC
# This is a shell archive.  Save it in a file, remove anything before
# this line, and then unpack it by entering "sh file".  Note, it may
# create directories; files and directories will be owned by you and
# have default permissions.
#
# This archive contains:
#
#	py-scrapy
#	py-scrapy/Makefile
#	py-scrapy/distinfo
#	py-scrapy/pkg-descr
#	py-scrapy/pkg-plist
#
echo c - py-scrapy
mkdir -p py-scrapy > /dev/null 2>&1
echo x - py-scrapy/Makefile
sed 's/^X//' >py-scrapy/Makefile << 'END-of-py-scrapy/Makefile'
X# New ports collection makefile for:    py-scrpy
X# Date created:                         10 Jul 2009
X# Whom:                                 Qing Feng <qingfeng@me.com>
X#
X# $FreeBSD$
X#
X
XPORTNAME=	scrpy
XPORTVERSION=	0.8
XCATEGORIES=	www python
XMASTER_SITES=	http://hg.scrapy.org/scrapy/archive/
XPKGNAMEPREFIX=	${PYTHON_PKGNAMEPREFIX}
XDISTNAME=	tip
XEXTRACT_SUFX=	.zip
X
XMAINTAINER=	qingfeng@me.com
XCOMMENT=	Scrapy is a high level scraping and web crawling framework for writing spiders to crawl and parse web pages for all kinds of purposes, from information retrieval to monitoring or testing web sites.
X
XBUILD_DEPENDS=	${PYTHON_SITELIBDIR}/twisted:${PORTSDIR}/devel/py-twistedCore
XBUILD_DEPENDS=	${PYTHON_SITELIBDIR}/libxml2:${PORTSDIR}/textproc/py-libxml2
X#LIB_DEPENDS=    xml2:${PORTSDIR}/textproc/libxml2
XRUN_DEPENDS=	${BUILD_DEPENDS}
XWRKSRC=		${WRKDIR}/scrapy-963e6fd4c371
X
XUSE_PYTHON=		yes
XUSE_PYDISTUTILS=	yes
X
X.include <bsd.port.mk>
END-of-py-scrapy/Makefile
echo x - py-scrapy/distinfo
sed 's/^X//' >py-scrapy/distinfo << 'END-of-py-scrapy/distinfo'
XMD5 (tip.zip) = 6277b2273198c4eef94dd2d8f22ee4b8
XSHA256 (tip.zip) = 9607244366e20d0aa4e1a3acdcc2693634e503d46df97b87b52904dece5e0249
XSIZE (tip.zip) = 855904
END-of-py-scrapy/distinfo
echo x - py-scrapy/pkg-descr
sed 's/^X//' >py-scrapy/pkg-descr << 'END-of-py-scrapy/pkg-descr'
XScrapy is a high level scraping and web crawling framework for writing spiders to crawl and parse web pages for all kinds of purposes, from information retrieval to monitoring or testing web sites.
X
XWWW:	http://scrapy.org/
END-of-py-scrapy/pkg-descr
echo x - py-scrapy/pkg-plist
sed 's/^X//' >py-scrapy/pkg-plist << 'END-of-py-scrapy/pkg-plist'
X.hg_archival.txt
X.hgignore
X@dirrm docs
X@dirrm docs/_ext
X@dirrm docs/_static
X@dirrm docs/_templates
X@dirrm docs/experimental
X@dirrm docs/intro
X@dirrm docs/media
X@dirrm docs/misc
X@dirrm docs/ref
X@dirrm docs/topics
X@dirrm docs/topics/_images
X@dirrm examples
X@dirrm examples/experimental
X@dirrm examples/experimental/googledir
X@dirrm examples/experimental/googledir/googledir
X@dirrm examples/experimental/googledir/googledir/spiders
X@dirrm examples/experimental/googledir/googledir/templates
X@dirrm examples/googledir
X@dirrm examples/googledir/googledir
X@dirrm examples/googledir/googledir/spiders
X@dirrm extras
X@dirrm extras/sql
X@dirrm profiling
X@dirrm profiling/priorityqueue
X@dirrm scrapy
X@dirrm scrapy/command
X@dirrm scrapy/command/commands
X@dirrm scrapy/conf
X@dirrm scrapy/conf/commands
X@dirrm scrapy/contrib
X@dirrm scrapy/contrib/cluster
X@dirrm scrapy/contrib/cluster/crawler
X@dirrm scrapy/contrib/cluster/hooks
X@dirrm scrapy/contrib/cluster/master
X@dirrm scrapy/contrib/cluster/tools
X@dirrm scrapy/contrib/cluster/worker
X@dirrm scrapy/contrib/codecs
X@dirrm scrapy/contrib/downloadermiddleware
X@dirrm scrapy/contrib/item
X@dirrm scrapy/contrib/linkextractors
X@dirrm scrapy/contrib/pipeline
X@dirrm scrapy/contrib/response
X@dirrm scrapy/contrib/schedulermiddleware
X@dirrm scrapy/contrib/spider
X@dirrm scrapy/contrib/spidermiddleware
X@dirrm scrapy/contrib/spiders
X@dirrm scrapy/contrib/web
X@dirrm scrapy/contrib/webconsole
X@dirrm scrapy/contrib_exp
X@dirrm scrapy/contrib_exp/adaptors
X@dirrm scrapy/contrib_exp/downloadermiddleware
X@dirrm scrapy/contrib_exp/history
X@dirrm scrapy/contrib_exp/newitem
X@dirrm scrapy/contrib_exp/pipeline
X@dirrm scrapy/core
X@dirrm scrapy/core/downloader
X@dirrm scrapy/core/downloader/responsetypes
X@dirrm scrapy/core/scheduler
X@dirrm scrapy/extension
X@dirrm scrapy/fetcher
X@dirrm scrapy/http
X@dirrm scrapy/http/request
X@dirrm scrapy/http/response
X@dirrm scrapy/item
X@dirrm scrapy/link
X@dirrm scrapy/log
X@dirrm scrapy/mail
X@dirrm scrapy/management
X@dirrm scrapy/patches
X@dirrm scrapy/spider
X@dirrm scrapy/stats
X@dirrm scrapy/stats/collector
X@dirrm scrapy/templates
X@dirrm scrapy/templates/project
X@dirrm scrapy/templates/project/module
X@dirrm scrapy/templates/project/module/spiders
X@dirrm scrapy/templates/project/module/templates
X@dirrm scrapy/templates/project/root
X@dirrm scrapy/tests
X@dirrm scrapy/tests/sample_data
X@dirrm scrapy/tests/sample_data/adaptors
X@dirrm scrapy/tests/sample_data/compressed
X@dirrm scrapy/tests/sample_data/feeds
X@dirrm scrapy/tests/sample_data/link_extractor
X@dirrm scrapy/tests/sample_data/test_site
X@dirrm scrapy/tests/test_spiders
X@dirrm scrapy/utils
X@dirrm scrapy/xlib
X@dirrm scrapy/xlib/pydispatch
X@dirrm scrapy/xlib/spidermonkey
X@dirrm scrapy/xpath
X@dirrm scripts
XAUTHORS
XINSTALL
XLICENSE
XMANIFEST.in
XREADME
Xbin/runtests.bat
Xbin/runtests.sh
Xbin/scrapy-admin.py
Xdocs/Makefile
Xdocs/README
Xdocs/_ext/scrapydocs.py
Xdocs/_static/items_adaptors-sample1.html
Xdocs/_static/scrapydoc.css
Xdocs/_static/selectors-sample1.html
Xdocs/_templates/index.html
Xdocs/_templates/layout.html
Xdocs/conf.py
Xdocs/contents.rst
Xdocs/experimental/index.rst
Xdocs/experimental/newitem-adaptors.rst
Xdocs/experimental/newitem.rst
Xdocs/faq.rst
Xdocs/intro/index.rst
Xdocs/intro/install.rst
Xdocs/intro/overview.rst
Xdocs/intro/tutorial.rst
Xdocs/media/scrapy-architecture.dia
Xdocs/misc/api-stability.rst
Xdocs/misc/index.rst
Xdocs/ref/downloader-middleware.rst
Xdocs/ref/email.rst
Xdocs/ref/exceptions.rst
Xdocs/ref/extension-manager.rst
Xdocs/ref/extensions.rst
Xdocs/ref/index.rst
Xdocs/ref/link-extractors.rst
Xdocs/ref/logging.rst
Xdocs/ref/request-response.rst
Xdocs/ref/selectors.rst
Xdocs/ref/settings.rst
Xdocs/ref/signals.rst
Xdocs/ref/spiders.rst
Xdocs/topics/_images/adaptors_diagram.png
Xdocs/topics/_images/adaptors_diagram.svg
Xdocs/topics/_images/firebug1.png
Xdocs/topics/_images/firebug2.png
Xdocs/topics/_images/firebug3.png
Xdocs/topics/_images/scrapy_architecture.odg
Xdocs/topics/_images/scrapy_architecture.png
Xdocs/topics/adaptors.rst
Xdocs/topics/architecture.rst
Xdocs/topics/downloader-middleware.rst
Xdocs/topics/extensions.rst
Xdocs/topics/firebug.rst
Xdocs/topics/firefox.rst
Xdocs/topics/index.rst
Xdocs/topics/item-pipeline.rst
Xdocs/topics/items.rst
Xdocs/topics/link-extractors.rst
Xdocs/topics/robotstxt.rst
Xdocs/topics/selectors.rst
Xdocs/topics/settings.rst
Xdocs/topics/shell.rst
Xdocs/topics/spider-middleware.rst
Xdocs/topics/spiders.rst
Xdocs/topics/stats.rst
Xdocs/topics/telnetconsole.rst
Xdocs/topics/webconsole.rst
Xexamples/experimental/googledir/googledir/__init__.py
Xexamples/experimental/googledir/googledir/items.py
Xexamples/experimental/googledir/googledir/pipelines.py
Xexamples/experimental/googledir/googledir/settings.py
Xexamples/experimental/googledir/googledir/spiders/__init__.py
Xexamples/experimental/googledir/googledir/spiders/google_directory.py
Xexamples/experimental/googledir/googledir/templates/spider_basic.tmpl
Xexamples/experimental/googledir/googledir/templates/spider_crawl.tmpl
Xexamples/experimental/googledir/googledir/templates/spider_csvfeed.tmpl
Xexamples/experimental/googledir/googledir/templates/spider_xmlfeed.tmpl
Xexamples/experimental/googledir/scrapy-ctl.py
Xexamples/googledir/googledir/__init__.py
Xexamples/googledir/googledir/items.py
Xexamples/googledir/googledir/pipelines.py
Xexamples/googledir/googledir/settings.py
Xexamples/googledir/googledir/spiders/__init__.py
Xexamples/googledir/googledir/spiders/google_directory.py
Xexamples/googledir/scrapy-ctl.py
Xextras/sql/scraping.sql
Xprofiling/priorityqueue/pq_classes.py
Xprofiling/priorityqueue/run.py
Xprofiling/priorityqueue/test_cases.py
Xscrapy/__init__.py
Xscrapy/command/__init__.py
Xscrapy/command/cmdline.py
Xscrapy/command/commands/__init__.py
Xscrapy/command/commands/crawl.py
Xscrapy/command/commands/download.py
Xscrapy/command/commands/genspider.py
Xscrapy/command/commands/help.py
Xscrapy/command/commands/list.py
Xscrapy/command/commands/log.py
Xscrapy/command/commands/parse.py
Xscrapy/command/commands/shell.py
Xscrapy/command/commands/start.py
Xscrapy/command/models.py
Xscrapy/conf/__init__.py
Xscrapy/conf/commands/__init__.py
Xscrapy/conf/commands/crawl.py
Xscrapy/conf/commands/help.py
Xscrapy/conf/commands/list.py
Xscrapy/conf/commands/log.py
Xscrapy/conf/commands/shell.py
Xscrapy/conf/commands/stats.py
Xscrapy/conf/commands/test.py
Xscrapy/conf/default_settings.py
Xscrapy/contrib/__init__.py
Xscrapy/contrib/aws.py
Xscrapy/contrib/closedomain.py
Xscrapy/contrib/cluster/__init__.py
Xscrapy/contrib/cluster/crawler/__init__.py
Xscrapy/contrib/cluster/crawler/manager.py
Xscrapy/contrib/cluster/hooks/__init__.py
Xscrapy/contrib/cluster/hooks/svn.py
Xscrapy/contrib/cluster/master/__init__.py
Xscrapy/contrib/cluster/master/manager.py
Xscrapy/contrib/cluster/master/web.py
Xscrapy/contrib/cluster/master/ws_api.txt
Xscrapy/contrib/cluster/tools/scrapy-cluster-ctl.py
Xscrapy/contrib/cluster/tools/test-worker.py
Xscrapy/contrib/cluster/worker/__init__.py
Xscrapy/contrib/cluster/worker/manager.py
Xscrapy/contrib/codecs/__init__.py
Xscrapy/contrib/codecs/x_mac_roman.py
Xscrapy/contrib/debug.py
Xscrapy/contrib/delayedclosedomain.py
Xscrapy/contrib/domainsch.py
Xscrapy/contrib/downloadermiddleware/__init__.py
Xscrapy/contrib/downloadermiddleware/cache.py
Xscrapy/contrib/downloadermiddleware/common.py
Xscrapy/contrib/downloadermiddleware/cookies.py
Xscrapy/contrib/downloadermiddleware/debug.py
Xscrapy/contrib/downloadermiddleware/defaultheaders.py
Xscrapy/contrib/downloadermiddleware/errorpages.py
Xscrapy/contrib/downloadermiddleware/httpauth.py
Xscrapy/contrib/downloadermiddleware/httpcache.py
Xscrapy/contrib/downloadermiddleware/httpcompression.py
Xscrapy/contrib/downloadermiddleware/redirect.py
Xscrapy/contrib/downloadermiddleware/retry.py
Xscrapy/contrib/downloadermiddleware/robotstxt.py
Xscrapy/contrib/downloadermiddleware/stats.py
Xscrapy/contrib/downloadermiddleware/useragent.py
Xscrapy/contrib/dupefilter.py
Xscrapy/contrib/groupsettings.py
Xscrapy/contrib/item/__init__.py
Xscrapy/contrib/item/models.py
Xscrapy/contrib/itemsampler.py
Xscrapy/contrib/linkextractors/__init__.py
Xscrapy/contrib/linkextractors/htmlparser.py
Xscrapy/contrib/linkextractors/image.py
Xscrapy/contrib/linkextractors/lxmlparser.py
Xscrapy/contrib/linkextractors/regex.py
Xscrapy/contrib/linkextractors/sgml.py
Xscrapy/contrib/memdebug.py
Xscrapy/contrib/memusage.py
Xscrapy/contrib/pipeline/__init__.py
Xscrapy/contrib/pipeline/images.py
Xscrapy/contrib/pipeline/media.py
Xscrapy/contrib/pipeline/s3images.py
Xscrapy/contrib/pipeline/show.py
Xscrapy/contrib/response/__init__.py
Xscrapy/contrib/response/soup.py
Xscrapy/contrib/schedulermiddleware/__init__.py
Xscrapy/contrib/schedulermiddleware/duplicatesfilter.py
Xscrapy/contrib/spider/__init__.py
Xscrapy/contrib/spider/profiler.py
Xscrapy/contrib/spider/reloader.py
Xscrapy/contrib/spidermiddleware/__init__.py
Xscrapy/contrib/spidermiddleware/depth.py
Xscrapy/contrib/spidermiddleware/httperror.py
Xscrapy/contrib/spidermiddleware/offsite.py
Xscrapy/contrib/spidermiddleware/referer.py
Xscrapy/contrib/spidermiddleware/requestlimit.py
Xscrapy/contrib/spidermiddleware/restrict.py
Xscrapy/contrib/spidermiddleware/urlfilter.py
Xscrapy/contrib/spidermiddleware/urllength.py
Xscrapy/contrib/spiders/__init__.py
Xscrapy/contrib/spiders/crawl.py
Xscrapy/contrib/spiders/feed.py
Xscrapy/contrib/spiders/init.py
Xscrapy/contrib/statsmailer.py
Xscrapy/contrib/web/__init__.py
Xscrapy/contrib/web/http.py
Xscrapy/contrib/web/json.py
Xscrapy/contrib/web/service.py
Xscrapy/contrib/web/site.py
Xscrapy/contrib/webconsole/__init__.py
Xscrapy/contrib/webconsole/enginestatus.py
Xscrapy/contrib/webconsole/livestats.py
Xscrapy/contrib/webconsole/scheduler.py
Xscrapy/contrib/webconsole/spiderctl.py
Xscrapy/contrib/webconsole/stats.py
Xscrapy/contrib_exp/__init__.py
Xscrapy/contrib_exp/adaptors/__init__.py
Xscrapy/contrib_exp/adaptors/date.py
Xscrapy/contrib_exp/adaptors/extraction.py
Xscrapy/contrib_exp/adaptors/markup.py
Xscrapy/contrib_exp/adaptors/misc.py
Xscrapy/contrib_exp/downloadermiddleware/__init__.py
Xscrapy/contrib_exp/downloadermiddleware/decompression.py
Xscrapy/contrib_exp/history/__init__.py
Xscrapy/contrib_exp/history/history.py
Xscrapy/contrib_exp/history/middleware.py
Xscrapy/contrib_exp/history/scheduler.py
Xscrapy/contrib_exp/history/store.py
Xscrapy/contrib_exp/newitem/__init__.py
Xscrapy/contrib_exp/newitem/adaptors.py
Xscrapy/contrib_exp/newitem/fields.py
Xscrapy/contrib_exp/newitem/models.py
Xscrapy/contrib_exp/newitem/serialization.py
Xscrapy/contrib_exp/pipeline/shoveitem.py
Xscrapy/core/__init__.py
Xscrapy/core/downloader/__init__.py
Xscrapy/core/downloader/dnscache.py
Xscrapy/core/downloader/handlers.py
Xscrapy/core/downloader/manager.py
Xscrapy/core/downloader/middleware.py
Xscrapy/core/downloader/responsetypes/__init__.py
Xscrapy/core/downloader/responsetypes/mime.types
Xscrapy/core/downloader/webclient.py
Xscrapy/core/engine.py
Xscrapy/core/exceptions.py
Xscrapy/core/manager.py
Xscrapy/core/scheduler/__init__.py
Xscrapy/core/scheduler/middleware.py
Xscrapy/core/scheduler/schedulers.py
Xscrapy/core/scheduler/store.py
Xscrapy/core/scraper.py
Xscrapy/core/signals.py
Xscrapy/extension/__init__.py
Xscrapy/fetcher/__init__.py
Xscrapy/http/__init__.py
Xscrapy/http/cookies.py
Xscrapy/http/headers.py
Xscrapy/http/request/__init__.py
Xscrapy/http/request/form.py
Xscrapy/http/request/rpc.py
Xscrapy/http/response/__init__.py
Xscrapy/http/response/html.py
Xscrapy/http/response/text.py
Xscrapy/http/response/xml.py
Xscrapy/http/url.py
Xscrapy/item/__init__.py
Xscrapy/item/adaptors.py
Xscrapy/item/models.py
Xscrapy/item/pipeline.py
Xscrapy/link/__init__.py
Xscrapy/link/extractors.py
Xscrapy/log/__init__.py
Xscrapy/mail/__init__.py
Xscrapy/management/__init__.py
Xscrapy/management/telnet.py
Xscrapy/management/web.py
Xscrapy/patches/__init__.py
Xscrapy/patches/monkeypatches.py
Xscrapy/spider/__init__.py
Xscrapy/spider/manager.py
Xscrapy/spider/middleware.py
Xscrapy/spider/models.py
Xscrapy/stats/__init__.py
Xscrapy/stats/collector/__init__.py
Xscrapy/stats/collector/mysql.py
Xscrapy/stats/collector/simpledb.py
Xscrapy/stats/corestats.py
Xscrapy/stats/signals.py
Xscrapy/templates/project/module/__init__.py
Xscrapy/templates/project/module/items.py.tmpl
Xscrapy/templates/project/module/pipelines.py.tmpl
Xscrapy/templates/project/module/settings.py.tmpl
Xscrapy/templates/project/module/spiders/__init__.py
Xscrapy/templates/project/module/templates/spider_basic.tmpl
Xscrapy/templates/project/module/templates/spider_crawl.tmpl
Xscrapy/templates/project/module/templates/spider_csvfeed.tmpl
Xscrapy/templates/project/module/templates/spider_xmlfeed.tmpl
Xscrapy/templates/project/root/scrapy-ctl.py
Xscrapy/tests/__init__.py
Xscrapy/tests/sample_data/adaptors/enc-ascii.html
Xscrapy/tests/sample_data/adaptors/enc-cp1252.html
Xscrapy/tests/sample_data/adaptors/enc-latin1.html
Xscrapy/tests/sample_data/adaptors/enc-utf8-meta-latin1.html
Xscrapy/tests/sample_data/adaptors/enc-utf8.html
Xscrapy/tests/sample_data/adaptors/extr_unquoted.xml
Xscrapy/tests/sample_data/compressed/feed-sample1.tar
Xscrapy/tests/sample_data/compressed/feed-sample1.xml
Xscrapy/tests/sample_data/compressed/feed-sample1.xml.bz2
Xscrapy/tests/sample_data/compressed/feed-sample1.xml.gz
Xscrapy/tests/sample_data/compressed/feed-sample1.zip
Xscrapy/tests/sample_data/compressed/html-gzip.bin
Xscrapy/tests/sample_data/compressed/html-rawdeflate.bin
Xscrapy/tests/sample_data/compressed/html-zlibdeflate.bin
Xscrapy/tests/sample_data/feeds/feed-sample1.xml
Xscrapy/tests/sample_data/feeds/feed-sample2.xml
Xscrapy/tests/sample_data/feeds/feed-sample3.csv
Xscrapy/tests/sample_data/feeds/feed-sample4.csv
Xscrapy/tests/sample_data/feeds/feed-sample5.csv
Xscrapy/tests/sample_data/link_extractor/image_linkextractor.html
Xscrapy/tests/sample_data/link_extractor/linkextractor_latin1.html
Xscrapy/tests/sample_data/link_extractor/linkextractor_noenc.html
Xscrapy/tests/sample_data/link_extractor/sgml_linkextractor.html
Xscrapy/tests/sample_data/test_site/index.html
Xscrapy/tests/sample_data/test_site/item1.html
Xscrapy/tests/sample_data/test_site/item2.html
Xscrapy/tests/test_adaptors.py
Xscrapy/tests/test_aws.py
Xscrapy/tests/test_c14nurls.py
Xscrapy/tests/test_contrib_linkextractors.py
Xscrapy/tests/test_contrib_response_soup.py
Xscrapy/tests/test_dependencies.py
Xscrapy/tests/test_downloadermiddleware_cookies.py
Xscrapy/tests/test_downloadermiddleware_decompression.py
Xscrapy/tests/test_downloadermiddleware_httpcompression.py
Xscrapy/tests/test_downloadermiddleware_redirect.py
Xscrapy/tests/test_downloadermiddleware_retry.py
Xscrapy/tests/test_downloadermiddleware_useragent.py
Xscrapy/tests/test_dupefilter.py
Xscrapy/tests/test_engine.py
Xscrapy/tests/test_http_cookies.py
Xscrapy/tests/test_http_headers.py
Xscrapy/tests/test_http_request.py
Xscrapy/tests/test_http_response.py
Xscrapy/tests/test_http_url.py
Xscrapy/tests/test_item.py
Xscrapy/tests/test_itemadaptor.py
Xscrapy/tests/test_libxml2.py
Xscrapy/tests/test_newitem.py
Xscrapy/tests/test_pipeline_images.py
Xscrapy/tests/test_responsetypes.py
Xscrapy/tests/test_robustscrapeditem.py
Xscrapy/tests/test_schedulermiddleware_duplicatesfilter.py
Xscrapy/tests/test_serialization.py
Xscrapy/tests/test_spidermonkey.py
Xscrapy/tests/test_spiders/__init__.py
Xscrapy/tests/test_spiders/testspider.py
Xscrapy/tests/test_stats.py
Xscrapy/tests/test_utils_datatypes.py
Xscrapy/tests/test_utils_defer.py
Xscrapy/tests/test_utils_iterators.py
Xscrapy/tests/test_utils_markup.py
Xscrapy/tests/test_utils_middleware.py
Xscrapy/tests/test_utils_misc.py
Xscrapy/tests/test_utils_python.py
Xscrapy/tests/test_utils_request.py
Xscrapy/tests/test_utils_response.py
Xscrapy/tests/test_utils_url.py
Xscrapy/tests/test_webclient.py
Xscrapy/tests/test_xpath.py
Xscrapy/tests/test_xpath_extension.py
Xscrapy/utils/__init__.py
Xscrapy/utils/c14n.py
Xscrapy/utils/datatypes.py
Xscrapy/utils/db.py
Xscrapy/utils/defer.py
Xscrapy/utils/display.py
Xscrapy/utils/http.py
Xscrapy/utils/iterators.py
Xscrapy/utils/markup.py
Xscrapy/utils/middleware.py
Xscrapy/utils/misc.py
Xscrapy/utils/python.py
Xscrapy/utils/request.py
Xscrapy/utils/response.py
Xscrapy/utils/serialization.py
Xscrapy/utils/test.py
Xscrapy/utils/url.py
Xscrapy/xlib/BeautifulSoup.py
Xscrapy/xlib/ClientForm.py
Xscrapy/xlib/__init__.py
Xscrapy/xlib/lrucache.py
Xscrapy/xlib/lsprofcalltree.py
Xscrapy/xlib/pydispatch/__init__.py
Xscrapy/xlib/pydispatch/dispatcher.py
Xscrapy/xlib/pydispatch/errors.py
Xscrapy/xlib/pydispatch/license.txt
Xscrapy/xlib/pydispatch/robust.py
Xscrapy/xlib/pydispatch/robustapply.py
Xscrapy/xlib/pydispatch/saferef.py
Xscrapy/xlib/spidermonkey/INSTALL.scrapy
Xscrapy/xlib/spidermonkey/__init__.py
Xscrapy/xlib/spidermonkey/sm_settings.py
Xscrapy/xlib/spidermonkey/spidermonkey.py
Xscrapy/xpath/__init__.py
Xscrapy/xpath/constructors.py
Xscrapy/xpath/document.py
Xscrapy/xpath/extension.py
Xscrapy/xpath/selector.py
Xscrapy/xpath/types.py
Xscripts/rpm-install.sh
Xsetup.cfg
Xsetup.py
END-of-py-scrapy/pkg-plist
exit
Comment 1 Philip M. Gollucci freebsd_committer freebsd_triage 2009-07-17 01:49:01 UTC
Responsible Changed
From-To: freebsd-ports-bugs->pgollucci

I'll take it.
Comment 2 Mark Linimon freebsd_committer freebsd_triage 2009-11-10 05:34:01 UTC
Responsible Changed
From-To: pgollucci->freebsd-ports-bugs

With bugmeister hat, reassign this one to the general pool, since it does 
not seem to have been worked on for several months.
Comment 3 dfilter service freebsd_committer freebsd_triage 2009-12-14 02:58:52 UTC
wen         2009-12-14 02:58:44 UTC

  FreeBSD ports repository

  Modified files:
    www                  Makefile 
  Added files:
    www/py-scrapy        Makefile distinfo pkg-descr pkg-plist 
  Log:
  Scrapy is a high level scraping and web crawling framework for writing
  spiders to crawl and parse web pages for all kinds of purposes, from
  information retrieval to monitoring or testing web sites.
  
  WWW: http://scrapy.org/
  
  PR:             ports/136811
  Submitted by:   Qing Feng <qingfeng@me.com>
  
  Revision  Changes    Path
  1.2493    +1 -0      ports/www/Makefile
  1.1       +28 -0     ports/www/py-scrapy/Makefile (new)
  1.1       +3 -0      ports/www/py-scrapy/distinfo (new)
  1.1       +5 -0      ports/www/py-scrapy/pkg-descr (new)
  1.1       +830 -0    ports/www/py-scrapy/pkg-plist (new)
_______________________________________________
cvs-all@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/cvs-all
To unsubscribe, send any mail to "cvs-all-unsubscribe@freebsd.org"
Comment 4 Wen Heping freebsd_committer freebsd_triage 2009-12-14 03:00:42 UTC
State Changed
From-To: open->closed

New port added, with minor changes. Thanks!